-- Logs begin at Tue 2022-08-30 03:20:33 UTC, end at Tue 2022-08-30 05:57:23 UTC. -- Aug 30 03:57:40.183498 n-d-854925-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 03:57:40.192456 n-d-854925-5 devstack@n-api.service[106503]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 03:57:40 2022] *** Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: nodename: n-d-854925-5 Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: machine: x86_64 Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: clock source: unix Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: pcre jit disabled Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: detected number of CPU cores: 4 Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: current working directory: / Aug 30 03:57:40.194448 n-d-854925-5 devstack@n-api.service[106503]: detected binary path: /usr/bin/uwsgi-core Aug 30 03:57:40.195129 n-d-854925-5 devstack@n-api.service[106503]: your processes number limit is 47680 Aug 30 03:57:40.195129 n-d-854925-5 devstack@n-api.service[106503]: your memory page size is 4096 bytes Aug 30 03:57:40.195129 n-d-854925-5 devstack@n-api.service[106503]: detected max file descriptor number: 2048 Aug 30 03:57:40.195129 n-d-854925-5 devstack@n-api.service[106503]: lock engine: pthread robust mutexes Aug 30 03:57:40.195129 n-d-854925-5 devstack@n-api.service[106503]: thunder lock: enabled Aug 30 03:57:40.195129 n-d-854925-5 devstack@n-api.service[106503]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 03:57:40.195129 n-d-854925-5 devstack@n-api.service[106503]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 03:57:40.233926 n-d-854925-5 devstack@n-api.service[106503]: Python main interpreter initialized at 0x55e9fbff49c0 Aug 30 03:57:40.233926 n-d-854925-5 devstack@n-api.service[106503]: python threads support enabled Aug 30 03:57:40.233926 n-d-854925-5 devstack@n-api.service[106503]: your server socket listen backlog is limited to 100 connections Aug 30 03:57:40.233926 n-d-854925-5 devstack@n-api.service[106503]: your mercy for graceful operations on workers is 90 seconds Aug 30 03:57:40.234284 n-d-854925-5 devstack@n-api.service[106503]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 03:57:40.234361 n-d-854925-5 devstack@n-api.service[106503]: *** Operational MODE: preforking *** Aug 30 03:57:40.234588 n-d-854925-5 devstack@n-api.service[106503]: *** uWSGI is running in multiple interpreter mode *** Aug 30 03:57:40.234588 n-d-854925-5 devstack@n-api.service[106503]: spawned uWSGI master process (pid: 106503) Aug 30 03:57:40.234770 n-d-854925-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 03:57:40.235958 n-d-854925-5 devstack@n-api.service[106503]: spawned uWSGI worker 1 (pid: 106504, cores: 1) Aug 30 03:57:40.235958 n-d-854925-5 devstack@n-api.service[106503]: spawned uWSGI worker 2 (pid: 106505, cores: 1) Aug 30 03:57:40.235958 n-d-854925-5 devstack@n-api.service[106503]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 03:57:40.890026 n-d-854925-5 devstack@n-api.service[106504]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 03:57:40.893361 n-d-854925-5 devstack@n-api.service[106505]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 03:57:41.968941 n-d-854925-5 devstack@n-api.service[106504]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:41.968941 n-d-854925-5 devstack@n-api.service[106504]: from cryptography.utils import int_from_bytes Aug 30 03:57:41.969452 n-d-854925-5 devstack@n-api.service[106504]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:41.969452 n-d-854925-5 devstack@n-api.service[106504]: from cryptography.utils import int_from_bytes Aug 30 03:57:41.970977 n-d-854925-5 devstack@n-api.service[106505]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:41.970977 n-d-854925-5 devstack@n-api.service[106505]: from cryptography.utils import int_from_bytes Aug 30 03:57:41.971398 n-d-854925-5 devstack@n-api.service[106505]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 03:57:41.971398 n-d-854925-5 devstack@n-api.service[106505]: from cryptography.utils import int_from_bytes Aug 30 03:57:44.446625 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:57:44.447276 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:57:44.447396 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:57:44.447731 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:57:44.447985 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:57:44.448370 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.448609 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 03:57:44.448998 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.449084 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 03:57:44.449165 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.449338 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.449494 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 03:57:44.449682 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.449776 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 03:57:44.449992 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.450089 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 03:57:44.450309 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.450406 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.450625 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.450713 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.450951 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.451156 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.451257 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.451492 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.451581 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.451810 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854925-5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.451907 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.452129 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.452224 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.452433 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.452535 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.452768 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.452921 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.453129 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.453272 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.453454 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.453587 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.453776 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.453907 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.454079 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.454232 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854925-5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.454575 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.454965 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.454965 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.455291 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.455291 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.455518 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.455636 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.455743 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.455918 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.456035 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.456229 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.456320 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.456535 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.456630 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.456853 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.457085 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.457227 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.457451 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.457570 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.457743 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.457856 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.458058 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.458200 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854925-5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.458394 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.458527 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.458713 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.458815 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.459028 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.459123 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.459368 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.459522 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.459658 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.459845 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.459987 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.460136 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.460280 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.460454 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.460687 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854925-5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.460794 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.461011 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.461109 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.461344 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.461444 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.461662 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.461753 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.462010 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.462109 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.462326 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.462429 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.462624 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.462721 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.462928 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.463024 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.463234 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.463333 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.463548 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.463637 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.463847 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.463935 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.464149 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.464247 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.464395 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.464505 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.464697 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.464826 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.465014 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.465115 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.465361 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.465454 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.465671 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.465763 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.465920 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.466052 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.466164 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.466359 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.466481 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.466665 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.466798 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.466915 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.467102 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.467224 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.467407 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.467548 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.467712 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.467872 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.468015 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.468195 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.468330 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.468432 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.468684 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.468772 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.469003 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.469166 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.469478 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.469610 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.469718 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.469843 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.469951 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.470053 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.470261 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.470359 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.470562 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.470659 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.470867 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.470961 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.471182 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.471290 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.471486 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.471582 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.471791 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.471886 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.472113 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.472203 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.472424 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.472520 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.472728 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.472827 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.473060 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.473155 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.473401 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.473494 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.473709 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.473811 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.474016 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.474105 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.474319 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.474409 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.474637 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.474736 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.474956 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.475052 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.475258 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.475356 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.475506 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.475605 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.475804 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.475899 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.476103 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.476200 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.476417 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.476507 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.476720 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.476809 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.477024 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.477114 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.477340 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.477478 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.477641 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.477729 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.477944 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.478034 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.478241 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.478339 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.478542 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.478631 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.478846 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.478935 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.479151 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.479252 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.479449 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.479549 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.479752 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.479851 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.480050 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.480146 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.480346 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.480443 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.480650 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.480817 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.480958 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.481048 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.481257 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.481374 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.481583 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.481682 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.481885 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.481979 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.482183 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.482271 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.482487 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.482583 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.482789 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.482876 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.483091 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.483189 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.483408 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.483505 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.483712 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.483800 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.484016 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.484121 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.484314 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.484416 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.484613 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.484712 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.484917 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.485007 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.485221 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.485318 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.485540 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.485628 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.485844 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.485934 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.486158 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.486258 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.486458 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.486552 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.486758 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.486845 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.487058 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.487148 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.487359 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.487448 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.487660 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.487752 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.487959 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.488048 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.488257 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.488346 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.488555 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.488651 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.489395 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.489489 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.489703 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.489790 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.490007 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.490096 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.490314 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.490416 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.490617 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.490712 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.490919 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.491006 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.491227 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.491323 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.491530 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.491620 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.491831 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.491930 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.492150 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.492239 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.492473 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.492561 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.492783 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.492880 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.493090 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.493192 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.493419 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.493513 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.493736 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.493841 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 03:57:44.494050 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.494151 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.494374 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.494467 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.494685 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.494775 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.494992 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.495080 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.495299 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.495388 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.495617 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.495707 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.495935 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.496025 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.496255 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.496342 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.496568 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.496658 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.496881 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.496970 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.497192 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.497305 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.497521 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.497616 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.497832 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.497922 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.498152 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.498241 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.498466 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.498555 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.498773 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.498863 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.499097 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.499184 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.499417 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.499514 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.499741 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.499859 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.500046 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.500188 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.500361 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.500449 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.500669 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.500758 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.500976 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.501078 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.501284 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.501396 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.501627 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.501736 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.501959 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.502125 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.502271 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.502361 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.502587 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.502676 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.502899 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.502997 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.503209 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.503297 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.503519 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.503606 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.503827 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.503916 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.504133 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.504227 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.504515 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.505139 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.505374 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.505482 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.505740 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.505839 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.505991 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.506088 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.506313 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.506402 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.506624 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.506710 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.506932 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.507020 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.507245 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.507333 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.507556 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.507644 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.507864 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.507956 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.508175 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.508266 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.508479 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.508576 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.508780 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.508879 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.509088 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.509177 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.509423 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.509559 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.509726 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.509826 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.510039 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.510175 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.510356 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.510448 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.510669 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.510767 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.510975 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.511072 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.511285 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.511376 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.511591 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.511689 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.511903 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.511992 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.512208 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.512296 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.512514 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.512602 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.512824 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.512920 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.513133 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.513222 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.513469 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.513563 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.513784 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.513930 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.514092 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.514194 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.514398 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.514490 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.514709 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.514796 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.515012 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.515099 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.515318 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.515408 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.515629 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.515716 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.515938 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.516037 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.516247 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.516335 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.516560 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.516649 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.516866 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.516963 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.517185 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.517273 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.517518 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.517624 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.517827 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.517927 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.518143 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.518239 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.518457 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.518549 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.518763 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.518862 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.519076 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.519164 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.519390 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.519489 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.519702 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.519800 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.520035 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.520124 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.520346 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.520434 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.520651 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.520741 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.520952 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.521041 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.521255 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.521387 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.521589 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.521680 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.521891 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.521981 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.522193 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.522288 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.522493 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.522584 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.522795 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.522884 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.523096 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.523193 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.523399 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.523486 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.523704 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.523793 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.524003 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.524101 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.524304 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.524392 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.524601 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.524689 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.524904 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.525001 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.525207 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.525297 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.525538 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.525640 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.525863 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.525962 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.526175 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.526264 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.526481 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.526576 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.526787 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.526878 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.527092 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.527189 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.527399 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.527487 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.527711 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.527812 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.528022 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.528112 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.528332 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.528459 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.528655 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.528745 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.528970 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.529060 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.529282 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.529420 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.529613 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.529746 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.529923 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.530023 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.530230 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.530328 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.530540 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.530637 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.530846 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.530967 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.531157 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.531329 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.531468 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.531556 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.531790 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.531879 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.532103 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.532209 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.532421 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.532509 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.532730 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.532817 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.533039 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.533140 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.533359 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.533451 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.533671 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.533760 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.533983 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.534081 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.534293 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.534390 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.534610 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.534709 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.534920 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.535018 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.535240 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.535327 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.535544 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.535631 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.535881 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.535971 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.536195 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.536298 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.536512 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.536609 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.536813 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.536910 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.537130 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.537219 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.537466 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.537567 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.537791 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.537882 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.538105 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.538201 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.538414 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.538510 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.538727 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.538814 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.539039 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.539135 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.539342 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.539439 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.539649 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.539737 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.539955 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.540050 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.540256 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.540359 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.540566 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.540656 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.540876 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.540966 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.541182 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.541280 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.541515 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.541606 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.541818 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.541906 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.542129 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.542226 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.542433 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.542534 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.542736 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.542832 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.543035 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.543124 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.543343 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.543431 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.543650 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.543737 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.543961 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.544048 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.544265 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.544352 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.544579 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.544668 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.544880 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.544969 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.545182 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.545271 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.545514 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.545606 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.545826 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.545916 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.546150 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.546239 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.546461 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.546595 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.546758 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.546847 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.547085 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.547172 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.547390 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.547554 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.547693 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.547782 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.548006 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.548113 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.548315 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.548415 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.548619 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.548707 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.548923 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.549019 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.549229 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.549350 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.549559 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.549648 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.549878 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.550011 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.550191 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.550291 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.550498 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.550588 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.550809 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.550908 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.551119 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.551699 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.551949 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.552038 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.552258 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.552360 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.552568 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.552664 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.552875 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.552963 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.553183 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.553272 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.553518 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.553610 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.553823 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.553911 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.554132 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.554235 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.554440 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.554530 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.554754 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.555006 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.555096 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.555339 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.555430 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.555656 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.555745 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.555968 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.556056 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.556276 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.556366 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.556589 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.556679 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.556908 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.557007 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.557237 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.557509 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.557614 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.557849 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.557938 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.558162 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.558246 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.558467 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.558558 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.558768 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.558859 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.559083 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.559180 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.559386 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.559493 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.559686 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.559782 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.559988 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.560081 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.560292 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.560390 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.560592 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.560689 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.560893 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.561004 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.561194 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.561292 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.561519 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.561623 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.561831 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.561921 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.562385 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.562489 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.562690 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.562781 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.562991 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.563089 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.563322 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.563422 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.563600 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.563690 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.563898 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.563987 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.564199 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.564297 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.564499 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.564596 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.564804 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.564910 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.565118 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.565208 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.565448 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.565553 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.565777 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.565881 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.566090 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.566180 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.566398 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.566487 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.566700 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.566803 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.567545 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.567643 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.567857 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.567948 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.568162 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.568262 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.568466 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.568566 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.568779 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.568899 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.569093 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.569203 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.569416 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.569516 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.569726 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.569856 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.570037 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.570173 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.570346 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.570444 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.570651 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.570739 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.570956 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.571056 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.571259 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.571355 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.571561 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.571658 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.571864 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.571953 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.572171 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.572259 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.572474 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.572572 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.572775 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.572863 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.573084 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.573171 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.573413 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.573526 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.573713 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.573809 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.574016 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.574111 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.574314 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.574415 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.574627 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.574715 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.574930 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.575025 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.575226 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.575327 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.575529 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.575618 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.575836 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.575925 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.576139 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.576227 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.576440 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.576527 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.576741 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.576829 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.577055 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.577142 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.577374 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.577466 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.577679 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.577766 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.577983 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.578072 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.578279 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.578409 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.578578 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.578668 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.578882 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.578979 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.579199 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.579301 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.579511 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.579607 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.579808 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.579895 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.580111 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.580204 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.580409 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.580511 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.580707 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.580795 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.581013 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.581130 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.581318 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.581461 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.581638 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.581731 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.581938 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.582028 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.582237 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.582342 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.582559 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.582658 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.582858 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.582955 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.583162 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.583251 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.583467 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.583556 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.583765 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.583854 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.584064 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.584155 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.584362 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.584460 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.584663 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.584763 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.584969 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.585062 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.585273 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.585396 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.585623 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.585713 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.585935 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.586034 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.586241 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.586330 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.586546 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.586642 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.586848 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.586944 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.587156 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.587243 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.587458 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.587560 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.587769 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.587859 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.588076 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.588165 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.588386 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.588486 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.588687 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.588783 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.588996 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.589103 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.589315 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.589454 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.589644 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.589733 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.589947 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.590035 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.590264 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.590361 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.590577 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.590674 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.590890 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.590980 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.591190 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.591289 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.591491 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.591586 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.591796 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.591883 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.592102 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.592192 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.592408 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.592495 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.592732 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.592823 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.593022 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.593119 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.593347 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.593441 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.593659 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.593759 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.593967 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.594061 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.594272 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.594366 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.594573 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.594675 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.594880 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.594967 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.595184 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.595271 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.595485 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.595580 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.595795 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.595882 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.596101 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.596189 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.596403 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.596500 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.596708 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.596802 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.597010 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.597096 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.597314 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.597421 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.597635 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.597725 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.597936 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.598575 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.598773 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.598886 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.599086 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.599238 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.599402 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.599545 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.599694 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.599847 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.599985 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.600132 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.600270 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.600407 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.600583 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.600682 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.600973 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.601065 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.601292 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.601410 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.601632 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.601724 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.601941 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.602043 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.602254 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.602354 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.602569 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.602660 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.602868 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.602956 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.603177 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.603275 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.603482 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.603571 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.603787 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.603888 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.604087 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.604187 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.604387 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.604477 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.604709 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.604798 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.605014 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.605104 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.605355 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.605447 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.605696 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.605784 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.606022 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.606114 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.606329 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.606420 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.606633 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.606798 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.606938 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.607029 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.607263 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.607353 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.607569 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.607659 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.607891 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.607982 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.608247 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.608335 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.608551 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.608666 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.608867 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.609023 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.609194 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.609364 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.609528 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.609619 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.609850 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.609954 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.610160 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.610291 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.610474 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.610565 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.610776 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.610881 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.611098 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.611196 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.611420 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.611510 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.611733 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.611836 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.612057 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.612144 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.612383 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.612480 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.612700 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.612799 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.613018 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.613115 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.613365 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.613471 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.613696 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.613805 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.614554 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.614656 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.614864 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.614954 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.615174 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.615266 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.615479 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.615597 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.615784 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.615925 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.616106 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.616243 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.616409 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.616571 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.616719 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.616901 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.617030 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.617212 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.617349 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.617548 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.617660 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.617864 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.617956 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.618172 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.618261 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.618481 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.618572 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.618808 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.618899 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.619117 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.619207 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.619433 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.619522 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.619748 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.619839 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.620058 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.620148 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.620365 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.620455 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.620670 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.620799 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.620974 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.621073 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.621278 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.621399 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.621615 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.621708 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.621932 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.622022 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.622245 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.622346 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.622565 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.622663 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.622870 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.622958 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.623196 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.623294 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.623501 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.623590 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.623806 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.623894 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.624113 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.624212 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.624421 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.624533 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.624742 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.624861 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.625057 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.625163 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.625399 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.625493 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.625701 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.625789 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.626003 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.626103 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.626310 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.626400 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.626611 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.626710 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.626914 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.627005 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.627218 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.627308 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.627526 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.627624 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.627844 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.627942 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.628127 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.628225 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.628426 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.628526 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.628748 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.628839 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.629056 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.629144 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.629406 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.629558 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.629717 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.629809 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.630018 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.630143 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.630322 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.630425 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.630624 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.630714 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.630927 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.631015 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.631240 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.631340 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.631562 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.631651 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.631866 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.631963 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.632185 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.632276 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.632495 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.632584 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.632803 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.632894 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.633110 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.633202 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.633440 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.633537 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.633752 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.633852 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.634067 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.634159 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.634379 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.634470 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.634684 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.634814 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.635047 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.635194 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.635327 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.635418 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.635601 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.635701 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.636004 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.636101 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.636326 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.636416 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.636649 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.636748 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.636977 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.637135 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.637279 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.637462 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.637612 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.637772 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.637925 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.638065 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.638226 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.638367 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.638538 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.638708 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.638855 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.639065 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.639214 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.639365 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.639629 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.639782 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.639931 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.640079 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.640218 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.640370 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.640525 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.640681 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.640827 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.640970 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.641121 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.641270 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.641528 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.641697 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.641850 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642003 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642154 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642321 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642432 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642523 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642616 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642820 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.642912 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.643131 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.643221 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.643446 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.643767 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.644150 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.644464 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.644779 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.644867 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.645136 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.645237 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.645467 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.645576 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.645785 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.645875 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.646098 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.646189 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.646422 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.646755 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.647082 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.647246 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.647401 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.647568 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.647735 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.647891 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.648032 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.648178 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.648426 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.648586 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.648756 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.648909 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.649064 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.649214 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.649425 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.649583 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.649827 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.649978 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.650103 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.650191 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.650351 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.650677 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.650982 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.651287 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.651596 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.651904 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.652233 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.652449 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.652609 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.652793 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.652918 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.653223 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.653401 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.653564 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.653872 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.654008 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.654403 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.654626 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.654756 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.655075 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.655272 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.655405 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.655730 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.655880 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.656048 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.656331 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.656448 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.656672 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.656762 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.657011 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.657112 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.657391 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.657589 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.657713 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.657921 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.658012 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.658270 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.658362 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.658608 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.658696 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.658923 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.659023 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.659257 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.659356 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.659587 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.659687 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.659900 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.660006 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.660203 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.660293 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.661023 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.661120 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.661383 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.661498 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.661691 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.661780 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.661999 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.662105 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.662310 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.662410 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.662616 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.662706 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.662919 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.663009 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.663224 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.663316 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.663527 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.663617 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.663837 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.664068 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.664170 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.664429 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.664520 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.664738 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.664871 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.665079 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.665210 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.665406 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.665521 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.665755 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.665845 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.666066 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.666165 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.666388 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.666485 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.666693 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.666782 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.666995 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.667086 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.667310 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.667407 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.667620 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.667711 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.667930 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.668020 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.668239 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.668328 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.668548 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.668638 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.668862 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.668952 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.669175 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.669265 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.669521 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.669744 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.669846 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.670081 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.670180 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.670401 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.670491 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.670733 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.670825 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.671040 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.671129 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.671354 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.671442 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.671659 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.671757 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.671965 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.672101 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.672275 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.672367 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.672582 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.672673 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.672892 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.672982 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.673197 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.673285 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.673528 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.673620 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.673835 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.673925 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.674142 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.674240 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.674448 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.674538 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.674754 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.674842 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.675061 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.675161 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.675369 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.675459 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.675677 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.675776 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.675982 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.676083 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.676860 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.676960 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.677174 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.677273 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.677514 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.677614 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.677833 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.677923 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.678150 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.678241 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.678462 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.678553 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.678779 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.678868 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.679095 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.679333 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.679432 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.679674 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.679764 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.679995 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.680082 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.680302 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.680402 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.680615 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.680711 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.680944 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.681035 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.681250 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.681366 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.681579 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.681669 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.681908 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.681996 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.682227 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.682328 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.682542 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.682633 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.682860 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.682949 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.683175 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.683274 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.683489 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.683586 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.683802 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.683907 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.684110 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.684198 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.684419 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.684508 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.684725 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.684831 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.685035 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.685125 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.685364 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.685458 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.685688 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.685789 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.686001 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.686092 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.686312 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.686400 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.686616 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.686707 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.686917 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.687008 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.687518 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.687624 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.687838 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.687930 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.688156 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.688246 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.688461 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.688552 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.688764 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.688856 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.689071 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.689160 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.689396 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.689490 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.689702 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.689795 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.690004 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.690137 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.690306 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.690411 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.690613 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.690703 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.690914 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.691003 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.691212 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.691349 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.691511 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.691671 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.691846 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.692021 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.692153 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.692351 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.692446 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.692666 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.692758 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.692992 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.693094 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.693319 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.693431 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.693656 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.693746 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.693955 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.694056 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.694256 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.694347 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.694584 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.694673 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.694917 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.695015 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.695229 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.695327 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.695548 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.695645 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.695857 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.695958 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.696162 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.696253 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.696470 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.696566 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.696825 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.696921 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.697097 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.697186 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.697435 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.697529 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.697742 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.697833 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.698045 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.698142 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.698360 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.698450 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.698667 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.698766 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.698976 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.699068 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.699283 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.699383 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.699591 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.699681 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.699897 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.699987 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.700199 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.700301 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.700506 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.700597 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.700812 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.700901 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.701117 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.701217 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.701447 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.701540 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.701758 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.701858 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.702070 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.702240 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.702370 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.702460 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.702664 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.702756 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.702970 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.703062 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.703276 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.703367 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.703580 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.703670 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.703916 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.704016 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.704248 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.704338 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.704564 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.704653 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.704876 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.704968 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.705186 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.705275 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.705543 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.705653 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.705857 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.705985 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.706184 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.706274 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.706509 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.706609 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.706818 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.706906 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.707129 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.707219 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.707479 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.707584 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.707793 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.707889 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.708111 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.708210 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.708428 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.708529 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.708744 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.708843 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.709058 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.709149 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.709384 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.709478 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.709695 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.709784 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.709938 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106504) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:57:44.710040 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.710332 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.710661 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.710984 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.711308 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.711630 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.711949 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.712282 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.712600 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.712915 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.713228 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.713575 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.713893 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.714213 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.714543 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.714848 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.715170 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.715494 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.715827 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.716159 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.716473 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.716803 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.717134 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.717512 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.717834 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.718181 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.718515 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.718832 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.719148 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.719456 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 03:57:44.719702 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106505) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 03:57:44.862506 n-d-854925-5 devstack@n-api.service[106504]: INFO dbcounter [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Registered counter for database nova_api Aug 30 03:57:44.872240 n-d-854925-5 devstack@n-api.service[106505]: INFO dbcounter [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Registered counter for database nova_api Aug 30 03:57:44.882659 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_db.sqlalchemy.engines [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:44.889223 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writer thread running {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:44.891902 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_db.sqlalchemy.engines [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:44.898459 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writer thread running {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:44.946993 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.context [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=106504) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 03:57:44.950757 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:44.951222 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:44.952811 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:44.953567 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:44.954002 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:44.955850 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.context [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=106505) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 03:57:44.955989 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:44.958527 n-d-854925-5 devstack@n-api.service[106504]: INFO dbcounter [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Registered counter for database nova_cell0 Aug 30 03:57:44.960191 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_concurrency.lockutils [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:44.960665 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_concurrency.lockutils [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:44.962544 n-d-854925-5 devstack@n-api.service[106504]: INFO dbcounter [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Registered counter for database nova_cell1 Aug 30 03:57:44.962661 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_concurrency.lockutils [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:44.963313 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_concurrency.lockutils [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 03:57:44.963756 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_concurrency.lockutils [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 03:57:44.965782 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_concurrency.lockutils [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106505) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 03:57:44.967773 n-d-854925-5 devstack@n-api.service[106505]: INFO dbcounter [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Registered counter for database nova_cell0 Aug 30 03:57:44.969569 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_db.sqlalchemy.engines [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:44.971694 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_db.sqlalchemy.engines [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:44.972036 n-d-854925-5 devstack@n-api.service[106505]: INFO dbcounter [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Registered counter for database nova_cell1 Aug 30 03:57:44.978284 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writer thread running {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:44.980503 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writer thread running {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:44.981497 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_db.sqlalchemy.engines [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:44.983622 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_db.sqlalchemy.engines [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:44.988564 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writer thread running {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:44.993724 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writer thread running {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:45.135306 n-d-854925-5 devstack@n-api.service[106504]: INFO dbcounter [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Registered counter for database nova_cell0 Aug 30 03:57:45.140258 n-d-854925-5 devstack@n-api.service[106505]: INFO dbcounter [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Registered counter for database nova_cell0 Aug 30 03:57:45.144206 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_db.sqlalchemy.engines [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106504) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:45.147007 n-d-854925-5 devstack@n-api.service[106505]: DEBUG oslo_db.sqlalchemy.engines [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106505) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 03:57:45.148683 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writer thread running {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:45.151859 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writer thread running {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 03:57:45.490687 n-d-854925-5 devstack@n-api.service[106504]: WARNING keystonemiddleware.auth_token [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:57:45.494377 n-d-854925-5 devstack@n-api.service[106505]: WARNING keystonemiddleware.auth_token [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:57:45.498005 n-d-854925-5 devstack@n-api.service[106504]: WARNING keystonemiddleware.auth_token [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:57:45.502025 n-d-854925-5 devstack@n-api.service[106505]: WARNING keystonemiddleware.auth_token [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:57:45.841534 n-d-854925-5 devstack@n-api.service[106504]: WARNING keystonemiddleware.auth_token [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:57:45.847448 n-d-854925-5 devstack@n-api.service[106504]: WARNING keystonemiddleware.auth_token [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:57:45.847558 n-d-854925-5 devstack@n-api.service[106505]: WARNING keystonemiddleware.auth_token [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 03:57:45.852768 n-d-854925-5 devstack@n-api.service[106504]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e9fbff49c0 pid: 106504 (default app) Aug 30 03:57:45.853546 n-d-854925-5 devstack@n-api.service[106505]: WARNING keystonemiddleware.auth_token [None req-12d4f11b-4f2f-47cd-a0bb-71a608f563ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 03:57:45.854835 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:57:45.856016 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001709 Aug 30 03:57:45.856434 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Tue Aug 30 03:57:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:57:45.858834 n-d-854925-5 devstack@n-api.service[106505]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e9fbff49c0 pid: 106505 (default app) Aug 30 03:59:04.010401 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:04.012050 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Aug 30 03:59:04.012459 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:04.024346 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writing DB stats nova_api:SELECT=3 {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.025501 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writing DB stats nova_cell1:SELECT=3 {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.026227 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writing DB stats nova_cell0:SELECT=3 {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.027641 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:04.876845 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-2f6464da-6ef5-4a0e-8d59-c435fab1b199 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:04.909189 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-2f6464da-6ef5-4a0e-8d59-c435fab1b199 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.889716 Aug 30 03:59:04.909790 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 03:59:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:07.273718 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:07.274806 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-f8cb8d7d-4a3f-47b4-8d63-b31929bfba21 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 30 03:59:07.285497 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:07 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:07.702263 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-cfed10a2-61dc-4c95-bd86-a946bf02993f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 256}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:07.751659 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-cfed10a2-61dc-4c95-bd86-a946bf02993f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.470649 Aug 30 03:59:07.759805 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:07.766651 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writing DB stats nova_api:SELECT=3 {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.767458 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writing DB stats nova_cell1:SELECT=3 {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.768705 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writing DB stats nova_cell0:SELECT=3 {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.769441 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:07.983212 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-ade29869-94b2-4575-a016-797530334985 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:08.050591 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-ade29869-94b2-4575-a016-797530334985 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287792 Aug 30 03:59:08.061511 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 03:59:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:10.441140 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-cfed10a2-61dc-4c95-bd86-a946bf02993f admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:10.445030 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-cfed10a2-61dc-4c95-bd86-a946bf02993f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004115 Aug 30 03:59:10.445728 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:11.209789 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-fdcf9942-2398-415b-8c34-3c8b3c399d04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 5}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:11.254274 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-fdcf9942-2398-415b-8c34-3c8b3c399d04 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.799224 Aug 30 03:59:11.254756 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:11.266569 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-ef648985-f726-4149-a81b-491b40313ead admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:11.310765 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-ef648985-f726-4149-a81b-491b40313ead admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047799 Aug 30 03:59:11.311792 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 03:59:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:13.971242 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-fdcf9942-2398-415b-8c34-3c8b3c399d04 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:13.972997 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-fdcf9942-2398-415b-8c34-3c8b3c399d04 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002177 Aug 30 03:59:13.974314 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:14.429356 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-abb3c85a-ca41-4e77-a031-f53367ad2702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "id": "d2", "vcpus": 1, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:14.451067 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-abb3c85a-ca41-4e77-a031-f53367ad2702 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.470353 Aug 30 03:59:14.452284 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:14.468041 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-2d8fcced-638c-4088-8c50-8a69b638a331 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:14.497074 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-2d8fcced-638c-4088-8c50-8a69b638a331 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036209 Aug 30 03:59:14.497730 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 03:59:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:17.010464 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-abb3c85a-ca41-4e77-a031-f53367ad2702 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:17.011487 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-abb3c85a-ca41-4e77-a031-f53367ad2702 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 30 03:59:17.011889 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:17.464790 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4c5f1d35-bdb0-4d26-848b-189f2e86058d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "id": "d3"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:17.491635 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4c5f1d35-bdb0-4d26-848b-189f2e86058d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.473427 Aug 30 03:59:17.500114 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:17.504381 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-1ef4bc59-aa78-48e8-b012-3933f7b05c55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:17.532322 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-1ef4bc59-aa78-48e8-b012-3933f7b05c55 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031607 Aug 30 03:59:17.533321 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 03:59:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:19.928001 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4c5f1d35-bdb0-4d26-848b-189f2e86058d admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:19.928912 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4c5f1d35-bdb0-4d26-848b-189f2e86058d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 30 03:59:19.935129 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:20.438872 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-32f7f2b5-9a80-4352-8fc4-446b53c5d206 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "id": "d4", "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:20.478962 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-32f7f2b5-9a80-4352-8fc4-446b53c5d206 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541964 Aug 30 03:59:20.479862 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:20.500972 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-ebd618e8-ae7a-4ffb-92de-6169ffcf0b74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:20.544607 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-ebd618e8-ae7a-4ffb-92de-6169ffcf0b74 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052924 Aug 30 03:59:20.553356 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1336 bytes} [Tue Aug 30 03:59:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:22.999799 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-32f7f2b5-9a80-4352-8fc4-446b53c5d206 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:23.001487 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-32f7f2b5-9a80-4352-8fc4-446b53c5d206 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002086 Aug 30 03:59:23.007666 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:23.419293 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-0778330c-2523-44db-a3b0-21ebd5fa7d75 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:23.444764 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-0778330c-2523-44db-a3b0-21ebd5fa7d75 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.436009 Aug 30 03:59:23.445310 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 03:59:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 03:59:25.837017 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-32f7f2b5-9a80-4352-8fc4-446b53c5d206 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:25.838068 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-32f7f2b5-9a80-4352-8fc4-446b53c5d206 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 30 03:59:25.838471 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:26.277909 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-2d176a53-1382-497b-9bd6-9707ae468f6e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny", "swap": 0, "rxtx_factor": 1.0}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:26.297410 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-2d176a53-1382-497b-9bd6-9707ae468f6e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.452342 Aug 30 03:59:26.297996 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:26.310917 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-049835ce-022e-4cc0-855b-5e94add719c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:26.336974 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-049835ce-022e-4cc0-855b-5e94add719c7 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029672 Aug 30 03:59:26.337589 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 03:59:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:28.851869 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-2d176a53-1382-497b-9bd6-9707ae468f6e admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:28.853071 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-2d176a53-1382-497b-9bd6-9707ae468f6e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001913 Aug 30 03:59:28.853583 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:29.285676 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-fbe9cb1c-68e5-4dc2-8aae-4966a035a0df admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "disk": 20}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:29.309478 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-fbe9cb1c-68e5-4dc2-8aae-4966a035a0df admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.447522 Aug 30 03:59:29.311225 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:29.322958 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4dc7a336-d5b1-4c0e-b9e1-3961231b8103 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:29.347427 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4dc7a336-d5b1-4c0e-b9e1-3961231b8103 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028201 Aug 30 03:59:29.348009 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 03:59:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:31.707578 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-fbe9cb1c-68e5-4dc2-8aae-4966a035a0df admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:31.708638 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-fbe9cb1c-68e5-4dc2-8aae-4966a035a0df admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002014 Aug 30 03:59:31.709076 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:32.116554 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-74356807-96e5-4c53-9f3a-fc430b327bb8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "id": "3", "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:32.137579 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-74356807-96e5-4c53-9f3a-fc430b327bb8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.422122 Aug 30 03:59:32.138949 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:32.153062 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-c22b2828-fbcd-4817-90be-7eb0b2ad4399 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:32.177773 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-c22b2828-fbcd-4817-90be-7eb0b2ad4399 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029370 Aug 30 03:59:32.178359 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 03:59:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 03:59:34.552104 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-74356807-96e5-4c53-9f3a-fc430b327bb8 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:34.553103 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-74356807-96e5-4c53-9f3a-fc430b327bb8 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Aug 30 03:59:34.553539 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:34.968364 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-b8eba11d-28c3-4362-9a27-ff2bb5137415 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "vcpus": 4, "name": "m1.large", "disk": 80}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:34.974606 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 03:59:34.994330 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-b8eba11d-28c3-4362-9a27-ff2bb5137415 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434636 Aug 30 03:59:34.995026 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 03:59:35.007427 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-764c5348-63c2-407c-be45-60dcb1c6df25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:35.037126 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-764c5348-63c2-407c-be45-60dcb1c6df25 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033818 Aug 30 03:59:35.038194 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 03:59:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 03:59:37.527809 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-b8eba11d-28c3-4362-9a27-ff2bb5137415 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 03:59:37.528826 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-b8eba11d-28c3-4362-9a27-ff2bb5137415 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 30 03:59:37.529235 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 03:59:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 03:59:37.985950 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4bcebed8-785f-491f-af6a-78f3227ea55e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge"}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:38.009284 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4bcebed8-785f-491f-af6a-78f3227ea55e admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.473486 Aug 30 03:59:38.010232 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1283 bytes} [Tue Aug 30 03:59:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 03:59:38.022185 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-60886264-1f1c-47e4-aaf0-f4388770403f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 03:59:38.051675 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-60886264-1f1c-47e4-aaf0-f4388770403f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032666 Aug 30 03:59:38.052269 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1333 bytes} [Tue Aug 30 03:59:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:00:00.838400 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4bcebed8-785f-491f-af6a-78f3227ea55e admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:00.839340 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4bcebed8-785f-491f-af6a-78f3227ea55e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 30 04:00:00.839739 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 04:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:00.851104 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:01.237311 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-faac5ce3-59ba-4bac-a293-eb0cdc48a6ba admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:01.255735 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-faac5ce3-59ba-4bac-a293-eb0cdc48a6ba admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409705 Aug 30 04:00:01.256297 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 04:00:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:00:02.295825 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4bcebed8-785f-491f-af6a-78f3227ea55e admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:02.296861 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4bcebed8-785f-491f-af6a-78f3227ea55e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 04:00:02.297261 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:02.845648 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-b672a7ab-a055-4621-82d6-22a83e4f2081 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:02.851700 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.wsgi [None req-b672a7ab-a055-4621-82d6-22a83e4f2081 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-b672a7ab-a055-4621-82d6-22a83e4f2081 admin admin] Request method failure captured: Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: Accept: application/json Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: Accept-Encoding: gzip, deflate Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: Connection: keep-alive Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: Content-Length: 0 Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: Host: 10.222.0.27 Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: Openstack-Api-Version: compute 2.90 Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: Openstack-System-Scope: None Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: User-Agent: python-novaclient Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Auth-Token: gAAAAABjDYtCIIIMpTgmdHwFl7bGlPQCkGHsfeZmZhBgjxrfnx8Fq5opi2Yq6Y5UBMvu2YMKvxsWrnjBMzLmc1uPwZ9NFI_vEmO1j7QYnowU1ZOrjQadhRmIaeMsOH0t7wnwpBwUR_n4epyOlPqjwt9Djl_zMdijY9z_JM23CBZvxjtIDtI0vNg Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Domain-Id: None Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Domain-Name: None Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Identity-Status: Confirmed Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Is-Admin-Project: True Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Domain-Id: default Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Domain-Name: Default Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Name: admin Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Role: reader,admin,member Aug 30 04:00:02.854970 n-d-854925-5 devstack@n-api.service[106505]: X-Roles: reader,admin,member Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86787ba72bbf47fb9e95ab44ad768a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}] Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant: admin Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant-Name: admin Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-User: admin Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-User-Domain-Id: default Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-User-Domain-Name: Default Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-User-Id: 7c9a35b85bfa4e759222644a399cdb07 Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: X-User-Name: admin Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: method: > Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: exception: Flavor 42 could not be found. Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: action_args: {'id': '42'} Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:00:02.856647 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:02.857595 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.858802 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-b672a7ab-a055-4621-82d6-22a83e4f2081 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:00:02.860063 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-b672a7ab-a055-4621-82d6-22a83e4f2081 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403111 Aug 30 04:00:02.860063 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 04:00:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:00:02.866966 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-5a2c63fc-16b2-40a3-9ff5-2ce252eed49f admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:02.871100 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:00:02.890737 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-5a2c63fc-16b2-40a3-9ff5-2ce252eed49f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027695 Aug 30 04:00:02.891278 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 04:00:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:00:02.908983 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-5e91cf86-cc6a-406b-9fe1-9fc565e1303a admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:02.932017 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-5e91cf86-cc6a-406b-9fe1-9fc565e1303a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026590 Aug 30 04:00:02.932564 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 04:00:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:00:02.943329 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e5812d35-c756-4348-9097-242241ff1465 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:02.949529 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.wsgi [None req-e5812d35-c756-4348-9097-242241ff1465 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e5812d35-c756-4348-9097-242241ff1465 admin admin] Request method failure captured: Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: Accept: application/json Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: Accept-Encoding: gzip, deflate Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: Connection: keep-alive Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: Content-Length: 0 Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: Host: 10.222.0.27 Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: Openstack-Api-Version: compute 2.90 Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: Openstack-System-Scope: None Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: User-Agent: python-novaclient Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Auth-Token: gAAAAABjDYtCIIIMpTgmdHwFl7bGlPQCkGHsfeZmZhBgjxrfnx8Fq5opi2Yq6Y5UBMvu2YMKvxsWrnjBMzLmc1uPwZ9NFI_vEmO1j7QYnowU1ZOrjQadhRmIaeMsOH0t7wnwpBwUR_n4epyOlPqjwt9Djl_zMdijY9z_JM23CBZvxjtIDtI0vNg Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Domain-Id: None Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Domain-Name: None Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Identity-Status: Confirmed Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Is-Admin-Project: True Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Domain-Id: default Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Domain-Name: Default Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Name: admin Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Role: reader,admin,member Aug 30 04:00:02.952708 n-d-854925-5 devstack@n-api.service[106504]: X-Roles: reader,admin,member Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86787ba72bbf47fb9e95ab44ad768a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}] Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant: admin Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant-Name: admin Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-User: admin Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-User-Domain-Id: default Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-User-Domain-Name: Default Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-User-Id: 7c9a35b85bfa4e759222644a399cdb07 Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: X-User-Name: admin Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: method: > Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: exception: Flavor 42 could not be found. Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: action_args: {'id': '42'} Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:00:02.954326 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:02.955347 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:02.956774 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e5812d35-c756-4348-9097-242241ff1465 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:00:02.958061 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-e5812d35-c756-4348-9097-242241ff1465 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015672 Aug 30 04:00:02.958061 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 04:00:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:00:03.936971 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-5e91cf86-cc6a-406b-9fe1-9fc565e1303a admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:03.938020 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-5e91cf86-cc6a-406b-9fe1-9fc565e1303a admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 30 04:00:03.938418 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:04.460651 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e0d230d0-ba10-4417-99b4-2b0ce752c58a admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:04.466274 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.wsgi [None req-e0d230d0-ba10-4417-99b4-2b0ce752c58a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e0d230d0-ba10-4417-99b4-2b0ce752c58a admin admin] Request method failure captured: Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: Accept: application/json Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: Accept-Encoding: gzip, deflate Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: Connection: keep-alive Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: Content-Length: 0 Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: Host: 10.222.0.27 Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: Openstack-Api-Version: compute 2.90 Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: Openstack-System-Scope: None Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: User-Agent: python-novaclient Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Auth-Token: gAAAAABjDYtDI533_85mkS9gOmmSi8CFv97jHK-FPfBJsnw6KNACGjDXVqefnl7pgIM77WCXGYIdpGCI7qZ6XsBqPFmhBdN8pu5BBtYbukOwyuTb_fnzEfNerK345K-VZNLFcJ1GUWIAcDQ678JeL3R8lDYgBCeNmIzmJ8UUerMXW2pEwrM9XyA Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Domain-Id: None Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Domain-Name: None Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Identity-Status: Confirmed Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Is-Admin-Project: True Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Domain-Id: default Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Domain-Name: Default Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Name: admin Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Role: reader,admin,member Aug 30 04:00:04.467880 n-d-854925-5 devstack@n-api.service[106504]: X-Roles: reader,admin,member Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86787ba72bbf47fb9e95ab44ad768a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}] Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant: admin Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant-Name: admin Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-User: admin Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-User-Domain-Id: default Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-User-Domain-Name: Default Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-User-Id: 7c9a35b85bfa4e759222644a399cdb07 Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: X-User-Name: admin Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: method: > Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: exception: Flavor 84 could not be found. Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: action_args: {'id': '84'} Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:00:04.469428 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:04.470295 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.471385 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e0d230d0-ba10-4417-99b4-2b0ce752c58a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:00:04.472418 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-e0d230d0-ba10-4417-99b4-2b0ce752c58a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394034 Aug 30 04:00:04.472418 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 04:00:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:00:04.479609 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-faf17d2a-2537-4dd2-9226-8acba50e6ae4 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:04.496257 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-faf17d2a-2537-4dd2-9226-8acba50e6ae4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020174 Aug 30 04:00:04.496806 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 04:00:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:00:04.506144 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e2a0dbfb-7e20-479b-9292-bc1574afb59b admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:04.521658 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-e2a0dbfb-7e20-479b-9292-bc1574afb59b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018936 Aug 30 04:00:04.522171 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 04:00:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:00:04.531160 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-9f6c292b-a1e8-4c48-8a7b-82103740b7e4 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:04.537073 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.wsgi [None req-9f6c292b-a1e8-4c48-8a7b-82103740b7e4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-9f6c292b-a1e8-4c48-8a7b-82103740b7e4 admin admin] Request method failure captured: Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: Accept: application/json Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: Accept-Encoding: gzip, deflate Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: Connection: keep-alive Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: Content-Length: 0 Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: Host: 10.222.0.27 Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: Openstack-Api-Version: compute 2.90 Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: Openstack-System-Scope: None Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: User-Agent: python-novaclient Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Auth-Token: gAAAAABjDYtDI533_85mkS9gOmmSi8CFv97jHK-FPfBJsnw6KNACGjDXVqefnl7pgIM77WCXGYIdpGCI7qZ6XsBqPFmhBdN8pu5BBtYbukOwyuTb_fnzEfNerK345K-VZNLFcJ1GUWIAcDQ678JeL3R8lDYgBCeNmIzmJ8UUerMXW2pEwrM9XyA Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Domain-Id: None Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Domain-Name: None Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Identity-Status: Confirmed Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Is-Admin-Project: True Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Domain-Id: default Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Domain-Name: Default Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Name: admin Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Role: reader,admin,member Aug 30 04:00:04.538600 n-d-854925-5 devstack@n-api.service[106505]: X-Roles: reader,admin,member Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86787ba72bbf47fb9e95ab44ad768a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}] Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant: admin Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant-Name: admin Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-User: admin Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-User-Domain-Id: default Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-User-Domain-Name: Default Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-User-Id: 7c9a35b85bfa4e759222644a399cdb07 Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: X-User-Name: admin Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: method: > Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: exception: Flavor 84 could not be found. Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: action_args: {'id': '84'} Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:00:04.540140 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:04.541211 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:04.542582 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-9f6c292b-a1e8-4c48-8a7b-82103740b7e4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:00:04.543841 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-9f6c292b-a1e8-4c48-8a7b-82103740b7e4 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012340 Aug 30 04:00:04.543841 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 04:00:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:00:05.508041 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e2a0dbfb-7e20-479b-9292-bc1574afb59b admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:05.509049 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-e2a0dbfb-7e20-479b-9292-bc1574afb59b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 30 04:00:05.509510 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:06.032869 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0be1efef-14ca-4570-a33a-39e39fc59360 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:06.039080 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.wsgi [None req-0be1efef-14ca-4570-a33a-39e39fc59360 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0be1efef-14ca-4570-a33a-39e39fc59360 admin admin] Request method failure captured: Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: Accept: application/json Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: Accept-Encoding: gzip, deflate Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: Connection: keep-alive Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: Content-Length: 0 Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: Host: 10.222.0.27 Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: Openstack-Api-Version: compute 2.90 Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: Openstack-System-Scope: None Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: User-Agent: python-novaclient Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Auth-Token: gAAAAABjDYtFMBrQwVFR8OW3b-_RC_6KNlKRvLzZAIFo8C-W2Qq9KvdAG-Udd-4Kh367jG0oeXbg1LRxQGwOxssjbu-00E_EvxAw_cb01o0GbV1rjBQyJ6xQnb7Z1vgDDZvWh8E31Vh9Q01D89OV9qNCaNqg8tqizyKdKNJv7LAm8hsD2_Pjy_0 Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Domain-Id: None Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Domain-Name: None Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Identity-Status: Confirmed Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Is-Admin-Project: True Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Domain-Id: default Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Domain-Name: Default Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Project-Name: admin Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Role: reader,admin,member Aug 30 04:00:06.040567 n-d-854925-5 devstack@n-api.service[106505]: X-Roles: reader,admin,member Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86787ba72bbf47fb9e95ab44ad768a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}] Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant: admin Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-Tenant-Name: admin Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-User: admin Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-User-Domain-Id: default Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-User-Domain-Name: Default Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-User-Id: 7c9a35b85bfa4e759222644a399cdb07 Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: X-User-Name: admin Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: method: > Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: exception: Flavor 451 could not be found. Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: action_args: {'id': '451'} Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:00:06.042162 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:06.043174 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.044474 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0be1efef-14ca-4570-a33a-39e39fc59360 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106505) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:00:06.045733 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0be1efef-14ca-4570-a33a-39e39fc59360 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.397018 Aug 30 04:00:06.045733 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 04:00:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:00:06.052327 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-7f5db034-ddca-455d-bea5-a04f7c1a4746 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:06.067937 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-7f5db034-ddca-455d-bea5-a04f7c1a4746 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019769 Aug 30 04:00:06.068455 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 04:00:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:00:06.077666 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:06.092835 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018617 Aug 30 04:00:06.093504 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Tue Aug 30 04:00:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:00:06.102143 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4d1fca68-7dec-42b2-9d9c-a76d9cb6ec6d admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:06.107346 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.wsgi [None req-4d1fca68-7dec-42b2-9d9c-a76d9cb6ec6d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4d1fca68-7dec-42b2-9d9c-a76d9cb6ec6d admin admin] Request method failure captured: Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: Accept: application/json Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: Accept-Encoding: gzip, deflate Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: Connection: keep-alive Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: Content-Length: 0 Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: Host: 10.222.0.27 Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: Openstack-Api-Version: compute 2.90 Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: Openstack-System-Scope: None Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: User-Agent: python-novaclient Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Auth-Token: gAAAAABjDYtFMBrQwVFR8OW3b-_RC_6KNlKRvLzZAIFo8C-W2Qq9KvdAG-Udd-4Kh367jG0oeXbg1LRxQGwOxssjbu-00E_EvxAw_cb01o0GbV1rjBQyJ6xQnb7Z1vgDDZvWh8E31Vh9Q01D89OV9qNCaNqg8tqizyKdKNJv7LAm8hsD2_Pjy_0 Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Domain-Id: None Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Domain-Name: None Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Identity-Status: Confirmed Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Is-Admin-Project: True Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Domain-Id: default Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Domain-Name: Default Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Project-Name: admin Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Role: reader,admin,member Aug 30 04:00:06.108820 n-d-854925-5 devstack@n-api.service[106504]: X-Roles: reader,admin,member Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_86787ba72bbf47fb9e95ab44ad768a8d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/86787ba72bbf47fb9e95ab44ad768a8d"}]}] Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant: admin Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant-Id: 86787ba72bbf47fb9e95ab44ad768a8d Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-Tenant-Name: admin Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-User: admin Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-User-Domain-Id: default Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-User-Domain-Name: Default Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-User-Id: 7c9a35b85bfa4e759222644a399cdb07 Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: X-User-Name: admin Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: method: > Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: exception: Flavor 451 could not be found. Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: action_args: {'id': '451'} Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:00:06.110393 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:06.111421 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: ERROR nova.api.openstack.wsgi Aug 30 04:00:06.112701 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4d1fca68-7dec-42b2-9d9c-a76d9cb6ec6d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106504) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:00:06.114022 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4d1fca68-7dec-42b2-9d9c-a76d9cb6ec6d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011457 Aug 30 04:00:06.114022 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 04:00:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:00:07.077248 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:07.078340 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Aug 30 04:00:07.078736 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:07.606314 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-89c77d98-2469-452d-85e3-dfbae871dde0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:07.624929 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-89c77d98-2469-452d-85e3-dfbae871dde0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409538 Aug 30 04:00:07.625420 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 04:00:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:08.576534 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:08.577608 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 30 04:00:08.577996 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:09.105613 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-71e74705-86aa-46a5-bcc1-c764104bb9c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:09.123943 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-71e74705-86aa-46a5-bcc1-c764104bb9c8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408732 Aug 30 04:00:09.124477 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 04:00:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:10.103671 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:10.104686 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 30 04:00:10.105084 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:10.628740 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-4f0115fb-1e33-416d-b6a7-6f756161df21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:10.649096 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-4f0115fb-1e33-416d-b6a7-6f756161df21 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.409503 Aug 30 04:00:10.649681 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 04:00:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:11.608922 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:11.609988 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 30 04:00:11.610379 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:12.130440 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-80928db5-f30b-4768-a9a3-0965127ee7b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:00:12.149013 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-80928db5-f30b-4768-a9a3-0965127ee7b0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.398943 Aug 30 04:00:12.149572 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Tue Aug 30 04:00:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:00:13.141138 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:13.142182 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 30 04:00:13.142611 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:00:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:00:13.672286 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-8cf94d88-f720-4cf7-93a1-986c41a8f379 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:00:13.693772 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-8cf94d88-f720-4cf7-93a1-986c41a8f379 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.414723 Aug 30 04:00:13.694305 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Aug 30 04:00:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:01:06.581942 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:06.583389 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-0ee5f83a-f726-484f-8c36-d2f864d05c10 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 30 04:01:06.583789 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 931 bytes} [Tue Aug 30 04:01:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:01:06.594266 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:06.980831 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-e7e7a9b0-b744-4b45-8c43-2217828056c7 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:07.000996 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-e7e7a9b0-b744-4b45-8c43-2217828056c7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411276 Aug 30 04:01:07.001563 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 04:01:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:01:07.024239 n-d-854925-5 devstack@n-api.service[106505]: DEBUG dbcounter [-] [106505] Writing DB stats nova_api:SELECT=14 {{(pid=106505) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:01:07.027942 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-ee5e4a5f-5df7-4f84-b922-e4d88bffd8e5 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:07.035514 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-ee5e4a5f-5df7-4f84-b922-e4d88bffd8e5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012786 Aug 30 04:01:07.036026 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Aug 30 04:01:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:07.047528 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-369c54fb-c73b-4708-ac5f-526d23d6be59 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:07.054998 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-369c54fb-c73b-4708-ac5f-526d23d6be59 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010978 Aug 30 04:01:07.055506 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Aug 30 04:01:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:01:07.066499 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-14a5c0f1-d475-4740-b340-4b122c17eb44 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:07.074712 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-14a5c0f1-d475-4740-b340-4b122c17eb44 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011724 Aug 30 04:01:07.075218 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1286 bytes} [Tue Aug 30 04:01:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:01:07.086634 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-b2665151-288a-4492-9123-fb7de4206eb9 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:01:07.093922 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-b2665151-288a-4492-9123-fb7de4206eb9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011267 Aug 30 04:01:07.094421 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1283 bytes} [Tue Aug 30 04:01:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:06:45.629475 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-14a5c0f1-d475-4740-b340-4b122c17eb44 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:45.630532 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-14a5c0f1-d475-4740-b340-4b122c17eb44 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 30 04:06:45.630934 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:45.776409 n-d-854925-5 devstack@n-api.service[106504]: DEBUG dbcounter [-] [106504] Writing DB stats nova_api:SELECT=6 {{(pid=106504) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:06:45.916462 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:45.919855 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:45.920318 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:45.920736 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:45.921461 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:45.921903 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:45.922307 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:45.963236 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-b7d6f59d-f61f-4f0f-9fd8-afb9d8c5787b admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.188723 Aug 30 04:06:45.963791 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 04:06:45 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:06:46.784621 n-d-854925-5 devstack@n-api.service[106505]: DEBUG nova.api.openstack.wsgi [None req-14a5c0f1-d475-4740-b340-4b122c17eb44 admin admin] Calling method '>' {{(pid=106505) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:46.785678 n-d-854925-5 devstack@n-api.service[106505]: INFO nova.api.openstack.requestlog [None req-14a5c0f1-d475-4740-b340-4b122c17eb44 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 30 04:06:46.786078 n-d-854925-5 devstack@n-api.service[106505]: [pid: 106505|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Tue Aug 30 04:06:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:06:46.988706 n-d-854925-5 devstack@n-api.service[106504]: DEBUG nova.api.openstack.wsgi [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] Calling method '>' {{(pid=106504) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:06:46.992101 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:46.992624 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:46.992990 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:46.994221 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:06:46.995321 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:06:46.995742 n-d-854925-5 devstack@n-api.service[106504]: DEBUG oslo_concurrency.lockutils [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106504) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:06:47.017689 n-d-854925-5 devstack@n-api.service[106504]: INFO nova.api.openstack.requestlog [None req-44eb1723-4bc5-4f91-beec-0ea5bc91b2b6 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.90 time: 0.091977 Aug 30 04:06:47.018231 n-d-854925-5 devstack@n-api.service[106504]: [pid: 106504|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 04:06:46 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:07:33.129257 n-d-854925-5 devstack@n-api.service[106503]: Tue Aug 30 04:07:33 2022 - graceful shutdown triggered... Aug 30 04:07:33.129414 n-d-854925-5 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 04:07:33.130646 n-d-854925-5 devstack@n-api.service[106504]: Gracefully killing worker 1 (pid: 106504)... Aug 30 04:07:33.131059 n-d-854925-5 devstack@n-api.service[106505]: Gracefully killing worker 2 (pid: 106505)... Aug 30 04:07:34.131709 n-d-854925-5 devstack@n-api.service[106503]: worker 1 buried after 1 seconds Aug 30 04:07:34.132192 n-d-854925-5 devstack@n-api.service[106503]: worker 2 buried after 1 seconds Aug 30 04:07:34.132192 n-d-854925-5 devstack@n-api.service[106503]: goodbye to uWSGI. Aug 30 04:07:34.133360 n-d-854925-5 systemd[1]: devstack@n-api.service: Succeeded. Aug 30 04:07:34.133920 n-d-854925-5 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 04:07:34.136651 n-d-854925-5 systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 04:07:34.157056 n-d-854925-5 devstack@n-api.service[122386]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 04:07:34 2022] *** Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: nodename: n-d-854925-5 Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: machine: x86_64 Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: clock source: unix Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: pcre jit disabled Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: detected number of CPU cores: 4 Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: current working directory: / Aug 30 04:07:34.177940 n-d-854925-5 devstack@n-api.service[122386]: detected binary path: /usr/bin/uwsgi-core Aug 30 04:07:34.178712 n-d-854925-5 devstack@n-api.service[122386]: your processes number limit is 47680 Aug 30 04:07:34.178712 n-d-854925-5 devstack@n-api.service[122386]: your memory page size is 4096 bytes Aug 30 04:07:34.178712 n-d-854925-5 devstack@n-api.service[122386]: detected max file descriptor number: 2048 Aug 30 04:07:34.178712 n-d-854925-5 devstack@n-api.service[122386]: lock engine: pthread robust mutexes Aug 30 04:07:34.178712 n-d-854925-5 devstack@n-api.service[122386]: thunder lock: enabled Aug 30 04:07:34.178712 n-d-854925-5 devstack@n-api.service[122386]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 04:07:34.178712 n-d-854925-5 devstack@n-api.service[122386]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 04:07:34.219622 n-d-854925-5 devstack@n-api.service[122386]: Python main interpreter initialized at 0x558a129f49c0 Aug 30 04:07:34.219622 n-d-854925-5 devstack@n-api.service[122386]: python threads support enabled Aug 30 04:07:34.219622 n-d-854925-5 devstack@n-api.service[122386]: your server socket listen backlog is limited to 100 connections Aug 30 04:07:34.219622 n-d-854925-5 devstack@n-api.service[122386]: your mercy for graceful operations on workers is 90 seconds Aug 30 04:07:34.220075 n-d-854925-5 devstack@n-api.service[122386]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 04:07:34.220075 n-d-854925-5 devstack@n-api.service[122386]: *** Operational MODE: preforking *** Aug 30 04:07:34.220932 n-d-854925-5 devstack@n-api.service[122386]: *** uWSGI is running in multiple interpreter mode *** Aug 30 04:07:34.220932 n-d-854925-5 devstack@n-api.service[122386]: spawned uWSGI master process (pid: 122386) Aug 30 04:07:34.221151 n-d-854925-5 systemd[1]: Started Devstack devstack@n-api.service. Aug 30 04:07:34.225357 n-d-854925-5 devstack@n-api.service[122386]: spawned uWSGI worker 1 (pid: 122402, cores: 1) Aug 30 04:07:34.225357 n-d-854925-5 devstack@n-api.service[122386]: spawned uWSGI worker 2 (pid: 122403, cores: 1) Aug 30 04:07:34.225357 n-d-854925-5 devstack@n-api.service[122386]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 04:07:34.886059 n-d-854925-5 devstack@n-api.service[122403]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:07:34.886670 n-d-854925-5 devstack@n-api.service[122402]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 04:07:36.047319 n-d-854925-5 devstack@n-api.service[122402]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:07:36.047319 n-d-854925-5 devstack@n-api.service[122402]: from cryptography.utils import int_from_bytes Aug 30 04:07:36.048057 n-d-854925-5 devstack@n-api.service[122402]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:07:36.048057 n-d-854925-5 devstack@n-api.service[122402]: from cryptography.utils import int_from_bytes Aug 30 04:07:36.049819 n-d-854925-5 devstack@n-api.service[122403]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:07:36.049819 n-d-854925-5 devstack@n-api.service[122403]: from cryptography.utils import int_from_bytes Aug 30 04:07:36.050275 n-d-854925-5 devstack@n-api.service[122403]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 04:07:36.050275 n-d-854925-5 devstack@n-api.service[122403]: from cryptography.utils import int_from_bytes Aug 30 04:07:38.456333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:07:38.457254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:07:38.457992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:07:38.458560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:07:38.458987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:07:38.459544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.460046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.460619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.461120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.461647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.462116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 04:07:38.462569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.462664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 04:07:38.462751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.462839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.462918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 04:07:38.463183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.463292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 04:07:38.463381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.463553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 04:07:38.463713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.463940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.464041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854925-5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.464269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.464399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.464593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.464703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.464918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.465028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.465254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.465458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.465675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.465785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.465988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.466097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.466301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.466419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.466625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.466821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.466954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.467190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.467517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-854925-5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.467841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.468196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.468318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.468515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.468744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.468974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.469194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.469492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.469713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.469931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.470670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.470896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.471118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.471374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.471604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.471825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.472056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.472278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.472508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.472728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.472944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.473170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.473413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854925-5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.473658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.473658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.474111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.474297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.474485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.474678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.474834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.474994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.475205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.475352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.475513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.475664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-854925-5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.475841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.475998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.476151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.476307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.476452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.476603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.476754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.476754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.477058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.477354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.479551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.479730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.479968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.480133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.480291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.480450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.480596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.480748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.480899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.481055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.481214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.481401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.481560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.481721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.481876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.482023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.482181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.482335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.482488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.482633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.482784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.482936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.483096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.483287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.483456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.483456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.484047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.484047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.484386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.484544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.484692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.484848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.485005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.485162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.485366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.485542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.485813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.486476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.486683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.486683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.486978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.487655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.487766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.487847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.487935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.488976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.489972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.490988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.491935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.492971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.493051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.493680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.493829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.493944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.494911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.495935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.496073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.496216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.496371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.496511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.496643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.496782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.496922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.497063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.497196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.497342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.497533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.497667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.497847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.498007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.498184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.498347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.498501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.498657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.498811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.498965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.499137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.499306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.499453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.499607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.499761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.499907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.500062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.500208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.500355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.500506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.500659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.500815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.500961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.501117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.501308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.501499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.501658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.501812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.501964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.502108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.502252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.502406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.502551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.502708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.502861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.503012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.503165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.503329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.503484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.503709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.503865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.504011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.504156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.504301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.504459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.504607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.504751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.504896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.505047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.505210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.505401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.505555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.505709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.505862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.506016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.506161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.506318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.506465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.506628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.506783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.506928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.507081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.507245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 04:07:38.507400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.507554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.507708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.507862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.508021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.508173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.508319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.508474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.508621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.508766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.508940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.509107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.509256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.509424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.509572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.509726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.509887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.510032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.510186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.510331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.510475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.510978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.510978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.511278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.511435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.511596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.511751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.511907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.512059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.512214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.512360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.512506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.512658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.512812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.512968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.513126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.513273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.513505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.513663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.513810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.513965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.514119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.514265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.514410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.514562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.514716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.514871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.515025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.515179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.515343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.515496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.515650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.515809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.515955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.516101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.516255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.516401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.516554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.516700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.516852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.517039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.517194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.517375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.517544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.517692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.517837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.517989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.518143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.518297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.518457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.518609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.518763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.518909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.519068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.519226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.519400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.519555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.519712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.519868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.520022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.520178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.520325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.520478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.520623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.520779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.520932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.521087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.521234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.521437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.521587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.521732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.521887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.522042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.522196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.522342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.522495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.522652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.522799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.522953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.523099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.523251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.523410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.523555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.523707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.523861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.524007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.524151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.524151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.524435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.524596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.524754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.524899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.525050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.525212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.525387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.525555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.525702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.525854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.526007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.526160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.526306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.526464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.526611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.526763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.526909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.527061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.527217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.527373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.527519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.527673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.527825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.527979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.528139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.528285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.528429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.528574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.528719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.528873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.529039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.529209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.529383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.529536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.529690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.529836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.530061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.530217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.530369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.530522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.530676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.530830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.530990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.531136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.531302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.531448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.531601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.531762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.531916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.532061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.532214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.532368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.533038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.533215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.533381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.533533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.533701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.533855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.534012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.534167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.534321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.534467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.534618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.534765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.535491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.535670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.535819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.535973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.536129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.536287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.536446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.536594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.536739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.536883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.537045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.537201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.537398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.537552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.537699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.537852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.537998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.538152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.538323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.538470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.538624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.538782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.538928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.539075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.539233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.539380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.539531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.539689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.539689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.539995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.540143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.540301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.540455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.540602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.540754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.540914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.541070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.541229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.541393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.541556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.541703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.541862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.542008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.542165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.542318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.542473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.542626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.542782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.542935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.543089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.543234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.543388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.543543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.543695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.543848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.543995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.544150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.544303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.544467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.544614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.544769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.544921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.544921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.545214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.545421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.545582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.545735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.545881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.546033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.546188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.546348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.546496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.546641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.546793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.546938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.547090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.547250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.547404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.547552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.547697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.547842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.548001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.548186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.548880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.549032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.549184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.549376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.549541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.549710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.550448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.550614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.550779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.550926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.551083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.551229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.551388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.551535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.551896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.552056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.552203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.552358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.552517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.552665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.552813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.552968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.553122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.553281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.553534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.553683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.553829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.553983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.554138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.554291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.554450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.554604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.554758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.554922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.555075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.555231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.555395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.555549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.555702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.555849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.556004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.556004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.556296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.556296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.556587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.556740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.556894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.557055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.557213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.557213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.557516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.557661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.557807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.557976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.558123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.558269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.558413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.558558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.558717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.558871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.559025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.559207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.559365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.559519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.559691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.559838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.559984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.560131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.560284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.560429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.560655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.560811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.560957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.561113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.561284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.561455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.561615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.561761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.561906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.562051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.562197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.562341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.562496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.562649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.562796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.562942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.563097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.563263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.563417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.563564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.563710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.563889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.564039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.564199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.564353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.564507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.564654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.564800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.564943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.565150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.565309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.565518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.565666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.565819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.565971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.566127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.566516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.566673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.566820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.566965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.567125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.567280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.567280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.567579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.567725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.567866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.568022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.568177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.568320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.568483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.568635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.568779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.568932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.569075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.569219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.569395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.569549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.569707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.569849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.570000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.570150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.570301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.570451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.570606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.570748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.570900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.571043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.571197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.571350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.571500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.571646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.572047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.572195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.572347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.572490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.572642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.572793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.572951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.573108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.573253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.573461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.573461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.573762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.573913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.574061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.574210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.574359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.574515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.574657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.574809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.574959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.575110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.575253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.575412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.575563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.575706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.575850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.575993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.576140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.576293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.576444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.576595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.576738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.576888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.577928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.578968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.579056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.579149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.579237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.579331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.579928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.580953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.581089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.581181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.581267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.581437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.581585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.581756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.581906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.582078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.582176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.582382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.582479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.582684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.582778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.582986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.583082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.583292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.583386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.583593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.583696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.583898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.583991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.584205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.584297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.584512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.584616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.584819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.584921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.585122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.585217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.585448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.585559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.585751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.585845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.586059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.586150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.586377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.586479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.586681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.586776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.586983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.587135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.587293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.587402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.587601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.587736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.587904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.588081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.588210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.588315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.588511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.588605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.588828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.588934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.589128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.589223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.589457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.589555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.589763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.589868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.590070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.590163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.590380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.590473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.590684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.590824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.590991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.591090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.591301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.591430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.591604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.591918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.592229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.592412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.592533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.592745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.592885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.593079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.593212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.593453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.593590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.593773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.593904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.594078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.594209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.594389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.594511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.594693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.594826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.594997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.595771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.596095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.596417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.596731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.597046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.597202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.597372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.597512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.597683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.597832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.597994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.598131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.598304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.598441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.598612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.598758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.598927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.599074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.599234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.599407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.599563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.599726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.599878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.600039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.600187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.600352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.600498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.600662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.600848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.601074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.601228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.601361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.601701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.602011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.602332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.602470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.602655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.602856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.602964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.603189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.603292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.603524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.603632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.603861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.603957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.604189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.604288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.604505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.604599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.604822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.604924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.605129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.605223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.605461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.605574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.605789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.605892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.606108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.606202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.606423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.606515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.606740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.606843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.607067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.607219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.607389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.607504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.607683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.607829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.607999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.608141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.608311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.608424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.608620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.608714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.608930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.609025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.609243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.609365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.609580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.609675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.609896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.609991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.610209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.610313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.610523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.610625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.610866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.610961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.611177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.611280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.611489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.611591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.611801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.611910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.612107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.612204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.612423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.612523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.612735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.612835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.613041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.613136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.613368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.613478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.613678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.613770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.613990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.614092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.614295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.614389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.614616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.614723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.614930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.615034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.615250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.615352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.615565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.615674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.615925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.616019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.616244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.616345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.616563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.616698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.616881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.617014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.617188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.617351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.617679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.617803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.618007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.618134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.618332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.618433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.618663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.618817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.618960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.619266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.619581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.619907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.620213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.620523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.620836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.621161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.621517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.621842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.622274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.622590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.622902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.623321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.623639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.623954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.624064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.624282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.624376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.624607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.624739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.624934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.625033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.625242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.625352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.625601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.625707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.625917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.626012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.626248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.626376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.626598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.626700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.626913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.627009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.627231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.627369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.627543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.627676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.627867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.627976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.628192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.628303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.628512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.628701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.628860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.629032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.629240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.629447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.629590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.629800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.629894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.630128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.630244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.630454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.630558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.630795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.630889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.631114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.631214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.631427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.631531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.631732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.631834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.632038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.632133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.632365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.632461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.632670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.632772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.632983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.633087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.633294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.633467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.633638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.633773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.633942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.634091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.634246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.634428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.634568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.634763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.634872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.635090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.635192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.635425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.635528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.635792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.635885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.636118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.636261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.636423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.636518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.636745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.636847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.637055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.637158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.637375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.637487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.637686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.637811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.637988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.638119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.638387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.638619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.638720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.638910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.639029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.639326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.639498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.639647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.639834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.639967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.640167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.640270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.640481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.640583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.640818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.640932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.641149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.641243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.641573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.641680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.641823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.642468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.642671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.642774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.642999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.643093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.643315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.643420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.643623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.643726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.643937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.644033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.644243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.644344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.644549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.644651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.644858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.645141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.645245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.645513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.645624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.645822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.645915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.646128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.646260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.646436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.646547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.646763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.646859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.647069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.647165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.647391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.647508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.647704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.647845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.647988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.648149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.648296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.648470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.648597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.648797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.648936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.649136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.649306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.649471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.649567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.649786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.649884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.650108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.650212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.650421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.650525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.650734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.650830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.651046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.651150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.651366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.651469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.651677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.651774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.651989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.652085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.652302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.652397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.652611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.652707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.652927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.653022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.653242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.653358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.653588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.653691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.653900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.654142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.654286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.654482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.654580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.654799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.654895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.655114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.655217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.655430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.655527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.655746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.655848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.656058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.656161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.656375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.656536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.656724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.656864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.657016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.657174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.657359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.657503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.658244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.658384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.658594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.658815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.658915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.659044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.659342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.663768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.664904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.665991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.666923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.690523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.691728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.691848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.691848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.692970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.693050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.693137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.693225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.693225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.693225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.693551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.693694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.694064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.694064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.694497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.694714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.694973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.695201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.695432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.695644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.695857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.696091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.696255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.696476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.696715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.697240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.697442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.703569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.703569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.706329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.707533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.707664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.707783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.707913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.708827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.709004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.709099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.709798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.710145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.710268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.710384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.710722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.710856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.711018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.711121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.711217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.711217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.711392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.711517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.712525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.712635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.712635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.712813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.712813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.712998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.712998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.713178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.713272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.713424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.713526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.713716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.713856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.713856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.714907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.715221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.715349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.715465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.715580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.715872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.715994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.716931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.717995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.718971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.719093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.719208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.719337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.719811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.719932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.720106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.720896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.721251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.722987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.723912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.724847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.725790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.726945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.727941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.728990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.729106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.729220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.729349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.729478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.729940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.730077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.730298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.730418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.730533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.730657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.730775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.731995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.732934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.733991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.734920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.735934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.736066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.736066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.736406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.736603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.736787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.736973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.737152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.737378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.737582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.737766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.737949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.738089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.738796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.738923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.739050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.739169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.739284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.739400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.739515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.739630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.741294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.741443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.741563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.741771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.741991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.742128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.742247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.742362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.742491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.742652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.742771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.742896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.743932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.744046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.744169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.744330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.744504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.744684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.744871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.745065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.745273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.745587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.745587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.745817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.745932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.746985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.747996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.748971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.749794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.750315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.750423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.750520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.750616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.750721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.750820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.750916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.751012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.751240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.751528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.751638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.751765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.751874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.751975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.752881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.753982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122403) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.754235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.755109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.756865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.757774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.757774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 04:07:38.757774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122402) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 04:07:38.802577 n-d-854925-5 devstack@n-api.service[122403]: INFO dbcounter [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Registered counter for database nova_api Aug 30 04:07:38.815529 n-d-854925-5 devstack@n-api.service[122402]: INFO dbcounter [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Registered counter for database nova_api Aug 30 04:07:38.822806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_db.sqlalchemy.engines [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:38.830016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writer thread running {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:38.838751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_db.sqlalchemy.engines [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:38.846497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writer thread running {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:38.888022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.context [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=122403) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:07:38.892739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.893219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.894851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.895673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.896036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.898090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.900128 n-d-854925-5 devstack@n-api.service[122403]: INFO dbcounter [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Registered counter for database nova_cell0 Aug 30 04:07:38.904321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.context [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=122402) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 04:07:38.904748 n-d-854925-5 devstack@n-api.service[122403]: INFO dbcounter [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Registered counter for database nova_cell1 Aug 30 04:07:38.912068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.912068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.912068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.912643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:07:38.912814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_db.sqlalchemy.engines [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:38.913093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:07:38.915166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:07:38.917275 n-d-854925-5 devstack@n-api.service[122402]: INFO dbcounter [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Registered counter for database nova_cell0 Aug 30 04:07:38.918756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writer thread running {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:38.919416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_db.sqlalchemy.engines [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:38.921465 n-d-854925-5 devstack@n-api.service[122402]: INFO dbcounter [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Registered counter for database nova_cell1 Aug 30 04:07:38.928650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_db.sqlalchemy.engines [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:38.931162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_db.sqlalchemy.engines [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:38.939700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writer thread running {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:38.940093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writer thread running {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:39.068870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writer thread running {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:39.078458 n-d-854925-5 devstack@n-api.service[122403]: INFO dbcounter [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Registered counter for database nova_cell0 Aug 30 04:07:39.086264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_db.sqlalchemy.engines [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122403) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:39.091274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writer thread running {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:39.097405 n-d-854925-5 devstack@n-api.service[122402]: INFO dbcounter [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Registered counter for database nova_cell0 Aug 30 04:07:39.106165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_db.sqlalchemy.engines [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122402) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 04:07:39.110737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writer thread running {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 04:07:39.425704 n-d-854925-5 devstack@n-api.service[122403]: WARNING keystonemiddleware.auth_token [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:07:39.433071 n-d-854925-5 devstack@n-api.service[122403]: WARNING keystonemiddleware.auth_token [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:07:39.463310 n-d-854925-5 devstack@n-api.service[122402]: WARNING keystonemiddleware.auth_token [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:07:39.470839 n-d-854925-5 devstack@n-api.service[122402]: WARNING keystonemiddleware.auth_token [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:07:39.794788 n-d-854925-5 devstack@n-api.service[122403]: WARNING keystonemiddleware.auth_token [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:07:39.802958 n-d-854925-5 devstack@n-api.service[122403]: WARNING keystonemiddleware.auth_token [None req-5891ac48-a0f8-476c-9176-4e384cfdc88c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:07:39.810008 n-d-854925-5 devstack@n-api.service[122403]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a129f49c0 pid: 122403 (default app) Aug 30 04:07:39.846604 n-d-854925-5 devstack@n-api.service[122402]: WARNING keystonemiddleware.auth_token [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 04:07:39.852584 n-d-854925-5 devstack@n-api.service[122402]: WARNING keystonemiddleware.auth_token [None req-6db72498-081e-4d88-a07a-3b15b125f6f5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 04:07:39.857885 n-d-854925-5 devstack@n-api.service[122402]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558a129f49c0 pid: 122402 (default app) Aug 30 04:08:18.146475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:18.147355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:18.148930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:18.149853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:19.414513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '.version_select at 0x7fe96bd399d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:19.421839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=122403) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 04:08:19.423340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:19.423955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:19.424522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:19.455815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:19.456299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:19.456784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:19.471271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:19.471782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:19.472366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:19.484622 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2cfc9f80-7c10-4174-add0-b85f8a63547c tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.349542 Aug 30 04:08:19.486456 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1/1] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 04:08:18 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:19.507393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:19.508398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:19.509797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:19.510747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:19.736640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a54080e2-e7d2-4ae8-a572-60d94ef70334 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-665209265", "name": "tempest-test_aggregate-1127713029"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:19.773423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-a54080e2-e7d2-4ae8-a572-60d94ef70334 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid ad55608d-a783-4eac-8b3b-234f012616de for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:08:19.875753 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a54080e2-e7d2-4ae8-a572-60d94ef70334 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.373967 Aug 30 04:08:19.876671 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1/2] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Aug 30 04:08:19 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:08:19.888257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05c49264-b32b-437d-a7e3-6a98dac0b9f0 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:19.910156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-05c49264-b32b-437d-a7e3-6a98dac0b9f0 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.025759 Aug 30 04:08:19.911987 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:08:19 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:19.941038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f6a5b09-55d8-4ffe-9fd3-dc5e02a3e161 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:19.986899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f6a5b09-55d8-4ffe-9fd3-dc5e02a3e161 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:19.987669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f6a5b09-55d8-4ffe-9fd3-dc5e02a3e161 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:19.988556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f6a5b09-55d8-4ffe-9fd3-dc5e02a3e161 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:21.333991 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f6a5b09-55d8-4ffe-9fd3-dc5e02a3e161 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.413959 Aug 30 04:08:21.350864 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2/4] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:08:19 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:21.917455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:21.919073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:21.919556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:21.919986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:21.920703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:21.921148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:21.921608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:21.972172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14062076-cacf-4c15-9a41-300414717a95 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.680567 Aug 30 04:08:21.972773 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Aug 30 04:08:21 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:22.212785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-196457926", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "availability_zone": "tempest-test_az-665209265"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:22.298452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.299413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.300002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.301023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.301670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.302361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.411323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6a5b46e2-1c51-48d1-8d56-948d9a2bd015 tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1092657308", "id": 1680365405, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:22.486412 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6a5b46e2-1c51-48d1-8d56-948d9a2bd015 tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.731951 Aug 30 04:08:22.488409 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3/6] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:08:21 2022] POST /compute/v2.1/flavors => generated 471 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:22.497429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:22.501361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.505490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.507073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.507896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.508361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.508805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:22.586992 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8134a99b-695e-4846-86b8-dd2734b731d5 tempest-AZAdminV2TestJSON-1908558178 tempest-AZAdminV2TestJSON-1908558178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 700 microversion: 2.1 time: 0.094436 Aug 30 04:08:22.587646 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Aug 30 04:08:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 700 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:22.854287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:08:22.964043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Calling method '.version_select at 0x7fe96b2e1ca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:22.981815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=122402) load_cells /opt/stack/nova/nova/compute/api.py:319}} Aug 30 04:08:22.983369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:22.983861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:22.997727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:23.055379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:23.056365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:23.056942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:23.094129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:23.095197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:23.095741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:23.122920 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8d979f96-768d-403b-a6a6-61bbee8f198c tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.533649 Aug 30 04:08:23.135087 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 5/8] 10.222.0.27 () {60 vars in 1208 bytes} [Tue Aug 30 04:08:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:08:23.353402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:08:23.354102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:08:23.354619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:08:23.355041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:08:23.355459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:08:23.388045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:23.388550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:23.390069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:23.393203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:23.393865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:23.394448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:23.495547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Getting quotas for project d54134d1d904443f8ed353a3d812ffab. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:08:23.532946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Getting quotas for user 44642b0f34744c068cc6a03d041d21f1 and project d54134d1d904443f8ed353a3d812ffab. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:08:23.569011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:08:23.575958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:08:23.678373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1209041703", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:23.690690 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-468dd134-a23a-4c48-bfc8-ab7fa5899cc5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.716250 Aug 30 04:08:23.693056 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 4/9] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:08:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:08:23.930179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Calling method '.version_select at 0x7fe96bb19ee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:23.932193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:23.933032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:23.933840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:23.971487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:23.972147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:23.972942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:23.991414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:23.993186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:23.994469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.015149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86b34405-7f54-4f54-b47d-a56e126718af tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.319832 Aug 30 04:08:24.017049 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 5/10] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:08:23 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:24.022551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-119576ea-c91b-4953-af7d-0d719d5b90cd tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:24.280202 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-119576ea-c91b-4953-af7d-0d719d5b90cd tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1680365405/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.261797 Aug 30 04:08:24.288230 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 6/11] 10.222.0.27 () {62 vars in 1265 bytes} [Tue Aug 30 04:08:24 2022] POST /compute/v2.1/flavors/1680365405/os-extra_specs => generated 62 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:24.309184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a06742f5-6247-45fb-acd1-82fdc8df43f9 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:24.312401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a06742f5-6247-45fb-acd1-82fdc8df43f9 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:24.475412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a06742f5-6247-45fb-acd1-82fdc8df43f9 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:24.500520 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a06742f5-6247-45fb-acd1-82fdc8df43f9 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1241 microversion: 2.1 time: 0.209323 Aug 30 04:08:24.503498 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 7/12] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:24 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1241 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:24.511358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Calling method '.version_select at 0x7fe96b2a7ca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:24.513960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.514702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.515336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.548481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.549152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.549789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.653301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.654036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.654848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.677115 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e322928-e3fa-43a0-82ce-1b358ca19da5 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-854925-5/servers" status: 200 len: 104 microversion: 2.1 time: 0.168460 Aug 30 04:08:24.680497 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Aug 30 04:08:24 2022] GET /compute/v2.1/os-hypervisors/n-h2-854925-5/servers => generated 104 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:24.693259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09e505c8-84fa-4885-bf05-83c08464697e tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:24.768676 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-09e505c8-84fa-4885-bf05-83c08464697e tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1680365405" status: 202 len: 0 microversion: 2.86 time: 0.086486 Aug 30 04:08:24.769956 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 9/14] 10.222.0.27 () {60 vars in 1202 bytes} [Tue Aug 30 04:08:24 2022] DELETE /compute/v2.1/flavors/1680365405 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:08:24.777602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Calling method '.version_select at 0x7fe96b20b670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:24.792528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.793186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.793699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.828639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.829169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.829651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.845293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.845824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.846796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.856745 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47eca350-44cc-449d-93d5-7936e25dd400 tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.085174 Aug 30 04:08:24.864379 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 10/15] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:08:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:24.869278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-22bf1ced-5b68-419a-b835-bdbb417cdc4f tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:24.935007 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-22bf1ced-5b68-419a-b835-bdbb417cdc4f tempest-FlavorMetadataValidation-2089052246 tempest-FlavorMetadataValidation-2089052246-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.069242 Aug 30 04:08:24.936186 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 11/16] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:08:24.942005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Calling method '.version_select at 0x7fe96b1a2940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:24.944364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.944988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.945635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.980284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:08:24.986268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:24.987308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:24.987972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:24.998642 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c69aca5a-06e1-429d-9e0c-89d59ce90c9c tempest-HypervisorAdminUnderV252Test-867819497 tempest-HypervisorAdminUnderV252Test-867819497-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-854925-5/search" status: 200 len: 104 microversion: 2.1 time: 0.060924 Aug 30 04:08:25.004419 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 12/17] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Aug 30 04:08:24 2022] GET /compute/v2.1/os-hypervisors/n-h2-854925-5/search => generated 104 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:25.526094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23e45f66-bf3d-4fde-9bae-bf296ef78afd tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:25.526856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23e45f66-bf3d-4fde-9bae-bf296ef78afd tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:25.669088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:08:25.669712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:08:25.670605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:08:25.671733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:08:25.672352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:08:25.710277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:25.718611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:25.719594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:25.721672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:25.722361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:25.723016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:25.752490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23e45f66-bf3d-4fde-9bae-bf296ef78afd tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:25.770477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23e45f66-bf3d-4fde-9bae-bf296ef78afd tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1241 microversion: 2.1 time: 0.244627 Aug 30 04:08:25.774200 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 13/18] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:25 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1241 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:25.809912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Getting quotas for project ace36fb5a6e840e18fb8ea79f0525628. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:08:25.820740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Getting quotas for user edfece7a34f54de5a9b74fdc650321cd and project ace36fb5a6e840e18fb8ea79f0525628. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:08:25.854803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:08:25.866605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:08:25.964682 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f45f41e4-87ce-4c06-83dd-e079fdb1494c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.828396 Aug 30 04:08:25.965650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 6/19] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:08:25.978563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fec705b8-8968-4088-bfdf-c9db27872bf0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:25.979651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fec705b8-8968-4088-bfdf-c9db27872bf0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:26.102517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fec705b8-8968-4088-bfdf-c9db27872bf0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:26.110456 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fec705b8-8968-4088-bfdf-c9db27872bf0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1220 microversion: 2.1 time: 0.135860 Aug 30 04:08:26.111616 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 14/20] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:25 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:26.804477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:26.806232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:26.820780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:26.823179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:26.823790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:26.827017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:26.828426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:26.830777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:26.880862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64f6e9d1-d986-4650-bc0d-26a68e2c0bf6 tempest-AZAdminNegativeTestJSON-1901666791 tempest-AZAdminNegativeTestJSON-1901666791-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:26.882794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64f6e9d1-d986-4650-bc0d-26a68e2c0bf6 tempest-AZAdminNegativeTestJSON-1901666791 tempest-AZAdminNegativeTestJSON-1901666791-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'ec425d4b12114a128c0fbdda270d6b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bd1bba7ef9e4f6d9cff1d9be03c9552', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64f6e9d1-d986-4650-bc0d-26a68e2c0bf6 tempest-AZAdminNegativeTestJSON-1901666791 tempest-AZAdminNegativeTestJSON-1901666791-project] Request method failure captured: Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY03BEL0lQ_SDZ8NBlmIyMNlqDpf5UN-wflSOm7-el5bCGVrNSlBi-Mah4htIvrt26Dtj6WFcsU2nPg_0wZivk25x3hdnQMvYok41gYYq7mo2TbXSBe0Kbd098VNLnFznQ2RlyUl3gQ_oELU9RLDS1pyyjc-YZ7_-0kl3xVFsr0ipBU Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 8bd1bba7ef9e4f6d9cff1d9be03c9552 Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1901666791 Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:08:26.889383 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8bd1bba7ef9e4f6d9cff1d9be03c9552", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8bd1bba7ef9e4f6d9cff1d9be03c9552"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bd1bba7ef9e4f6d9cff1d9be03c9552"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bd1bba7ef9e4f6d9cff1d9be03c9552"}]}] Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AZAdminNegativeTestJSON-1901666791 Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 8bd1bba7ef9e4f6d9cff1d9be03c9552 Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1901666791 Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AZAdminNegativeTestJSON-1901666791-project Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: ec425d4b12114a128c0fbdda270d6b8d Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AZAdminNegativeTestJSON-1901666791-project Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 04:08:26.891245 n-d-854925-5 devstack@n-api.service[122402]: action_args: {} Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:26.892131 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 30 04:08:26.893960 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:26.917146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64f6e9d1-d986-4650-bc0d-26a68e2c0bf6 tempest-AZAdminNegativeTestJSON-1901666791 tempest-AZAdminNegativeTestJSON-1901666791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:26.923180 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64f6e9d1-d986-4650-bc0d-26a68e2c0bf6 tempest-AZAdminNegativeTestJSON-1901666791 tempest-AZAdminNegativeTestJSON-1901666791-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.583709 Aug 30 04:08:26.923742 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 7/21] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Aug 30 04:08:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 586 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:27.137665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7bc48b0a-aa11-444a-bb27-b018b31ac744 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:27.138700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7bc48b0a-aa11-444a-bb27-b018b31ac744 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:27.151083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:27.179636 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-194c480c-0710-4432-b0f9-41f8ddbf8bbc tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1289 microversion: 2.1 time: 0.378668 Aug 30 04:08:27.194196 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 15/22] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:26 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1289 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:27.283408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7bc48b0a-aa11-444a-bb27-b018b31ac744 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:27.305540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7bc48b0a-aa11-444a-bb27-b018b31ac744 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1220 microversion: 2.1 time: 0.178377 Aug 30 04:08:27.306163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 8/23] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:27 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1220 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:28.212632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:28.214033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:28.234501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:28.237566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:28.242929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:28.243957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:28.247937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:28.248966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:28.333463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:28.335048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:28.350219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:28.352023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:28.352922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:28.355155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:28.358720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:28.359521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:28.437856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:28.450358 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7e18c46-db74-4852-90f7-e0868519b09d tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1295 microversion: 2.1 time: 0.245029 Aug 30 04:08:28.466770 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 16/24] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:28 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1295 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:28.686511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:28.713460 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1d99b75a-920e-437b-85a2-45b91b75ce95 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1293 microversion: 2.1 time: 0.385054 Aug 30 04:08:28.716050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 9/25] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:28 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1293 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:29.478433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:29.479046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:29.490448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:29.490940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:29.495535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:29.496369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:29.496890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:29.497257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:29.736026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:29.736646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:29.746731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:29.753995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:29.754661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:29.755565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:29.759347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:29.759987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:29.839002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:29.847731 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-43206150-b933-4b3f-bd29-d65284f0ebac tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1295 microversion: 2.1 time: 0.373103 Aug 30 04:08:29.854062 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 17/26] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:29 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1295 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:29.958332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:29.968283 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf8ca864-94c4-478a-871c-6b7191e84dd1 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1299 microversion: 2.1 time: 0.235722 Aug 30 04:08:29.981368 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 10/27] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:29 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:30.883270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:30.884058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:30.894333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:30.894831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:30.895317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:30.896029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:30.896486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:30.914115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:30.994046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:30.995322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:31.022845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:31.024098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:31.027591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:31.029858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:31.030507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:31.040683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:31.418966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:31.443427 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a06355ec-2007-4dd9-8696-1e04872892a6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1299 microversion: 2.1 time: 0.451684 Aug 30 04:08:31.446556 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 11/28] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:30 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1299 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:31.576893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:31.598346 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-405c40e5-1939-460b-9e64-33e9b822b75a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.725789 Aug 30 04:08:31.615916 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 18/29] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:30 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:32.467128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:32.467757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:32.476237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:32.480754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:32.483383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:32.484334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:32.485592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:32.486791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:33.195985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61a69be1-3f47-44cc-8f0c-e85a6de1d891 tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-2041578361", "id": 883172393, "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:33.326771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61a69be1-3f47-44cc-8f0c-e85a6de1d891 tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.729381 Aug 30 04:08:33.336854 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 19/30] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:08:32 2022] POST /compute/v2.1/flavors => generated 465 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:33.355430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:33.357282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:33.393514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:33.397610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:33.398290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:33.400611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:33.412524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:33.414874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:33.438065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:33.563248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:33.577877 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dd369ea-7123-4584-b244-de60eb5d2c09 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 1.114512 Aug 30 04:08:33.580969 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 12/31] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:32 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:33.889636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:33.902336 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-383e0cff-39e7-46e8-894f-77a69d66a223 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.565652 Aug 30 04:08:33.902938 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 20/32] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:33 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:34.358792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77ff2c11-476f-4aca-95db-84a795262962 tempest-FlavorsV261TestJSON-408430720 tempest-FlavorsV261TestJSON-408430720-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.382807 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77ff2c11-476f-4aca-95db-84a795262962 tempest-FlavorsV261TestJSON-408430720 tempest-FlavorsV261TestJSON-408430720-project] 10.222.0.27 "GET /compute/v2.1/flavors/883172393" status: 200 len: 465 microversion: 2.61 time: 0.799605 Aug 30 04:08:34.385850 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 13/33] 10.222.0.27 () {60 vars in 1196 bytes} [Tue Aug 30 04:08:33 2022] GET /compute/v2.1/flavors/883172393 => generated 465 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:34.399215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b36d012c-9d04-47db-b0fb-858a7af6405c tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] Action: 'update', calling method: .version_select at 0x7fe96c0fff70>, body: {"flavor": {"description": "new"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:34.480230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=6,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:34.494162 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b36d012c-9d04-47db-b0fb-858a7af6405c tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/883172393" status: 200 len: 466 microversion: 2.61 time: 0.099948 Aug 30 04:08:34.495196 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 21/34] 10.222.0.27 () {62 vars in 1216 bytes} [Tue Aug 30 04:08:34 2022] PUT /compute/v2.1/flavors/883172393 => generated 466 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:34.508361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-760b7632-f5e7-4ad0-933f-889133bd8306 tempest-FlavorsV261TestJSON-408430720 tempest-FlavorsV261TestJSON-408430720-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.620275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.620969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:34.650280 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-760b7632-f5e7-4ad0-933f-889133bd8306 tempest-FlavorsV261TestJSON-408430720 tempest-FlavorsV261TestJSON-408430720-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.145079 Aug 30 04:08:34.651361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:34.670340 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 14/35] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:34 2022] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:08:34.670549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:34.670549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:34.670549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:34.670549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:34.670803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:34.676984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5636cdd9-979b-4499-8775-2d8cdd286970 tempest-FlavorsV261TestJSON-408430720 tempest-FlavorsV261TestJSON-408430720-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.753030 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5636cdd9-979b-4499-8775-2d8cdd286970 tempest-FlavorsV261TestJSON-408430720 tempest-FlavorsV261TestJSON-408430720-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.077997 Aug 30 04:08:34.755395 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 15/36] 10.222.0.27 () {60 vars in 1166 bytes} [Tue Aug 30 04:08:34 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:08:34.777792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-596f6061-2231-4ab9-a08f-18d04d22e893 tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:34.887126 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-596f6061-2231-4ab9-a08f-18d04d22e893 tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/883172393" status: 202 len: 0 microversion: 2.61 time: 0.118971 Aug 30 04:08:34.890701 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 16/37] 10.222.0.27 () {60 vars in 1199 bytes} [Tue Aug 30 04:08:34 2022] DELETE /compute/v2.1/flavors/883172393 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:08:35.333592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Calling method '.version_select at 0x7fe96b215790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:35.337540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:35.338034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:35.338536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:35.345936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:35.352753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:35.354713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:35.382933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:35.395552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3f2396e8-933f-439b-b157-5a4d735cdbaa tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.794391 Aug 30 04:08:35.396164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 22/38] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:34 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:35.418346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fdb421b9-5260-4da1-b1d3-b3afbbda8024 tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:35.484351 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b35d456-2f78-492a-9090-e8627f71c87b tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.589564 Aug 30 04:08:35.487715 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 17/39] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Aug 30 04:08:34 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:35.499901 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fdb421b9-5260-4da1-b1d3-b3afbbda8024 tempest-FlavorsV261TestJSON-1166212842 tempest-FlavorsV261TestJSON-1166212842-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.102631 Aug 30 04:08:35.503209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:35.506003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:35.514125 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 23/40] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:35 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:08:35.514949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:35.515462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:35.515969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:35.517374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:35.517491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:35.517905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:35.703072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e97e7339-c575-4eb1-b6b2-270c377cd6bb req-57fb0734-efb8-4f78-b266-8871fdc2cc88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422a0262-f212-4d4e-87b0-99ec7fe17e0e", "tag": "719db109-e8d2-4bf0-85ea-5eebc2daf1d1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:35.726963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e97e7339-c575-4eb1-b6b2-270c377cd6bb req-57fb0734-efb8-4f78-b266-8871fdc2cc88 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:35.728497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e97e7339-c575-4eb1-b6b2-270c377cd6bb req-57fb0734-efb8-4f78-b266-8871fdc2cc88 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:35.730701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e97e7339-c575-4eb1-b6b2-270c377cd6bb req-57fb0734-efb8-4f78-b266-8871fdc2cc88 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:35.767806 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e97e7339-c575-4eb1-b6b2-270c377cd6bb req-57fb0734-efb8-4f78-b266-8871fdc2cc88 service nova] Creating event network-changed:719db109-e8d2-4bf0-85ea-5eebc2daf1d1 for instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e on n-h2-854925-5 Aug 30 04:08:35.768596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e97e7339-c575-4eb1-b6b2-270c377cd6bb req-57fb0734-efb8-4f78-b266-8871fdc2cc88 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:08:35.770747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e97e7339-c575-4eb1-b6b2-270c377cd6bb req-57fb0734-efb8-4f78-b266-8871fdc2cc88 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:08:35.775544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:35.776230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:35.783475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:35.785042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:35.785746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:35.786342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:35.828264 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.compute.rpcapi [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:08:35.829748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] Releasing lock "compute-rpcapi-router" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:08:35.892769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-45db4f8e-2872-4b83-8749-5afb68e82b0b None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.376698 Aug 30 04:08:35.910362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 24/41] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:36.106828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:36.380736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:36.390956 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f7bd2088-ae5c-41fc-a6e0-838819528241 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.900564 Aug 30 04:08:36.395000 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 18/42] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:35 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:36.421114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.422098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:36.439378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:36.439881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:36.440327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:36.441041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:36.441541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:36.453345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c40b8b26-7bc8-4c51-8057-ac5155f4a1fe tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Calling method '.version_select at 0x7fe96b1c45e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.458604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:36.461357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c40b8b26-7bc8-4c51-8057-ac5155f4a1fe tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'ecf096039324491baf80fed8e5801d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09ee4c9a174904b881bda19566043f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c40b8b26-7bc8-4c51-8057-ac5155f4a1fe tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Request method failure captured: Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1AkhJYlRj6LmK9RioraZmJ2B24wi5XpVj60nfiG72GcsVZANVm-AZ6mHNEM9n72CSFmjxKc6h-kwDBfnfzgVltNDbfWww-JBRf-ZCRlmK-yublUyCto9KwT2vEfh8m2IOIrCjkkDQ3PQ_NtJ5m57QAYvC2yzSl8zqujoGfYnyERrE Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:36.479211 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f09ee4c9a174904b881bda19566043f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}] Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ecf096039324491baf80fed8e5801d1f Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: action_args: {} Aug 30 04:08:36.480619 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:36.481474 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 30 04:08:36.482598 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.483752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c40b8b26-7bc8-4c51-8057-ac5155f4a1fe tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.483752 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c40b8b26-7bc8-4c51-8057-ac5155f4a1fe tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.569301 Aug 30 04:08:36.488288 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 25/43] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Aug 30 04:08:35 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 577 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:36.512929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4cee623-d90c-43fa-9cc2-593fdf868ecf tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Calling method '.version_select at 0x7fe96b2a7ee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.525545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4cee623-d90c-43fa-9cc2-593fdf868ecf tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'ecf096039324491baf80fed8e5801d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09ee4c9a174904b881bda19566043f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4cee623-d90c-43fa-9cc2-593fdf868ecf tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Request method failure captured: Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/n-d-854925-5/reboot HTTP/1.1 Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1AkhJYlRj6LmK9RioraZmJ2B24wi5XpVj60nfiG72GcsVZANVm-AZ6mHNEM9n72CSFmjxKc6h-kwDBfnfzgVltNDbfWww-JBRf-ZCRlmK-yublUyCto9KwT2vEfh8m2IOIrCjkkDQ3PQ_NtJ5m57QAYvC2yzSl8zqujoGfYnyERrE Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:36.529169 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f09ee4c9a174904b881bda19566043f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}] Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ecf096039324491baf80fed8e5801d1f Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5'} Aug 30 04:08:36.530562 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:36.531403 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 30 04:08:36.533226 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.545627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4cee623-d90c-43fa-9cc2-593fdf868ecf tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.547214 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4cee623-d90c-43fa-9cc2-593fdf868ecf tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-854925-5/reboot" status: 403 len: 111 microversion: 2.1 time: 0.052870 Aug 30 04:08:36.550091 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 26/44] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/n-d-854925-5/reboot => generated 111 bytes in 57 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:08:36.569850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3bebbeb9-f9ec-441e-8767-6c339415f650 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Calling method '.version_select at 0x7fe96b1c4e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.650443 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3bebbeb9-f9ec-441e-8767-6c339415f650 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3bebbeb9-f9ec-441e-8767-6c339415f650 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:36.682499 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'nonexistent_hostname'} Aug 30 04:08:36.683950 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:08:36.684805 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 04:08:36.686032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.687190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3bebbeb9-f9ec-441e-8767-6c339415f650 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.688524 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3bebbeb9-f9ec-441e-8767-6c339415f650 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.128722 Aug 30 04:08:36.689182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 27/45] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:08:36.715864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a31afe57-6dba-4447-8edd-e6f1b1c7af0c tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Calling method '.version_select at 0x7fe96aede1f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.727107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a31afe57-6dba-4447-8edd-e6f1b1c7af0c tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'ecf096039324491baf80fed8e5801d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09ee4c9a174904b881bda19566043f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a31afe57-6dba-4447-8edd-e6f1b1c7af0c tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Request method failure captured: Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/n-d-854925-5 HTTP/1.1 Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1AkhJYlRj6LmK9RioraZmJ2B24wi5XpVj60nfiG72GcsVZANVm-AZ6mHNEM9n72CSFmjxKc6h-kwDBfnfzgVltNDbfWww-JBRf-ZCRlmK-yublUyCto9KwT2vEfh8m2IOIrCjkkDQ3PQ_NtJ5m57QAYvC2yzSl8zqujoGfYnyERrE Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:36.728623 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f09ee4c9a174904b881bda19566043f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}] Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ecf096039324491baf80fed8e5801d1f Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5'} Aug 30 04:08:36.729705 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:36.730391 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 30 04:08:36.731334 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.736563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a31afe57-6dba-4447-8edd-e6f1b1c7af0c tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.737514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a31afe57-6dba-4447-8edd-e6f1b1c7af0c tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-854925-5" status: 403 len: 109 microversion: 2.1 time: 0.040726 Aug 30 04:08:36.738587 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 28/46] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/n-d-854925-5 => generated 109 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:36.761269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77d0e29d-af00-4676-9b89-d52d25bc2472 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Calling method '.version_select at 0x7fe96aeded30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.772666 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-77d0e29d-af00-4676-9b89-d52d25bc2472 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77d0e29d-af00-4676-9b89-d52d25bc2472 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:36.774362 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'nonexistent_hostname'} Aug 30 04:08:36.775463 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.776117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.777062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.777991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77d0e29d-af00-4676-9b89-d52d25bc2472 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.781584 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77d0e29d-af00-4676-9b89-d52d25bc2472 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.035517 Aug 30 04:08:36.782458 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 29/47] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:08:36.796757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e24dc26-b601-44b9-9d24-0605075ec9b3 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Calling method '.version_select at 0x7fe96aede820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.805927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0e24dc26-b601-44b9-9d24-0605075ec9b3 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'ecf096039324491baf80fed8e5801d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09ee4c9a174904b881bda19566043f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e24dc26-b601-44b9-9d24-0605075ec9b3 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Request method failure captured: Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/n-d-854925-5/shutdown HTTP/1.1 Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1AkhJYlRj6LmK9RioraZmJ2B24wi5XpVj60nfiG72GcsVZANVm-AZ6mHNEM9n72CSFmjxKc6h-kwDBfnfzgVltNDbfWww-JBRf-ZCRlmK-yublUyCto9KwT2vEfh8m2IOIrCjkkDQ3PQ_NtJ5m57QAYvC2yzSl8zqujoGfYnyERrE Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:36.807623 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f09ee4c9a174904b881bda19566043f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}] Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ecf096039324491baf80fed8e5801d1f Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5'} Aug 30 04:08:36.808968 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:36.810085 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 30 04:08:36.811346 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.812555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e24dc26-b601-44b9-9d24-0605075ec9b3 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.812555 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e24dc26-b601-44b9-9d24-0605075ec9b3 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-854925-5/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.018926 Aug 30 04:08:36.814164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 30/48] 10.222.0.27 () {58 vars in 1194 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/n-d-854925-5/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:36.832765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7d9648a-9bf1-440f-aeb6-0e4803f3bd2e tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Calling method '.version_select at 0x7fe96aeed3a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.869586 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-b7d9648a-9bf1-440f-aeb6-0e4803f3bd2e tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7d9648a-9bf1-440f-aeb6-0e4803f3bd2e tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:36.871444 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'nonexistent_hostname'} Aug 30 04:08:36.872743 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:08:36.873647 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 04:08:36.874847 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.876489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7d9648a-9bf1-440f-aeb6-0e4803f3bd2e tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.877205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7d9648a-9bf1-440f-aeb6-0e4803f3bd2e tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.055930 Aug 30 04:08:36.883708 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 31/49] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:08:36.915121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a8d18b7-c374-4465-89d1-d21459386c2e tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Calling method '.version_select at 0x7fe96aede550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:36.925778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a8d18b7-c374-4465-89d1-d21459386c2e tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'ecf096039324491baf80fed8e5801d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09ee4c9a174904b881bda19566043f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a8d18b7-c374-4465-89d1-d21459386c2e tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Request method failure captured: Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/n-d-854925-5/startup HTTP/1.1 Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1AkhJYlRj6LmK9RioraZmJ2B24wi5XpVj60nfiG72GcsVZANVm-AZ6mHNEM9n72CSFmjxKc6h-kwDBfnfzgVltNDbfWww-JBRf-ZCRlmK-yublUyCto9KwT2vEfh8m2IOIrCjkkDQ3PQ_NtJ5m57QAYvC2yzSl8zqujoGfYnyERrE Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:36.932588 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f09ee4c9a174904b881bda19566043f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}] Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ecf096039324491baf80fed8e5801d1f Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5'} Aug 30 04:08:36.933918 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:36.934676 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 30 04:08:36.935818 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:36.936946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a8d18b7-c374-4465-89d1-d21459386c2e tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:36.936946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a8d18b7-c374-4465-89d1-d21459386c2e tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-d-854925-5/startup" status: 403 len: 110 microversion: 2.1 time: 0.042910 Aug 30 04:08:36.942730 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 32/50] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/n-d-854925-5/startup => generated 110 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:08:36.969779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5e529dc-5585-4226-a646-cf4c28e6764c tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Calling method '.version_select at 0x7fe96b1c45e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:37.005525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f5e529dc-5585-4226-a646-cf4c28e6764c tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5e529dc-5585-4226-a646-cf4c28e6764c tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:37.020057 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'nonexistent_hostname'} Aug 30 04:08:37.021264 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:08:37.021955 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 30 04:08:37.022855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5e529dc-5585-4226-a646-cf4c28e6764c tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:37.023861 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f5e529dc-5585-4226-a646-cf4c28e6764c tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.075338 Aug 30 04:08:37.027718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 33/51] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:08:37.043373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f9a622d2-a4a6-45fc-90ce-7797c34725b8 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aede160>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f9a622d2-a4a6-45fc-90ce-7797c34725b8 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/os-hosts/n-d-854925-5 HTTP/1.1 Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 51 Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:37.070170 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: {"status": "enable", "maintenance_mode": "invalid"} Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:37.071282 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance: Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.071939 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.073468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f9a622d2-a4a6-45fc-90ce-7797c34725b8 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f9a622d2-a4a6-45fc-90ce-7797c34725b8 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-854925-5" status: 400 len: 199 microversion: 2.1 time: 0.044256 Aug 30 04:08:37.074417 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 34/52] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:37 2022] PUT /compute/v2.1/os-hosts/n-d-854925-5 => generated 199 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:08:37.082292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73a4d2aa-97cf-4ca9-b59c-ec091824ec90 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aeed0d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73a4d2aa-97cf-4ca9-b59c-ec091824ec90 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/os-hosts/n-d-854925-5 HTTP/1.1 Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 51 Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:37.096407 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: {"status": "invalid", "maintenance_mode": "enable"} Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:37.097610 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance: Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.098268 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.099499 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.100439 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.100439 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:08:37.100439 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:08:37.100439 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 30 04:08:37.100439 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.100439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73a4d2aa-97cf-4ca9-b59c-ec091824ec90 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:37.100439 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-73a4d2aa-97cf-4ca9-b59c-ec091824ec90 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-854925-5" status: 400 len: 189 microversion: 2.1 time: 0.021285 Aug 30 04:08:37.110268 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 35/53] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:37 2022] PUT /compute/v2.1/os-hosts/n-d-854925-5 => generated 189 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:08:37.116617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1765118-136d-4f0c-bb35-19c57c0fadc7 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Action: 'update', calling method: .version_select at 0x7fe96b0c83a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:37.134114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f1765118-136d-4f0c-bb35-19c57c0fadc7 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'ecf096039324491baf80fed8e5801d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f09ee4c9a174904b881bda19566043f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1765118-136d-4f0c-bb35-19c57c0fadc7 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Request method failure captured: Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/os-hosts/n-d-854925-5 HTTP/1.1 Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 50 Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1AkhJYlRj6LmK9RioraZmJ2B24wi5XpVj60nfiG72GcsVZANVm-AZ6mHNEM9n72CSFmjxKc6h-kwDBfnfzgVltNDbfWww-JBRf-ZCRlmK-yublUyCto9KwT2vEfh8m2IOIrCjkkDQ3PQ_NtJ5m57QAYvC2yzSl8zqujoGfYnyERrE Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:37.136127 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7f09ee4c9a174904b881bda19566043f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7f09ee4c9a174904b881bda19566043f"}]}] Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7f09ee4c9a174904b881bda19566043f Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-632912286 Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ecf096039324491baf80fed8e5801d1f Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-632912286-project Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 04:08:37.137200 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:37.138861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 30 04:08:37.139830 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.140820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1765118-136d-4f0c-bb35-19c57c0fadc7 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:37.140820 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f1765118-136d-4f0c-bb35-19c57c0fadc7 tempest-HostsAdminNegativeTestJSON-632912286 tempest-HostsAdminNegativeTestJSON-632912286-project] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-854925-5" status: 403 len: 111 microversion: 2.1 time: 0.025323 Aug 30 04:08:37.150191 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 36/54] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:37 2022] PUT /compute/v2.1/os-hosts/n-d-854925-5 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:37.155916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56dadee0-df23-452d-a34e-ff6a63f170d2 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aede0d0>, body: {"status": null, "maintenance_mode": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56dadee0-df23-452d-a34e-ff6a63f170d2 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/os-hosts/n-d-854925-5 HTTP/1.1 Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 42 Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:37.173578 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: {"status": null, "maintenance_mode": null} Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 04:08:37.175348 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-d-854925-5', 'body': {'status': None, 'maintenance_mode': None}} Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'disable', Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'Enable', Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'Disable', Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance: Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi None Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.176132 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.177392 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.178507 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:08:37.178507 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:08:37.178507 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 30 04:08:37.178507 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.178507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56dadee0-df23-452d-a34e-ff6a63f170d2 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:37.178507 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-56dadee0-df23-452d-a34e-ff6a63f170d2 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/n-d-854925-5" status: 400 len: 127 microversion: 2.1 time: 0.019886 Aug 30 04:08:37.178507 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 37/55] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:37 2022] PUT /compute/v2.1/os-hosts/n-d-854925-5 => generated 127 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:08:37.196703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-328fb1c7-3dfe-42c0-9c0a-cea15e636983 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aede160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:37.202228 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.hosts [None req-328fb1c7-3dfe-42c0-9c0a-cea15e636983 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Enabling host nonexistent_hostname. Aug 30 04:08:37.211831 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-328fb1c7-3dfe-42c0-9c0a-cea15e636983 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-328fb1c7-3dfe-42c0-9c0a-cea15e636983 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Request method failure captured: Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 50 Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1C6a-PALsTuR2-2yfQR-GOFG8pDqD-jgAMEIROfvfi8xG7tKyY1E-kovPERhcV4SxPg-w7DUJABDpGr0XFtdS689yTr0ZFzYetcMz4ChJunAJpQMBQSl144qBTKvt5D-PABMkfFsZEgkzXRyjoZvcFP5nUQKctZaB9chmGjM2K9bc Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:37.215073 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7424233d6d97471daecc26a2d6648811", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7424233d6d97471daecc26a2d6648811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7424233d6d97471daecc26a2d6648811"}]}] Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7424233d6d97471daecc26a2d6648811 Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-73059742 Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 44ada589019d4d9b861e1e5d34e1dc8a Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HostsAdminNegativeTestJSON-73059742-project-admin Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: {"status": "enable", "maintenance_mode": "enable"} Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.216290 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5988, in targeted Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 04:08:37.217006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:08:37.217992 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 30 04:08:37.218975 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:37.221723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-328fb1c7-3dfe-42c0-9c0a-cea15e636983 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:37.222813 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-328fb1c7-3dfe-42c0-9c0a-cea15e636983 tempest-HostsAdminNegativeTestJSON-73059742 tempest-HostsAdminNegativeTestJSON-73059742-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.038853 Aug 30 04:08:37.223879 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 38/56] 10.222.0.27 () {60 vars in 1211 bytes} [Tue Aug 30 04:08:37 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:08:37.295420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:37.419959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:37.421550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:37.436959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:37.446245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:37.449233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:37.452917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:37.456380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:37.459482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:37.460715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:37.495921 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51ed5c13-5718-4588-bf0c-e62e75bde71e tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 1.078066 Aug 30 04:08:37.509762 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 19/57] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:36 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:38.527209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:38.528206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:38.541639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:38.543608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:38.545908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:38.548911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:38.549617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:38.551475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.036291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:39.048056 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-35fa1a02-fe57-4cdb-aec3-093257cd1c91 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.525905 Aug 30 04:08:39.050951 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 20/58] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:38 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:39.107618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:39.126101 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86b6e6d1-7192-40aa-ba9c-9be8969fc7c5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 1.708732 Aug 30 04:08:39.138491 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 39/59] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:37 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:39.380712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3db734c5-7f89-4b20-ac20-5cdb65cae577 req-d6f4e622-56e0-4a6e-91a8-a7497d1037b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882849b7-c019-4ea5-aa15-c54d74be15ac", "tag": "5e5681a4-b0fa-45ed-ae79-bc3c952157c3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:39.418950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3db734c5-7f89-4b20-ac20-5cdb65cae577 req-d6f4e622-56e0-4a6e-91a8-a7497d1037b1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:39.427462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3db734c5-7f89-4b20-ac20-5cdb65cae577 req-d6f4e622-56e0-4a6e-91a8-a7497d1037b1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:39.429504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3db734c5-7f89-4b20-ac20-5cdb65cae577 req-d6f4e622-56e0-4a6e-91a8-a7497d1037b1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.435392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-45294d49-d7fc-4d06-af5d-a2a878caa3d5 tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-268298248", "id": 192643817, "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:39.504624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3db734c5-7f89-4b20-ac20-5cdb65cae577 req-d6f4e622-56e0-4a6e-91a8-a7497d1037b1 service nova] Creating event network-changed:5e5681a4-b0fa-45ed-ae79-bc3c952157c3 for instance 882849b7-c019-4ea5-aa15-c54d74be15ac on n-h2-854925-5 Aug 30 04:08:39.507449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3db734c5-7f89-4b20-ac20-5cdb65cae577 req-d6f4e622-56e0-4a6e-91a8-a7497d1037b1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:08:39.509604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3db734c5-7f89-4b20-ac20-5cdb65cae577 req-d6f4e622-56e0-4a6e-91a8-a7497d1037b1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:08:39.513583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:39.513734 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-45294d49-d7fc-4d06-af5d-a2a878caa3d5 tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.345253 Aug 30 04:08:39.523814 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 40/60] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:08:39 2022] POST /compute/v2.1/flavors => generated 445 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:39.528873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:39.530697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.531551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:39.532135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:39.532578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:39.563456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.rpcapi [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 04:08:39.571630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] Releasing lock "compute-rpcapi-router" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:08:39.629086 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b613a6ea-d2fb-4f81-b9d9-e302a073c6ec None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.575479 Aug 30 04:08:39.629782 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 21/61] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:39.954886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc7294a5-ebdc-4aed-92bd-e48b6f6d48d6 tempest-FlavorsV255TestJSON-820086398 tempest-FlavorsV255TestJSON-820086398-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:39.975526 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc7294a5-ebdc-4aed-92bd-e48b6f6d48d6 tempest-FlavorsV255TestJSON-820086398 tempest-FlavorsV255TestJSON-820086398-project] 10.222.0.27 "GET /compute/v2.1/flavors/192643817" status: 200 len: 445 microversion: 2.55 time: 0.448826 Aug 30 04:08:39.978342 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 41/62] 10.222.0.27 () {60 vars in 1196 bytes} [Tue Aug 30 04:08:39 2022] GET /compute/v2.1/flavors/192643817 => generated 445 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:39.993772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63133ccb-6465-46af-88df-d98f59cf0e27 tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] Action: 'update', calling method: .version_select at 0x7fe96c0fef70>, body: {"flavor": {"description": "new"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:40.076276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:40.078277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:40.102061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.103178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.107226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.111001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.115085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.115912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.178565 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63133ccb-6465-46af-88df-d98f59cf0e27 tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/192643817" status: 200 len: 446 microversion: 2.55 time: 0.189153 Aug 30 04:08:40.179997 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 22/63] 10.222.0.27 () {62 vars in 1216 bytes} [Tue Aug 30 04:08:39 2022] PUT /compute/v2.1/flavors/192643817 => generated 446 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:08:40.185114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:40.188934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:40.208821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.208995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.209400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.212149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:40.214191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:40.216037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:40.730844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:40.741090 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c1efe8e-b5b7-4b3c-a515-1945af561360 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.670334 Aug 30 04:08:40.761688 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 42/64] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:40 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:40.767562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fa097818-3ed3-438b-b560-4620f479f0f9 tempest-FlavorsV255TestJSON-820086398 tempest-FlavorsV255TestJSON-820086398-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:40.863803 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fa097818-3ed3-438b-b560-4620f479f0f9 tempest-FlavorsV255TestJSON-820086398 tempest-FlavorsV255TestJSON-820086398-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.098132 Aug 30 04:08:40.870804 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 43/65] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:40 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:08:40.895098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ae8fcb7-f186-4524-b262-8b0ac91ef69e tempest-FlavorsV255TestJSON-820086398 tempest-FlavorsV255TestJSON-820086398-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:40.944874 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ae8fcb7-f186-4524-b262-8b0ac91ef69e tempest-FlavorsV255TestJSON-820086398 tempest-FlavorsV255TestJSON-820086398-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.054503 Aug 30 04:08:40.952573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:40.958684 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 44/66] 10.222.0.27 () {60 vars in 1166 bytes} [Tue Aug 30 04:08:40 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:08:40.973735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56190fe5-8816-4577-be69-4f7275e2ef10 tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:40.977037 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4336cea8-0334-44d2-bbbc-33b0b26ea16e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.795674 Aug 30 04:08:40.980606 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 23/67] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:40 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:41.032914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-56190fe5-8816-4577-be69-4f7275e2ef10 tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/192643817" status: 202 len: 0 microversion: 2.55 time: 0.062762 Aug 30 04:08:41.035581 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 45/68] 10.222.0.27 () {60 vars in 1199 bytes} [Tue Aug 30 04:08:40 2022] DELETE /compute/v2.1/flavors/192643817 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:08:41.049499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fc995d0-20df-4659-be8c-8b764d5fd15c tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:41.156180 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fc995d0-20df-4659-be8c-8b764d5fd15c tempest-FlavorsV255TestJSON-1473470972 tempest-FlavorsV255TestJSON-1473470972-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.116320 Aug 30 04:08:41.186274 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 24/69] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:08:41 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:08:41.769923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:41.771134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:41.784247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:41.785051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:41.786775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:41.791719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:41.792423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:41.793022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:42.010507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:42.011300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:42.062647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:42.071644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:42.082222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:42.099867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:42.100548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:42.106738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:42.129230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:42.142423 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cac21c9-2ec5-44c3-92dc-60c6b429f94a tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.376476 Aug 30 04:08:42.144931 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 46/70] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:41 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:42.373373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:42.386177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd885e52-3db3-4491-bd78-9575588e6584 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.379046 Aug 30 04:08:42.394549 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 25/71] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:42 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:43.164695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:43.166074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:43.183733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:43.186497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:43.186982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:43.190294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:43.190771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:43.194847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:43.415986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:43.416616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:43.418968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:43.429768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:43.430423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:43.430682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:43.431394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:43.431849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:43.432275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:43.595712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:43.608225 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1c5bb31-d778-42be-8954-377bf63b1e12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.447770 Aug 30 04:08:43.608822 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 47/72] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:43 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:43.784745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:43.813377 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0e8b8a8-c9a3-4716-b216-2382af406f82 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.401066 Aug 30 04:08:43.814213 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 26/73] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:43 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:44.631977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:44.633515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:44.644041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:44.647682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:44.648309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:44.649203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:44.653247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:44.655626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:44.672103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:44.839834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:44.840370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:44.867559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:44.868059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:44.868500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:44.869219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:44.880172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:44.881093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:45.748091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:45.759463 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b500319a-ae36-49fc-9a0e-4a115e217d12 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 1.132828 Aug 30 04:08:45.767801 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 48/74] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:44 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:46.008677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:46.022934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5119610c-6d00-4e1f-a4bc-ef4cfc42edb2 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 1.187792 Aug 30 04:08:46.025994 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 27/75] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:44 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:46.639047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:46.788776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:46.795592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:46.814602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:46.815748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:46.817063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:46.818060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:46.819913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:46.820522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:47.243726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31adf05c-4dd1-4ed2-b47b-1791d414a03b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Calling method '.version_select at 0x7fe96b1c4e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:47.246841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31adf05c-4dd1-4ed2-b47b-1791d414a03b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '2c3e7337c3f3427f9830722ecf82440b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f24f54a8e4444be5889737da39e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31adf05c-4dd1-4ed2-b47b-1791d414a03b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Request method failure captured: Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1MMBeNVREGOccqCAYJCDefXMFqIMNDI45_2NnfxZFRptEdjIAR97G_2iEtnz1_BOv5B_fKMyvdRFiPrrBgHu42WBqroVgtX8o2KNUUsrVx2Ha7UuwkrS7jfErFdFjlMgVvbGp83idjauUkT0MUiB8cWKLuMsKITKtUC5o0yMgusks Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:47.249232 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f14f24f54a8e4444be5889737da39e85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}] Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 2c3e7337c3f3427f9830722ecf82440b Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: action_args: {} Aug 30 04:08:47.251038 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:47.251796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 30 04:08:47.253806 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.258334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31adf05c-4dd1-4ed2-b47b-1791d414a03b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:47.259383 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31adf05c-4dd1-4ed2-b47b-1791d414a03b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.638916 Aug 30 04:08:47.261952 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 49/76] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 04:08:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 642 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:47.274631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:47.276791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:47.292035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:47.293262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:47.294843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:47.295714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:47.297969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:47.300272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:47.316305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:47.329085 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-87180516-d9c3-4b92-b633-c82ea2d3c122 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.546679 Aug 30 04:08:47.332013 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 28/77] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:46 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:47.341152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04e3999b-9804-4e2f-bd09-987184eb1661 tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Calling method '.version_select at 0x7fe96b086ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:47.346217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-04e3999b-9804-4e2f-bd09-987184eb1661 tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '2c3e7337c3f3427f9830722ecf82440b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f24f54a8e4444be5889737da39e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04e3999b-9804-4e2f-bd09-987184eb1661 tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Request method failure captured: Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1MMBeNVREGOccqCAYJCDefXMFqIMNDI45_2NnfxZFRptEdjIAR97G_2iEtnz1_BOv5B_fKMyvdRFiPrrBgHu42WBqroVgtX8o2KNUUsrVx2Ha7UuwkrS7jfErFdFjlMgVvbGp83idjauUkT0MUiB8cWKLuMsKITKtUC5o0yMgusks Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:08:47.351715 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f14f24f54a8e4444be5889737da39e85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}] Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2c3e7337c3f3427f9830722ecf82440b Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: action_args: {} Aug 30 04:08:47.353178 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:47.354069 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 30 04:08:47.355269 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.360305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04e3999b-9804-4e2f-bd09-987184eb1661 tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:47.361760 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-04e3999b-9804-4e2f-bd09-987184eb1661 tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.026740 Aug 30 04:08:47.373476 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 29/78] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:08:47 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:47.388044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3103e259-1367-4434-bc09-d13cf31dc60b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Calling method '.version_select at 0x7fe96b08fd30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:47.390528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3103e259-1367-4434-bc09-d13cf31dc60b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '2c3e7337c3f3427f9830722ecf82440b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f24f54a8e4444be5889737da39e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3103e259-1367-4434-bc09-d13cf31dc60b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Request method failure captured: Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1MMBeNVREGOccqCAYJCDefXMFqIMNDI45_2NnfxZFRptEdjIAR97G_2iEtnz1_BOv5B_fKMyvdRFiPrrBgHu42WBqroVgtX8o2KNUUsrVx2Ha7UuwkrS7jfErFdFjlMgVvbGp83idjauUkT0MUiB8cWKLuMsKITKtUC5o0yMgusks Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:08:47.392799 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f14f24f54a8e4444be5889737da39e85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}] Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2c3e7337c3f3427f9830722ecf82440b Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: action_args: {} Aug 30 04:08:47.394184 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:47.395019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 30 04:08:47.396286 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:47.397677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3103e259-1367-4434-bc09-d13cf31dc60b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:47.400005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3103e259-1367-4434-bc09-d13cf31dc60b tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.025237 Aug 30 04:08:47.408898 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 30/79] 10.222.0.27 () {58 vars in 1179 bytes} [Tue Aug 30 04:08:47 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:47.865431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:47.880059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d25e11b4-8dc2-4065-8391-d42653f0e98e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.614747 Aug 30 04:08:47.883475 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 50/80] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:47 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:48.038288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Calling method '.version_select at 0x7fe96b1f5dc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.041250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.041912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.043056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.079574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.080440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.081084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.093208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.095964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.096799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.117656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e418fa3c-c21b-4480-a13c-eb86e057cc6c tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.704259 Aug 30 04:08:48.125166 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 31/81] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:08:47 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.141279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b82644e-6bc6-42ae-a1c1-34ba29bcfd32 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.156149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b82644e-6bc6-42ae-a1c1-34ba29bcfd32 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.267420 Aug 30 04:08:48.157345 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 51/82] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:08:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.166132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f32ac5a3-f128-4a26-8839-cfc9b47b5a6e tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Calling method '.version_select at 0x7fe96aeeec10>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.180777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f32ac5a3-f128-4a26-8839-cfc9b47b5a6e tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '2c3e7337c3f3427f9830722ecf82440b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f24f54a8e4444be5889737da39e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f32ac5a3-f128-4a26-8839-cfc9b47b5a6e tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Request method failure captured: Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1MMBeNVREGOccqCAYJCDefXMFqIMNDI45_2NnfxZFRptEdjIAR97G_2iEtnz1_BOv5B_fKMyvdRFiPrrBgHu42WBqroVgtX8o2KNUUsrVx2Ha7UuwkrS7jfErFdFjlMgVvbGp83idjauUkT0MUiB8cWKLuMsKITKtUC5o0yMgusks Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:48.185060 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f14f24f54a8e4444be5889737da39e85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}] Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 2c3e7337c3f3427f9830722ecf82440b Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1'} Aug 30 04:08:48.186491 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:48.187561 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 30 04:08:48.189223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.191965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f32ac5a3-f128-4a26-8839-cfc9b47b5a6e tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:48.195403 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f32ac5a3-f128-4a26-8839-cfc9b47b5a6e tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.034572 Aug 30 04:08:48.195975 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 52/83] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:48.265315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96b08fca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.275011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.275911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.276578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.278169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.281056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.282182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.303301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:48.304657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80fcab50-ad18-4cd4-99ba-faae461634f3 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1488673630", "id": 2135024539, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:48.338271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80fcab50-ad18-4cd4-99ba-faae461634f3 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.137868 Aug 30 04:08:48.338979 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 53/84] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:08:48 2022] POST /compute/v2.1/flavors => generated 425 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.345082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3fa8aa10-2d9f-41b8-bfca-17b7ab78a26b tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Calling method '.version_select at 0x7fe96b0c8550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.348155 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3fa8aa10-2d9f-41b8-bfca-17b7ab78a26b tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] HTTP exception thrown: Hypervisor with ID '14b1fa7f-44e6-45c4-835a-3654b2b56344' could not be found. Aug 30 04:08:48.360736 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d1c8a97c-ad96-4e70-9ec2-fc5d71a9d25c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 397 microversion: 2.1 time: 0.233916 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3fa8aa10-2d9f-41b8-bfca-17b7ab78a26b tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Request method failure captured: Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hypervisors/14b1fa7f-44e6-45c4-835a-3654b2b56344/uptime HTTP/1.1 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1OMZbM6TP7rErgTqJd0iiIO-2iQ1DQsoJcEYDBvtev9UZ7Ui1Ucx8cGAskJlHW4tQGK1ZmZJKNyhKt6-BjY7iOAEfsJxp3-SRZE3q4SHBUPQy-6u6DDI_Y5ojJJVkGw8i0B4fE5RXx0xHG22Cq1xW68OLKIPIpU5QjkNtJtO5Uor8 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: cd8fd79fab344bea992824c5f244f595 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-919454398 Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:08:48.376515 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd8fd79fab344bea992824c5f244f595", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd8fd79fab344bea992824c5f244f595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd8fd79fab344bea992824c5f244f595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd8fd79fab344bea992824c5f244f595"}]}] Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-919454398 Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: cd8fd79fab344bea992824c5f244f595 Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-919454398 Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 6a0099841cbc46e49f326fe5b24c1a3d Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: exception: Hypervisor with ID '14b1fa7f-44e6-45c4-835a-3654b2b56344' could not be found. Aug 30 04:08:48.378733 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '14b1fa7f-44e6-45c4-835a-3654b2b56344'} Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '14b1fa7f-44e6-45c4-835a-3654b2b56344' Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 04:08:48.379495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '14b1fa7f-44e6-45c4-835a-3654b2b56344' could not be found. Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.380677 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.383166 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.383166 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.383166 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.383166 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:48.383166 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:48.383166 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '14b1fa7f-44e6-45c4-835a-3654b2b56344' could not be found. Aug 30 04:08:48.383166 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.383974 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 32/85] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hosts => generated 397 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.385081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3fa8aa10-2d9f-41b8-bfca-17b7ab78a26b tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Returning 404 to user: Hypervisor with ID '14b1fa7f-44e6-45c4-835a-3654b2b56344' could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:48.386280 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3fa8aa10-2d9f-41b8-bfca-17b7ab78a26b tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/14b1fa7f-44e6-45c4-835a-3654b2b56344/uptime" status: 404 len: 123 microversion: 2.1 time: 0.046322 Aug 30 04:08:48.387018 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 54/86] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hypervisors/14b1fa7f-44e6-45c4-835a-3654b2b56344/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:48.398996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-962ebf54-c086-4699-bda0-cdd083d9134d tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.405279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.407806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:48.415274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.415983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.418152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.418677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-962ebf54-c086-4699-bda0-cdd083d9134d tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.038087 Aug 30 04:08:48.419256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.419874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.420455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.429668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 33/87] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:08:48.436355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96b112e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.442260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.443021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.443852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.444835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.446178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.446819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.484141 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-899001f4-9a88-4129-bdab-39b4479d1127 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 397 microversion: 2.1 time: 0.052600 Aug 30 04:08:48.485777 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 34/88] 10.222.0.27 () {58 vars in 1139 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hosts?zone= => generated 397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.492850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Calling method '.version_select at 0x7fe96b1f5ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.496528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.497225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.498054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.524146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.524724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.525233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.539439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.540013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.540525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.550136 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64e77b69-8756-4d71-93cd-3651f356cca5 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.062912 Aug 30 04:08:48.556653 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 35/89] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.562402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8102616f-b603-48a0-a2da-7dfe5738b6e4 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1352874201", "id": 148429225, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:48.591719 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8102616f-b603-48a0-a2da-7dfe5738b6e4 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.032930 Aug 30 04:08:48.601434 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 36/90] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:08:48 2022] POST /compute/v2.1/flavors => generated 422 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.607302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96b112ca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.612197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.612971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.613698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.614710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.615324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.615931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.655201 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e7405ed7-2a8d-4240-8cd2-0114a1c6cd51 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.052210 Aug 30 04:08:48.656398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 37/91] 10.222.0.27 () {58 vars in 1145 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:08:48.676737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bdfdad0f-f6cb-4380-ad54-81e7e30bcf6a tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Calling method '.version_select at 0x7fe96b086160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.676737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bdfdad0f-f6cb-4380-ad54-81e7e30bcf6a tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '2c3e7337c3f3427f9830722ecf82440b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14f24f54a8e4444be5889737da39e85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bdfdad0f-f6cb-4380-ad54-81e7e30bcf6a tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Request method failure captured: Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1MMBeNVREGOccqCAYJCDefXMFqIMNDI45_2NnfxZFRptEdjIAR97G_2iEtnz1_BOv5B_fKMyvdRFiPrrBgHu42WBqroVgtX8o2KNUUsrVx2Ha7UuwkrS7jfErFdFjlMgVvbGp83idjauUkT0MUiB8cWKLuMsKITKtUC5o0yMgusks Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:08:48.683049 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f14f24f54a8e4444be5889737da39e85", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f14f24f54a8e4444be5889737da39e85"}]}] Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: f14f24f54a8e4444be5889737da39e85 Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-867478614 Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2c3e7337c3f3427f9830722ecf82440b Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-867478614-project Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1'} Aug 30 04:08:48.684605 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:48.685940 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 30 04:08:48.687237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.690440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bdfdad0f-f6cb-4380-ad54-81e7e30bcf6a tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:48.691457 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bdfdad0f-f6cb-4380-ad54-81e7e30bcf6a tempest-HypervisorAdminNegativeTestJSON-867478614 tempest-HypervisorAdminNegativeTestJSON-867478614-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.033312 Aug 30 04:08:48.705198 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 38/92] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:48.715846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-deb160a2-e43c-49d7-bf3f-e48a0b2c6540 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.729753 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-deb160a2-e43c-49d7-bf3f-e48a0b2c6540 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.022535 Aug 30 04:08:48.739165 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 39/93] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:08:48.743430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4dec7a1-48cf-4e5d-929a-17a969cb3f20 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Calling method '.version_select at 0x7fe96b0b9700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.747483 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b4dec7a1-48cf-4e5d-929a-17a969cb3f20 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] HTTP exception thrown: Hypervisor with ID '9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a' could not be found. Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4dec7a1-48cf-4e5d-929a-17a969cb3f20 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Request method failure captured: Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-hypervisors/9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a HTTP/1.1 Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1OMZbM6TP7rErgTqJd0iiIO-2iQ1DQsoJcEYDBvtev9UZ7Ui1Ucx8cGAskJlHW4tQGK1ZmZJKNyhKt6-BjY7iOAEfsJxp3-SRZE3q4SHBUPQy-6u6DDI_Y5ojJJVkGw8i0B4fE5RXx0xHG22Cq1xW68OLKIPIpU5QjkNtJtO5Uor8 Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: cd8fd79fab344bea992824c5f244f595 Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-919454398 Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:08:48.752945 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cd8fd79fab344bea992824c5f244f595", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cd8fd79fab344bea992824c5f244f595"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd8fd79fab344bea992824c5f244f595"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cd8fd79fab344bea992824c5f244f595"}]}] Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-919454398 Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: cd8fd79fab344bea992824c5f244f595 Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-919454398 Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 6a0099841cbc46e49f326fe5b24c1a3d Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: exception: Hypervisor with ID '9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a' could not be found. Aug 30 04:08:48.754439 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a'} Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a' Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 30 04:08:48.755191 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:08:48.756552 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a' could not be found. Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a' could not be found. Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4dec7a1-48cf-4e5d-929a-17a969cb3f20 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] Returning 404 to user: Hypervisor with ID '9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a' could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:48.757811 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b4dec7a1-48cf-4e5d-929a-17a969cb3f20 tempest-HypervisorAdminNegativeTestJSON-919454398 tempest-HypervisorAdminNegativeTestJSON-919454398-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a" status: 404 len: 123 microversion: 2.1 time: 0.014976 Aug 30 04:08:48.770723 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 40/94] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/os-hypervisors/9cf7c620-3ef8-4ee1-9bee-ad4cd33e5b9a => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:48.781225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef2c7b86-7abb-42cb-84e8-cb990d26625f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Action: 'create', calling method: .version_select at 0x7fe96b086ee0>, body: {"keypair": {"name": "tempest-keypair-284590994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1RP8hhcmduTY9tqeUUn5+/VYQIinL9WTs9PVIk+9v5Uo6tGdZlSIH2ILwxdoQXHY5VrA5BUITIK8G9m+9HPeB70FjFqonDeBdS22PMx+CQtKgdCtJbX8qjcOSVVPnNkg=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:48.839833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ef2c7b86-7abb-42cb-84e8-cb990d26625f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Getting quotas for project 9b96459442a54f3caa87eb12f10d85b0. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:08:48.854277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ef2c7b86-7abb-42cb-84e8-cb990d26625f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Getting quotas for user b102593edbd9489883889617591d412d and project 9b96459442a54f3caa87eb12f10d85b0. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:08:48.897560 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef2c7b86-7abb-42cb-84e8-cb990d26625f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123278 Aug 30 04:08:48.898911 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 41/95] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:08:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:48.920979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:48.921786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:48.944309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.946851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.949760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:48.950479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:48.954687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:48.956361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:49.261913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:49.280557 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c1a75c1-1caa-471d-bc3d-a2652ca3c68d tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.885118 Aug 30 04:08:49.282085 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 55/96] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:49.690373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:49.699368 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a9c40163-8046-410b-a123-6598c5ec1a21 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.799123 Aug 30 04:08:49.700988 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 42/97] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:48 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:50.306900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:50.308488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:50.328995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:50.329526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:50.331785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:50.332666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:50.333125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:50.337674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:50.723253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:50.723933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:50.746329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:50.747147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:50.747746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:50.751976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:50.752597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:50.753044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:50.795111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:50.812404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-485e6a46-2fa0-47ba-b047-49983359c487 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.511568 Aug 30 04:08:50.814820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 56/98] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:50 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:51.215420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:51.230880 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-021b9d90-212d-4939-9330-beb4c421e4de tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.510845 Aug 30 04:08:51.234407 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 43/99] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:50 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:51.847100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:51.848975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:51.862878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:51.863554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:51.864189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:51.865600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:51.866475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:51.867066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:52.203402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:52.217943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-43fa63d7-fa3d-4e46-b67c-28a2da8e5b7f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.379789 Aug 30 04:08:52.237608 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 57/100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:51 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:52.256914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:52.257566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:52.279012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:52.279673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:52.282295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:52.283807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:52.284852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:52.287542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:53.024488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:53.045532 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb522ba5-3b44-46f8-a67d-2dc270781dee tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.792526 Aug 30 04:08:53.046458 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 44/101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:52 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:53.245511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:53.246238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:53.270033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-73fccb1a-8c0c-4799-885b-92718ad47686 req-2944c953-0a4e-4274-bfb5-0c80cbf29670 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422a0262-f212-4d4e-87b0-99ec7fe17e0e", "name": "network-vif-plugged", "status": "completed", "tag": "719db109-e8d2-4bf0-85ea-5eebc2daf1d1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:53.282306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:53.284730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:53.285915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:53.287539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:53.288832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-73fccb1a-8c0c-4799-885b-92718ad47686 req-2944c953-0a4e-4274-bfb5-0c80cbf29670 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:53.289745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-73fccb1a-8c0c-4799-885b-92718ad47686 req-2944c953-0a4e-4274-bfb5-0c80cbf29670 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:53.290272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:53.290717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-73fccb1a-8c0c-4799-885b-92718ad47686 req-2944c953-0a4e-4274-bfb5-0c80cbf29670 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:53.290839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:53.319475 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-73fccb1a-8c0c-4799-885b-92718ad47686 req-2944c953-0a4e-4274-bfb5-0c80cbf29670 service nova] Creating event network-vif-plugged:719db109-e8d2-4bf0-85ea-5eebc2daf1d1 for instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e on n-h2-854925-5 Aug 30 04:08:53.335872 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-73fccb1a-8c0c-4799-885b-92718ad47686 req-2944c953-0a4e-4274-bfb5-0c80cbf29670 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174079 Aug 30 04:08:53.337259 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 58/102] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:53.610783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:53.625282 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8800dffb-b26e-455d-963e-c6234f0b4bac tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.384696 Aug 30 04:08:53.628170 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 45/103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:53 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:54.067926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:54.068633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:54.076126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:54.077212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:54.077914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:54.078894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:54.079562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:54.080192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:54.256645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:54.270935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59722dd5-ff1f-4f1d-96a2-60516f3c9607 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.207173 Aug 30 04:08:54.274723 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 59/104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:54 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:54.310958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cb161874-e95e-4814-ba16-47e84c4eb34c tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:54.314104 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-cb161874-e95e-4814-ba16-47e84c4eb34c tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cb161874-e95e-4814-ba16-47e84c4eb34c tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926-project-admin] Request method failure captured: Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1WkEJxBolIZpIC9K9Kv4smdAjKg-oBuMRGaO9HhGLoNrka-uj70UppguSj3b9JOVMSr1FK9d6EvYY9-Oj_vFpjgkl_ZfKKLvNAZodRMpnFQdKfU4sCuJFh_yGfLjKsGYvfzxbUBBVeosIASPhpTBzENytVyYrVuIKc5_hlOoRTCCE Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 27376397aecd4dc1834403cf3d80e8de Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:08:54.326184 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27376397aecd4dc1834403cf3d80e8de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27376397aecd4dc1834403cf3d80e8de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27376397aecd4dc1834403cf3d80e8de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27376397aecd4dc1834403cf3d80e8de"}]}] Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 27376397aecd4dc1834403cf3d80e8de Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926-project-admin Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9ffe06ec56dc4790a7c551c0158c060e Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926-project-admin Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:08:54.327849 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid timestamp for date invalid_time Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'invalid_time'} Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:54.330310 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 30 04:08:54.331471 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.334921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cb161874-e95e-4814-ba16-47e84c4eb34c tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:54.351036 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cb161874-e95e-4814-ba16-47e84c4eb34c tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926 tempest-InstanceUsageAuditLogNegativeTestJSON-1287779926-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.191108 Aug 30 04:08:54.352422 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 46/105] 10.222.0.27 () {58 vars in 1224 bytes} [Tue Aug 30 04:08:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:08:54.439266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-946321037", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "148429225", "adminPass": "***", "networks": [{"uuid": "091b2e9f-1ebd-4352-add9-2ffd7934e943"}], "security_groups": [{"name": "tempest-securitygroup--190180249"}], "key_name": "tempest-keypair-284590994", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:54.580852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9868b134-7ff2-4f0a-a6b5-85a0e68e692b tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:54.583125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9868b134-7ff2-4f0a-a6b5-85a0e68e692b tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '08604fbddf3844e58490c633477769a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de402cfa25eb48bbbead23e457373e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9868b134-7ff2-4f0a-a6b5-85a0e68e692b tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Request method failure captured: Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1UgA_pQFd4eOevltHYCIgccvYUOPzCcwxNZRD1mZtm0nJUCVIN3S01i7bCWRllpxB8fquflouJTHv_7rp_g5x0vSDXC2wCTvVMsTzdEgpQ2c_Vwey8lDqvpejltb5OnmqYCja2KJQLFSapRhEuOlfSo6Mrs5pD8PPJbHuSPvIiwWI Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: de402cfa25eb48bbbead23e457373e02 Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:54.591249 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de402cfa25eb48bbbead23e457373e02", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de402cfa25eb48bbbead23e457373e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de402cfa25eb48bbbead23e457373e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de402cfa25eb48bbbead23e457373e02"}]}] Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: de402cfa25eb48bbbead23e457373e02 Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 08604fbddf3844e58490c633477769a9 Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project Aug 30 04:08:54.593049 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: action_args: {} Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:54.593811 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 30 04:08:54.595723 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.597767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9868b134-7ff2-4f0a-a6b5-85a0e68e692b tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:54.598806 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9868b134-7ff2-4f0a-a6b5-85a0e68e692b tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.240398 Aug 30 04:08:54.600683 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 60/106] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Aug 30 04:08:54 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 243 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:54.614643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73e2c124-6d11-4b42-8580-6dda68ed3fe4 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:54.621504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73e2c124-6d11-4b42-8580-6dda68ed3fe4 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '08604fbddf3844e58490c633477769a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de402cfa25eb48bbbead23e457373e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73e2c124-6d11-4b42-8580-6dda68ed3fe4 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Request method failure captured: Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2004:08:54 HTTP/1.1 Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1UgA_pQFd4eOevltHYCIgccvYUOPzCcwxNZRD1mZtm0nJUCVIN3S01i7bCWRllpxB8fquflouJTHv_7rp_g5x0vSDXC2wCTvVMsTzdEgpQ2c_Vwey8lDqvpejltb5OnmqYCja2KJQLFSapRhEuOlfSo6Mrs5pD8PPJbHuSPvIiwWI Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: de402cfa25eb48bbbead23e457373e02 Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:08:54.623287 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de402cfa25eb48bbbead23e457373e02", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de402cfa25eb48bbbead23e457373e02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de402cfa25eb48bbbead23e457373e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de402cfa25eb48bbbead23e457373e02"}]}] Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: de402cfa25eb48bbbead23e457373e02 Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 08604fbddf3844e58490c633477769a9 Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project Aug 30 04:08:54.626527 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '2022-08-30 04:08:54'} Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:08:54.627190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 30 04:08:54.629838 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:08:54.632070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73e2c124-6d11-4b42-8580-6dda68ed3fe4 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:08:54.632070 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-73e2c124-6d11-4b42-8580-6dda68ed3fe4 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438 tempest-InstanceUsageAuditLogNegativeTestJSON-1806169438-project] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 04:08:54" status: 403 len: 128 microversion: 2.1 time: 0.018999 Aug 30 04:08:54.632729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] validate_networks() for [('091b2e9f-1ebd-4352-add9-2ffd7934e943', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:08:54.638049 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 61/107] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:08:54 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2004%3A08%3A54 => generated 128 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:08:54.658967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:54.659931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:54.672522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:54.675852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:54.679952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:54.681708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:54.682690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:54.683433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:55.108396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:55.131207 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2a49efde-13b1-4a34-b4c6-0c2fbc6c13c3 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 0.471496 Aug 30 04:08:55.133280 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 62/108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:54 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:08:55.311763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:55.312444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:55.335444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:55.338651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:55.339277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:55.343268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:55.344673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:55.352355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:56.070262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:56.092562 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce4c6fa0-543f-4e44-a533-c9359655e30a tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1337 microversion: 2.1 time: 0.787706 Aug 30 04:08:56.096455 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 63/109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:55 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1337 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:56.113458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c81586b1-b4af-45c1-abb1-a18e339951b4 req-8ae060d7-9865-4ecc-84df-d05aae88b59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882849b7-c019-4ea5-aa15-c54d74be15ac", "name": "network-vif-plugged", "status": "completed", "tag": "5e5681a4-b0fa-45ed-ae79-bc3c952157c3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:08:56.167468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c81586b1-b4af-45c1-abb1-a18e339951b4 req-8ae060d7-9865-4ecc-84df-d05aae88b59d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:56.171854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c81586b1-b4af-45c1-abb1-a18e339951b4 req-8ae060d7-9865-4ecc-84df-d05aae88b59d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:56.181879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c81586b1-b4af-45c1-abb1-a18e339951b4 req-8ae060d7-9865-4ecc-84df-d05aae88b59d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:56.236235 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c81586b1-b4af-45c1-abb1-a18e339951b4 req-8ae060d7-9865-4ecc-84df-d05aae88b59d service nova] Creating event network-vif-plugged:5e5681a4-b0fa-45ed-ae79-bc3c952157c3 for instance 882849b7-c019-4ea5-aa15-c54d74be15ac on n-h2-854925-5 Aug 30 04:08:56.248842 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c81586b1-b4af-45c1-abb1-a18e339951b4 req-8ae060d7-9865-4ecc-84df-d05aae88b59d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149113 Aug 30 04:08:56.249467 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 64/110] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:08:56.270175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:56.271384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:56.308139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:56.309770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:56.311503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:56.314686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:56.315487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:56.318337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.251529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:57.269956 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6e9fab8-eb84-4924-a15a-288fe98ce1f6 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1341 microversion: 2.1 time: 1.017850 Aug 30 04:08:57.270793 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 65/111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:56 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1341 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:57.282330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:57.283216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:57.317375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.318701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.319317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.320361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.320979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.321584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.417039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:08:57.419149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:08:57.419938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:08:57.420583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:08:57.421201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:08:57.436864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.438134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.440037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.441917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.443434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.445044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.467479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=15 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:08:57.486122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Getting quotas for project 9b96459442a54f3caa87eb12f10d85b0. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:08:57.522911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Getting quotas for user b102593edbd9489883889617591d412d and project 9b96459442a54f3caa87eb12f10d85b0. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:08:57.537263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:08:57.540203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:08:57.631722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae0492a8-d83e-47b5-ac71-e828fb5ec0fe tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.197106 Aug 30 04:08:57.635076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 47/112] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:08:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 3200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:08:57.648668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb9f759f-9a45-462d-b533-7f63d55076b4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:57.651495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb9f759f-9a45-462d-b533-7f63d55076b4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:57.821801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:57.836418 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ceabffc4-f15b-4790-a1e6-886ffe714e7e tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1486 microversion: 2.1 time: 0.564397 Aug 30 04:08:57.861894 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 66/113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:57 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1486 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:57.866888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:57.874317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:57.878065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fb9f759f-9a45-462d-b533-7f63d55076b4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:57.884904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.887109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.889047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.890686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:57.891875 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb9f759f-9a45-462d-b533-7f63d55076b4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1261 microversion: 2.1 time: 0.248580 Aug 30 04:08:57.894711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:57.895351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:57.896142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 48/114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:57 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1261 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:58.293785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:58.294547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:58.315307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:58.315803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:58.316239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:58.328093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:58.331464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:58.334599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:59.195518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a6d4f0da-ae1c-46bf-8d8c-21aa8ba18f95 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1637 microversion: 2.1 time: 1.332430 Aug 30 04:08:59.196860 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 67/115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:57 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1637 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:59.203157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:59.205176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:59.222438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:59.234224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:59.249665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:59.254126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:59.254872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:59.255502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:59.604731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:59.616927 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-238b2a10-57b0-40ea-b102-001049dd323d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1257 microversion: 2.1 time: 0.418632 Aug 30 04:08:59.621735 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 68/116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:59 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1257 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:59.633890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:08:59.634624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:08:59.657014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:59.657808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:59.658396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:59.659337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:08:59.660025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:08:59.660591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:08:59.709654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:08:59.727360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba1f8a3b-c8c5-460d-9615-9c3959b56c3c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1491 microversion: 2.1 time: 1.438968 Aug 30 04:08:59.729175 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 49/117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:08:58 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1491 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:08:59.758696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:09:00.124856 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b2afdcb-3b33-4618-8b55-4372d2d17bd1 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 204 len: 0 microversion: 2.1 time: 0.497347 Aug 30 04:09:00.126599 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 69/118] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:08:59 2022] DELETE /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:09:00.145693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:00.146840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:00.164761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.166860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.168361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.169564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.170211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.171100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.493909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:00.494327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:00.501339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.501838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.502277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.503107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.503557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.514900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.564599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:00.578919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f1ba4bf6-5b0c-4b20-9c89-8782e5ba9933 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1492 microversion: 2.1 time: 0.445771 Aug 30 04:09:00.594194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 70/119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:00 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1492 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:00.638799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:00.639499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:00.650821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.651324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.651765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.657817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.658373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.658893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.703036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:09:00.742059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:00.845848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:00.864946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76aa36eb-b685-450c-80f8-651e20898e77 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.230396 Aug 30 04:09:00.880413 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 71/120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:00 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:00.946487 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8586ce29-0bdb-43bf-bfce-05a7de52ef1e tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 204 len: 0 microversion: 2.1 time: 1.198368 Aug 30 04:09:00.947649 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 50/121] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:08:59 2022] DELETE /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 0 bytes in 1201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:09:00.967808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:00.968475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:00.978674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.979245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.979686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:00.980443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:00.981209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:00.981472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:01.508226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:01.518405 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d8e59b08-0cd8-4b4e-bc30-3847fa72eb93 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1497 microversion: 2.1 time: 0.555482 Aug 30 04:09:01.522648 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 72/122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:00 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1497 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:01.611885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:01.612883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:01.628171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:01.634546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:01.635185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:01.641196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:01.643454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:01.644292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:01.903321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:01.903960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:01.919988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:01.921684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:01.922636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:01.924292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:01.925248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:01.925934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:01.928847 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18b4d0dc-63d8-40b3-a739-ec21bd532cd5 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1492 microversion: 2.1 time: 0.323560 Aug 30 04:09:01.929565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:01.943783 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 51/123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:01 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1492 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:02.105516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:02.115019 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fef0d148-dee7-4006-b09a-6ce0caa4f395 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.216007 Aug 30 04:09:02.115604 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 73/124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:01 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:02.175049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b9d2cbf0-7c9b-4047-b7fa-1c0a07735505 tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] Calling method '.version_select at 0x7fe96b1f5dc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:02.191710 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b9d2cbf0-7c9b-4047-b7fa-1c0a07735505 tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.220412 Aug 30 04:09:02.192715 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 52/125] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Aug 30 04:09:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:02.208884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e3c116a3-710f-4ad4-af47-f5993e259c5b tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aeed670>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:02.306944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:02.549513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:02.550297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:02.563350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:02.566969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:02.568164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:02.570223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:02.583394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:02.585079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:02.870397 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e3c116a3-710f-4ad4-af47-f5993e259c5b tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.668571 Aug 30 04:09:02.872776 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 74/126] 10.222.0.27 () {60 vars in 1206 bytes} [Tue Aug 30 04:09:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:02.919600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb525567-6607-48a4-ab38-a235ebfe72fb tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] Calling method '.version_select at 0x7fe96af07d30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:02.939345 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb525567-6607-48a4-ab38-a235ebfe72fb tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.055043 Aug 30 04:09:02.940544 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 75/127] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Aug 30 04:09:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:02.957913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c2e0f23-6c99-4d82-b0e3-89859fc12308 tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] Action: 'update', calling method: .version_select at 0x7fe96adb2670>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:03.106646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:03.126467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-87c621c8-637b-4d93-9981-288c723ce125 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1497 microversion: 2.1 time: 0.590795 Aug 30 04:09:03.127306 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 53/128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:02 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1497 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:03.135137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:03.135745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:03.154874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:03.155969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:03.164653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:03.165778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:03.166406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:03.167049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:03.177727 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c2e0f23-6c99-4d82-b0e3-89859fc12308 tempest-QuotaClassesAdminTestJSON-1763776168 tempest-QuotaClassesAdminTestJSON-1763776168-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.227010 Aug 30 04:09:03.178497 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 76/129] 10.222.0.27 () {60 vars in 1206 bytes} [Tue Aug 30 04:09:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:03.192768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:03.193607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:03.203957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:03.204569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:03.205907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:03.207385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:03.207956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:03.208483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:03.343742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:03.355146 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-49ed3eea-8eca-48ca-960a-e0d8ec2e3daa tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.173137 Aug 30 04:09:03.358226 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 77/130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:03 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:03.481648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:03.489474 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a5312f7-5782-47b2-9498-a6330deb9153 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1492 microversion: 2.1 time: 0.358378 Aug 30 04:09:03.508811 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 54/131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:03 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1492 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:04.147569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:04.148180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:04.155475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.159351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.159949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.160713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.161215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.161742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.380642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:04.381272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:04.394757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.395486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.396093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.396979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.397619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.405300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.515213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:04.528935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad64857f-1f63-4615-b8ca-62b111e83203 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1455 microversion: 2.1 time: 0.381737 Aug 30 04:09:04.529887 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 78/132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:04 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1455 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:04.540786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:04.543707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:04.565124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.565999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.566844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.568085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.568999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.569771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.732851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:04.741779 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5f8d734b-8ae4-4c35-ab07-9ee9bfb5db26 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.364729 Aug 30 04:09:04.742505 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 55/133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:04 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:04.766508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f83ab074-5ad4-40d6-a7f3-cf107594fde8 req-554c05d1-85cf-45c6-b395-d3ce128c5467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882849b7-c019-4ea5-aa15-c54d74be15ac", "name": "network-vif-deleted", "tag": "5e5681a4-b0fa-45ed-ae79-bc3c952157c3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:04.792988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f83ab074-5ad4-40d6-a7f3-cf107594fde8 req-554c05d1-85cf-45c6-b395-d3ce128c5467 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.793855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f83ab074-5ad4-40d6-a7f3-cf107594fde8 req-554c05d1-85cf-45c6-b395-d3ce128c5467 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.794529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f83ab074-5ad4-40d6-a7f3-cf107594fde8 req-554c05d1-85cf-45c6-b395-d3ce128c5467 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.824954 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f83ab074-5ad4-40d6-a7f3-cf107594fde8 req-554c05d1-85cf-45c6-b395-d3ce128c5467 service nova] Creating event network-vif-deleted:5e5681a4-b0fa-45ed-ae79-bc3c952157c3 for instance 882849b7-c019-4ea5-aa15-c54d74be15ac on n-h2-854925-5 Aug 30 04:09:04.831767 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f83ab074-5ad4-40d6-a7f3-cf107594fde8 req-554c05d1-85cf-45c6-b395-d3ce128c5467 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070000 Aug 30 04:09:04.834062 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 56/134] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:04.842324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-927949a7-8baf-405c-95fd-3b0895b7597f req-a93d3f0a-54a5-4cfb-8c65-5d60c19f2741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422a0262-f212-4d4e-87b0-99ec7fe17e0e", "name": "network-vif-deleted", "tag": "719db109-e8d2-4bf0-85ea-5eebc2daf1d1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:04.871460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-927949a7-8baf-405c-95fd-3b0895b7597f req-a93d3f0a-54a5-4cfb-8c65-5d60c19f2741 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:04.872270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-927949a7-8baf-405c-95fd-3b0895b7597f req-a93d3f0a-54a5-4cfb-8c65-5d60c19f2741 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:04.872916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-927949a7-8baf-405c-95fd-3b0895b7597f req-a93d3f0a-54a5-4cfb-8c65-5d60c19f2741 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:04.904139 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-927949a7-8baf-405c-95fd-3b0895b7597f req-a93d3f0a-54a5-4cfb-8c65-5d60c19f2741 service nova] Creating event network-vif-deleted:719db109-e8d2-4bf0-85ea-5eebc2daf1d1 for instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e on n-h2-854925-5 Aug 30 04:09:04.917495 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-927949a7-8baf-405c-95fd-3b0895b7597f req-a93d3f0a-54a5-4cfb-8c65-5d60c19f2741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078732 Aug 30 04:09:04.921416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 57/135] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:04.994708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44642b0f34744c068cc6a03d041d21f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd54134d1d904443f8ed353a3d812ffab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:05.013919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83f3d2f8-4e10-4055-89bb-eeb99b242b24 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 200 len: 1450 microversion: 2.1 time: 0.481157 Aug 30 04:09:05.014903 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 79/136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:04 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 1450 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:05.553634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:05.554773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:05.557249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:05.580280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:05.591866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:05.592463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:05.593552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:05.597044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:05.597844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:05.745013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:05.746408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:05.747598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:05.748294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lazy-loading 'fault' on Instance uuid 882849b7-c019-4ea5-aa15-c54d74be15ac {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:09:05.765161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:05.766682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:05.777696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:05.784797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:05.787097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:05.788083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:05.792345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:05.794643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:06.375059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:06.386570 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d5f55cb-612b-43b4-8728-c40a7d61feda tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 200 len: 1331 microversion: 2.1 time: 0.838918 Aug 30 04:09:06.387167 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 58/137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:05 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 1331 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:06.408676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:06.409634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:06.418718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:06.419133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:06.419580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:06.420285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:06.420742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:06.421165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:06.449022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:06.459970 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fbc1c692-cd54-49e5-a513-b9da9162612a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.698598 Aug 30 04:09:06.461299 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 80/138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:05 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:06.486698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] HTTP exception thrown: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Request method failure captured: Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e HTTP/1.1 Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY0weaSA5Eg-x8l9qbXbaGRJNiBlnZkeawiopVvKYHOrI6ROmGSP1a2ZRljvG1zhNhVsDf33yk6-8pkvy0J1aoUpB-dcuuXotytAZ4zuhXznyqL7N6sHOuYRmKho5R1YWdxIVtlgrBJuE0-pDKXNgaGzteNCVBGdFab70tB2TdOELAg Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: d54134d1d904443f8ed353a3d812ffab Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:06.508694 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d54134d1d904443f8ed353a3d812ffab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d54134d1d904443f8ed353a3d812ffab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d54134d1d904443f8ed353a3d812ffab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d54134d1d904443f8ed353a3d812ffab"}]}] Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: d54134d1d904443f8ed353a3d812ffab Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminTestJSON-1894616293-project Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 44642b0f34744c068cc6a03d041d21f1 Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminTestJSON-1894616293-project Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:06.509913 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '422a0262-f212-4d4e-87b0-99ec7fe17e0e'} Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:06.510685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:06.511793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:06.512787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Returning 404 to user: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:06.512787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99e1f758-bb86-45fb-b46b-2526772e6da6 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 404 len: 111 microversion: 2.1 time: 0.120556 Aug 30 04:09:06.512787 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 59/139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:06 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:06.520312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f099009-80fd-4fe0-ab8e-dcf3228dbe76 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:06.543557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f099009-80fd-4fe0-ab8e-dcf3228dbe76 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:06.544211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f099009-80fd-4fe0-ab8e-dcf3228dbe76 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:06.544603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f099009-80fd-4fe0-ab8e-dcf3228dbe76 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:07.409125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:07.410390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:07.423252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:07.435819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:07.436337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:07.438176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:07.439773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:07.440213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:07.493219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:07.494902 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] HTTP exception thrown: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Request method failure captured: Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac HTTP/1.1 Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY0yu0BmcHzYcCQaEGvq41T3BDBTN_OgDRz94g-A4ZBfkpBAsCB9yvSFtoMr81mezT-S-b3O7z-MgpHB1mtzljve66TxZvDoaBTJPks2MfM8N20H_TL4ChtOtLP1ycLejTqotcNNLMRI4iE1qTPLpvMhzDd9CWSO-8YhCUVgws2bxH0 Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:07.496618 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ace36fb5a6e840e18fb8ea79f0525628", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}] Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: edfece7a34f54de5a9b74fdc650321cd Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:07.498012 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '882849b7-c019-4ea5-aa15-c54d74be15ac'} Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:07.498802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:07.500100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:07.502596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Returning 404 to user: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:07.503637 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1853c148-4a35-49a6-8d5e-c95919929d3b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 404 len: 111 microversion: 2.1 time: 0.100272 Aug 30 04:09:07.504648 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 60/140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:07 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:09:07.511308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:07.513837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:07.539976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:07.543458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:07.543911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:07.544643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:07.545099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:07.547855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:07.620583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:07.776649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:07.791851 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63f080b3-9c50-4610-985a-9ba45700509e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.285752 Aug 30 04:09:07.793810 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 61/141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:07 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:07.800201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1021978475", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:07.803290 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f099009-80fd-4fe0-ab8e-dcf3228dbe76 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 1.287477 Aug 30 04:09:07.810211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 81/142] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:06 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:07.815649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e6795a4-1f85-42ae-96b6-711f09b16137 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:07.830789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=66,nova_api:UPDATE=22,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:07.894015 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e6795a4-1f85-42ae-96b6-711f09b16137 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.082484 Aug 30 04:09:07.894601 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 82/143] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:07 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:07.920467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:09:07.923471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9b981389-368e-4ce2-822f-6a8d1c7c78b2 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1308106719"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:07.928554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-9b981389-368e-4ce2-822f-6a8d1c7c78b2 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid 59e5e1a8-a6d7-48ba-b756-446fa3df4e1b for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:08.013345 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9b981389-368e-4ce2-822f-6a8d1c7c78b2 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.098076 Aug 30 04:09:08.019488 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 83/144] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:07 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:08.032450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffe15ebc-076f-4935-9ef8-2aab55c573af tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:08.051257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffe15ebc-076f-4935-9ef8-2aab55c573af tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.053459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffe15ebc-076f-4935-9ef8-2aab55c573af tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.054114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffe15ebc-076f-4935-9ef8-2aab55c573af tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.376149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ffe15ebc-076f-4935-9ef8-2aab55c573af tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.351748 Aug 30 04:09:08.376788 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 84/145] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:08 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:08.388916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a477b24-af7a-445c-85f8-04543d44a818 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:08.403107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2a477b24-af7a-445c-85f8-04543d44a818 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.018234 Aug 30 04:09:08.403678 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 85/146] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:09:08 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:08.430472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-795a269e-66c6-4084-8b78-867e7f7d2e9a tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:08.459261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-795a269e-66c6-4084-8b78-867e7f7d2e9a tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.459759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-795a269e-66c6-4084-8b78-867e7f7d2e9a tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.467143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-795a269e-66c6-4084-8b78-867e7f7d2e9a tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.586053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:09:08.586505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:09:08.587013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:09:08.587428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:09:08.587843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:09:08.611439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.611937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.614854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.616726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.617405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.619193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.676169 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-795a269e-66c6-4084-8b78-867e7f7d2e9a tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.264264 Aug 30 04:09:08.678545 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 86/147] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:08 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:08.689045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f411f88f-1deb-4823-b9f0-69494ef26812 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:08.742397 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f411f88f-1deb-4823-b9f0-69494ef26812 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.057503 Aug 30 04:09:08.743634 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 87/148] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:08 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:08.763182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-43ddc853-e780-417a-8e6a-23d8ba44a934 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1308708246"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:08.774470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-43ddc853-e780-417a-8e6a-23d8ba44a934 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid 1526dcc9-5690-4ecc-b4b1-fd5a6c05c462 for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:08.861512 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-43ddc853-e780-417a-8e6a-23d8ba44a934 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109453 Aug 30 04:09:08.863865 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 88/149] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:08.873923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:08.874915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:08.887354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.888469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.889155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.892760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:08.893566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:08.894189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:08.945856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Getting quotas for project ace36fb5a6e840e18fb8ea79f0525628. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:08.954325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Getting quotas for user edfece7a34f54de5a9b74fdc650321cd and project ace36fb5a6e840e18fb8ea79f0525628. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:08.973394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:09:08.976448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:09:09.096359 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4066f153-6c70-45cb-a6d0-c8ab1c4999d0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.300174 Aug 30 04:09:09.103106 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 62/150] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:09:09.117177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e87a08c-3266-4da8-ac48-37942bcc1266 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:09.135561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e87a08c-3266-4da8-ac48-37942bcc1266 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:09.136122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e87a08c-3266-4da8-ac48-37942bcc1266 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:09.140009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e87a08c-3266-4da8-ac48-37942bcc1266 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:09.377599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:09.397704 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e8cd2ca8-d9a4-4c63-99bf-17b71bc6cbb2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.529146 Aug 30 04:09:09.400040 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 89/151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:08 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:09.415475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fcffaeb2-9ccf-4352-ab36-82e731444ef5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:09.419584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fcffaeb2-9ccf-4352-ab36-82e731444ef5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:09.453389 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e87a08c-3266-4da8-ac48-37942bcc1266 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.348902 Aug 30 04:09:09.454011 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 63/152] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:09 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:09.469849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9cd8814d-751a-41b7-9373-44cc07d400fa tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:09.517480 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9cd8814d-751a-41b7-9373-44cc07d400fa tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.056184 Aug 30 04:09:09.518228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 64/153] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:09:09 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:09.543670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb4be2ce-71bf-47fe-ba36-7a07d38bbf26 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:09.560994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb4be2ce-71bf-47fe-ba36-7a07d38bbf26 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:09.561527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb4be2ce-71bf-47fe-ba36-7a07d38bbf26 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:09.561973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb4be2ce-71bf-47fe-ba36-7a07d38bbf26 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:09.671161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fcffaeb2-9ccf-4352-ab36-82e731444ef5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:09.689242 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fcffaeb2-9ccf-4352-ab36-82e731444ef5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1220 microversion: 2.1 time: 0.284784 Aug 30 04:09:09.691455 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 90/154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:09 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1220 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:09.768550 n-d-854925-5 devstack@n-api.service[122402]: WARNING nova.scheduler.client.report [None req-fb4be2ce-71bf-47fe-ba36-7a07d38bbf26 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] [req-6c47b4f2-d114-496c-8962-fa3fcfc9c510] Failed to update aggregates to [] for resource provider with UUID 06eed9b4-c260-4bd4-b10a-87a3493b1835. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-6c47b4f2-d114-496c-8962-fa3fcfc9c510"}]} Aug 30 04:09:09.949830 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb4be2ce-71bf-47fe-ba36-7a07d38bbf26 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.422722 Aug 30 04:09:09.950750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 65/155] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:09 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:09.962861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00287a54-fd04-4058-96d5-28353fa21cdf tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:10.023399 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00287a54-fd04-4058-96d5-28353fa21cdf tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.064950 Aug 30 04:09:10.025499 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 91/156] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:09 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:10.037610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3800d624-82ce-41d9-9f67-7e4d34fdcf9d tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1380319000"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:10.044724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-3800d624-82ce-41d9-9f67-7e4d34fdcf9d tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid dbb12d23-4e5d-4861-86cd-2971c69b4cdb for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:10.107512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3800d624-82ce-41d9-9f67-7e4d34fdcf9d tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.072743 Aug 30 04:09:10.109183 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 66/157] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:10.122006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f594ded-4847-49cb-bcae-b1515fccdd01 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:10.150021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f594ded-4847-49cb-bcae-b1515fccdd01 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.150662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f594ded-4847-49cb-bcae-b1515fccdd01 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.151114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f594ded-4847-49cb-bcae-b1515fccdd01 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.399096 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f594ded-4847-49cb-bcae-b1515fccdd01 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.283008 Aug 30 04:09:10.399790 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 92/158] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:10 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:10.413775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adf5dffc-5a80-4aa1-9eb1-ff601309d604 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:10.419977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:10.420801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:10.427675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.428629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.429256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.430296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.430962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.431856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.447652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5dffc-5a80-4aa1-9eb1-ff601309d604 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.449283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5dffc-5a80-4aa1-9eb1-ff601309d604 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.450833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5dffc-5a80-4aa1-9eb1-ff601309d604 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.678630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adf5dffc-5a80-4aa1-9eb1-ff601309d604 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.270012 Aug 30 04:09:10.679995 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 67/159] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:10 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:10.693475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:10.699201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c381d713-47db-42e2-b128-6cebf9d30719 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:10.709985 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10877b0c-f4a9-4c36-8565-11420e674103 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1319 microversion: 2.1 time: 0.294200 Aug 30 04:09:10.716870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 93/160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:10 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:10.738207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:10.740395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:10.748167 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c381d713-47db-42e2-b128-6cebf9d30719 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.061122 Aug 30 04:09:10.748759 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 68/161] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:10 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:10.763470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.764347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.764796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.764928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b88dec7-2ef4-49bf-9bfc-39ca123dc6ab tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-887059461"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:10.770271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-5b88dec7-2ef4-49bf-9bfc-39ca123dc6ab tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid 25ad9d00-10c1-4bde-bf77-665eacb597fc for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:10.770880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.774360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.774611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.839947 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b88dec7-2ef4-49bf-9bfc-39ca123dc6ab tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.083623 Aug 30 04:09:10.845310 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 69/162] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:10.865409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96ae6b280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:10.872435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.873272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.874023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.876298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:10.876771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:10.878814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:10.916888 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45d8da4d-c0b1-48ce-9111-b413bae406d5 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.069167 Aug 30 04:09:10.917550 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 70/163] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Aug 30 04:09:10 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:10.928658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53e18875-8467-4dcf-8c11-72962f62e976 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.012175 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-53e18875-8467-4dcf-8c11-72962f62e976 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.092526 Aug 30 04:09:11.013750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 71/164] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:11.025584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96b2e1ca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.031539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:11.034600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.036942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.037253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:11.039957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.040428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.040851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:11.049497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-62e83777-1191-4935-9dc7-c3122e15e108 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1272 microversion: 2.1 time: 0.328602 Aug 30 04:09:11.050574 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 94/165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:10 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1272 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:11.064385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-521affbe-e5da-497e-a0a6-4d7ad1750400 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.104414 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-521affbe-e5da-497e-a0a6-4d7ad1750400 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-521affbe-e5da-497e-a0a6-4d7ad1750400 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Request method failure captured: Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY0ywFqL87jnhtc9jXPZatQJM7uZWQXbfG92VpZmRstzJm4scG3SQhEU21K6ZnGRt484Oft2WoYiwdYPsVs6i9NxDS5Vzp4ZqEbCyvp3P6IEVRrU6zUF9zM0iEl_K0GTEGbhS5yNNeoOSPoNN0Kvi9BB-awssAS-fC68ByM0Tvm4A14 Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:11.122776 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80e9a3ad891e4259a6c038024e5c25de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}] Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b3e6305ef228467ca39a3c7cead3586e Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: exception: Aggregate 5 could not be found. Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5'} Aug 30 04:09:11.124452 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:11.125903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.127157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-521affbe-e5da-497e-a0a6-4d7ad1750400 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:11.129188 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-521affbe-e5da-497e-a0a6-4d7ad1750400 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.073086 Aug 30 04:09:11.129650 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01bcc07e-1776-4971-8e71-7c663b4bb415 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.113419 Aug 30 04:09:11.129650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 72/166] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:11 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:11.130298 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 95/167] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:09:11 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:09:11.153360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bef897ce-932a-404f-aab9-befb14b99da1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.159832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96c25cf70>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.168435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.176487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.177524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:11.178698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.184433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.184902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:11.195658 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-bef897ce-932a-404f-aab9-befb14b99da1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bef897ce-932a-404f-aab9-befb14b99da1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Request method failure captured: Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY0ywFqL87jnhtc9jXPZatQJM7uZWQXbfG92VpZmRstzJm4scG3SQhEU21K6ZnGRt484Oft2WoYiwdYPsVs6i9NxDS5Vzp4ZqEbCyvp3P6IEVRrU6zUF9zM0iEl_K0GTEGbhS5yNNeoOSPoNN0Kvi9BB-awssAS-fC68ByM0Tvm4A14 Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:11.204743 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80e9a3ad891e4259a6c038024e5c25de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}] Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b3e6305ef228467ca39a3c7cead3586e Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: exception: Aggregate 5 could not be found. Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5'} Aug 30 04:09:11.206000 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:11.206715 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:11.207759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:11.208910 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:11.208910 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:11.208910 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:11.208910 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Aug 30 04:09:11.208910 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:11.208910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bef897ce-932a-404f-aab9-befb14b99da1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:11.208910 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bef897ce-932a-404f-aab9-befb14b99da1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.064069 Aug 30 04:09:11.215234 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 96/168] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:11 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:09:11.231387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b8919c0-8826-4fd2-861c-0484216f9e71 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1918621394"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:11.235622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-2b8919c0-8826-4fd2-861c-0484216f9e71 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Generated uuid 704dc1bb-fe1c-4374-9194-711eb83728bd for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:11.289018 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b5eb54b-83ba-45b3-add8-478de5f2408f tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.140856 Aug 30 04:09:11.294535 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 73/169] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Aug 30 04:09:11 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:11.315506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2da2ccc4-19c0-42a7-b373-73d3a24db3b1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-153462332", "name": "tempest-test_aggregate-959822836"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:11.327805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-2da2ccc4-19c0-42a7-b373-73d3a24db3b1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid 508d1abc-5538-4690-bb00-27000c5da0d0 for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:11.351497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b8919c0-8826-4fd2-861c-0484216f9e71 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.133768 Aug 30 04:09:11.357941 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 97/170] 10.222.0.27 () {62 vars in 1205 bytes} [Tue Aug 30 04:09:11 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:11.383160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96ad6d9d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.403988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.405076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.409491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:11.454712 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2da2ccc4-19c0-42a7-b373-73d3a24db3b1 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.155394 Aug 30 04:09:11.455567 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 74/171] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Aug 30 04:09:11 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:11.463147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.464027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.464650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:11.479200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c4986c5-7bab-47ff-a441-b713f6fc31ff tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-778812910"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:11.526565 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d060d197-f9bc-42fa-b5fb-600290317dd4 tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h2-854925-5" status: 200 len: 467 microversion: 2.1 time: 0.160358 Aug 30 04:09:11.527146 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 98/172] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 04:09:11 2022] GET /compute/v2.1/os-hosts/n-h2-854925-5 => generated 467 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:11.859737 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c4986c5-7bab-47ff-a441-b713f6fc31ff tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.402079 Aug 30 04:09:11.863785 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 75/173] 10.222.0.27 () {62 vars in 1210 bytes} [Tue Aug 30 04:09:11 2022] PUT /compute/v2.1/os-aggregates/6 => generated 298 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:11.879680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b1b529b-8b1c-40af-853b-aa8fceb3b734 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.952851 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b1b529b-8b1c-40af-853b-aa8fceb3b734 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.086247 Aug 30 04:09:11.955031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 76/174] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:11.959833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Calling method '.version_select at 0x7fe96b1120d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:11.971695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:DELETE=8,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:11.983872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:11.984509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:11.984927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:12.003020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-beada1c7-e00d-45dd-abde-28d0e033370a tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] Action: 'create', calling method: .version_select at 0x7fe96adb2820>, body: {"security_group": {"name": "tempest-securitygroup-1897066233", "description": "tempest-description-492712685"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:12.028143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:12.030002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:12.030619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:12.099451 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01f371c2-a577-4a55-9088-e2576a51d48c tempest-HostsAdminTestJSON-1371105850 tempest-HostsAdminTestJSON-1371105850-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hosts/n-h1-854925-5" status: 200 len: 467 microversion: 2.1 time: 0.143235 Aug 30 04:09:12.102178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 77/175] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 04:09:11 2022] GET /compute/v2.1/os-hosts/n-h1-854925-5 => generated 467 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:12.107643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:12.109818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:12.119882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:12.125618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:12.128818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:12.129823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:12.130447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:12.131222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:12.493357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:12.505186 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99c7376c-9ec4-4f70-8c64-f3eb3453c74c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.401769 Aug 30 04:09:12.521805 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 78/176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:12 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:12.527608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ad7c9837-6ad7-4520-bfa8-dc864763b84f tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:12.541090 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ad7c9837-6ad7-4520-bfa8-dc864763b84f tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 298 microversion: 2.41 time: 0.017874 Aug 30 04:09:12.555365 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 79/177] 10.222.0.27 () {60 vars in 1190 bytes} [Tue Aug 30 04:09:12 2022] GET /compute/v2.1/os-aggregates/6 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:12.715751 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-beada1c7-e00d-45dd-abde-28d0e033370a tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.178771 Aug 30 04:09:12.718177 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 99/178] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:09:11 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:12.733453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e9c8f50-9c5c-4830-a253-2ce609f5c708 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:12.758467 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-6e9c8f50-9c5c-4830-a253-2ce609f5c708 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e9c8f50-9c5c-4830-a253-2ce609f5c708 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Request method failure captured: Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY0ywFqL87jnhtc9jXPZatQJM7uZWQXbfG92VpZmRstzJm4scG3SQhEU21K6ZnGRt484Oft2WoYiwdYPsVs6i9NxDS5Vzp4ZqEbCyvp3P6IEVRrU6zUF9zM0iEl_K0GTEGbhS5yNNeoOSPoNN0Kvi9BB-awssAS-fC68ByM0Tvm4A14 Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:12.761218 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80e9a3ad891e4259a6c038024e5c25de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}] Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b3e6305ef228467ca39a3c7cead3586e Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: exception: Aggregate 7 could not be found. Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7'} Aug 30 04:09:12.762808 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:12.763707 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 30 04:09:12.765008 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:12.768605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e9c8f50-9c5c-4830-a253-2ce609f5c708 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:12.778407 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e9c8f50-9c5c-4830-a253-2ce609f5c708 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.049789 Aug 30 04:09:12.779678 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 100/179] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:09:12 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:09:12.785652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:12.786455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:12.797533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:12.798950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:12.800091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:12.801306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:12.802203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:12.802853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:12.945747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:12.959349 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d47942da-b9d4-4db7-8ab6-a3c419ef978f tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1278 microversion: 2.1 time: 0.178299 Aug 30 04:09:12.961427 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 101/180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:12 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:12.974722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1613832766", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "c3c9ddd9-fb5e-49c2-b881-772d074b19d2"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:12.985863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4c84551-f408-4a94-abc8-bc3a2d0cbef0 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:13.002562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c84551-f408-4a94-abc8-bc3a2d0cbef0 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:13.003049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c84551-f408-4a94-abc8-bc3a2d0cbef0 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:13.003596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c84551-f408-4a94-abc8-bc3a2d0cbef0 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:13.091161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] validate_networks() for [('c3c9ddd9-fb5e-49c2-b881-772d074b19d2', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:09:13.213744 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4c84551-f408-4a94-abc8-bc3a2d0cbef0 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 313 microversion: 2.41 time: 0.232073 Aug 30 04:09:13.214258 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 102/181] 10.222.0.27 () {62 vars in 1232 bytes} [Tue Aug 30 04:09:12 2022] POST /compute/v2.1/os-aggregates/6/action => generated 313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:13.220303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d21d273f-2270-4949-8117-06823c5ee52c tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] Action: 'create', calling method: .version_select at 0x7fe96acde940>, body: {"security_group": {"name": "tempest-securitygroup-1232690556", "description": "tempest-description-1776251441"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:13.738425 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d21d273f-2270-4949-8117-06823c5ee52c tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.522807 Aug 30 04:09:13.739060 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 103/182] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:09:13 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:13.749713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f68a2fe4-0877-4def-9e01-7cbce6a3a3e0 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:13.764991 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f68a2fe4-0877-4def-9e01-7cbce6a3a3e0 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f68a2fe4-0877-4def-9e01-7cbce6a3a3e0 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Request method failure captured: Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY0ywFqL87jnhtc9jXPZatQJM7uZWQXbfG92VpZmRstzJm4scG3SQhEU21K6ZnGRt484Oft2WoYiwdYPsVs6i9NxDS5Vzp4ZqEbCyvp3P6IEVRrU6zUF9zM0iEl_K0GTEGbhS5yNNeoOSPoNN0Kvi9BB-awssAS-fC68ByM0Tvm4A14 Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:13.768871 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_80e9a3ad891e4259a6c038024e5c25de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/80e9a3ad891e4259a6c038024e5c25de"}]}] Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 80e9a3ad891e4259a6c038024e5c25de Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-174972442 Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b3e6305ef228467ca39a3c7cead3586e Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminTestJSON-174972442-project-admin Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: exception: Aggregate 7 could not be found. Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7'} Aug 30 04:09:13.770400 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:13.771092 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:13.772147 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:13.773262 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:13.773262 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:13.773262 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:13.773262 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 30 04:09:13.773262 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:13.776837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f68a2fe4-0877-4def-9e01-7cbce6a3a3e0 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:13.779355 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f68a2fe4-0877-4def-9e01-7cbce6a3a3e0 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.038360 Aug 30 04:09:13.790024 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 104/183] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:09:13.799957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14eed0bc-1e36-4536-a18e-4dc284edff4b tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:13.822426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14eed0bc-1e36-4536-a18e-4dc284edff4b tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:13.823623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14eed0bc-1e36-4536-a18e-4dc284edff4b tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:13.824410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14eed0bc-1e36-4536-a18e-4dc284edff4b tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:13.918376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:09:13.918811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:09:13.919474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:09:13.920684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:09:13.921148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:09:13.941785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:13.942293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:13.942731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:13.945287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:13.948128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:13.949133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:14.001558 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14eed0bc-1e36-4536-a18e-4dc284edff4b tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.41 time: 0.206172 Aug 30 04:09:14.011387 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 105/184] 10.222.0.27 () {62 vars in 1232 bytes} [Tue Aug 30 04:09:13 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:14.017269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:14.018324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:14.020863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:14.037665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:14.038473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:14.039130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:14.040083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:14.040962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:14.042116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:14.051114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for user c05146c8ea7b425eb8eda0088841dd8a and project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:14.105767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:09:14.107971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:09:14.235816 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a085102-2017-4d6a-b5b2-84113c5fc88b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677502 Aug 30 04:09:14.236785 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 80/185] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:09:14.318136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:14.329717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc671161-b43a-43af-95d1-fefc0c8debd1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.316854 Aug 30 04:09:14.344901 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 106/186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:14 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:14.355063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5341520-8079-4b20-9fc2-e67f88f7c177 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1117083046"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:14.364578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-d5341520-8079-4b20-9fc2-e67f88f7c177 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid 107b0398-43ce-43e4-95ed-c05b3ccb40ea for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:14.446859 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5341520-8079-4b20-9fc2-e67f88f7c177 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.100475 Aug 30 04:09:14.449286 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 107/187] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:14.472356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:14.473107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:14.522492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:14.523347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:14.524020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:14.525071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:14.525772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:14.526413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:14.617402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:14.769119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8b99a13b-fa2a-4d1d-8cca-cc4bed6d3ed7 tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] Action: 'create', calling method: .version_select at 0x7fe96ae7a550>, body: {"security_group": {"name": "tempest-securitygroup-1401419063", "description": "tempest-description-1581900082"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:15.181255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:15.204240 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a68dbefb-476d-4ede-90ee-39534d689616 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1320 microversion: 2.1 time: 0.742549 Aug 30 04:09:15.229573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 108/188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:14 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1320 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:15.243494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14a64adc-9582-417a-9000-42753f198a21 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:15.261428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=8,nova_api:INSERT=7 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:15.291347 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14a64adc-9582-417a-9000-42753f198a21 tempest-AggregatesAdminTestV241-1399662949 tempest-AggregatesAdminTestV241-1399662949-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.055357 Aug 30 04:09:15.292216 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 109/189] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 04:09:15 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:15.299867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5400151-357b-4fda-98fb-29f16d478795 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:15.300917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5400151-357b-4fda-98fb-29f16d478795 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:15.472160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b5400151-357b-4fda-98fb-29f16d478795 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:15.496659 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5400151-357b-4fda-98fb-29f16d478795 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1211 microversion: 2.1 time: 0.202957 Aug 30 04:09:15.500073 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 110/190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:15 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1211 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:15.537136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-894d9e40-92ed-4b17-b47d-8ffc24d1e26d tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:15.549750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-894d9e40-92ed-4b17-b47d-8ffc24d1e26d tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.025578 Aug 30 04:09:15.550897 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 111/191] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:09:15 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:15.567109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ea4ae9fe-388a-4d1a-a97d-ccdacab793a3 req-6b4542ab-d186-4906-a81c-69f433d36ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7921f451-2ab5-4c56-8efe-31230544542f", "tag": "d2517cf5-e55a-4cec-b014-eabf985f3f86"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:15.585762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ea4ae9fe-388a-4d1a-a97d-ccdacab793a3 req-6b4542ab-d186-4906-a81c-69f433d36ee1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:15.586430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ea4ae9fe-388a-4d1a-a97d-ccdacab793a3 req-6b4542ab-d186-4906-a81c-69f433d36ee1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:15.586961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ea4ae9fe-388a-4d1a-a97d-ccdacab793a3 req-6b4542ab-d186-4906-a81c-69f433d36ee1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:15.606501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ea4ae9fe-388a-4d1a-a97d-ccdacab793a3 req-6b4542ab-d186-4906-a81c-69f433d36ee1 service nova] Creating event network-changed:d2517cf5-e55a-4cec-b014-eabf985f3f86 for instance 7921f451-2ab5-4c56-8efe-31230544542f on n-h1-854925-5 Aug 30 04:09:15.613346 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ea4ae9fe-388a-4d1a-a97d-ccdacab793a3 req-6b4542ab-d186-4906-a81c-69f433d36ee1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056238 Aug 30 04:09:15.614481 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 112/192] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:15.623654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:15.624588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:15.635742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:15.636290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:15.637955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:15.639279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:15.641246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:15.641710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:15.985252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:15.995352 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14ebf0a4-267c-4a64-8e37-205b15075ece tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.379382 Aug 30 04:09:15.997694 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 113/193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:15 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:16.009209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3a0e9150-b83f-4a59-a246-0c8f73caae6f tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:16.120914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3a0e9150-b83f-4a59-a246-0c8f73caae6f tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.118559 Aug 30 04:09:16.123273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 114/194] 10.222.0.27 () {60 vars in 1191 bytes} [Tue Aug 30 04:09:15 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:16.134455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f4523bc8-3593-4c65-b808-e7fbfd8d86c9 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:16.163735 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f4523bc8-3593-4c65-b808-e7fbfd8d86c9 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.032903 Aug 30 04:09:16.177128 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 115/195] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:09:16 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:16.195007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf838af9-826b-455d-8dc5-1619dd104081 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:16.283844 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf838af9-826b-455d-8dc5-1619dd104081 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.098309 Aug 30 04:09:16.284598 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 116/196] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:16 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:16.305459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:16.308003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:16.327584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:16.328464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:16.329262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:16.344824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:16.345546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:16.346109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:16.351445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8b99a13b-fa2a-4d1d-8cca-cc4bed6d3ed7 tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.113491 Aug 30 04:09:16.352044 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 81/197] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:09:14 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:16.365000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2de02b75-5602-4618-8fbc-869d93789fae tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1481934741", "availability_zone": "tempest-test_az-2145973547"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:16.392626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-2de02b75-5602-4618-8fbc-869d93789fae tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid 95226868-f68f-4196-836f-534357086a84 for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:16.464998 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2de02b75-5602-4618-8fbc-869d93789fae tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.103821 Aug 30 04:09:16.467732 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 82/198] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Aug 30 04:09:16 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:16.478573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c30fb93b-28e3-4493-97e6-49ae6f3ca915 tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] Action: 'create', calling method: .version_select at 0x7fe96ae6b940>, body: {"security_group": {"name": "tempest-securitygroup-200551168", "description": "tempest-description-1103801138"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:17.083209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:17.098589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec66959e-522d-40a5-a82e-f96ae0ba7793 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1320 microversion: 2.1 time: 0.812380 Aug 30 04:09:17.113926 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 117/199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:16 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1320 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:17.119797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-afe8fab2-7117-42d5-aa0d-9ed5dbf9cb34 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1481934741_new", "availability_zone": "tempest-test_az-2145973547_new"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:17.399017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afe8fab2-7117-42d5-aa0d-9ed5dbf9cb34 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:17.399640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afe8fab2-7117-42d5-aa0d-9ed5dbf9cb34 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:17.399909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afe8fab2-7117-42d5-aa0d-9ed5dbf9cb34 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:17.473418 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-afe8fab2-7117-42d5-aa0d-9ed5dbf9cb34 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.357602 Aug 30 04:09:17.475800 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 118/200] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:09:17 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:17.479838 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c30fb93b-28e3-4493-97e6-49ae6f3ca915 tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.010968 Aug 30 04:09:17.481285 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 83/201] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:09:16 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:17.487436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:17.488329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:17.489939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:17.490965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:17.504582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:17.505086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:17.506009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:17.506734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:17.506914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:17.507683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:17.507875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:17.510351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:17.510600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:17.511680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:17.524168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:17.525318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:17.692321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:17.713170 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4070e39-027b-45ae-a44f-ef7a0f01c3ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1269 microversion: 2.1 time: 0.231599 Aug 30 04:09:17.717492 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 119/202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:17 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1269 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:17.736538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f43ac60-6812-4a37-ac89-593870f6df9a tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:17.766040 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f43ac60-6812-4a37-ac89-593870f6df9a tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.045436 Aug 30 04:09:17.777006 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 120/203] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:09:17 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:17.786092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8f7725e1-9129-44e9-bfab-0a01decf67a5 tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] Calling method '.version_select at 0x7fe96ad0a550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:18.229190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:18.240582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d4d1f486-372b-4563-b6f9-703266b06d44 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.757803 Aug 30 04:09:18.242332 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 84/204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:17 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:18.263259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fecfda26-c5fd-4283-931f-9edc62232113 req-9f4fb093-de02-47e8-ad68-0f9c26b2749c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023290fc-bfc6-4efb-8fec-b2d8ebad9d5a", "tag": "0caa6ac9-7795-4063-8f92-7b6de9fdd2da"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:18.280002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fecfda26-c5fd-4283-931f-9edc62232113 req-9f4fb093-de02-47e8-ad68-0f9c26b2749c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:18.280399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fecfda26-c5fd-4283-931f-9edc62232113 req-9f4fb093-de02-47e8-ad68-0f9c26b2749c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:18.280833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fecfda26-c5fd-4283-931f-9edc62232113 req-9f4fb093-de02-47e8-ad68-0f9c26b2749c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:18.293793 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fecfda26-c5fd-4283-931f-9edc62232113 req-9f4fb093-de02-47e8-ad68-0f9c26b2749c service nova] Creating event network-changed:0caa6ac9-7795-4063-8f92-7b6de9fdd2da for instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a on n-h2-854925-5 Aug 30 04:09:18.300320 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fecfda26-c5fd-4283-931f-9edc62232113 req-9f4fb093-de02-47e8-ad68-0f9c26b2749c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056808 Aug 30 04:09:18.301156 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 85/205] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:18.307369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0a212774-68db-47ff-8b1f-eb1a4d6c1363 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:18.343179 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0a212774-68db-47ff-8b1f-eb1a4d6c1363 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.040619 Aug 30 04:09:18.344488 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 86/206] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:18 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:18.349770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:18.350771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:18.357116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:18.358041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:18.358790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:18.359706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:18.360307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:18.360915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:18.896896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:18.906328 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0d75790-0b0a-42ef-8c9b-9bcf1e8eb956 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1320 microversion: 2.1 time: 0.560679 Aug 30 04:09:18.910112 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 87/207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:18 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1320 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:18.928247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef978fd-1b48-4111-8291-e1dfee6d8099 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1784058218"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:18.931835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-9ef978fd-1b48-4111-8291-e1dfee6d8099 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Generated uuid b944b2ce-b2b1-4899-bf42-1eebfe42f533 for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:18.999724 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ef978fd-1b48-4111-8291-e1dfee6d8099 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.088504 Aug 30 04:09:19.007988 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 88/208] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:18 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:19.014019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:19.015201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:19.026340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:19.027298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:19.028303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:19.029586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:19.031834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:19.032474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:19.276194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:19.295465 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7179f6c5-348e-4aa9-b2b2-177e405c7def tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1269 microversion: 2.1 time: 0.285762 Aug 30 04:09:19.296201 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 89/209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:19 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1269 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:19.310271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-333b7ca2-d1f9-4a95-bc57-9c3cc024fe0d tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:19.322119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-333b7ca2-d1f9-4a95-bc57-9c3cc024fe0d tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.024406 Aug 30 04:09:19.322714 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 90/210] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:09:19 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:19.334702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:19.335326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:19.349773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:19.353155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:19.353636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:19.354446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:19.354908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:19.355337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:19.803752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:19.814951 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d9db325-953e-4733-aa66-e72507af7287 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.491102 Aug 30 04:09:19.815942 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 91/211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:19 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:19.820729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8d7d4c69-e076-46fc-ae00-9bd56294ace8 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:19.854834 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8d7d4c69-e076-46fc-ae00-9bd56294ace8 tempest-AggregatesAdminTestJSON-174972442 tempest-AggregatesAdminTestJSON-174972442-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.037606 Aug 30 04:09:19.855385 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 92/212] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:19 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:20.348816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Calling method '.version_select at 0x7fe96c25cf70>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:20.352521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.352994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.357683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.389781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.395304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.397680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.461913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.462417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.462857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.483758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.484315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.485262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.530473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.534298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.534910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.555729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be89067d-03e4-4eec-bc40-335c5527072e tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.699238 Aug 30 04:09:20.565375 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 93/213] 10.222.0.27 () {60 vars in 1243 bytes} [Tue Aug 30 04:09:19 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:20.568053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:20.568621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:20.577842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.578957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.579479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.580626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.581209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.581921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.600613 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] HTTP exception thrown: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Request method failure captured: Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e HTTP/1.1 Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY0weaSA5Eg-x8l9qbXbaGRJNiBlnZkeawiopVvKYHOrI6ROmGSP1a2ZRljvG1zhNhVsDf33yk6-8pkvy0J1aoUpB-dcuuXotytAZ4zuhXznyqL7N6sHOuYRmKho5R1YWdxIVtlgrBJuE0-pDKXNgaGzteNCVBGdFab70tB2TdOELAg Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: d54134d1d904443f8ed353a3d812ffab Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:20.602941 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d54134d1d904443f8ed353a3d812ffab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d54134d1d904443f8ed353a3d812ffab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d54134d1d904443f8ed353a3d812ffab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d54134d1d904443f8ed353a3d812ffab"}]}] Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: d54134d1d904443f8ed353a3d812ffab Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminTestJSON-1894616293-project Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 44642b0f34744c068cc6a03d041d21f1 Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminTestJSON-1894616293-project Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:20.604420 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '422a0262-f212-4d4e-87b0-99ec7fe17e0e'} Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:20.605380 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:20.606690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:20.608676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Returning 404 to user: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:20.609062 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fee0f856-21d1-40f7-a8b3-d8635f8d28f8 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "DELETE /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 404 len: 111 microversion: 2.1 time: 0.047866 Aug 30 04:09:20.610127 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 94/214] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:20 2022] DELETE /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:20.619881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:20.622121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:20.635692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.636190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.637031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:20.637776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:20.641784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:20.642232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.160674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:21.170046 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6fa83980-8f24-448e-8001-64fad3cf3568 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1320 microversion: 2.1 time: 0.558016 Aug 30 04:09:21.170989 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 95/215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:20 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1320 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:21.179194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:21.180474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:21.188131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.188965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.189439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.190662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.191288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.191868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.744437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:21.752974 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3bd88f4-e8ac-4bbb-8bc9-6fb11e0611c2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1311 microversion: 2.1 time: 0.580809 Aug 30 04:09:21.753589 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 96/216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:21 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1311 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:21.758266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Calling method '.version_select at 0x7fe96aff7d30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:21.762208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.762864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.763486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.778990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.779720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.780373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.807547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.808249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.808908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.812257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:21.823859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.824596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.825395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.851956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.852515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.853626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.862360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-10b314a6-9b35-4cc9-88c2-fc9013162fc0 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.107416 Aug 30 04:09:21.863233 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 97/217] 10.222.0.27 () {60 vars in 1222 bytes} [Tue Aug 30 04:09:21 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:21.889477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:21.892348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] [instance: 422a0262-f212-4d4e-87b0-99ec7fe17e0e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:21.908442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.911302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.911772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.912523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.912997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.914479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.945554 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] HTTP exception thrown: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Request method failure captured: Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e HTTP/1.1 Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY0weaSA5Eg-x8l9qbXbaGRJNiBlnZkeawiopVvKYHOrI6ROmGSP1a2ZRljvG1zhNhVsDf33yk6-8pkvy0J1aoUpB-dcuuXotytAZ4zuhXznyqL7N6sHOuYRmKho5R1YWdxIVtlgrBJuE0-pDKXNgaGzteNCVBGdFab70tB2TdOELAg Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: d54134d1d904443f8ed353a3d812ffab Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:21.947120 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d54134d1d904443f8ed353a3d812ffab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d54134d1d904443f8ed353a3d812ffab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d54134d1d904443f8ed353a3d812ffab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d54134d1d904443f8ed353a3d812ffab"}]}] Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: d54134d1d904443f8ed353a3d812ffab Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1894616293 Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminTestJSON-1894616293-project Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 44642b0f34744c068cc6a03d041d21f1 Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminTestJSON-1894616293-project Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:21.948338 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '422a0262-f212-4d4e-87b0-99ec7fe17e0e'} Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:21.949266 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. Aug 30 04:09:21.950763 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:21.951994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] Returning 404 to user: Instance 422a0262-f212-4d4e-87b0-99ec7fe17e0e could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:21.951994 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26556b02-936c-45db-ba2a-febf1ec60ca4 tempest-AggregatesAdminTestJSON-1894616293 tempest-AggregatesAdminTestJSON-1894616293-project] 10.222.0.27 "GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e" status: 404 len: 111 microversion: 2.1 time: 0.083929 Aug 30 04:09:21.957496 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 98/218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:21 2022] GET /compute/v2.1/servers/422a0262-f212-4d4e-87b0-99ec7fe17e0e => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:21.963160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:21.964168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:21.974768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.975625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.976307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:21.978174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:21.978892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:21.979557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:22.500319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:22.511464 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e512767-1b8b-43ac-a0b0-8227b252e67a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.552400 Aug 30 04:09:22.524939 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 99/219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:21 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:22.794813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:22.803300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:22.803793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:22.804239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:22.818286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:22.818775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:22.823250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:22.876421 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dae8d72d-aa3b-45df-b456-038ff8a9eb9f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.350194 Aug 30 04:09:22.877637 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 100/220] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:09:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:22.892396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Calling method '.version_select at 0x7fe96ae51310>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:22.917302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:22.918450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:22.918959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:22.971835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:22.972556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:22.973164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:22.980129 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a580ccca-c5b1-4403-a00e-c497a519ba99 tempest-HypervisorAdminV253TestBase-1244433542 tempest-HypervisorAdminV253TestBase-1244433542-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/06eed9b4-c260-4bd4-b10a-87a3493b1835" status: 200 len: 792 microversion: 2.53 time: 0.101129 Aug 30 04:09:22.980953 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 101/221] 10.222.0.27 () {60 vars in 1298 bytes} [Tue Aug 30 04:09:22 2022] GET /compute/v2.1/os-hypervisors/06eed9b4-c260-4bd4-b10a-87a3493b1835 => generated 792 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:22.996754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:22.997564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:23.004342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:23.005105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:23.005754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:23.006673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:23.007763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:23.008395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:23.428489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:23.451995 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bfb3de52-ad9c-48ba-884f-34e0e0f2821b tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1320 microversion: 2.1 time: 0.459601 Aug 30 04:09:23.454031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 102/222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:22 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:23.460517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:23.461530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:23.469074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:23.469810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:23.470395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:23.471406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:23.472018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:23.472592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:23.786264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:23.800742 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9f1b94d2-401b-4c08-b21e-960cad1f25c1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1311 microversion: 2.1 time: 0.344815 Aug 30 04:09:23.801542 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 103/223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:23 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1311 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:23.840107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-54e6546a-f755-4ee7-afba-a561d35acf74 req-01eebeb9-f836-4d9c-95b0-5b5cb2231c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1feaf5e3-ffa0-4d63-97fa-34a827c83030", "tag": "800ce387-891d-40d8-84a2-2fa64cc25a42"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:23.889509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-54e6546a-f755-4ee7-afba-a561d35acf74 req-01eebeb9-f836-4d9c-95b0-5b5cb2231c76 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:23.890084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-54e6546a-f755-4ee7-afba-a561d35acf74 req-01eebeb9-f836-4d9c-95b0-5b5cb2231c76 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:23.893196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-54e6546a-f755-4ee7-afba-a561d35acf74 req-01eebeb9-f836-4d9c-95b0-5b5cb2231c76 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:23.927245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-54e6546a-f755-4ee7-afba-a561d35acf74 req-01eebeb9-f836-4d9c-95b0-5b5cb2231c76 service nova] Creating event network-changed:800ce387-891d-40d8-84a2-2fa64cc25a42 for instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 on n-h2-854925-5 Aug 30 04:09:23.935007 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-54e6546a-f755-4ee7-afba-a561d35acf74 req-01eebeb9-f836-4d9c-95b0-5b5cb2231c76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114281 Aug 30 04:09:23.936184 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 104/224] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:23.944698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c5a4b9f-47e4-42da-aeb9-deeea82eaebf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1512424850"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:23.948840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-9c5a4b9f-47e4-42da-aeb9-deeea82eaebf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid e2f0bed6-f67e-481c-93ab-9290889bb919 for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:23.963316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:23.981856 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c5a4b9f-47e4-42da-aeb9-deeea82eaebf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044080 Aug 30 04:09:23.983319 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 105/225] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:24.004543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-04fe0182-e90a-4f13-8c0f-816ae140c1ad req-0618fc8a-2476-4bb8-9706-f061e0f104e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023290fc-bfc6-4efb-8fec-b2d8ebad9d5a", "name": "network-vif-plugged", "status": "completed", "tag": "0caa6ac9-7795-4063-8f92-7b6de9fdd2da"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:24.035142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-04fe0182-e90a-4f13-8c0f-816ae140c1ad req-0618fc8a-2476-4bb8-9706-f061e0f104e2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:24.035862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-04fe0182-e90a-4f13-8c0f-816ae140c1ad req-0618fc8a-2476-4bb8-9706-f061e0f104e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:24.039174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-04fe0182-e90a-4f13-8c0f-816ae140c1ad req-0618fc8a-2476-4bb8-9706-f061e0f104e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:24.060365 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-04fe0182-e90a-4f13-8c0f-816ae140c1ad req-0618fc8a-2476-4bb8-9706-f061e0f104e2 service nova] Creating event network-vif-plugged:0caa6ac9-7795-4063-8f92-7b6de9fdd2da for instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a on n-h2-854925-5 Aug 30 04:09:24.076780 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-04fe0182-e90a-4f13-8c0f-816ae140c1ad req-0618fc8a-2476-4bb8-9706-f061e0f104e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077631 Aug 30 04:09:24.077737 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 106/226] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:24.085633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:24.088108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:24.093052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=26 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:24.108985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:24.110106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:24.110534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:24.121170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:24.121693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:24.122138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:24.375128 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8f7725e1-9129-44e9-bfab-0a01decf67a5 tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11055 microversion: 2.1 time: 6.595481 Aug 30 04:09:24.378485 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 121/227] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Aug 30 04:09:17 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11055 bytes in 6601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:24.404191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d48bc2f1-f2b3-4874-b2da-67b3b0d5b761 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:24.413821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:24.421129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d48bc2f1-f2b3-4874-b2da-67b3b0d5b761 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:24.422169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d48bc2f1-f2b3-4874-b2da-67b3b0d5b761 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:24.422659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d48bc2f1-f2b3-4874-b2da-67b3b0d5b761 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:24.432379 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c530739-7224-45de-bec9-09533728906b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.353115 Aug 30 04:09:24.437035 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 107/228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:24 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:24.454165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b489c47-50b9-46dc-9cb8-58ffcabebcde tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] Calling method '.version_select at 0x7fe96ad35ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:24.651018 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d48bc2f1-f2b3-4874-b2da-67b3b0d5b761 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.271302 Aug 30 04:09:24.652285 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 122/229] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:24 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:24.659516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:24.660591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:24.672578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:24.673486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:24.674143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:24.675139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:24.675938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:24.676585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:25.098606 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b489c47-50b9-46dc-9cb8-58ffcabebcde tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.656562 Aug 30 04:09:25.107515 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 108/230] 10.222.0.27 () {58 vars in 1191 bytes} [Tue Aug 30 04:09:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:25.108070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:25.146667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:25.149819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:25.150928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:25.163558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:25.176525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7da2415-4e9e-4ed5-93ae-d6e76e7c80f5 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1320 microversion: 2.1 time: 0.521680 Aug 30 04:09:25.181603 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 123/231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:24 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1320 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:25.190526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:25.191614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:25.201645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:25.202238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:25.202748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:25.203532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:25.204078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:25.204776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:25.256594 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-854925-5. Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 39 Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:09:25.357246 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: {"add_host": {"host": "n-h2-854925-5"}} Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:25.358519 n-d-854925-5 devstack@n-api.service[122402]: exception: Aggregate 11 already has host n-h2-854925-5. Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-854925-5'}}} Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result.read() Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:09:25.359801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-854925-5-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:09:25.360922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:09:25.361981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:09:25.371495 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result.read() Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-854925-5-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 4, 9, 25, 221122), 'updated_at': None, 'host': 'n-h2-854925-5', 'aggregate_id': 11}] Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:25.373717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6639, in add_host_to_aggregate Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-854925-5. Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.377768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-854925-5. Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:25.380090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:25.383779 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-854925-5. Aug 30 04:09:25.383779 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:25.383779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-854925-5. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:25.383779 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dd6bc34f-74dc-4795-b816-18e1c8639813 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.259218 Aug 30 04:09:25.383779 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 109/232] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:25 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 270 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 30 04:09:25.389908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc168579-c84b-4af7-acac-50208cdb148e tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] Calling method '.version_select at 0x7fe96ab54d30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:25.482734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:26.373980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:26.385985 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-657d6d87-5f39-444d-87f2-dd4815f49f04 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1311 microversion: 2.1 time: 1.202461 Aug 30 04:09:26.400976 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 124/233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:25 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1311 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:26.408410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-12ca7b98-7983-47de-ac6d-3b6dfb39f8a0 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:26.420996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ca7b98-7983-47de-ac6d-3b6dfb39f8a0 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.422398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ca7b98-7983-47de-ac6d-3b6dfb39f8a0 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.423696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ca7b98-7983-47de-ac6d-3b6dfb39f8a0 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.473862 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc168579-c84b-4af7-acac-50208cdb148e tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/20ad0083-ba98-4b3c-bc07-ac29b4ec703d" status: 202 len: 0 microversion: 2.1 time: 1.100068 Aug 30 04:09:26.474993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 110/234] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:09:25 2022] DELETE /compute/v2.1/os-security-groups/20ad0083-ba98-4b3c-bc07-ac29b4ec703d => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:26.480027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:26.481078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:26.495446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.495935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.496368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.497077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.497566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.497982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.716017 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-12ca7b98-7983-47de-ac6d-3b6dfb39f8a0 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.313621 Aug 30 04:09:26.717302 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 125/235] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:26 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:26.730170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-641f7f2b-252f-47a4-9f5d-ab4521cb1162 req-72c58323-0786-454f-815c-12509e27b4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7921f451-2ab5-4c56-8efe-31230544542f", "name": "network-vif-plugged", "status": "completed", "tag": "d2517cf5-e55a-4cec-b014-eabf985f3f86"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:26.743355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-641f7f2b-252f-47a4-9f5d-ab4521cb1162 req-72c58323-0786-454f-815c-12509e27b4a0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.743944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-641f7f2b-252f-47a4-9f5d-ab4521cb1162 req-72c58323-0786-454f-815c-12509e27b4a0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.744744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-641f7f2b-252f-47a4-9f5d-ab4521cb1162 req-72c58323-0786-454f-815c-12509e27b4a0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.756971 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-641f7f2b-252f-47a4-9f5d-ab4521cb1162 req-72c58323-0786-454f-815c-12509e27b4a0 service nova] Creating event network-vif-plugged:d2517cf5-e55a-4cec-b014-eabf985f3f86 for instance 7921f451-2ab5-4c56-8efe-31230544542f on n-h1-854925-5 Aug 30 04:09:26.762486 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-641f7f2b-252f-47a4-9f5d-ab4521cb1162 req-72c58323-0786-454f-815c-12509e27b4a0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043818 Aug 30 04:09:26.763613 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 126/236] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:26.769888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:26.771023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:26.778325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.779168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.779807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.780618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:26.781427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:26.782209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:26.804858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:26.831371 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-539a5cc7-413e-4c0b-837b-9ee4929ff386 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.354157 Aug 30 04:09:26.845861 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 111/237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:26 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:27.000571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:27.009892 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ff015d7-df52-4094-8a3b-a3bc2891c6f2 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1470 microversion: 2.1 time: 0.244920 Aug 30 04:09:27.010470 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 127/238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:26 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1470 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:27.015288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0aa4ed8-2136-43ba-94a5-466c9a69a08e tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] Calling method '.version_select at 0x7fe96ad6d700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.229495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-652f4b21-68cc-46cf-b668-ee24af8a6b61 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1769853727", "id": 421972859, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:27.251902 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f0aa4ed8-2136-43ba-94a5-466c9a69a08e tempest-SecurityGroupsTestAdminJSON-621177597 tempest-SecurityGroupsTestAdminJSON-621177597-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/efdd0ac5-9ac1-4f32-a2d8-94b79394e72e" status: 202 len: 0 microversion: 2.1 time: 0.239944 Aug 30 04:09:27.253290 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 128/239] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:09:27 2022] DELETE /compute/v2.1/os-security-groups/efdd0ac5-9ac1-4f32-a2d8-94b79394e72e => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:27.262592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b09314e8-e3a2-4c2c-8189-fcbf02dd1263 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.272321 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-652f4b21-68cc-46cf-b668-ee24af8a6b61 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.424093 Aug 30 04:09:27.280617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 112/240] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:26 2022] POST /compute/v2.1/flavors => generated 427 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:27.298479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:27.302067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:27.313981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.314472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.314909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.315356 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b09314e8-e3a2-4c2c-8189-fcbf02dd1263 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.057184 Aug 30 04:09:27.315659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.315889 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 129/241] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:27 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:27.316112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.316531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.326251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb087041-e119-47ae-a239-6f5c261355ff tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] Calling method '.version_select at 0x7fe96aed7940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.470269 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5727fbe3-cd8f-440e-b733-14f58bce2860 tempest-DeleteServersAdminTestJSON-480065065 tempest-DeleteServersAdminTestJSON-480065065-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a/action" status: 202 len: 0 microversion: 2.1 time: 0.187533 Aug 30 04:09:27.474540 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 113/242] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:09:27 2022] POST /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:27.480229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18aa10ef-06a2-4263-9db6-9e66cd168beb tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.501115 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18aa10ef-06a2-4263-9db6-9e66cd168beb tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/421972859" status: 202 len: 0 microversion: 2.1 time: 0.024708 Aug 30 04:09:27.502095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 114/243] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:09:27 2022] DELETE /compute/v2.1/flavors/421972859 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:27.510216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89dfe334-42b6-4cc6-8738-4cb7170c087c tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-325207952"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:27.513916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-89dfe334-42b6-4cc6-8738-4cb7170c087c tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid e26d7496-0031-47da-93be-06a18d63021e for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:27.542618 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89dfe334-42b6-4cc6-8738-4cb7170c087c tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.036110 Aug 30 04:09:27.544605 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 115/244] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:27.550080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.551429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:27.563368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.564210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.565541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.567994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.568479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.568923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.637037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb087041-e119-47ae-a239-6f5c261355ff tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/f0ed81b7-15eb-4134-8f06-ef63d7929a8c" status: 202 len: 0 microversion: 2.1 time: 0.320002 Aug 30 04:09:27.637947 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 130/245] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:09:27 2022] DELETE /compute/v2.1/os-security-groups/f0ed81b7-15eb-4134-8f06-ef63d7929a8c => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:27.645837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.648047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:27.659050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.659684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.660247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.661059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.662564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.663180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.718320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:27.719521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:27.720112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:27.720806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lazy-loading 'fault' on Instance uuid 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:09:27.872994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:27.882122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee76a622-bfcd-4852-ac70-b81214a2ac62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1311 microversion: 2.1 time: 0.336312 Aug 30 04:09:27.882813 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 116/246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:27 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1311 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:27.903583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b71f3767-3724-4465-a45c-02bbc91541fb tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:27.928183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:27.934758 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b71f3767-3724-4465-a45c-02bbc91541fb tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.050925 Aug 30 04:09:27.935713 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 117/247] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:27 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:27.938346 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ebbcff8-9f57-4bb0-a725-c1cc8ae7eb98 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1453 microversion: 2.1 time: 0.298462 Aug 30 04:09:27.939045 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 131/248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:27 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1453 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:27.944045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-383f2d68-abb0-4d84-b3d5-50f13ee215c9 tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] Calling method '.version_select at 0x7fe96aed7f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.173065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-383f2d68-abb0-4d84-b3d5-50f13ee215c9 tempest-SecurityGroupsTestAdminJSON-897995973 tempest-SecurityGroupsTestAdminJSON-897995973-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/2436ff81-7ee9-4489-9c22-d87f58063a62" status: 202 len: 0 microversion: 2.1 time: 0.232749 Aug 30 04:09:28.178213 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 132/249] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:09:27 2022] DELETE /compute/v2.1/os-security-groups/2436ff81-7ee9-4489-9c22-d87f58063a62 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:28.183575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.184497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:28.192528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.193307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.194010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.194782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.195438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.196074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.276681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2346f86d-7f19-4390-996a-9caf4aef1d1f tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.284258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2346f86d-7f19-4390-996a-9caf4aef1d1f tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '45fa3b065bdf444ca220fc1371022e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a800439e5f34d61ae5272ce62255199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2346f86d-7f19-4390-996a-9caf4aef1d1f tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Request method failure captured: Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 39 Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wSWDstPlKxBAgTFC79ou2zB3_p3hkFsN8Y6blH9aSJyHDXgDATDXyEHGH1DneLDsiAWBCaQmn7lREe-pQbaqsHE42DuvKNjMw0gSpOOVQqckZJxzC4tU_J2eCMsWljUe_bbU5lvj48kUAegmfEHhv2fmY8DXQ_XtcM9hRON6xYv4 Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:28.286904 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a800439e5f34d61ae5272ce62255199", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}] Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 45fa3b065bdf444ca220fc1371022e81 Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: {"add_host": {"host": "n-h2-854925-5"}} Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:28.288068 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-854925-5'}}} Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:28.288774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 30 04:09:28.289849 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.292747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2346f86d-7f19-4390-996a-9caf4aef1d1f tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:28.293796 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2346f86d-7f19-4390-996a-9caf4aef1d1f tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.357105 Aug 30 04:09:28.295003 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 118/250] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:27 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 359 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:28.301958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.302912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:28.311239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.311972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.313411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.314320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.315336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.315947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.347303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:28.352759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:09:28.355467 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79d69a3e-a171-4063-9816-be34744c3351 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1386 microversion: 2.1 time: 0.175974 Aug 30 04:09:28.356718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 133/251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:28 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:28.362404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab126434-2e3f-4d60-848c-fe70a16536ad tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-99036944", "id": 1568283911, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.392852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab126434-2e3f-4d60-848c-fe70a16536ad tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.035002 Aug 30 04:09:28.393812 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 134/252] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/flavors => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:28.399644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38a25471-734e-4a6b-b4b6-13d4bc22a55f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.430456 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38a25471-734e-4a6b-b4b6-13d4bc22a55f tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.035269 Aug 30 04:09:28.431133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 135/253] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:28 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:28.442813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d73a0e1b-a8b1-4007-aeb9-3566cfec4712 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.472448 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d73a0e1b-a8b1-4007-aeb9-3566cfec4712 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.037880 Aug 30 04:09:28.474048 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 136/254] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:28 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:28.478537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b20d24e-6176-4bd0-8f3f-0e6bfde81274 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1929383013"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.482720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-3b20d24e-6176-4bd0-8f3f-0e6bfde81274 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid fd5be242-001b-4bf6-af97-689a55ae7f0e for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:28.529692 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b20d24e-6176-4bd0-8f3f-0e6bfde81274 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.054289 Aug 30 04:09:28.530926 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 137/255] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:28.545178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1acd6521-11d6-4b9a-9fcd-36c68c9b1c5d tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.548494 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af9c321a-df43-486b-98a7-1f483d862285 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "DELETE /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 204 len: 0 microversion: 2.1 time: 0.250549 Aug 30 04:09:28.549221 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 119/256] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:28 2022] DELETE /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:09:28.556191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-654941"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.570983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.571851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.572689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.573020 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1acd6521-11d6-4b9a-9fcd-36c68c9b1c5d tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1568283911" status: 202 len: 0 microversion: 2.1 time: 0.040030 Aug 30 04:09:28.574047 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 138/257] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:09:28 2022] DELETE /compute/v2.1/flavors/1568283911 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:28.582435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.583079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.583523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.583934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:28.584372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.588152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:28.594300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.594814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.595487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.595971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-654941 could not be found. Aug 30 04:09:28.596739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.597557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.598366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 54 Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:09:28.600568 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: {"add_host": {"host": "tempest-nonexist_host-654941"}} Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:28.602090 n-d-854925-5 devstack@n-api.service[122402]: exception: Compute host tempest-nonexist_host-654941 could not be found. Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-654941'}}} Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-654941' is not mapped to any cell Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.602998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in add_host_to_aggregate Aug 30 04:09:28.604306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-654941 could not be found. Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-654941 could not be found. Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.605685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-654941 could not be found. Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-654941 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36e81f40-895c-4b5d-b451-f8a1defc2e52 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 107 microversion: 2.1 time: 0.053132 Aug 30 04:09:28.607025 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 120/258] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/os-aggregates/13/action => generated 107 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:28.615227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34fe9dd8-3581-4ace-bf45-a17358ee4b82 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.658761 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34fe9dd8-3581-4ace-bf45-a17358ee4b82 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.050256 Aug 30 04:09:28.664469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.664601 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 121/259] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:28 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:28.673640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.673640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.673640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lazy-loading 'fault' on Instance uuid 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:09:28.673936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3596fefb-9735-40cf-889b-d208e28f5542 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.705755 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3596fefb-9735-40cf-889b-d208e28f5542 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.039155 Aug 30 04:09:28.707432 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 122/260] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:28 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:28.715439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce12d63c-ca6d-42d4-868a-4abfde846f80 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-8465082", "id": 1891632374, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.743835 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce12d63c-ca6d-42d4-868a-4abfde846f80 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.035067 Aug 30 04:09:28.750490 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 123/261] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/flavors => generated 426 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:28.757354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a6f843d-85ad-4add-a9a0-cb028b8f801d tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a6f843d-85ad-4add-a9a0-cb028b8f801d tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 283 Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:09:28.767383 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.768607 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:09:28.769277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:28.769933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.770942 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.771765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:09:28.771765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:09:28.771765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:09:28.771765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.771765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a6f843d-85ad-4add-a9a0-cb028b8f801d tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:28.773605 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a6f843d-85ad-4add-a9a0-cb028b8f801d tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.020984 Aug 30 04:09:28.774189 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 124/262] 10.222.0.27 () {60 vars in 1165 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:09:28.778587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d959c512-dcb0-4f7d-8c53-fffcd0674696 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.806573 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d959c512-dcb0-4f7d-8c53-fffcd0674696 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1891632374" status: 202 len: 0 microversion: 2.1 time: 0.031096 Aug 30 04:09:28.807263 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 125/263] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:09:28 2022] DELETE /compute/v2.1/flavors/1891632374 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:28.817350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8e0bbb0-9b6f-4ee8-bbe6-c145f29479cf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8e0bbb0-9b6f-4ee8-bbe6-c145f29479cf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 27 Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:09:28.821170 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: {"aggregate": {"name": ""}} Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:28.822796 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi '' Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:28.823876 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:09:28.825088 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.826173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8e0bbb0-9b6f-4ee8-bbe6-c145f29479cf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:28.826173 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8e0bbb0-9b6f-4ee8-bbe6-c145f29479cf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.014383 Aug 30 04:09:28.826173 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 126/264] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:09:28.829121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d02f1775-31af-4182-b725-a7d8ebdd0750 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.831988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:28.846109 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-474b2799-90ed-4303-8d85-0c9549dd6ade tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1459 microversion: 2.1 time: 0.267772 Aug 30 04:09:28.846607 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 139/265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:28 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1459 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:28.852073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d02f1775-31af-4182-b725-a7d8ebdd0750 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.027350 Aug 30 04:09:28.859214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbcc6ebd-a8dc-4b55-84a0-85a97ed177c5 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-526776471"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.861750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 127/266] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:28 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:28.862563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbcc6ebd-a8dc-4b55-84a0-85a97ed177c5 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '45fa3b065bdf444ca220fc1371022e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a800439e5f34d61ae5272ce62255199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbcc6ebd-a8dc-4b55-84a0-85a97ed177c5 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Request method failure captured: Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 59 Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1wSWDstPlKxBAgTFC79ou2zB3_p3hkFsN8Y6blH9aSJyHDXgDATDXyEHGH1DneLDsiAWBCaQmn7lREe-pQbaqsHE42DuvKNjMw0gSpOOVQqckZJxzC4tU_J2eCMsWljUe_bbU5lvj48kUAegmfEHhv2fmY8DXQ_XtcM9hRON6xYv4 Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:28.864273 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a800439e5f34d61ae5272ce62255199", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}] Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 45fa3b065bdf444ca220fc1371022e81 Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: {"aggregate": {"name": "tempest-test_aggregate-526776471"}} Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:28.865467 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-526776471'}}} Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:28.866196 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:28.867219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 30 04:09:28.869152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.869152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbcc6ebd-a8dc-4b55-84a0-85a97ed177c5 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:28.869152 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbcc6ebd-a8dc-4b55-84a0-85a97ed177c5 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.012473 Aug 30 04:09:28.869152 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 140/267] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:28.871672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44ffa418-6ae5-4626-a026-ef30c4db80d3 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1441362248", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.877905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1752c38d-d336-4478-aea9-82eecc0ae1f6 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-26067786"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.882244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-1752c38d-d336-4478-aea9-82eecc0ae1f6 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid 73c19137-dd99-4c02-94d7-845d029b7105 for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:28.895021 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44ffa418-6ae5-4626-a026-ef30c4db80d3 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.027090 Aug 30 04:09:28.895948 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 128/268] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/flavors => generated 507 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:28.908494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.909316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:28.916624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.917161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.917629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.918363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:28.918773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:28.919195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:28.920514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1752c38d-d336-4478-aea9-82eecc0ae1f6 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.046219 Aug 30 04:09:28.928139 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 141/269] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:28.934009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-13d8574c-427f-4245-8d46-ea9af0c83a84 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:28.959622 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-13d8574c-427f-4245-8d46-ea9af0c83a84 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/4963ad49-f650-4fc6-a923-8b1e11cb396a" status: 202 len: 0 microversion: 2.1 time: 0.029737 Aug 30 04:09:28.963737 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 142/270] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:28 2022] DELETE /compute/v2.1/flavors/4963ad49-f650-4fc6-a923-8b1e11cb396a => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:28.965784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5b15e94-4356-4030-9e09-0aa2a6a5d18e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-26067786"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:28.970255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-b5b15e94-4356-4030-9e09-0aa2a6a5d18e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid 7b16b611-c688-4573-8026-003eb73fba16 for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:28.987037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-b5b15e94-4356-4030-9e09-0aa2a6a5d18e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-26067786 already exists. Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5b15e94-4356-4030-9e09-0aa2a6a5d18e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 58 Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:28.989232 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: {"aggregate": {"name": "tempest-test_aggregate-26067786"}} Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:28.990452 n-d-854925-5 devstack@n-api.service[122403]: exception: Aggregate tempest-test_aggregate-26067786 already exists. Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-26067786'}}} Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6456, in create_aggregate Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 30 04:09:28.991168 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-26067786 already exists. Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:28.992180 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-26067786 already exists. Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-26067786 already exists. Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5b15e94-4356-4030-9e09-0aa2a6a5d18e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-26067786 already exists. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:28.993271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5b15e94-4356-4030-9e09-0aa2a6a5d18e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 409 len: 109 microversion: 2.1 time: 0.030317 Aug 30 04:09:28.995719 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 143/271] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:28 2022] POST /compute/v2.1/os-aggregates => generated 109 bytes in 35 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:09:29.001279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21076e9d-e2f7-42cd-aea7-1b6ef9a7f16b tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.028262 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21076e9d-e2f7-42cd-aea7-1b6ef9a7f16b tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.031369 Aug 30 04:09:29.037356 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 144/272] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:28 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:29.037356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ab2ed6f-29c2-497f-878f-5c31f3155ffc tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.088331 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ab2ed6f-29c2-497f-878f-5c31f3155ffc tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.058202 Aug 30 04:09:29.089380 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 145/273] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:29 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:29.102223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c0d57097-ca15-4444-8809-11096d541a7b tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-416936865", "id": "8c7ec750-6453-49e2-b69c-6803450aef5b", "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:29.124188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:29.130511 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c0d57097-ca15-4444-8809-11096d541a7b tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.034680 Aug 30 04:09:29.133313 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8912511a-eae7-4c6e-a679-2f3b1f5f5b05 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1311 microversion: 2.1 time: 0.229398 Aug 30 04:09:29.134076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 129/274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:28 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:29.139342 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 146/275] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:29 2022] POST /compute/v2.1/flavors => generated 506 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.155763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d81489b3-8f0b-4f82-8cc1-0af16bba4c00 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1279385503"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:29.157202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c210ecf-ffd1-4917-b7b9-a516d39d29c9 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.159874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-d81489b3-8f0b-4f82-8cc1-0af16bba4c00 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid b52226e2-6a86-4594-a1d4-3e9d7b4fce47 for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:29.190449 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c210ecf-ffd1-4917-b7b9-a516d39d29c9 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/8c7ec750-6453-49e2-b69c-6803450aef5b" status: 202 len: 0 microversion: 2.1 time: 0.041489 Aug 30 04:09:29.194314 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 147/276] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:29 2022] DELETE /compute/v2.1/flavors/8c7ec750-6453-49e2-b69c-6803450aef5b => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:29.220951 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d81489b3-8f0b-4f82-8cc1-0af16bba4c00 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067867 Aug 30 04:09:29.222410 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 130/277] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.233309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5eb51a9d-0f93-4c0b-9f90-64e77bc911eb tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.309853 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5eb51a9d-0f93-4c0b-9f90-64e77bc911eb tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.083713 Aug 30 04:09:29.310563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 131/278] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:29.317175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9fbbd77-8615-4041-b004-f2b11327b498 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.319251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c9fbbd77-8615-4041-b004-f2b11327b498 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '45fa3b065bdf444ca220fc1371022e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a800439e5f34d61ae5272ce62255199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9fbbd77-8615-4041-b004-f2b11327b498 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Request method failure captured: Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wSWDstPlKxBAgTFC79ou2zB3_p3hkFsN8Y6blH9aSJyHDXgDATDXyEHGH1DneLDsiAWBCaQmn7lREe-pQbaqsHE42DuvKNjMw0gSpOOVQqckZJxzC4tU_J2eCMsWljUe_bbU5lvj48kUAegmfEHhv2fmY8DXQ_XtcM9hRON6xYv4 Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:29.320976 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a800439e5f34d61ae5272ce62255199", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}] Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 45fa3b065bdf444ca220fc1371022e81 Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 04:09:29.322228 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '15'} Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:29.322921 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 30 04:09:29.324281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.327192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9fbbd77-8615-4041-b004-f2b11327b498 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:29.330471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c9fbbd77-8615-4041-b004-f2b11327b498 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.017700 Aug 30 04:09:29.332373 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 132/279] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:29.339836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3bdb2d0d-026d-4bd3-a79b-028a239d3405 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1397778064", "id": 2011445578, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:29.364322 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3bdb2d0d-026d-4bd3-a79b-028a239d3405 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.030530 Aug 30 04:09:29.365523 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 133/280] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:29 2022] POST /compute/v2.1/flavors => generated 414 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.372512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0db74361-9a28-4414-8e86-f21954d76b50 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.401386 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0db74361-9a28-4414-8e86-f21954d76b50 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.034667 Aug 30 04:09:29.402842 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 134/281] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:29 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:29.408012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-93f681d2-7f00-4980-b6df-41097871c720 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.418793 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-93f681d2-7f00-4980-b6df-41097871c720 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/2011445578" status: 200 len: 414 microversion: 2.1 time: 0.014446 Aug 30 04:09:29.419613 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 135/282] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/flavors/2011445578 => generated 414 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.424431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.425215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:29.432233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19475b19-ee83-4756-b093-48612047b903 tempest-InstanceUsageAuditLogTestJSON-1018692347 tempest-InstanceUsageAuditLogTestJSON-1018692347-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.450606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.451127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.451530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.454552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.455197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.456122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.471689 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19475b19-ee83-4756-b093-48612047b903 tempest-InstanceUsageAuditLogTestJSON-1018692347 tempest-InstanceUsageAuditLogTestJSON-1018692347-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30 04:09:29" status: 200 len: 318 microversion: 2.1 time: 0.279130 Aug 30 04:09:29.472890 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 148/283] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-30%2004%3A09%3A29 => generated 318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.478016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ae4962c-04e4-45aa-b144-b6bcc01f8370 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.491552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0ae4962c-04e4-45aa-b144-b6bcc01f8370 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ae4962c-04e4-45aa-b144-b6bcc01f8370 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:29.493678 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: exception: Aggregate -1 could not be found. Aug 30 04:09:29.494875 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '-1'} Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6515, in delete_aggregate Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 04:09:29.495977 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.497003 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:29.498173 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:29.498173 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:29.498173 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:29.498173 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:29.498173 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 04:09:29.498173 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.501133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ae4962c-04e4-45aa-b144-b6bcc01f8370 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:29.502331 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ae4962c-04e4-45aa-b144-b6bcc01f8370 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.028166 Aug 30 04:09:29.508094 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 149/284] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:29 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:09:29.661679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:29.664655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:29.673105 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2a564e2d-df61-4faf-9fc8-943f97db3322 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1583 microversion: 2.1 time: 0.252410 Aug 30 04:09:29.674253 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 136/285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1583 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:29.679094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b8b4c1f3-7089-4969-8756-558137ef02bd tempest-InstanceUsageAuditLogTestJSON-1018692347 tempest-InstanceUsageAuditLogTestJSON-1018692347-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.700748 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b8b4c1f3-7089-4969-8756-558137ef02bd tempest-InstanceUsageAuditLogTestJSON-1018692347 tempest-InstanceUsageAuditLogTestJSON-1018692347-project-admin] 10.222.0.27 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.025172 Aug 30 04:09:29.701435 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 137/286] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.705933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d7ac003-a7d7-4936-b7ff-db8a9079879e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2066468361"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:29.710040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-6d7ac003-a7d7-4936-b7ff-db8a9079879e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid f0718941-a227-480c-b16a-b847a7f76ef6 for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:29.733567 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d7ac003-a7d7-4936-b7ff-db8a9079879e tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.030997 Aug 30 04:09:29.738941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 138/287] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:29 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.744796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b3e99288-4c1a-4a58-9049-4a7c50b3782a req-709e0ab6-5275-43e4-bc6b-7f35457f75fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1feaf5e3-ffa0-4d63-97fa-34a827c83030", "name": "network-vif-plugged", "status": "completed", "tag": "800ce387-891d-40d8-84a2-2fa64cc25a42"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:29.755172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3e99288-4c1a-4a58-9049-4a7c50b3782a req-709e0ab6-5275-43e4-bc6b-7f35457f75fd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.755645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3e99288-4c1a-4a58-9049-4a7c50b3782a req-709e0ab6-5275-43e4-bc6b-7f35457f75fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.756068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3e99288-4c1a-4a58-9049-4a7c50b3782a req-709e0ab6-5275-43e4-bc6b-7f35457f75fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.769363 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b3e99288-4c1a-4a58-9049-4a7c50b3782a req-709e0ab6-5275-43e4-bc6b-7f35457f75fd service nova] Creating event network-vif-plugged:800ce387-891d-40d8-84a2-2fa64cc25a42 for instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 on n-h2-854925-5 Aug 30 04:09:29.774812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b3e99288-4c1a-4a58-9049-4a7c50b3782a req-709e0ab6-5275-43e4-bc6b-7f35457f75fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033196 Aug 30 04:09:29.775698 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 139/288] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.781458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.782041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:29.784120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8,nova_api:DELETE=10,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:29.787546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-690ecfa8-2bbe-4bb5-87c6-37f1f33d55e7 tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.789897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.790399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.790833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.791535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.792686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.792686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.870509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-690ecfa8-2bbe-4bb5-87c6-37f1f33d55e7 tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6222 microversion: 2.1 time: 0.360722 Aug 30 04:09:29.871227 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 150/289] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/flavors/detail => generated 6222 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:29.877887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9b24325-4af9-475f-81a4-3e5aa1a50fcf tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.879375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b9b24325-4af9-475f-81a4-3e5aa1a50fcf tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '45fa3b065bdf444ca220fc1371022e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a800439e5f34d61ae5272ce62255199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9b24325-4af9-475f-81a4-3e5aa1a50fcf tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Request method failure captured: Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1wSWDstPlKxBAgTFC79ou2zB3_p3hkFsN8Y6blH9aSJyHDXgDATDXyEHGH1DneLDsiAWBCaQmn7lREe-pQbaqsHE42DuvKNjMw0gSpOOVQqckZJxzC4tU_J2eCMsWljUe_bbU5lvj48kUAegmfEHhv2fmY8DXQ_XtcM9hRON6xYv4 Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:29.881624 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a800439e5f34d61ae5272ce62255199", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}] Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 45fa3b065bdf444ca220fc1371022e81 Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 04:09:29.882813 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '16'} Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:29.883468 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:29.885177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9b24325-4af9-475f-81a4-3e5aa1a50fcf tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:29.886156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9b24325-4af9-475f-81a4-3e5aa1a50fcf tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.010835 Aug 30 04:09:29.886156 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 151/290] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:29.890025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:29.890835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:29.899241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.899736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.900585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.901309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.901811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.902287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.957608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:29.958091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:29.958535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:29.959164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lazy-loading 'fault' on Instance uuid 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:09:29.971496 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a6a77634-9963-48f5-a928-315cd82cb912 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194456 Aug 30 04:09:29.979794 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 140/291] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f/os-interface => generated 284 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:29.979794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-197b22f5-1762-42a9-b152-e6e4d851afc9 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.002225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-197b22f5-1762-42a9-b152-e6e4d851afc9 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2011445578" status: 202 len: 0 microversion: 2.1 time: 0.028209 Aug 30 04:09:30.003860 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 141/292] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:09:29 2022] DELETE /compute/v2.1/flavors/2011445578 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:30.010877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d98b5e5-3ee4-4cd9-8992-501a72801abb tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.060354 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d98b5e5-3ee4-4cd9-8992-501a72801abb tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.054232 Aug 30 04:09:30.062675 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 142/293] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:30 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:30.073355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51658d9e-bac8-44b4-a903-66ede4565ee0 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.120431 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51658d9e-bac8-44b4-a903-66ede4565ee0 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.055665 Aug 30 04:09:30.122296 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 143/294] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:30 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:30.130860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c73a1e12-c575-409e-add1-bc42eb29bc1a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.155412 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-c73a1e12-c575-409e-add1-bc42eb29bc1a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c73a1e12-c575-409e-add1-bc42eb29bc1a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:09:30.164369 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: exception: Aggregate -1 could not be found. Aug 30 04:09:30.166148 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '-1'} Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6462, in get_aggregate Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.166844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 30 04:09:30.167910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.169533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c73a1e12-c575-409e-add1-bc42eb29bc1a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:30.169533 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c73a1e12-c575-409e-add1-bc42eb29bc1a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.043061 Aug 30 04:09:30.169533 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 144/295] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:09:30 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:09:30.186981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1f2ed9a-bfd7-4fe5-8e5d-85e497197b72 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-997280120", "id": 1877340888, "os-flavor-access:is_public": "False"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:30.223540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1f2ed9a-bfd7-4fe5-8e5d-85e497197b72 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.053159 Aug 30 04:09:30.224303 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 145/296] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:30 2022] POST /compute/v2.1/flavors => generated 429 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:30.230183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.230461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:30.239582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:30.240077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:30.242560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:30.243887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:30.248665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:30.249554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:30.683367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:30.701554 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1cec7242-daf8-44dc-9dd6-6107f469ef21 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1459 microversion: 2.1 time: 0.816078 Aug 30 04:09:30.703936 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 152/297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:29 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1459 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:30.727701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:30.730983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cc50102-377f-4570-92b0-78a935efc317 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.732961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7cc50102-377f-4570-92b0-78a935efc317 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '45fa3b065bdf444ca220fc1371022e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a800439e5f34d61ae5272ce62255199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cc50102-377f-4570-92b0-78a935efc317 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Request method failure captured: Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1wSWDstPlKxBAgTFC79ou2zB3_p3hkFsN8Y6blH9aSJyHDXgDATDXyEHGH1DneLDsiAWBCaQmn7lREe-pQbaqsHE42DuvKNjMw0gSpOOVQqckZJxzC4tU_J2eCMsWljUe_bbU5lvj48kUAegmfEHhv2fmY8DXQ_XtcM9hRON6xYv4 Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:30.734887 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a800439e5f34d61ae5272ce62255199", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}] Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 45fa3b065bdf444ca220fc1371022e81 Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 04:09:30.736171 n-d-854925-5 devstack@n-api.service[122403]: action_args: {} Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:30.736850 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 30 04:09:30.737947 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.738905 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44561fd9-daa2-4454-9d5b-f513bc5d4bc9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1311 microversion: 2.1 time: 0.512316 Aug 30 04:09:30.741102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cc50102-377f-4570-92b0-78a935efc317 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:30.742598 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cc50102-377f-4570-92b0-78a935efc317 tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.037178 Aug 30 04:09:30.749421 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 153/298] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:09:30 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:30.754188 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 146/299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:30 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1311 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:30.756297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cf85778-1423-4ecd-99b9-7e2b1253572f tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "1877340888"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:30.760794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1bae6611-e06c-4df3-8bb7-f3c3a8bd440d tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1548428211"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:30.764558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-1bae6611-e06c-4df3-8bb7-f3c3a8bd440d tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid 20d0400c-d969-4b25-a46d-edcceb81544d for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:30.774336 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0cf85778-1423-4ecd-99b9-7e2b1253572f tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] HTTP exception thrown: Flavor 1877340888 could not be found. Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cf85778-1423-4ecd-99b9-7e2b1253572f tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] Request method failure captured: Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 107 Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY118KE6E5K9g02V0lNbDrBo9KDoYqKvLdDXE5ushcjSjDW_wyGZSCD2kH6nV1QSQ2qPqQjOOtrLX3kbqk4B1Zf6Z-POUAkhSRdmSoNdSlHg0HV0j_7PNG0OunCcmtdkfczrG1dE4dysYUSQqkpjMUltefmpMNA8i7_OSH1z0kQEK0Y Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4225bf7a104f40fcb88d826b1ec36258 Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsAdminTestJSON-2143724466 Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:30.779128 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4225bf7a104f40fcb88d826b1ec36258", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4225bf7a104f40fcb88d826b1ec36258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4225bf7a104f40fcb88d826b1ec36258"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4225bf7a104f40fcb88d826b1ec36258"}]}] Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsAdminTestJSON-2143724466 Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4225bf7a104f40fcb88d826b1ec36258 Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2143724466 Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsAdminTestJSON-2143724466-project Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 95dda66c560846ad9c353eb19b310dde Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsAdminTestJSON-2143724466-project Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "test", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "1877340888"}} Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:30.781478 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor 1877340888 could not be found. Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '1877340888'}}} Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1877340888 could not be found. Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.782534 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1877340888 could not be found. Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:30.784089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:30.786318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:30.786318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:30.786318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:30.786318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1877340888 could not be found. Aug 30 04:09:30.786318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:30.787374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cf85778-1423-4ecd-99b9-7e2b1253572f tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] Returning 400 to user: Flavor 1877340888 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:30.789480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0cf85778-1423-4ecd-99b9-7e2b1253572f tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.037017 Aug 30 04:09:30.795425 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 154/300] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:30 2022] POST /compute/v2.1/servers => generated 81 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:30.796040 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1bae6611-e06c-4df3-8bb7-f3c3a8bd440d tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040100 Aug 30 04:09:30.797404 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 147/301] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:30 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:30.809802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a839707-da47-42ad-84bb-029fd7cbf48a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:30.816677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ec5a823-7dc8-4c23-bc6e-b1e555512c42 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.828537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a839707-da47-42ad-84bb-029fd7cbf48a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:30.829593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a839707-da47-42ad-84bb-029fd7cbf48a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:30.830305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a839707-da47-42ad-84bb-029fd7cbf48a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:30.859199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7ec5a823-7dc8-4c23-bc6e-b1e555512c42 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1877340888" status: 202 len: 0 microversion: 2.1 time: 0.062052 Aug 30 04:09:30.859954 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 155/302] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:09:30 2022] DELETE /compute/v2.1/flavors/1877340888 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:30.874125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-13d21625-3379-4e78-9e79-8a3ff1981354 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:30.955503 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-13d21625-3379-4e78-9e79-8a3ff1981354 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.090456 Aug 30 04:09:30.960968 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 156/303] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:30 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:30.985316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5f5a9fea-d014-4957-ac7f-b7c68e96cab2 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-305925879", "id": 804739911, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:31.026208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5f5a9fea-d014-4957-ac7f-b7c68e96cab2 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.047085 Aug 30 04:09:31.026943 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 157/304] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:30 2022] POST /compute/v2.1/flavors => generated 411 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.040744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5edc09b3-7ec2-4a58-85db-1c271de3301c tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1670957657", "id": 1860202255, "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:31.052391 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a839707-da47-42ad-84bb-029fd7cbf48a tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 243 microversion: 2.1 time: 0.245837 Aug 30 04:09:31.053468 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 148/305] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:30 2022] POST /compute/v2.1/os-aggregates/17/action => generated 243 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:31.066752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9959e799-f90c-46a7-8cc3-1983135bb22b tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:31.072695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9959e799-f90c-46a7-8cc3-1983135bb22b tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '45fa3b065bdf444ca220fc1371022e81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a800439e5f34d61ae5272ce62255199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:31.077677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5edc09b3-7ec2-4a58-85db-1c271de3301c tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.042951 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9959e799-f90c-46a7-8cc3-1983135bb22b tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Request method failure captured: Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 42 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wSWDstPlKxBAgTFC79ou2zB3_p3hkFsN8Y6blH9aSJyHDXgDATDXyEHGH1DneLDsiAWBCaQmn7lREe-pQbaqsHE42DuvKNjMw0gSpOOVQqckZJxzC4tU_J2eCMsWljUe_bbU5lvj48kUAegmfEHhv2fmY8DXQ_XtcM9hRON6xYv4 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:31.080082 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5a800439e5f34d61ae5272ce62255199", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5a800439e5f34d61ae5272ce62255199"}]}] Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 5a800439e5f34d61ae5272ce62255199 Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396 Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 45fa3b065bdf444ca220fc1371022e81 Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2100722396-project Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: {"remove_host": {"host": "n-h2-854925-5"}} Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:31.081267 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-854925-5'}}} Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:31.082025 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 30 04:09:31.083049 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.084071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9959e799-f90c-46a7-8cc3-1983135bb22b tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:31.084071 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9959e799-f90c-46a7-8cc3-1983135bb22b tempest-AggregatesAdminNegativeTestJSON-2100722396 tempest-AggregatesAdminNegativeTestJSON-2100722396-project] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.020550 Aug 30 04:09:31.084071 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 149/306] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:31.094195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-810bd521-e3c8-4ee3-bf84-dec4ba06f097 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:31.100134 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 158/307] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.112616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-653ea766-9a9e-4df9-afee-a09bb785c564 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.135812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-810bd521-e3c8-4ee3-bf84-dec4ba06f097 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.138131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-810bd521-e3c8-4ee3-bf84-dec4ba06f097 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.139445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-810bd521-e3c8-4ee3-bf84-dec4ba06f097 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.148105 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-653ea766-9a9e-4df9-afee-a09bb785c564 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.040099 Aug 30 04:09:31.152183 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 159/308] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.161163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f12c056-7f0d-45f1-ac87-cc53c62ffdb5 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.190039 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f12c056-7f0d-45f1-ac87-cc53c62ffdb5 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.026712 Aug 30 04:09:31.191026 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 160/309] 10.222.0.27 () {58 vars in 1177 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:31.205728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a47b209f-68c6-4711-8ced-a0a15ed705ce tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.220929 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a47b209f-68c6-4711-8ced-a0a15ed705ce tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.019325 Aug 30 04:09:31.221550 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 161/310] 10.222.0.27 () {58 vars in 1171 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.242215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52cd131c-55f8-4ccd-ab95-a56b553f9610 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.278808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52cd131c-55f8-4ccd-ab95-a56b553f9610 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.042876 Aug 30 04:09:31.279635 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 162/311] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.310018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6276ee4a-f7a5-475f-ba92-ecaeb0e1bbde tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.350761 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-810bd521-e3c8-4ee3-bf84-dec4ba06f097 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.262519 Aug 30 04:09:31.351725 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 150/312] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:31 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.366979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ec4aacd-c768-402b-bcaa-1d83a25ec9ae tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.391777 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6276ee4a-f7a5-475f-ba92-ecaeb0e1bbde tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6222 microversion: 2.1 time: 0.093124 Aug 30 04:09:31.409381 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 163/313] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:31.429021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd49c7e6-774e-4fa1-aa9b-88b2d0bfc0cf tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.435973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ec4aacd-c768-402b-bcaa-1d83a25ec9ae tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.073134 Aug 30 04:09:31.437458 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 151/314] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:31 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 30 04:09:31.465545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d539d515-1e9c-42b2-ab8e-b857b71eb737 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1538295968"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:31.481434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.aggregate [None req-d539d515-1e9c-42b2-ab8e-b857b71eb737 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Generated uuid e1596f3e-ceb3-4c14-bff8-2ad75d836491 for aggregate {{(pid=122402) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:09:31.509807 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd49c7e6-774e-4fa1-aa9b-88b2d0bfc0cf tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6222 microversion: 2.1 time: 0.088573 Aug 30 04:09:31.511847 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 164/315] 10.222.0.27 () {58 vars in 1175 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:31.542034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-32595380-8e70-46b4-8b74-c093dce66a9a tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.548806 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d539d515-1e9c-42b2-ab8e-b857b71eb737 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.103101 Aug 30 04:09:31.550072 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 152/316] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:09:31 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.566998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:31.581724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-32595380-8e70-46b4-8b74-c093dce66a9a tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6222 microversion: 2.1 time: 0.048364 Aug 30 04:09:31.595365 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 165/317] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6222 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:31.603973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1edda40d-6375-4096-b899-f785ccc8ed98 req-10307d29-e460-4256-99e6-6bbe68999c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023290fc-bfc6-4efb-8fec-b2d8ebad9d5a", "name": "network-vif-deleted", "tag": "0caa6ac9-7795-4063-8f92-7b6de9fdd2da"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:31.613932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.616316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.618477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.619365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1edda40d-6375-4096-b899-f785ccc8ed98 req-10307d29-e460-4256-99e6-6bbe68999c55 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.620081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1edda40d-6375-4096-b899-f785ccc8ed98 req-10307d29-e460-4256-99e6-6bbe68999c55 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.620722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1edda40d-6375-4096-b899-f785ccc8ed98 req-10307d29-e460-4256-99e6-6bbe68999c55 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.635002 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1edda40d-6375-4096-b899-f785ccc8ed98 req-10307d29-e460-4256-99e6-6bbe68999c55 service nova] Creating event network-vif-deleted:0caa6ac9-7795-4063-8f92-7b6de9fdd2da for instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a on n-h2-854925-5 Aug 30 04:09:31.638010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.638697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.642998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.644425 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1edda40d-6375-4096-b899-f785ccc8ed98 req-10307d29-e460-4256-99e6-6bbe68999c55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046400 Aug 30 04:09:31.648755 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 166/318] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:31.661648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0bcd6a55-3291-4293-916d-d92282f59449 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.667814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.compute.aggregates [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 04:09:31.668683 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Request method failure captured: Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 42 Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1wvWR-oS2AmbAyNq-SPkiS5p7_gRKgGYVd6C4gIstnDe6BPWybhQqtJvEd3LiZqfULLivjRAHDJJvPFFYFZxD2CprIdaFPV_2Mu2yA4zZ5tj4RWfIsb6wb5vt7P1s4f7uX-5jvRw3QA_QKLc9kvz8QeHOnFAYmgCIwKAdwPl-JQo4 Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:09:31.671683 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c67ef062bc1d419f96c13852a870725a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c67ef062bc1d419f96c13852a870725a"}]}] Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c67ef062bc1d419f96c13852a870725a Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-556208178 Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b2fa6b0cffe340a6848fdb6c611ae6ee Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: {"remove_host": {"host": "nonexist_host"}} Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:31.673844 n-d-854925-5 devstack@n-api.service[122402]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5997, in _get_service_in_cell_by_host Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6003, in _get_service_in_cell_by_host Aug 30 04:09:31.674585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6681, in remove_host_from_aggregate Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 30 04:09:31.675637 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.680005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:31.683122 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:31.683122 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:31.683122 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:31.683122 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:31.683122 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 30 04:09:31.683122 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:31.686001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:31.687744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b766d78-7a31-42fb-924a-7955b25d4591 tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.130544 Aug 30 04:09:31.688733 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 153/319] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:09:31 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:09:31.716726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d4b993c-1f11-4c8e-beb8-e6f833d0fcdf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.736582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0bcd6a55-3291-4293-916d-d92282f59449 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6222 microversion: 2.1 time: 0.085829 Aug 30 04:09:31.753384 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 167/320] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:31.760041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.761006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:31.769868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.770370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.770808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.772770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.773458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.773933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.803219 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3d4b993c-1f11-4c8e-beb8-e6f833d0fcdf tempest-AggregatesAdminNegativeTestJSON-556208178 tempest-AggregatesAdminNegativeTestJSON-556208178-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.109455 Aug 30 04:09:31.806832 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 154/321] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:09:31 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:31.836197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e0f4f5fd-7c03-48bc-9176-f8a62907ee5e tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.837641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.838841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.841418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.843082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lazy-loading 'fault' on Instance uuid 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:09:31.872143 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e0f4f5fd-7c03-48bc-9176-f8a62907ee5e tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1860202255" status: 202 len: 0 microversion: 2.1 time: 0.063731 Aug 30 04:09:31.873122 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 155/322] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:09:31 2022] DELETE /compute/v2.1/flavors/1860202255 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:31.882931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:31.883853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:31.894122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.894913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.895423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:31.896256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:31.896765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:31.897483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:32.069147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edfece7a34f54de5a9b74fdc650321cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ace36fb5a6e840e18fb8ea79f0525628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:32.080783 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7995af0-e4cd-4fbe-9a1f-eb482d69ea4c tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 200 len: 1417 microversion: 2.1 time: 0.325049 Aug 30 04:09:32.094640 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 168/323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 1417 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:32.103358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06f266a6-4727-416d-b15a-6b75f0ea0071 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:32.148256 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06f266a6-4727-416d-b15a-6b75f0ea0071 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.052437 Aug 30 04:09:32.149426 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 169/324] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:32 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:32.169720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-204b6f8b-255c-4336-9d7f-c309e1b292e1 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:32.193023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-204b6f8b-255c-4336-9d7f-c309e1b292e1 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/804739911" status: 202 len: 0 microversion: 2.1 time: 0.027221 Aug 30 04:09:32.196213 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 170/325] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:09:32 2022] DELETE /compute/v2.1/flavors/804739911 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:09:32.208875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-67c36511-dd34-4b8a-93f0-6662a5f27ab8 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:32.245158 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-67c36511-dd34-4b8a-93f0-6662a5f27ab8 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.045257 Aug 30 04:09:32.247115 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 171/326] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:32 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:32.258976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:32.268145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c37c8060-7e4e-45a6-965f-3f51cbb1b8fe tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1703559753", "id": 998170472, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:32.272339 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c2db9246-bf00-4b88-8e2c-cc36e3a8dc62 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1495 microversion: 2.1 time: 0.394371 Aug 30 04:09:32.275907 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 156/327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:31 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1495 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:32.304403 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c37c8060-7e4e-45a6-965f-3f51cbb1b8fe tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.040870 Aug 30 04:09:32.305354 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 172/328] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:32 2022] POST /compute/v2.1/flavors => generated 412 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:32.849996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-565698399", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:32.874175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:32.877273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:32.892165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:32.895657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:32.899218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:32.901715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:32.911549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:32.913922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:32.918145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=5,nova_api:DELETE=14 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:32.988514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:09:33.160176 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ac8e8a3-c66f-4013-a9e2-51d85ce0d44a tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1646 microversion: 2.1 time: 0.864420 Aug 30 04:09:33.163774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 157/329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:32 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1646 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:33.173586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fba6a9cb-9cd8-4066-8b6e-ea77e1187a91 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:33.220320 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fba6a9cb-9cd8-4066-8b6e-ea77e1187a91 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.055843 Aug 30 04:09:33.220929 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 158/330] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:33 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:33.230244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:33.231050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:33.246627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.250138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.250588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.251321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.251784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.252219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.369637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:09:33.370122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:09:33.370892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:09:33.371394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:09:33.371817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:09:33.389243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.392785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.393581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.395425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.397174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.399987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.444018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:33.458723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for user 7ead040764484d059aa9a82f0714373f and project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:33.492923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:09:33.498911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:09:33.564637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:33.579756 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82d61668-b080-4ed3-ab95-51dd880df642 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 200 len: 1583 microversion: 2.1 time: 0.352939 Aug 30 04:09:33.598689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 159/331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:33 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 1583 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:33.625430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b3e97061-20e6-405e-bd48-1a33434c083c req-f2dfddd6-7f34-48fc-8c62-44e65cabc2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7921f451-2ab5-4c56-8efe-31230544542f", "tag": "d2517cf5-e55a-4cec-b014-eabf985f3f86"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:33.631849 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31a47b83-5873-4af1-aabe-45997c15956c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318895 Aug 30 04:09:33.639866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3e97061-20e6-405e-bd48-1a33434c083c req-f2dfddd6-7f34-48fc-8c62-44e65cabc2a4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.641575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3e97061-20e6-405e-bd48-1a33434c083c req-f2dfddd6-7f34-48fc-8c62-44e65cabc2a4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.642197 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 173/332] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:09:33.642853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3e97061-20e6-405e-bd48-1a33434c083c req-f2dfddd6-7f34-48fc-8c62-44e65cabc2a4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.653642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:33.654277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:33.670776 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b3e97061-20e6-405e-bd48-1a33434c083c req-f2dfddd6-7f34-48fc-8c62-44e65cabc2a4 service nova] Creating event network-changed:d2517cf5-e55a-4cec-b014-eabf985f3f86 for instance 7921f451-2ab5-4c56-8efe-31230544542f on n-h1-854925-5 Aug 30 04:09:33.677797 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b3e97061-20e6-405e-bd48-1a33434c083c req-f2dfddd6-7f34-48fc-8c62-44e65cabc2a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076617 Aug 30 04:09:33.678562 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 160/333] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:33.685270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:33.686061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:33.692654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.695179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.695670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.696100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.696985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.697476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.697829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.698078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.698287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.699602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:33.700934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:33.702676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:33.775297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] HTTP exception thrown: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Request method failure captured: Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a HTTP/1.1 Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY0yu0BmcHzYcCQaEGvq41T3BDBTN_OgDRz94g-A4ZBfkpBAsCB9yvSFtoMr81mezT-S-b3O7z-MgpHB1mtzljve66TxZvDoaBTJPks2MfM8N20H_TL4ChtOtLP1ycLejTqotcNNLMRI4iE1qTPLpvMhzDd9CWSO-8YhCUVgws2bxH0 Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:33.777799 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ace36fb5a6e840e18fb8ea79f0525628", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}] Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: edfece7a34f54de5a9b74fdc650321cd Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:33.779036 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '023290fc-bfc6-4efb-8fec-b2d8ebad9d5a'} Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:33.779708 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:33.780844 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:33.783565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Returning 404 to user: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:33.787839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-078fff2f-b62f-4a04-b2f4-5321b39cec66 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 404 len: 111 microversion: 2.1 time: 0.142120 Aug 30 04:09:33.798135 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 174/334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:33 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:33.805732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0468f944-8416-43df-af82-e14e3de53093 tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:33.890059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0468f944-8416-43df-af82-e14e3de53093 tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.090513 Aug 30 04:09:33.905970 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 175/335] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:33 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:33.911471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79a53f98-e8c8-4b2d-a32f-83d0eb1e19ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:33.913669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79a53f98-e8c8-4b2d-a32f-83d0eb1e19ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:34.023137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79a53f98-e8c8-4b2d-a32f-83d0eb1e19ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:34.031521 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79a53f98-e8c8-4b2d-a32f-83d0eb1e19ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1212 microversion: 2.1 time: 0.124043 Aug 30 04:09:34.051954 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 176/336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:33 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1212 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:34.062453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.063519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:34.079825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f544685b-2786-4c37-adb0-1ae129575fee tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1646 microversion: 2.1 time: 0.399286 Aug 30 04:09:34.080594 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 161/337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:33 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1646 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:34.088151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.088662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.089107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.089847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.090306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.090735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.101043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d2e428f-10b8-481e-8625-95179c627637 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.115143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:34.128867 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d2e428f-10b8-481e-8625-95179c627637 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/998170472" status: 202 len: 0 microversion: 2.1 time: 0.033775 Aug 30 04:09:34.129741 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 162/338] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:09:34 2022] DELETE /compute/v2.1/flavors/998170472 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:34.136867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.138939 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] HTTP exception thrown: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Request method failure captured: Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a HTTP/1.1 Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY0yu0BmcHzYcCQaEGvq41T3BDBTN_OgDRz94g-A4ZBfkpBAsCB9yvSFtoMr81mezT-S-b3O7z-MgpHB1mtzljve66TxZvDoaBTJPks2MfM8N20H_TL4ChtOtLP1ycLejTqotcNNLMRI4iE1qTPLpvMhzDd9CWSO-8YhCUVgws2bxH0 Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:34.140523 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ace36fb5a6e840e18fb8ea79f0525628", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}] Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: edfece7a34f54de5a9b74fdc650321cd Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.141757 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '023290fc-bfc6-4efb-8fec-b2d8ebad9d5a'} Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:34.142495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.143560 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.148692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Returning 404 to user: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:34.148859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.148859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.148859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.148859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.149508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.149508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.156285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79bdfbe0-619d-4f8c-b0c2-4b76ea66ffc4 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "DELETE /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 404 len: 111 microversion: 2.1 time: 0.102394 Aug 30 04:09:34.156887 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 177/339] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:34 2022] DELETE /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:34.165259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d425e3bc-83ab-4a84-ba87-27e18ba7184d tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.203921 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6125a32-697d-4dcf-a1d3-c175263d569d tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.071519 Aug 30 04:09:34.212300 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 163/340] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:09:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:34.218558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.219481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:34.223292 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d425e3bc-83ab-4a84-ba87-27e18ba7184d tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.065262 Aug 30 04:09:34.223893 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 178/341] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:34 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:34.227488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.228151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.229081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.229975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.230427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.231314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.236678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854925-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:34.239100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:34.251456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] HTTP exception thrown: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Request method failure captured: Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a HTTP/1.1 Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY0yu0BmcHzYcCQaEGvq41T3BDBTN_OgDRz94g-A4ZBfkpBAsCB9yvSFtoMr81mezT-S-b3O7z-MgpHB1mtzljve66TxZvDoaBTJPks2MfM8N20H_TL4ChtOtLP1ycLejTqotcNNLMRI4iE1qTPLpvMhzDd9CWSO-8YhCUVgws2bxH0 Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:34.254699 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ace36fb5a6e840e18fb8ea79f0525628", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}] Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: edfece7a34f54de5a9b74fdc650321cd Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.256394 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '023290fc-bfc6-4efb-8fec-b2d8ebad9d5a'} Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:34.257065 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. Aug 30 04:09:34.258654 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.260251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Returning 404 to user: Instance 023290fc-bfc6-4efb-8fec-b2d8ebad9d5a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:34.260701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.260701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.260701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.261916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.262013 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee30fc67-18ed-4dce-b87e-45197682b6f0 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a" status: 404 len: 111 microversion: 2.1 time: 0.046752 Aug 30 04:09:34.262101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.262270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.264971 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 164/342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:34 2022] GET /compute/v2.1/servers/023290fc-bfc6-4efb-8fec-b2d8ebad9d5a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:34.272733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ca57551-de09-4ac8-aee3-5ecd7c65dc89 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-16806212", "id": 800977109, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:34.308407 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ca57551-de09-4ac8-aee3-5ecd7c65dc89 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.039300 Aug 30 04:09:34.312091 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 165/343] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:34.319267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.319768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:34.340908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.345956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.346625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.348146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.350584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.353130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.426353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] HTTP exception thrown: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Request method failure captured: Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac HTTP/1.1 Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY0yu0BmcHzYcCQaEGvq41T3BDBTN_OgDRz94g-A4ZBfkpBAsCB9yvSFtoMr81mezT-S-b3O7z-MgpHB1mtzljve66TxZvDoaBTJPks2MfM8N20H_TL4ChtOtLP1ycLejTqotcNNLMRI4iE1qTPLpvMhzDd9CWSO-8YhCUVgws2bxH0 Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:34.428618 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ace36fb5a6e840e18fb8ea79f0525628", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}] Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: edfece7a34f54de5a9b74fdc650321cd Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.429941 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '882849b7-c019-4ea5-aa15-c54d74be15ac'} Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:34.430628 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.431679 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.432936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Returning 404 to user: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:34.432936 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36865056-afe5-428d-af46-f7ca6d5a81af tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "DELETE /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 404 len: 111 microversion: 2.1 time: 0.115493 Aug 30 04:09:34.434971 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 166/344] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:34 2022] DELETE /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:34.440961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-35ce54d5-f2bd-4ab0-8e2f-d5894d5b8aa3 tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.491597 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-35ce54d5-f2bd-4ab0-8e2f-d5894d5b8aa3 tempest-FlavorsAdminTestJSON-2143724466 tempest-FlavorsAdminTestJSON-2143724466-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.054639 Aug 30 04:09:34.492445 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 167/345] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:34 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:34.498474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.499297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] [instance: 882849b7-c019-4ea5-aa15-c54d74be15ac] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:34.501467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=16,nova_api:INSERT=5 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:34.506751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.507429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.508810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.509961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:34.511163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:34.511834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:34.538226 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] HTTP exception thrown: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Request method failure captured: Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac HTTP/1.1 Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY0yu0BmcHzYcCQaEGvq41T3BDBTN_OgDRz94g-A4ZBfkpBAsCB9yvSFtoMr81mezT-S-b3O7z-MgpHB1mtzljve66TxZvDoaBTJPks2MfM8N20H_TL4ChtOtLP1ycLejTqotcNNLMRI4iE1qTPLpvMhzDd9CWSO-8YhCUVgws2bxH0 Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:09:34.540803 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ace36fb5a6e840e18fb8ea79f0525628", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ace36fb5a6e840e18fb8ea79f0525628"}]}] Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ace36fb5a6e840e18fb8ea79f0525628 Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1383429278 Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: edfece7a34f54de5a9b74fdc650321cd Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersAdminTestJSON-1383429278-project Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.542181 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '882849b7-c019-4ea5-aa15-c54d74be15ac'} Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:34.543021 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. Aug 30 04:09:34.544140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:09:34.548889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] Returning 404 to user: Instance 882849b7-c019-4ea5-aa15-c54d74be15ac could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:34.560220 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a54a7f1e-a9c5-42cf-8e97-e6fbd0882a74 tempest-DeleteServersAdminTestJSON-1383429278 tempest-DeleteServersAdminTestJSON-1383429278-project] 10.222.0.27 "GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac" status: 404 len: 111 microversion: 2.1 time: 0.066212 Aug 30 04:09:34.565593 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 168/346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:34 2022] GET /compute/v2.1/servers/882849b7-c019-4ea5-aa15-c54d74be15ac => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:34.571704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8cdf958a-e51f-468d-ba1b-ff2572b1af8d tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.599082 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8cdf958a-e51f-468d-ba1b-ff2572b1af8d tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/800977109" status: 202 len: 0 microversion: 2.1 time: 0.032051 Aug 30 04:09:34.601371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 169/347] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:09:34 2022] DELETE /compute/v2.1/flavors/800977109 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:34.611897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8b2e4084-2f20-45b6-b9fc-643396ea76d8 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:34.642609 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8b2e4084-2f20-45b6-b9fc-643396ea76d8 tempest-FlavorsAdminTestJSON-1695537344 tempest-FlavorsAdminTestJSON-1695537344-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.036327 Aug 30 04:09:34.643583 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 170/348] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:34 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:35.259020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lazy-loading 'flavor' on Instance uuid 1feaf5e3-ffa0-4d63-97fa-34a827c83030 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:09:35.309993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Going to try to live migrate instance to n-h1-854925-5 {{(pid=122403) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:09:35.348133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-429761926", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": "none"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:35.428361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:09:35.428861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:09:35.430059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:09:35.431415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:09:35.433130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:09:35.450020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:35.450615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:35.451116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:35.451915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:35.452532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:35.453732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:35.481893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Getting quotas for project d2f6317237414bfaa2620e4aed248f9e. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:35.489321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Getting quotas for user 307eec7d0fcc497ca7599e3c6a9ef37b and project d2f6317237414bfaa2620e4aed248f9e. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:35.503531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:09:35.505996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:09:35.586295 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ec09c6b-707f-4ca7-a26d-e3b74634de6b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.940815 Aug 30 04:09:35.586940 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 171/349] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:09:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:09:35.602247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:35.603883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:35.628598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:35.631500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:35.632084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:35.634195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:35.637666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:35.638694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:35.778601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:35.790309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ae32d6b-0e18-4c84-951c-5210961a947f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1272 microversion: 2.1 time: 0.196492 Aug 30 04:09:35.805890 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 172/350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:35 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:35.812027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-505de415-7ad4-4520-8f3a-e7c3a2e18b07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:35.816068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-505de415-7ad4-4520-8f3a-e7c3a2e18b07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:35.957484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-505de415-7ad4-4520-8f3a-e7c3a2e18b07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:35.971011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-505de415-7ad4-4520-8f3a-e7c3a2e18b07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:35.972833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-505de415-7ad4-4520-8f3a-e7c3a2e18b07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:35.982971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-505de415-7ad4-4520-8f3a-e7c3a2e18b07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "PUT /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1358 microversion: 2.75 time: 0.175848 Aug 30 04:09:35.984121 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 173/351] 10.222.0.27 () {62 vars in 1297 bytes} [Tue Aug 30 04:09:35 2022] PUT /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:36.011621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e45ea517-ed47-4ad5-b1f7-90334546b701 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:36.012353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e45ea517-ed47-4ad5-b1f7-90334546b701 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:36.109773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e45ea517-ed47-4ad5-b1f7-90334546b701 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:36.136760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e45ea517-ed47-4ad5-b1f7-90334546b701 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:36.154633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e45ea517-ed47-4ad5-b1f7-90334546b701 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:36.171391 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e45ea517-ed47-4ad5-b1f7-90334546b701 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1358 microversion: 2.75 time: 0.163998 Aug 30 04:09:36.175463 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 174/352] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:36 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:36.814767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:36.815391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:36.827403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:36.829626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:36.830863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:36.832151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:36.832944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:36.833773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:36.934832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:36.946314 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0554cd67-5bea-469d-b9cc-7f087402faed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1270 microversion: 2.1 time: 0.137359 Aug 30 04:09:36.949943 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 175/353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:36 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:37.199163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:37.201142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:37.225259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:37.225808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:37.227078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:37.227829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:37.228291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:37.228717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:37.425765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:37.443965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:37.445832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:37.452446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-41eea20c-8e5e-4d66-a464-83a20180f67a tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1410 microversion: 2.75 time: 0.257621 Aug 30 04:09:37.454380 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 176/354] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:37 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1410 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:37.976232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:37.978919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:37.988127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:37.988697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:37.989229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:37.990425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:37.991376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:37.992010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:38.181695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:38.193103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e9c5a99-c050-4200-a382-4bb647e20800 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1312 microversion: 2.1 time: 0.224226 Aug 30 04:09:38.209625 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 177/355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:37 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:38.348034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6eff7360-758a-4679-b715-2795d3484c86 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Action: 'create', calling method: .version_select at 0x7fe96aa4d280>, body: {"keypair": {"name": "tempest-keypair-505766701", "type": "ssh", "user_id": "cb78cd0b46a04bdc9994eb752354d5e9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsoPKWQwQ1SgU0Rp1yFQ5C/GilB8nkidoc0SLNJS+oEkXuINVNL8XmkjlWprCui0FKGPB+uGBHcupDv64WgH0ygeChtsjKihocPs1s9LDbZQbaU5vx4BXcZJ0COkMO+lw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:38.384243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6eff7360-758a-4679-b715-2795d3484c86 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Getting quotas for project 87018246c71b42859a8e70fd4dfbe309. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:38.389832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6eff7360-758a-4679-b715-2795d3484c86 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Getting quotas for user 31019e8b39e9431bb1d73e88f38d4181 and project 87018246c71b42859a8e70fd4dfbe309. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:38.423239 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6eff7360-758a-4679-b715-2795d3484c86 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.212182 Aug 30 04:09:38.423844 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 178/356] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:09:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 214 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:09:38.428789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3dedb9d4-d689-405d-995e-dd3d452a07c6 req-cd64d66e-9a8f-4c93-80a3-a2c5f58c018b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5b231b-2496-4cc0-a8c9-908714605d2b", "tag": "ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:38.441101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3dedb9d4-d689-405d-995e-dd3d452a07c6 req-cd64d66e-9a8f-4c93-80a3-a2c5f58c018b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:38.441702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3dedb9d4-d689-405d-995e-dd3d452a07c6 req-cd64d66e-9a8f-4c93-80a3-a2c5f58c018b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:38.442205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3dedb9d4-d689-405d-995e-dd3d452a07c6 req-cd64d66e-9a8f-4c93-80a3-a2c5f58c018b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:38.456935 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3dedb9d4-d689-405d-995e-dd3d452a07c6 req-cd64d66e-9a8f-4c93-80a3-a2c5f58c018b service nova] Creating event network-changed:ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748 for instance 5f5b231b-2496-4cc0-a8c9-908714605d2b on n-h2-854925-5 Aug 30 04:09:38.464785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3dedb9d4-d689-405d-995e-dd3d452a07c6 req-cd64d66e-9a8f-4c93-80a3-a2c5f58c018b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038340 Aug 30 04:09:38.465828 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 179/357] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:38.472719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-020610d3-a004-40e4-a619-84c17ed5b100 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Action: 'create', calling method: .version_select at 0x7fe96ab13a60>, body: {"keypair": {"name": "tempest-keypair-1253393855", "type": "ssh", "user_id": "cb78cd0b46a04bdc9994eb752354d5e9", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuitxO3uZmw/BEw28lrHAtw/1fOLn7aREtCufomrmF8VspszdfXczjsdL0x5OETlqLCdhmllnxAIHWUUcAXw7IeVLeqdqiJ4MfyECy4J2sV2K3VuMviD3j70epm3G+RKA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:38.491566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-020610d3-a004-40e4-a619-84c17ed5b100 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Getting quotas for project 87018246c71b42859a8e70fd4dfbe309. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:38.507049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-020610d3-a004-40e4-a619-84c17ed5b100 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Getting quotas for user 31019e8b39e9431bb1d73e88f38d4181 and project 87018246c71b42859a8e70fd4dfbe309. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:38.543934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-020610d3-a004-40e4-a619-84c17ed5b100 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.076485 Aug 30 04:09:38.544548 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 180/358] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:09:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:09:38.550437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:38.551404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:38.557895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:38.558673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:38.559261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:38.560114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:38.560718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:38.561300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:38.643621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:38.652494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:38.654209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:38.660864 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a6c65ced-3af2-48d6-803b-35d91b276060 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1416 microversion: 2.75 time: 0.114861 Aug 30 04:09:38.661918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 181/359] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:38 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1416 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:38.667329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6bd3ad48-68c7-4999-9742-fa05fab1cbeb tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Calling method '.version_select at 0x7fe96ab135e0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:38.680268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6bd3ad48-68c7-4999-9742-fa05fab1cbeb tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-505766701?user_id=cb78cd0b46a04bdc9994eb752354d5e9" status: 200 len: 511 microversion: 2.10 time: 0.017075 Aug 30 04:09:38.681185 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 182/360] 10.222.0.27 () {60 vars in 1337 bytes} [Tue Aug 30 04:09:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-505766701?user_id=cb78cd0b46a04bdc9994eb752354d5e9 => generated 511 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:38.698645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-798341a4-ca8f-437a-9f8f-c297ff65cce8 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Action: 'create', calling method: .version_select at 0x7fe96ab134c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-2071243220", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw2uQb53I16FDrGJ7N91txCj+HgBpllEb0K91BimQWf+YbR8wX3yT9hsjZq6VUAv7Zsh6upCBr0XLHLCYL4Ngw6Nh91g0z032e39BSnovRH7Nxdiav8ic4bFiL39GAjqw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:38.726923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-798341a4-ca8f-437a-9f8f-c297ff65cce8 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Getting quotas for project 87018246c71b42859a8e70fd4dfbe309. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:38.732725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-798341a4-ca8f-437a-9f8f-c297ff65cce8 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Getting quotas for user 31019e8b39e9431bb1d73e88f38d4181 and project 87018246c71b42859a8e70fd4dfbe309. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:38.766687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-798341a4-ca8f-437a-9f8f-c297ff65cce8 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.071780 Aug 30 04:09:38.768425 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 183/361] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:09:38 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 75 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:09:38.783158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c80d72c-d212-4ac1-ba3e-fa6b1023d565 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Calling method '.version_select at 0x7fe96a9bfb80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:38.788079 n-d-854925-5 devstack@n-api.service[122402]: WARNING oslo_db.sqlalchemy.utils [None req-0c80d72c-d212-4ac1-ba3e-fa6b1023d565 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 04:09:38.809827 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c80d72c-d212-4ac1-ba3e-fa6b1023d565 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "GET /compute/v2.1/os-keypairs?user_id=cb78cd0b46a04bdc9994eb752354d5e9" status: 200 len: 725 microversion: 2.10 time: 0.034847 Aug 30 04:09:38.818439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 184/362] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Aug 30 04:09:38 2022] GET /compute/v2.1/os-keypairs?user_id=cb78cd0b46a04bdc9994eb752354d5e9 => generated 725 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:09:38.824460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-85781369-81d9-4f10-af16-2724d32b8f51 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Calling method '.version_select at 0x7fe96a9bf430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:38.847069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:38.880455 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-85781369-81d9-4f10-af16-2724d32b8f51 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2071243220" status: 204 len: 0 microversion: 2.10 time: 0.060343 Aug 30 04:09:38.885471 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 185/363] 10.222.0.27 () {60 vars in 1325 bytes} [Tue Aug 30 04:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-2071243220 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:09:38.892498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f83ef44-97f5-453e-b065-cbc413f2ccf2 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Calling method '.version_select at 0x7fe96aa4e940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:38.929148 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f83ef44-97f5-453e-b065-cbc413f2ccf2 tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253393855?user_id=cb78cd0b46a04bdc9994eb752354d5e9" status: 204 len: 0 microversion: 2.10 time: 0.040913 Aug 30 04:09:38.933389 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 186/364] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253393855?user_id=cb78cd0b46a04bdc9994eb752354d5e9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:09:38.942327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2a7d97e-ebbf-4b1c-95de-81ff7c228b0b tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] Calling method '.version_select at 0x7fe96aa84700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:38.975848 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2a7d97e-ebbf-4b1c-95de-81ff7c228b0b tempest-KeyPairsV210TestJSON-1970348817 tempest-KeyPairsV210TestJSON-1970348817-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-505766701?user_id=cb78cd0b46a04bdc9994eb752354d5e9" status: 204 len: 0 microversion: 2.10 time: 0.040424 Aug 30 04:09:38.978930 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 187/365] 10.222.0.27 () {60 vars in 1340 bytes} [Tue Aug 30 04:09:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-505766701?user_id=cb78cd0b46a04bdc9994eb752354d5e9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:09:39.217802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:39.218747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:39.256768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:39.258864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:39.259325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:39.260064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:39.260534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:39.260962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:39.291717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b6d9917-462f-44b9-8f11-3ae06fa60953 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030/action" status: 202 len: 0 microversion: 2.1 time: 5.059313 Aug 30 04:09:39.292418 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 179/366] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:09:34 2022] POST /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030/action => generated 0 bytes in 5068 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:39.301904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:39.302651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:39.318542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:39.319289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:39.319917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:39.321479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:39.322383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:39.322957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:39.528493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:39.541600 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-566281ea-7254-46aa-93d3-713d8e0b6510 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1312 microversion: 2.1 time: 0.325402 Aug 30 04:09:39.543463 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 188/367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:39 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1312 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:39.606315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:39.618076 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b5ceb0c-9cc8-486f-8395-eb810ed84681 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.320799 Aug 30 04:09:39.618984 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 180/368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:39 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:39.686881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:39.688109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:39.694723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:39.695597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:39.696041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:39.697025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:39.697520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:39.697948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:39.719292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:39.786549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:39.797628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:39.810756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:39.818244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e31303ab-df91-4c26-97bb-1207e9467833 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1416 microversion: 2.75 time: 0.134901 Aug 30 04:09:39.833351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 189/369] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:39 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1416 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:40.563882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:40.564705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:40.571034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.571623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.572309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.573090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.573630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.574533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.642407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:40.642407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:40.652583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.654074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.654747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.655682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.656577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.658825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.816482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:40.834055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cebae2b8-5361-4c5a-a6d5-cbe21248d591 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1312 microversion: 2.1 time: 0.274482 Aug 30 04:09:40.834662 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 181/370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:40 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:40.843844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:40.844722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:40.857356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.858102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.867520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.868517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:40.869232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:40.869767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:40.971465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:40.979733 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-334875b3-695a-461c-9abf-999a09689c0a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.343214 Aug 30 04:09:40.982023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 190/371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:40 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:41.017102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:41.033058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:41.035704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:41.047928 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9d42ac5-8518-434a-9e13-c7bb06539f68 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1416 microversion: 2.75 time: 0.207710 Aug 30 04:09:41.049464 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 182/372] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:40 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1416 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:09:41.360472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-426057862", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:41.439836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:09:41.790333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:09:41.791669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:09:41.792958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:09:41.794205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:09:41.795158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:09:41.805672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:41.806162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:41.806689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:41.807456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:41.807917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:41.808811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:41.820423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a142e63-1f26-402f-ad2b-4555ac00ab12 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1332356394", "id": 986230452, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:41.830694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=21 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:41.842654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Getting quotas for project af56332dd1924e84b4bd25806a8592c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:41.842935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a142e63-1f26-402f-ad2b-4555ac00ab12 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.389052 Aug 30 04:09:41.848981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Getting quotas for user fa1ee60b2ee34adbabf8c02804bfcfec and project af56332dd1924e84b4bd25806a8592c4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:41.852049 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 183/373] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:41 2022] POST /compute/v2.1/flavors => generated 428 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:41.858234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:41.858975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:41.865042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:09:41.867320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:41.867617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:09:41.868156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:41.868835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:41.869718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:41.870389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:41.871053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:41.953461 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-639aaaca-847f-421e-a2a5-46c8c4e689b1 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968009 Aug 30 04:09:41.962270 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 191/374] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:09:41.984313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c1ded4d-cc0e-419a-8571-b03db3027a6b tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "12ddb8f2a28c4a3986cdfd4a10ae4aaf"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:42.027270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.038113 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-520e72a3-0edb-4aa4-9a72-1edf60edc5c2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1312 microversion: 2.1 time: 0.184668 Aug 30 04:09:42.039946 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 184/375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:41 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1312 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:42.052062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1cc35c2e-225c-4cce-9d32-7312f0ff33da tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:42.053452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1cc35c2e-225c-4cce-9d32-7312f0ff33da tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:42.200913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1cc35c2e-225c-4cce-9d32-7312f0ff33da tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.211774 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1cc35c2e-225c-4cce-9d32-7312f0ff33da tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1213 microversion: 2.1 time: 0.169147 Aug 30 04:09:42.212554 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 185/376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:42 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1213 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:42.220671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:42.221295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:42.233377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.233908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.236627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.239081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.239566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.240164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.397761 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c1ded4d-cc0e-419a-8571-b03db3027a6b tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/986230452/action" status: 200 len: 96 microversion: 2.1 time: 0.434021 Aug 30 04:09:42.398745 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 192/377] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Aug 30 04:09:41 2022] POST /compute/v2.1/flavors/986230452/action => generated 96 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:42.553607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.561395 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a039336d-d5f3-422b-aba1-70f07889ac0b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.348005 Aug 30 04:09:42.561973 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 186/378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:42 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:42.577839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:42.579046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:42.598080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.598570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.599004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.599707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:42.600154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:42.600593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:42.742214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-350d2d5e-a14e-4bc4-9318-e76f14041524 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1290082973", "ram": 512, "vcpus": 1, "disk": 10, "id": 815810032, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:42.764197 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-350d2d5e-a14e-4bc4-9318-e76f14041524 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.363908 Aug 30 04:09:42.765319 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 193/379] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:42 2022] POST /compute/v2.1/flavors => generated 413 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:42.939418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.960751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.970856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:42.979396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-582549a6-aeaf-4640-bf14-1de456f08106 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1437 microversion: 2.75 time: 0.410313 Aug 30 04:09:42.980585 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 187/380] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:42 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1437 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:42.985587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe0951d2-83cc-49d7-8b1d-854136c25255 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:43.029901 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fe0951d2-83cc-49d7-8b1d-854136c25255 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/815810032/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.048014 Aug 30 04:09:43.030585 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 188/381] 10.222.0.27 () {60 vars in 1221 bytes} [Tue Aug 30 04:09:42 2022] POST /compute/v2.1/flavors/815810032/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:43.043223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07df0bc0-a9bf-4af9-a3df-76b5b377166b tempest-FlavorsAccessTestJSON-153943782 tempest-FlavorsAccessTestJSON-153943782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:43.047097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:43.051095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:43.060274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.060762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.065945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.067061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.067775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.068452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.080926 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07df0bc0-a9bf-4af9-a3df-76b5b377166b tempest-FlavorsAccessTestJSON-153943782 tempest-FlavorsAccessTestJSON-153943782-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6639 microversion: 2.1 time: 0.314541 Aug 30 04:09:43.081848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 194/382] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:42 2022] GET /compute/v2.1/flavors/detail => generated 6639 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:43.182204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:09:43.183013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:09:43.183664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:09:43.184668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:09:43.185256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:09:43.278806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:43.286216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.287118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.287998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.288925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.289560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.290144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.412687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:43.462104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c00e10dc-8284-40f1-ac44-9635eb1a23dc tempest-FlavorsExtraSpecsTestJSON-537224469 tempest-FlavorsExtraSpecsTestJSON-537224469-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:43.466114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:43.477971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c00e10dc-8284-40f1-ac44-9635eb1a23dc tempest-FlavorsExtraSpecsTestJSON-537224469 tempest-FlavorsExtraSpecsTestJSON-537224469-project] 10.222.0.27 "GET /compute/v2.1/flavors/815810032/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.394447 Aug 30 04:09:43.479017 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 195/383] 10.222.0.27 () {58 vars in 1200 bytes} [Tue Aug 30 04:09:43 2022] GET /compute/v2.1/flavors/815810032/os-extra_specs => generated 66 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:43.491652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:43.494041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:43.494592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:43.501148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:43.514147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.515092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.515682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.516542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.517136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.517749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.526532 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ef02d8e-6560-483b-b09b-6f7470ba6e8d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "POST /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c/action" status: 202 len: 1494 microversion: 2.75 time: 0.492938 Aug 30 04:09:43.527970 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 189/384] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:09:43 2022] POST /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c/action => generated 1494 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 04:09:43.539190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36dcb2c1-8030-40d6-9b53-2ff5a03903ec tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "12ddb8f2a28c4a3986cdfd4a10ae4aaf"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:43.833878 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36dcb2c1-8030-40d6-9b53-2ff5a03903ec tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/986230452/action" status: 200 len: 21 microversion: 2.1 time: 0.304078 Aug 30 04:09:43.834759 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 190/385] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Aug 30 04:09:43 2022] POST /compute/v2.1/flavors/986230452/action => generated 21 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:43.842721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:43.844522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:43.853260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.854214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.854889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.856033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.856711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.857476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.917771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:43.929163 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a6ea9191-71d7-4121-a478-67487abf7518 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1312 microversion: 2.1 time: 0.447808 Aug 30 04:09:43.932313 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 196/386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:43 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1312 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:43.943422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-eec12f70-7788-41ab-addd-ac3a506388c1 req-f3b96d78-1552-458c-b300-fb159a9bffc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1feaf5e3-ffa0-4d63-97fa-34a827c83030", "name": "network-vif-unplugged", "status": "completed", "tag": "800ce387-891d-40d8-84a2-2fa64cc25a42"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:43.956765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eec12f70-7788-41ab-addd-ac3a506388c1 req-f3b96d78-1552-458c-b300-fb159a9bffc6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:43.957550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eec12f70-7788-41ab-addd-ac3a506388c1 req-f3b96d78-1552-458c-b300-fb159a9bffc6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:43.958138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eec12f70-7788-41ab-addd-ac3a506388c1 req-f3b96d78-1552-458c-b300-fb159a9bffc6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:43.972284 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-eec12f70-7788-41ab-addd-ac3a506388c1 req-f3b96d78-1552-458c-b300-fb159a9bffc6 service nova] Creating event network-vif-unplugged:800ce387-891d-40d8-84a2-2fa64cc25a42 for instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 on n-h2-854925-5 Aug 30 04:09:43.978456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-eec12f70-7788-41ab-addd-ac3a506388c1 req-f3b96d78-1552-458c-b300-fb159a9bffc6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044793 Aug 30 04:09:43.979984 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 197/387] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:43.987632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b076c305-3e96-4b6e-9fb5-0923fd823838 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:44.024389 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b076c305-3e96-4b6e-9fb5-0923fd823838 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/815810032/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042990 Aug 30 04:09:44.025038 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 198/388] 10.222.0.27 () {60 vars in 1221 bytes} [Tue Aug 30 04:09:43 2022] POST /compute/v2.1/flavors/815810032/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.029960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.031503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:44.032519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:44.038552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.039286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.039915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.040820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.041515 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3bfe36fd-cc36-4c86-bb28-ca724d54ce76 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1271 microversion: 2.1 time: 0.205357 Aug 30 04:09:44.041660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.042099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.055922 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 191/389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:43 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.063203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.064087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:44.070535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.071269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.071910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.072794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.073474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.074372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.176130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:44.185347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:44.187100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:44.203196 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f64cfdc9-5473-438b-852b-bdeca7619e41 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.176526 Aug 30 04:09:44.204052 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 199/390] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:44.265220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-450150212", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:44.272222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:44.282103 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d58a3623-ab42-4669-a2b2-7c7690ccecff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.224795 Aug 30 04:09:44.283349 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 192/391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.289517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2865e334-2c25-42c3-9376-3f7df71aa742 tempest-FlavorsAccessTestJSON-153943782 tempest-FlavorsAccessTestJSON-153943782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.314365 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2865e334-2c25-42c3-9376-3f7df71aa742 tempest-FlavorsAccessTestJSON-153943782 tempest-FlavorsAccessTestJSON-153943782-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.029770 Aug 30 04:09:44.315004 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 193/392] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.319799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e7606736-248b-4254-94db-bda36d887414 tempest-FlavorsExtraSpecsTestJSON-537224469 tempest-FlavorsExtraSpecsTestJSON-537224469-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.329603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e7606736-248b-4254-94db-bda36d887414 tempest-FlavorsExtraSpecsTestJSON-537224469 tempest-FlavorsExtraSpecsTestJSON-537224469-project] 10.222.0.27 "GET /compute/v2.1/flavors/815810032/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.013392 Aug 30 04:09:44.331529 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 194/393] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/815810032/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.336228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47d282c1-ab33-4f9c-ab15-5c78b209c9b1 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.336597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:09:44.355575 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47d282c1-ab33-4f9c-ab15-5c78b209c9b1 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/986230452" status: 202 len: 0 microversion: 2.1 time: 0.022716 Aug 30 04:09:44.356492 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 195/394] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:09:44 2022] DELETE /compute/v2.1/flavors/986230452 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:44.362845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-183aade2-269c-4d9f-a17c-f8a308dccee1 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:44.378275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=2,nova_api:DELETE=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:44.390409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-183aade2-269c-4d9f-a17c-f8a308dccee1 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/815810032/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032657 Aug 30 04:09:44.390994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 196/395] 10.222.0.27 () {60 vars in 1221 bytes} [Tue Aug 30 04:09:44 2022] POST /compute/v2.1/flavors/815810032/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.395790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b021e2f4-f616-45c5-8d89-a0621324f977 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.424438 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b021e2f4-f616-45c5-8d89-a0621324f977 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.031931 Aug 30 04:09:44.425306 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 197/396] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.431471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25a635e5-2f0a-42a2-8ad5-4e550ef4b7c8 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.455612 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25a635e5-2f0a-42a2-8ad5-4e550ef4b7c8 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/815810032/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027957 Aug 30 04:09:44.458406 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 198/397] 10.222.0.27 () {58 vars in 1200 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/815810032/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.465953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce29a30d-40d0-4efd-b4be-6f3c8dfe820b tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1757348887", "id": 1425870162, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:44.487793 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce29a30d-40d0-4efd-b4be-6f3c8dfe820b tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.028232 Aug 30 04:09:44.488393 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 199/398] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:44 2022] POST /compute/v2.1/flavors => generated 431 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:44.493373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-827ce797-806e-4624-8b88-c5180ffa66a8 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:44.531359 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-827ce797-806e-4624-8b88-c5180ffa66a8 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/815810032/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040986 Aug 30 04:09:44.532270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 200/399] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:09:44 2022] PUT /compute/v2.1/flavors/815810032/os-extra_specs/hw:numa_nodes => generated 22 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.537460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f9eb95b-b61c-43f1-82e8-50be111e4661 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.556862 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f9eb95b-b61c-43f1-82e8-50be111e4661 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/1425870162/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.023309 Aug 30 04:09:44.558237 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 201/400] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/1425870162/os-flavor-access => generated 21 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.566166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce6a2ab0-586d-47a0-b47d-d7b8419480ba tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.575006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce6a2ab0-586d-47a0-b47d-d7b8419480ba tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/815810032/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012487 Aug 30 04:09:44.576862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:09:44.578303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:09:44.579438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:09:44.580180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:09:44.581214 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 202/401] 10.222.0.27 () {58 vars in 1200 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/815810032/os-extra_specs => generated 66 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.581762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:09:44.586118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-218fef1f-9d54-405a-a86a-7da9a2bfca50 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.597957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.599081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.599719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.600744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.601567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.602193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.606894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-218fef1f-9d54-405a-a86a-7da9a2bfca50 tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1425870162" status: 202 len: 0 microversion: 2.1 time: 0.024459 Aug 30 04:09:44.607488 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 203/402] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:09:44 2022] DELETE /compute/v2.1/flavors/1425870162 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:44.614048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7fade595-efb7-47f8-8469-9800fa0ba0ab tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.634175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Getting quotas for project bd7d995ea79e4de7ace9373cb4100356. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:09:44.642852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Getting quotas for user cc32e95900cc40fdaf525e102ed1651b and project bd7d995ea79e4de7ace9373cb4100356. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:09:44.653395 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7fade595-efb7-47f8-8469-9800fa0ba0ab tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/815810032/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.044046 Aug 30 04:09:44.657683 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 204/403] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:09:44 2022] DELETE /compute/v2.1/flavors/815810032/os-extra_specs/hw:numa_nodes => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:44.662518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-632ba1d5-a360-4aa0-b652-0ec31433c7cb tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.665343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:09:44.667994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:09:44.684912 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-632ba1d5-a360-4aa0-b652-0ec31433c7cb tempest-FlavorsAccessTestJSON-2128657250 tempest-FlavorsAccessTestJSON-2128657250-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.025861 Aug 30 04:09:44.701352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 205/404] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.704410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-580eb38c-8f9a-46a0-be1b-c720a5e06905 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.726982 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-580eb38c-8f9a-46a0-be1b-c720a5e06905 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/815810032/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.031695 Aug 30 04:09:44.727769 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 206/405] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:09:44 2022] DELETE /compute/v2.1/flavors/815810032/os-extra_specs/hw:cpu_policy => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:09:44.736185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-890f7690-f2ca-42c1-ad56-f667147c437d tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.743849 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d6de5393-e7dc-4568-a3e0-9b888e9701c0 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538486 Aug 30 04:09:44.744511 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 200/406] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:09:44.744928 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-890f7690-f2ca-42c1-ad56-f667147c437d tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/815810032/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012637 Aug 30 04:09:44.752091 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 207/407] 10.222.0.27 () {58 vars in 1200 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/815810032/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:44.761488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bee45db0-9e74-4d77-92de-dea389661ae8 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.764643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-98f2097e-76b4-4cb6-a847-cd5787f904c8 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.765118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98f2097e-76b4-4cb6-a847-cd5787f904c8 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:44.799756 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bee45db0-9e74-4d77-92de-dea389661ae8 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/815810032" status: 202 len: 0 microversion: 2.1 time: 0.042081 Aug 30 04:09:44.800527 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 208/408] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:09:44 2022] DELETE /compute/v2.1/flavors/815810032 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:44.809051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9e9dedf6-b33e-43a0-8aa3-66d83542d0a2 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.832974 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9e9dedf6-b33e-43a0-8aa3-66d83542d0a2 tempest-FlavorsExtraSpecsTestJSON-495792807 tempest-FlavorsExtraSpecsTestJSON-495792807-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.027550 Aug 30 04:09:44.845965 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 209/409] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.854067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-98f2097e-76b4-4cb6-a847-cd5787f904c8 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:44.866522 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-98f2097e-76b4-4cb6-a847-cd5787f904c8 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1222 microversion: 2.1 time: 0.108308 Aug 30 04:09:44.878277 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 201/410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:44.955572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:44.956190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:44.964533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.966094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.966375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:44.967850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:44.970834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:44.972079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.062715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:45.063451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:45.079539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.080379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.085085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.086889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.087369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.087829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.279446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:45.294657 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99c92e8d-a63b-4497-a302-591dc061dc7c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1312 microversion: 2.1 time: 0.339896 Aug 30 04:09:45.295284 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 210/411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:44 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1312 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:45.312891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:45.313945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:45.323569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.324449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.327140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.328432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.329251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.331206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.399697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:45.409857 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7baaaf6e-7ff3-4df3-b3f1-f384c912ec1c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.351220 Aug 30 04:09:45.416424 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 202/412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:45 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:45.423401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:45.431599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:45.447973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.448639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.449468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.450298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.454421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.454978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.460628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:45.474849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:45.478481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:45.487570 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-237e0ca6-e570-4dff-948e-b713cb516728 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.190606 Aug 30 04:09:45.489091 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 211/413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:45 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:45.649171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:45.658183 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51846fe9-0aa1-4d63-9dec-ec2a24d0a65d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.240460 Aug 30 04:09:45.672235 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 203/414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:45 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:45.724222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-88f675bb-c45e-4c80-8100-fce2c5574a08 req-7e964bf6-39bb-47aa-89d9-2e9b27b57412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5b231b-2496-4cc0-a8c9-908714605d2b", "name": "network-vif-plugged", "status": "completed", "tag": "ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:45.736007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-88f675bb-c45e-4c80-8100-fce2c5574a08 req-7e964bf6-39bb-47aa-89d9-2e9b27b57412 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.737353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-88f675bb-c45e-4c80-8100-fce2c5574a08 req-7e964bf6-39bb-47aa-89d9-2e9b27b57412 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.738645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-88f675bb-c45e-4c80-8100-fce2c5574a08 req-7e964bf6-39bb-47aa-89d9-2e9b27b57412 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.743821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:45.754740 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-88f675bb-c45e-4c80-8100-fce2c5574a08 req-7e964bf6-39bb-47aa-89d9-2e9b27b57412 service nova] Creating event network-vif-plugged:ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748 for instance 5f5b231b-2496-4cc0-a8c9-908714605d2b on n-h2-854925-5 Aug 30 04:09:45.760974 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-88f675bb-c45e-4c80-8100-fce2c5574a08 req-7e964bf6-39bb-47aa-89d9-2e9b27b57412 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042329 Aug 30 04:09:45.762533 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 212/415] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:45.890083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:45.891272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:45.897954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.898140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.898642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:45.899683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:45.900231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:45.900544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.001350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:46.014062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f7439f10-245e-45e1-90bb-0eba9bf6803a req-aa19543f-f6c3-4fa9-8268-1837426b0afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1feaf5e3-ffa0-4d63-97fa-34a827c83030", "tag": "800ce387-891d-40d8-84a2-2fa64cc25a42"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:46.015304 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5bf761c-78a5-4030-8d17-faf6611d9d94 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1218 microversion: 2.1 time: 0.128943 Aug 30 04:09:46.031056 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 204/416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:45 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:46.040475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f7439f10-245e-45e1-90bb-0eba9bf6803a req-aa19543f-f6c3-4fa9-8268-1837426b0afe service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.040971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f7439f10-245e-45e1-90bb-0eba9bf6803a req-aa19543f-f6c3-4fa9-8268-1837426b0afe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.041443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f7439f10-245e-45e1-90bb-0eba9bf6803a req-aa19543f-f6c3-4fa9-8268-1837426b0afe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.056766 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f7439f10-245e-45e1-90bb-0eba9bf6803a req-aa19543f-f6c3-4fa9-8268-1837426b0afe service nova] Creating event network-changed:800ce387-891d-40d8-84a2-2fa64cc25a42 for instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 on n-h2-854925-5 Aug 30 04:09:46.063069 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f7439f10-245e-45e1-90bb-0eba9bf6803a req-aa19543f-f6c3-4fa9-8268-1837426b0afe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061020 Aug 30 04:09:46.063810 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 213/417] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:46.316688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:46.317521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:46.323438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.324193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.324629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.325343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.325860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.326296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.434996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:46.436600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:46.452810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.453839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.454753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.457788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.460983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.462005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.795864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:46.804359 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0626e081-7eb6-4c3b-811b-92dd1066387a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1312 microversion: 2.1 time: 0.492031 Aug 30 04:09:46.804957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 205/418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:46 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:46.809401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-dabf3f55-1021-4128-b97a-a735cc5dea71 req-7c3565be-eab5-4c49-98d6-59e36d81eee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "215b4756-43b0-407e-b08b-30e65eeddc9c", "tag": "19cbaf31-6723-4fae-a617-3e31dc4955c3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:46.833855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-dabf3f55-1021-4128-b97a-a735cc5dea71 req-7c3565be-eab5-4c49-98d6-59e36d81eee2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.837671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-dabf3f55-1021-4128-b97a-a735cc5dea71 req-7c3565be-eab5-4c49-98d6-59e36d81eee2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.838173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-dabf3f55-1021-4128-b97a-a735cc5dea71 req-7c3565be-eab5-4c49-98d6-59e36d81eee2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.862929 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-dabf3f55-1021-4128-b97a-a735cc5dea71 req-7c3565be-eab5-4c49-98d6-59e36d81eee2 service nova] Creating event network-changed:19cbaf31-6723-4fae-a617-3e31dc4955c3 for instance 215b4756-43b0-407e-b08b-30e65eeddc9c on n-h2-854925-5 Aug 30 04:09:46.868308 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-dabf3f55-1021-4128-b97a-a735cc5dea71 req-7c3565be-eab5-4c49-98d6-59e36d81eee2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062002 Aug 30 04:09:46.869144 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 206/419] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:46.875709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:46.876471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:46.886479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.887063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.887509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.888342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.888988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.889693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.920599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:46.930533 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b599537-fd61-49f9-8b78-717809a2858a tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.499925 Aug 30 04:09:46.945304 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 214/420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:46 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:46.951412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:46.952324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:46.959905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.960698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.961059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.962387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:46.962533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:46.962946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:46.970228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:46.983496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:46.986621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:46.991192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=3,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:46.994947 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7bbf6336-a73e-4325-8911-5c1c69561206 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.124262 Aug 30 04:09:46.996670 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 207/421] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:46 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:47.041497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:47.042601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:47.050135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.051008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.051625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:47.052540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.053153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.053799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:47.216177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:47.227861 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88b2ac92-9d7f-4bda-b56d-34caa7b71e15 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1280 microversion: 2.1 time: 0.191950 Aug 30 04:09:47.245256 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 208/422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:47 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1280 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:47.289212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:47.301142 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8d9e7f6-667d-4ff4-83d2-f49ea0c6d4dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.353464 Aug 30 04:09:47.315298 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 215/423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:46 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:47.823826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:47.824714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:47.839652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.840156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.840597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:47.841309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.841794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.842226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:47.952248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:47.952902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:47.960066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.960621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.961004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:47.961741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:47.962202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:47.962635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.281686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:48.297509 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5a976276-ec9c-4ec5-919e-5f2da280ba15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1461 microversion: 2.1 time: 0.476272 Aug 30 04:09:48.299361 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 209/424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:47 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1461 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:48.307129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:48.308537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:48.315256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:48.327505 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00ed33d4-d912-4e8d-866d-237650de76d3 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.379294 Aug 30 04:09:48.331019 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 216/425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:47 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:48.334270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.338449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.339125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.340038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.349767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.350164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.351979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:48.352644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:48.373197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.373731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.374183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.374924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.375436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.375828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.466471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:48.478269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:48.480317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:48.487230 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a47ce791-c9c5-41ab-8bdf-dcfd246dec0d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.186768 Aug 30 04:09:48.488513 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 210/426] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:48 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:48.682782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:48.694773 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23acabb4-41f9-479f-9375-8267910b5905 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.362426 Aug 30 04:09:48.696061 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 217/427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:48 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:48.714472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:48.715601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:48.723165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.724038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.724864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.725947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.726546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.727340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.759012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:48.759852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:48.767036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.767626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.768164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.769133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:48.769731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:48.770271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:48.998185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:49.009377 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b086730-543c-410c-81fa-ccf77656cafa tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.312086 Aug 30 04:09:49.010377 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 218/428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:48 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:49.364404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64cd3e07-571e-46cb-85b8-9a01974c61cb tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1612 microversion: 2.1 time: 0.874477 Aug 30 04:09:49.368988 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 211/429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:48 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1612 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:49.374407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:49.375931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:49.384226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.385303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.386473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.388080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.389293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.390302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.554124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Calling method '.version_select at 0x7fe96acadc10>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:49.556112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.556727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.557371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.572244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.572824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.573369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.584536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.585147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.585772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.592070 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23a77bcc-1bf6-4343-9e45-8b5062c51efb tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.326051 Aug 30 04:09:49.592918 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 219/430] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:09:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:09:49.597995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:49.598730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:49.604588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.605075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.605548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.606275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.606732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.607155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.685391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd9ad8b7c062d4d2fa6604c354223a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b5714ad31147e09278412b8e7de2de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:49.685982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] flavor_id is None. Assuming migration. {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 04:09:49.686426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:09:49.853368 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5ca9661-9d51-4125-8510-3c6f88fd459d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b/action" status: 202 len: 0 microversion: 2.1 time: 0.258903 Aug 30 04:09:49.854535 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 220/431] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:09:49 2022] POST /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:49.918148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d06d1d3e-61e8-40e8-80a4-6613ab8af96a tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-256884357", "ram": 512, "vcpus": 1, "disk": 10, "id": 1350893999, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:49.941724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d06d1d3e-61e8-40e8-80a4-6613ab8af96a tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.085797 Aug 30 04:09:49.943122 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 221/432] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:49 2022] POST /compute/v2.1/flavors => generated 415 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:49.958345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:49.958779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:49.964899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:RELEASE=5,nova_api:SAVEPOINT=4,nova_api:SELECT=80,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:49.966538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.967182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.967766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.970033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:49.970566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:49.971235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:49.975832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:49.987831 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-612cc289-7cef-40ed-80ae-ebb813fed051 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.616679 Aug 30 04:09:49.989504 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 212/433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:49 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:50.005261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Calling method '.version_select at 0x7fe96a93edc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:50.007121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.007612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.008050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.028926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.029461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.029957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.037307 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-41f2c9b9-5784-4273-878d-2b2bf4e98a58 tempest-HypervisorAdminV228Test-986811193 tempest-HypervisorAdminV228Test-986811193-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.046576 Aug 30 04:09:50.037941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 213/434] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 04:09:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:09:50.042607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:50.043422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:50.050659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.051437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.052141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.053091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.053580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.054243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.079963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.094674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.096622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.104013 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df61b874-7b60-4ef3-907b-6ca514d7dc83 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.157765 Aug 30 04:09:50.118152 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 222/435] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:49 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:50.125739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:50.127057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:50.142782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.143271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.143705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.144553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.145156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.145601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.485712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.493612 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8dd762c0-289e-47ab-a569-1fa993c3ecab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1470 microversion: 2.1 time: 0.374270 Aug 30 04:09:50.509698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.511346 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 223/436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:50 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1470 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:50.521575 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c87403dc-bca6-4281-ac6a-b9f24ec07e40 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.479965 Aug 30 04:09:50.524276 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 214/437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:50 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:50.535927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:50.536554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:50.553813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.555638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.556281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.557177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.558518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.563332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.568578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:50.776118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4084d400-37a2-4c81-971a-5b50a96d3c9a tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:50.797588 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4084d400-37a2-4c81-971a-5b50a96d3c9a tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] HTTP exception thrown: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4084d400-37a2-4c81-971a-5b50a96d3c9a tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Request method failure captured: Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/flavors/1350893999/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2MTAVixeJWa6vnoQ7Y7MlP4CcMR6IvB4GeJWdxDECeKZzu-pf9oirzukX2WFBPyMUFSEhUjFrjqvY019EeY6HdFU_MjFPdIXzgxHgLlWGmIqdJqSSGTdsKDuBnQeqsRvFROwlYM_VsjQfI_05FjndL5nt8sjJWUrBy8ORshj_aaz0 Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:50.803440 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae184f029f6746f2a6fa5135b40c1b93", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}] Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c90a2c7fa3ef4e6eb7f5a63417be0df1 Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:50.804694 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '1350893999', 'id': 'hw:cpu_thread_policy'} Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:50.805397 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4084d400-37a2-4c81-971a-5b50a96d3c9a tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Returning 404 to user: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4084d400-37a2-4c81-971a-5b50a96d3c9a tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] 10.222.0.27 "GET /compute/v2.1/flavors/1350893999/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.291857 Aug 30 04:09:50.806679 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 224/438] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:09:50 2022] GET /compute/v2.1/flavors/1350893999/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:50.810714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-730ce3e0-e94f-4483-bf13-cab68837a1c0 req-98ab49b7-9801-4e9a-8e77-0e616ddb8b24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d47aea9-05a3-4ccb-b9f3-1a705de09ada", "tag": "b7267744-b2d6-4b27-96d6-da6626934486"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:50.823650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-730ce3e0-e94f-4483-bf13-cab68837a1c0 req-98ab49b7-9801-4e9a-8e77-0e616ddb8b24 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:50.824593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-730ce3e0-e94f-4483-bf13-cab68837a1c0 req-98ab49b7-9801-4e9a-8e77-0e616ddb8b24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:50.825168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-730ce3e0-e94f-4483-bf13-cab68837a1c0 req-98ab49b7-9801-4e9a-8e77-0e616ddb8b24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:50.843085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-730ce3e0-e94f-4483-bf13-cab68837a1c0 req-98ab49b7-9801-4e9a-8e77-0e616ddb8b24 service nova] Creating event network-changed:b7267744-b2d6-4b27-96d6-da6626934486 for instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada on n-h1-854925-5 Aug 30 04:09:50.853876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-730ce3e0-e94f-4483-bf13-cab68837a1c0 req-98ab49b7-9801-4e9a-8e77-0e616ddb8b24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044515 Aug 30 04:09:50.855210 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 225/439] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:50.863709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7ba3ae9-da32-4dc8-ae58-1c5afed2b9cf tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:50.869081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7ba3ae9-da32-4dc8-ae58-1c5afed2b9cf tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c90a2c7fa3ef4e6eb7f5a63417be0df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae184f029f6746f2a6fa5135b40c1b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7ba3ae9-da32-4dc8-ae58-1c5afed2b9cf tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Request method failure captured: Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/flavors/1350893999/os-extra_specs HTTP/1.1 Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 66 Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2MTAVixeJWa6vnoQ7Y7MlP4CcMR6IvB4GeJWdxDECeKZzu-pf9oirzukX2WFBPyMUFSEhUjFrjqvY019EeY6HdFU_MjFPdIXzgxHgLlWGmIqdJqSSGTdsKDuBnQeqsRvFROwlYM_VsjQfI_05FjndL5nt8sjJWUrBy8ORshj_aaz0 Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:50.874952 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae184f029f6746f2a6fa5135b40c1b93", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}] Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c90a2c7fa3ef4e6eb7f5a63417be0df1 Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 30 04:09:50.876463 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '1350893999', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:50.877145 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 30 04:09:50.878281 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.881851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7ba3ae9-da32-4dc8-ae58-1c5afed2b9cf tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:50.881851 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7ba3ae9-da32-4dc8-ae58-1c5afed2b9cf tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] 10.222.0.27 "POST /compute/v2.1/flavors/1350893999/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019174 Aug 30 04:09:50.897006 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 226/440] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Aug 30 04:09:50 2022] POST /compute/v2.1/flavors/1350893999/os-extra_specs => generated 124 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:50.911077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-135804c1-3db4-408a-a894-61fc06da5b36 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:50.968978 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-135804c1-3db4-408a-a894-61fc06da5b36 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1350893999/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068972 Aug 30 04:09:50.969911 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 227/441] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Aug 30 04:09:50 2022] POST /compute/v2.1/flavors/1350893999/os-extra_specs => generated 66 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:50.981043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-254e4a36-d1db-4ec8-841a-476326d2c07d tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:50.982597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-254e4a36-d1db-4ec8-841a-476326d2c07d tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c90a2c7fa3ef4e6eb7f5a63417be0df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae184f029f6746f2a6fa5135b40c1b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-254e4a36-d1db-4ec8-841a-476326d2c07d tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Request method failure captured: Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2MTAVixeJWa6vnoQ7Y7MlP4CcMR6IvB4GeJWdxDECeKZzu-pf9oirzukX2WFBPyMUFSEhUjFrjqvY019EeY6HdFU_MjFPdIXzgxHgLlWGmIqdJqSSGTdsKDuBnQeqsRvFROwlYM_VsjQfI_05FjndL5nt8sjJWUrBy8ORshj_aaz0 Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:50.984448 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae184f029f6746f2a6fa5135b40c1b93", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}] Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c90a2c7fa3ef4e6eb7f5a63417be0df1 Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:50.985705 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '1350893999', 'id': 'hw:numa_nodes'} Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:50.986531 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:50.987671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-254e4a36-d1db-4ec8-841a-476326d2c07d tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:50.988695 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-254e4a36-d1db-4ec8-841a-476326d2c07d tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] 10.222.0.27 "DELETE /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.009741 Aug 30 04:09:50.991264 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 228/442] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:09:50 2022] DELETE /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:50.996144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da6cf7b8-77c7-4470-ac2f-e03548e98da7 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:51.003259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.013047 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36a464c6-f3af-4ec8-917b-ea807ada587f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.487470 Aug 30 04:09:51.013665 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 215/443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:50 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:51.024027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.025760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:51.033464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.033988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.034500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.036040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.036898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.037746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.039245 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da6cf7b8-77c7-4470-ac2f-e03548e98da7 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1350893999/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046655 Aug 30 04:09:51.039855 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 229/444] 10.222.0.27 () {60 vars in 1224 bytes} [Tue Aug 30 04:09:50 2022] POST /compute/v2.1/flavors/1350893999/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:09:51.056532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1cd1b2e0-bb5e-4452-a0d2-a1211019ecfa tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:51.060232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1cd1b2e0-bb5e-4452-a0d2-a1211019ecfa tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c90a2c7fa3ef4e6eb7f5a63417be0df1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae184f029f6746f2a6fa5135b40c1b93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1cd1b2e0-bb5e-4452-a0d2-a1211019ecfa tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Request method failure captured: Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 22 Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2MTAVixeJWa6vnoQ7Y7MlP4CcMR6IvB4GeJWdxDECeKZzu-pf9oirzukX2WFBPyMUFSEhUjFrjqvY019EeY6HdFU_MjFPdIXzgxHgLlWGmIqdJqSSGTdsKDuBnQeqsRvFROwlYM_VsjQfI_05FjndL5nt8sjJWUrBy8ORshj_aaz0 Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:09:51.062640 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae184f029f6746f2a6fa5135b40c1b93", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae184f029f6746f2a6fa5135b40c1b93"}]}] Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: ae184f029f6746f2a6fa5135b40c1b93 Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c90a2c7fa3ef4e6eb7f5a63417be0df1 Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: {"hw:numa_nodes": "1"} Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:51.064884 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '1350893999', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:09:51.065905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 30 04:09:51.068199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.069420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1cd1b2e0-bb5e-4452-a0d2-a1211019ecfa tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:51.069420 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1cd1b2e0-bb5e-4452-a0d2-a1211019ecfa tempest-FlavorsExtraSpecsNegativeTestJSON-76955826 tempest-FlavorsExtraSpecsNegativeTestJSON-76955826-project] 10.222.0.27 "PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014334 Aug 30 04:09:51.069420 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 230/445] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Aug 30 04:09:51 2022] PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:51.076705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb11ce23-765e-4754-a136-038bc7393d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.086501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-fb11ce23-765e-4754-a136-038bc7393d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] HTTP exception thrown: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb11ce23-765e-4754-a136-038bc7393d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Request method failure captured: Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/flavors/1350893999/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2Np4rQGkSE_fKumoAI1C5gPbiyHCPYd_-9DpcqNkpiGYd4zf_BzAzCp550Zg6LvvtYi0Ty-FEcJweiAuaLWMX--VzkIEidTsVm1EypWjpjCSR8_w9aiHDcYg6vDxnUygruKWcy1o09UFI74yGTi-KRoWR9gzj36xnSjXiVIzKRyvE Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 125c60562c564c5d85f5293a51b44158 Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:51.089136 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_125c60562c564c5d85f5293a51b44158", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/125c60562c564c5d85f5293a51b44158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/125c60562c564c5d85f5293a51b44158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/125c60562c564c5d85f5293a51b44158"}]}] Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 125c60562c564c5d85f5293a51b44158 Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d3926abc67b4405fad526f1cf85144e7 Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:51.090773 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '1350893999', 'id': 'hw:cpu_thread_policy'} Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:51.091569 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb11ce23-765e-4754-a136-038bc7393d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Returning 404 to user: Flavor 1350893999 has no extra specs with key hw:cpu_thread_policy. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:51.094463 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb11ce23-765e-4754-a136-038bc7393d12 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1350893999/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.019600 Aug 30 04:09:51.100961 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 231/446] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:09:51 2022] DELETE /compute/v2.1/flavors/1350893999/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:09:51.105978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-87746748-45f3-48a1-bb7a-4e76df8da880 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:51.110711 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-87746748-45f3-48a1-bb7a-4e76df8da880 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-87746748-45f3-48a1-bb7a-4e76df8da880 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Request method failure captured: Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 27 Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2Np4rQGkSE_fKumoAI1C5gPbiyHCPYd_-9DpcqNkpiGYd4zf_BzAzCp550Zg6LvvtYi0Ty-FEcJweiAuaLWMX--VzkIEidTsVm1EypWjpjCSR8_w9aiHDcYg6vDxnUygruKWcy1o09UFI74yGTi-KRoWR9gzj36xnSjXiVIzKRyvE Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 125c60562c564c5d85f5293a51b44158 Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:51.113388 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_125c60562c564c5d85f5293a51b44158", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/125c60562c564c5d85f5293a51b44158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/125c60562c564c5d85f5293a51b44158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/125c60562c564c5d85f5293a51b44158"}]}] Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 125c60562c564c5d85f5293a51b44158 Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d3926abc67b4405fad526f1cf85144e7 Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: {"hw:cpu_policy": "shared"} Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:51.114989 n-d-854925-5 devstack@n-api.service[122403]: exception: Request body and URI mismatch Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '1350893999', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.115958 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.117418 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:09:51.117418 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:09:51.117418 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 30 04:09:51.117418 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.117418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-87746748-45f3-48a1-bb7a-4e76df8da880 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:51.117418 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-87746748-45f3-48a1-bb7a-4e76df8da880 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.014076 Aug 30 04:09:51.118907 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 232/447] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Aug 30 04:09:51 2022] PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes => generated 73 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:09:51.129490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64f72211-34af-4e8c-8641-c53573c4999e tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64f72211-34af-4e8c-8641-c53573c4999e tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Request method failure captured: Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 49 Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2Np4rQGkSE_fKumoAI1C5gPbiyHCPYd_-9DpcqNkpiGYd4zf_BzAzCp550Zg6LvvtYi0Ty-FEcJweiAuaLWMX--VzkIEidTsVm1EypWjpjCSR8_w9aiHDcYg6vDxnUygruKWcy1o09UFI74yGTi-KRoWR9gzj36xnSjXiVIzKRyvE Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 125c60562c564c5d85f5293a51b44158 Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:09:51.134066 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_125c60562c564c5d85f5293a51b44158", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/125c60562c564c5d85f5293a51b44158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/125c60562c564c5d85f5293a51b44158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/125c60562c564c5d85f5293a51b44158"}]}] Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 125c60562c564c5d85f5293a51b44158 Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d3926abc67b4405fad526f1cf85144e7 Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 30 04:09:51.135308 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '1350893999', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance: Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 30 04:09:51.135972 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.137503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:09:51.138653 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:09:51.138653 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:09:51.138653 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:09:51.138653 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:09:51.138653 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 30 04:09:51.138653 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:09:51.139851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64f72211-34af-4e8c-8641-c53573c4999e tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:09:51.140758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64f72211-34af-4e8c-8641-c53573c4999e tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.016037 Aug 30 04:09:51.141686 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 233/448] 10.222.0.27 () {60 vars in 1265 bytes} [Tue Aug 30 04:09:51 2022] PUT /compute/v2.1/flavors/1350893999/os-extra_specs/hw:numa_nodes => generated 117 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:09:51.149661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.150858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:51.158150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.158897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.159561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.160441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.161074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.161746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.293767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.306725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.308570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.316129 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0a9b923-a664-48b2-97e2-ea8fdd3c0bce tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.172401 Aug 30 04:09:51.317041 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 234/449] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:51 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:51.322206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3142c12e-b849-4a8d-bce9-76e6c2e90c8c tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.347778 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3142c12e-b849-4a8d-bce9-76e6c2e90c8c tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1350893999" status: 202 len: 0 microversion: 2.1 time: 0.029239 Aug 30 04:09:51.351557 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 235/450] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:09:51 2022] DELETE /compute/v2.1/flavors/1350893999 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:09:51.356419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21e46dcb-909b-4e9a-81c1-c4bf99196436 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.383414 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21e46dcb-909b-4e9a-81c1-c4bf99196436 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018 tempest-FlavorsExtraSpecsNegativeTestJSON-1945429018-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.030647 Aug 30 04:09:51.384240 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 236/451] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:51 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:51.504894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.523048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.523474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:51.530267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f8282a61-6960-4b08-ae8b-96a6d421bb43 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.515365 Aug 30 04:09:51.531438 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 216/452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:51 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:51.556409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:51.557535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:51.568128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.569130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.570163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.571260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.572146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.573801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.578326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.578859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.579302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.580020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:51.580472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:51.580897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:51.969746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:51.987653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d1cd8726-f58f-48b1-bb20-67837ad2049e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.444303 Aug 30 04:09:51.990288 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 217/453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:51 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:51.999592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:52.011670 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-44a1bc77-9233-4ba7-aea5-b8bc9ff4bd3f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1470 microversion: 2.1 time: 0.497996 Aug 30 04:09:52.014252 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 237/454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:51 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:52.037211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:52.038738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:52.045058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.046127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.047425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.048403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.049062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.049832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.301728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:52.315547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee81c3de-8242-4d29-b307-14d2adf11fb3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.282127 Aug 30 04:09:52.316147 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 218/455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:52 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:52.346547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:52.347272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:52.351337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=14 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:52.355463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.356238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.356891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.357854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.358690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.359292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.451232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:52.460712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:52.462597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:52.468497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f4a5d59c-009c-44ff-b0f0-2a89449b7a29 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.126341 Aug 30 04:09:52.469687 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 238/456] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:52 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:52.555828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:52.558556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:52.572643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.573187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.573747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.586409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:52.587660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:52.588204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:52.739283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:52.755991 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-16662399-274e-4d18-bf81-d667042ab617 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.208218 Aug 30 04:09:52.756928 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 219/457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:52 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:53.010854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:53.013869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:53.035411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:53.036205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:53.044434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.044898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.045380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.046051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.047042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.047468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.054395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.054882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.055311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.056940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.057423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.057854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.259298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:53.267491 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6b309c14-1171-4082-9124-313a72681c40 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1470 microversion: 2.1 time: 0.236285 Aug 30 04:09:53.268524 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 220/458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:53 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:53.276677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:53.285828 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c6b8b57-4081-437c-8862-930641997ce4 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.279073 Aug 30 04:09:53.300272 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 239/459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:53 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:53.341357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:53.341974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:53.348383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.348866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.349298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.350083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.350531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.351111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.447390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-513712c9-3920-497c-a82b-563462363672 req-9a05291c-9836-4f90-b933-72b98d466e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215b4756-43b0-407e-b08b-30e65eeddc9c", "name": "network-vif-plugged", "status": "completed", "tag": "19cbaf31-6723-4fae-a617-3e31dc4955c3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:53.470639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-513712c9-3920-497c-a82b-563462363672 req-9a05291c-9836-4f90-b933-72b98d466e1b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.471185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-513712c9-3920-497c-a82b-563462363672 req-9a05291c-9836-4f90-b933-72b98d466e1b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.471683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-513712c9-3920-497c-a82b-563462363672 req-9a05291c-9836-4f90-b933-72b98d466e1b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.507593 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-513712c9-3920-497c-a82b-563462363672 req-9a05291c-9836-4f90-b933-72b98d466e1b service nova] Creating event network-vif-plugged:19cbaf31-6723-4fae-a617-3e31dc4955c3 for instance 215b4756-43b0-407e-b08b-30e65eeddc9c on n-h2-854925-5 Aug 30 04:09:53.520465 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-513712c9-3920-497c-a82b-563462363672 req-9a05291c-9836-4f90-b933-72b98d466e1b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080051 Aug 30 04:09:53.520677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:53.521467 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 240/460] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:53.528744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7fdf210-48cc-4416-b92b-de9dda82b7a3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.191281 Aug 30 04:09:53.530377 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 221/461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:53 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:53.548793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:53.550122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:53.557628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.558374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.559026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.559934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.560511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.561150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.661191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:53.665195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:53.674145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:53.675585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:53.683102 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6bfda90-effe-42ff-bcb5-bd64c168c4c0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.158621 Aug 30 04:09:53.699740 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 241/462] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:53 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:53.778848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:53.779984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:53.789914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.790572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.791111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.791732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:53.792188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:53.792606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:53.958675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:53.967633 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a927f539-0032-44ce-8bb7-dd057650bd89 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.192585 Aug 30 04:09:53.969244 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 222/463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:53 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:54.291917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:54.292666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:54.301211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.301838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.302739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.303398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.304066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.304687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.308099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:54.308711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:54.316315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.316827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.317244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.317962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.318436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.318856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.587759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:54.590995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:54.597480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1470 microversion: 2.1 time: 0.311472 Aug 30 04:09:54.603161 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e350b5a-1adb-4459-9cfa-25ed4fff68ab tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.299278 Aug 30 04:09:54.603726 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 223/464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:54 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:54.610207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 242/465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:54 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1470 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:54.610603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:54.611361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:54.617950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.618432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.618867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.619562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.620013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.620609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.625273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:54.681984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:54.682947 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27347b75-80d0-40a6-85ac-89c04307d9cb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001312 Aug 30 04:09:54.683281 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 243/466] 10.222.0.27 () {56 vars in 886 bytes} [Tue Aug 30 04:09:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 04:09:54.708372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:54.708976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:54.715775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.716511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.717102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.717990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:54.719143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:54.719707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:54.801344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:54.814996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:54.819066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:54.821881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:54.824603 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-206f7e49-2f7c-481e-8450-51864a9c1e80 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.219109 Aug 30 04:09:54.825856 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 224/467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:54 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:54.831653 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ec330f0-8b62-4097-b2ed-ab116c226c1d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.127097 Aug 30 04:09:54.832434 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 244/468] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:54 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:09:54.990769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:54.991691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:54.994425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=40 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:55.003998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:55.004898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:55.006021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:55.007215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:55.008378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:55.009456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:55.176780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:55.185265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6fbd2561-ea74-4520-942d-1e8c8ee36601 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1313 microversion: 2.1 time: 0.198930 Aug 30 04:09:55.195236 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 225/469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:54 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:55.621342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:55.622118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:55.629675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:55.630192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:55.630650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:55.631401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:55.638337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:55.639457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:55.654005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:55.654538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:55.660910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:55.661702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:55.662153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:55.666253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:55.668649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:55.677238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:55.995751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:55.997956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:56.006945 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9aa2f3ed-021c-417c-93d6-e49bd433d8f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1470 microversion: 2.1 time: 0.388781 Aug 30 04:09:56.009782 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 245/470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:55 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:56.010708 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf439eed-29c2-40ae-b8c3-5f948b65d85e tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.383317 Aug 30 04:09:56.011291 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 226/471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:55 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:56.026010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:56.027185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:56.034450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:56.035210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:56.035846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:56.036775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:56.036900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:56.037581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:56.037814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:56.038482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:56.045694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:56.046242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:56.046720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:56.047418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:56.048052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:56.048632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:56.529121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:56.542264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:56.544371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:56.551910 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-914ee1b3-7963-4e41-833e-6e557b3f9a7d tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.539537 Aug 30 04:09:56.567118 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 227/472] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:56 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:56.578614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:56.580073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:56.587855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:56.588535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:56.589517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:56.590287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:56.590812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:56.591585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:56.767543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:56.777365 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5eb124a-3206-45ec-9d58-02088bef2e4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1505 microversion: 2.1 time: 0.767774 Aug 30 04:09:56.777952 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 246/473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:56 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1505 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:57.039282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:57.040243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:57.051259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.052939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.053771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.055019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.059621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:57.070715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.071536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.091818 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64a5d30c-d992-4a6b-be4c-b7eb57f4cd0c tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1463 microversion: 2.1 time: 0.523357 Aug 30 04:09:57.095857 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 228/474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:56 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1463 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:57.128731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:57.129376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:57.150286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.150704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.151147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.151870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.152333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.152765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.643854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:57.652920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d91e7ed7-833a-45a9-87f6-8ca5794ec0f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1470 microversion: 2.1 time: 0.623185 Aug 30 04:09:57.654022 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 247/475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:57 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1470 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:09:57.674986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:57.692093 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca353dfd-19b0-4e97-a745-46d4dec14ffc tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.569755 Aug 30 04:09:57.694191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 229/476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:57 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:57.699542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:57.700346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:57.706499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.707187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.707791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.708593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.709211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.709827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.820238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:57.829068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:57.830799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:57.837234 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af6497e7-7d95-44cb-8799-b5d3227490f7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.141783 Aug 30 04:09:57.838359 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 230/477] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:57 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:57.843089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:57.844411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:57.851630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.852405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.852999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.853900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.854509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.855351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.915948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Calling method '.version_select at 0x7fe96a9124c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:57.929079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.929585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.930242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.952486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:57.953255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:57.953711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:57.972161 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab3a1bb8-2eb8-4f0a-9652-1e72a4ad4b18 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/af56332dd1924e84b4bd25806a8592c4?start=2022-08-29T04%3A09%3A57.112837&end=2022-08-31T04%3A09%3A57.112837" status: 200 len: 694 microversion: 2.1 time: 0.316770 Aug 30 04:09:57.973147 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 248/478] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Aug 30 04:09:57 2022] GET /compute/v2.1/os-simple-tenant-usage/af56332dd1924e84b4bd25806a8592c4?start=2022-08-29T04%3A09%3A57.112837&end=2022-08-31T04%3A09%3A57.112837 => generated 694 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:57.990436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '.version_select at 0x7fe96aa83160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.001801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.002829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.003455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.015126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.015865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.016477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.031479 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37d280ad-039a-4b3f-8bdf-0c46d1a7b964 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/af56332dd1924e84b4bd25806a8592c4?start=2022-08-29T04%3A09%3A57.112837&end=2022-08-31T04%3A09%3A57.112837" status: 200 len: 694 microversion: 2.1 time: 0.044370 Aug 30 04:09:58.043765 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 249/479] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Aug 30 04:09:57 2022] GET /compute/v2.1/os-simple-tenant-usage/af56332dd1924e84b4bd25806a8592c4?start=2022-08-29T04%3A09%3A57.112837&end=2022-08-31T04%3A09%3A57.112837 => generated 694 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:58.050894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Calling method '.version_select at 0x7fe96a8e2f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.063789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.064344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.065044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.086692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.087551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.088177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.174066 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ccf0707-6049-439d-bdcf-0bd40dc1c953 tempest-TenantUsagesTestJSON-1553133817 tempest-TenantUsagesTestJSON-1553133817-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T04%3A09%3A57.112837&end=2022-08-31T04%3A09%3A57.112837&detailed=1" status: 200 len: 5246 microversion: 2.1 time: 0.127108 Aug 30 04:09:58.205640 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 250/480] 10.222.0.27 () {58 vars in 1335 bytes} [Tue Aug 30 04:09:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T04%3A09%3A57.112837&end=2022-08-31T04%3A09%3A57.112837&detailed=1 => generated 5246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:58.224955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.226169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:58.252586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.253640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.254393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.262507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.263320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.264008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.350050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:09:58.412055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:58.417195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:58.427542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22b3658b-78cb-4c24-b1f7-7ea522faaacb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1495 microversion: 2.1 time: 0.587931 Aug 30 04:09:58.432886 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 231/481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:57 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1495 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:58.463466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-718b8531-57ed-4e3c-8fc9-57046ae5a669 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '.version_select at 0x7fe96a93ee50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.467118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-718b8531-57ed-4e3c-8fc9-57046ae5a669 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.467609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-718b8531-57ed-4e3c-8fc9-57046ae5a669 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.468050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-718b8531-57ed-4e3c-8fc9-57046ae5a669 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.531682 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-718b8531-57ed-4e3c-8fc9-57046ae5a669 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 791 microversion: 2.1 time: 0.082063 Aug 30 04:09:58.533310 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 232/482] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:09:58 2022] GET /compute/v2.1/os-migrations => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:09:58.537658 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f1071de-f617-403f-b1c1-31375ad55180 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "DELETE /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 204 len: 0 microversion: 2.1 time: 0.329176 Aug 30 04:09:58.538570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 251/483] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:09:58 2022] DELETE /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:09:58.553102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.555391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:58.556846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.559266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:58.575074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.577123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.578199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.579091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.580649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.584084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.585045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.586024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.586627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.587351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.588023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.588431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.884703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:58.892958 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8af50450-32d5-4ff9-ba43-8014f644b796 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1469 microversion: 2.1 time: 0.346750 Aug 30 04:09:58.894162 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 252/484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:58 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1469 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:58.904448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.908224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:58.920576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.921207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c95862f2-49e7-447c-8e2f-84413e8c3334 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1646 microversion: 2.1 time: 0.378521 Aug 30 04:09:58.922457 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 233/485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:58 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1646 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:58.923438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.923892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.925201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.925682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.928292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:58.929059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:58.932472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.935597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.936301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.937793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:58.938876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:58.940430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:58.941553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.214194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:59.228726 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31d8ff53-46c8-42d9-a0ee-3c2b0fb6041d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.328139 Aug 30 04:09:59.241728 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 253/486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:58 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:59.247700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:59.247700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:09:59.261597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.262096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.262536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.263252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.263699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.264136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.278605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:59.289034 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-927e6117-ed76-49ff-9915-cd1a5182d4d3 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.365167 Aug 30 04:09:59.290920 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 234/487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:58 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:09:59.305123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-927027026", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "c3c9ddd9-fb5e-49c2-b881-772d074b19d2"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:59.361461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:59.385533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:59.391857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:09:59.401821 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d45f9b0f-b038-4831-86f0-5e13c33846a4 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.163070 Aug 30 04:09:59.403041 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 254/488] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:09:59 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:09:59.414893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] validate_networks() for [('c3c9ddd9-fb5e-49c2-b881-772d074b19d2', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:09:59.720267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96aa9caf0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:59.722267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.722930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.723528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.766771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.767448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.767894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.785907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.790414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.791072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.811893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-63823b12-980e-45b2-a5df-20654c0702d1 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.327551 Aug 30 04:09:59.821023 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 255/489] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:09:59 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:59.830066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9b22c36e-c6b2-4aff-a763-e31f2ed6cdb3 req-e831cd50-2bd4-4837-8e00-a76d200b9c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d47aea9-05a3-4ccb-b9f3-1a705de09ada", "name": "network-vif-plugged", "status": "completed", "tag": "b7267744-b2d6-4b27-96d6-da6626934486"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:09:59.849646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b22c36e-c6b2-4aff-a763-e31f2ed6cdb3 req-e831cd50-2bd4-4837-8e00-a76d200b9c18 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.864444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b22c36e-c6b2-4aff-a763-e31f2ed6cdb3 req-e831cd50-2bd4-4837-8e00-a76d200b9c18 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.866476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b22c36e-c6b2-4aff-a763-e31f2ed6cdb3 req-e831cd50-2bd4-4837-8e00-a76d200b9c18 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.883678 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9b22c36e-c6b2-4aff-a763-e31f2ed6cdb3 req-e831cd50-2bd4-4837-8e00-a76d200b9c18 service nova] Creating event network-vif-plugged:b7267744-b2d6-4b27-96d6-da6626934486 for instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada on n-h1-854925-5 Aug 30 04:09:59.892060 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9b22c36e-c6b2-4aff-a763-e31f2ed6cdb3 req-e831cd50-2bd4-4837-8e00-a76d200b9c18 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068219 Aug 30 04:09:59.893827 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 256/490] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:09:59.902025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96a940310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:09:59.908303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.909567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.910191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.929095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=86,nova_api:SAVEPOINT=4,nova_api:INSERT=2,nova_api:RELEASE=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:09:59.947667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.951005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.951622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.977069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:09:59.977807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:09:59.978411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:09:59.992369 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-baf8dc2e-1f9d-459b-a6b3-cf4eda5afc74 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.096311 Aug 30 04:10:00.003943 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 257/491] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 04:09:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:00.003943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.003943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:00.019056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.019710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.020217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.020997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.021864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.022590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.047359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:00.048146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:00.048819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:00.049484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:00.050133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:00.062626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.063120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.063560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.064292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.064750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.065179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.093759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:00.103320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for user c05146c8ea7b425eb8eda0088841dd8a and project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:00.126223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:10:00.130300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:10:00.195278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:00.199547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d2c9b23c-436d-450e-8868-f11277cc4abb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907177 Aug 30 04:10:00.203951 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 235/492] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:10:00.208605 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7573688e-28d3-4191-b7fc-558281f2fae4 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1469 microversion: 2.1 time: 0.212496 Aug 30 04:10:00.209741 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 258/493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:09:59 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1469 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:00.226444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96a8eb820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.226444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.226444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.226444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.235719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.236342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.236902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.249360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-02a443e8-412f-4d11-b732-558ee5629a3d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.251048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02a443e8-412f-4d11-b732-558ee5629a3d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:00.263483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.264082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.264586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.271541 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f41ad38-b504-40c7-8ed2-e39de627bb3d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.060525 Aug 30 04:10:00.277473 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 236/494] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:00.282165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.282996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:00.289872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.290572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.291224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.292331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.293139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.293757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.342549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-02a443e8-412f-4d11-b732-558ee5629a3d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:00.353740 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-02a443e8-412f-4d11-b732-558ee5629a3d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1210 microversion: 2.1 time: 0.109570 Aug 30 04:10:00.368258 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 259/495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:00.373084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96a8e2280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.375264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.375762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.376204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.399771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.400327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.400778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.411253 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ca70410-fcb0-44a3-a696-356ad78d365d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.041794 Aug 30 04:10:00.414174 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 260/496] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:00.432975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.433620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:00.450447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.451017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.451452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.452254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.453223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.477236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.555298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:00.563812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d339bee-56e9-4550-97f6-53ca0a7d8742 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.290206 Aug 30 04:10:00.564402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 237/497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:00.578747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.581838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:00.595734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.603561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.604089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.604835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.605300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.605782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.728788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:00.743370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:00.748132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:00.749064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:00.753962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:00.760875 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-71a47eda-0baa-4fd4-8274-b7408dcec3b3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.191416 Aug 30 04:10:00.761089 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f486345-43fc-4c46-9aee-3bc909ce21a2 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1322 microversion: 2.1 time: 0.343901 Aug 30 04:10:00.769154 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 261/498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:00.770270 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 238/499] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:00.776788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e13d85bf-2bd2-4dba-8f0c-f35a4893f68d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96aa9ca60>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.778393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13d85bf-2bd2-4dba-8f0c-f35a4893f68d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.779356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13d85bf-2bd2-4dba-8f0c-f35a4893f68d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.780512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13d85bf-2bd2-4dba-8f0c-f35a4893f68d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.805634 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e13d85bf-2bd2-4dba-8f0c-f35a4893f68d tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.034091 Aug 30 04:10:00.814215 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 262/500] 10.222.0.27 () {58 vars in 1179 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:00.819166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96a8eb5e0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.821647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.822209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.822722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.838945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.839685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.840362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.853991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.854895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.855534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.865299 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eaa1a79c-4ca9-44a7-ae2d-8f0b117f1f29 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.049716 Aug 30 04:10:00.872023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 239/501] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:10:00.879131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96a9fcee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.882555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.883345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.884021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.902607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.903352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.903787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.916779 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b327f65-bb8c-414d-b801-965b1443bb80 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.043613 Aug 30 04:10:00.918302 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 263/502] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:00.939727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96a8eb9d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:00.946563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.947072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.947513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.964981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:00.966825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:00.967299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:00.980053 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dbb64bc-353d-4c9b-979d-13b2af2608ab tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.050607 Aug 30 04:10:00.981443 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 240/503] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:00.996440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Calling method '.version_select at 0x7fe96a9400d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:01.001103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.001735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.003459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.034124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.034620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.035056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.077125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.077712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.078622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.140830 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb9ace81-599c-49b4-92c7-c6e9c6e21775 tempest-HypervisorAdminTestJSON-369543074 tempest-HypervisorAdminTestJSON-369543074-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.149141 Aug 30 04:10:01.142200 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 264/504] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Aug 30 04:10:00 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:01.231587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:01.232361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:01.244261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.244758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.245198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.245937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.247489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.247489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.376537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:01.377895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:01.399122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.400024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.400675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.401656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.402349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.403179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.634911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:01.643684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f8112632-1923-4cf8-b618-2fcf788f4cb4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1206 microversion: 2.1 time: 0.272476 Aug 30 04:10:01.649659 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 265/505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:01 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1206 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:01.654777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:01.660214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:01.675936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.678126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.679094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:01.681109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:01.681606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:01.682039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.012229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.025128 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-15e016df-8437-46c0-a071-36c971c0fd74 tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1469 microversion: 2.1 time: 0.797596 Aug 30 04:10:02.027637 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 241/506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:01 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1469 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:02.045573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:02.046153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:02.074445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.079981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.082517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.086310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.089233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.090961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.135537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.146065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb6a7cf9-0854-4d1c-9ccc-b1740b320beb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.494843 Aug 30 04:10:02.149134 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 266/507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:01 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:02.159749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:02.160778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:02.175642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.178073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.180184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.181214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.181927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.182628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.315147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.329171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.331310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.352618 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c284f57f-b3ba-4763-a59a-aa7ca4a9de9b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.201885 Aug 30 04:10:02.359553 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 267/508] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:02 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:02.372789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b5b3d81c-f1e6-414d-acf6-ee88a76a801f req-a7cde4a3-9073-406d-968a-cf03d3fddf47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "215b4756-43b0-407e-b08b-30e65eeddc9c", "name": "network-vif-deleted", "tag": "19cbaf31-6723-4fae-a617-3e31dc4955c3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:02.403537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b5b3d81c-f1e6-414d-acf6-ee88a76a801f req-a7cde4a3-9073-406d-968a-cf03d3fddf47 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.404304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b5b3d81c-f1e6-414d-acf6-ee88a76a801f req-a7cde4a3-9073-406d-968a-cf03d3fddf47 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.405195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b5b3d81c-f1e6-414d-acf6-ee88a76a801f req-a7cde4a3-9073-406d-968a-cf03d3fddf47 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.424538 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b5b3d81c-f1e6-414d-acf6-ee88a76a801f req-a7cde4a3-9073-406d-968a-cf03d3fddf47 service nova] Creating event network-vif-deleted:19cbaf31-6723-4fae-a617-3e31dc4955c3 for instance 215b4756-43b0-407e-b08b-30e65eeddc9c on n-h2-854925-5 Aug 30 04:10:02.431788 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b5b3d81c-f1e6-414d-acf6-ee88a76a801f req-a7cde4a3-9073-406d-968a-cf03d3fddf47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070249 Aug 30 04:10:02.433655 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 268/509] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:02.634694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.650441 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7dde83c0-6666-4578-89c1-8c2cb2bad981 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1472 microversion: 2.1 time: 0.615538 Aug 30 04:10:02.651781 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 242/510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:02 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1472 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:02.670048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:02.670981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:02.674546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:02.675272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:02.684503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.685185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.686254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.688990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.689758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.690376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.691241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.691852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.692478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.692598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.693785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.694247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.786989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Request method failure captured: Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada/diagnostics HTTP/1.1 Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2Gke6AH6vAvbiF-MkwQaVI397JGhDEg0hLT5Z7eqVIUmQLIQJeX1MwLp2OSJlmAv3cqZE3tWS0pPPKLSCOVpbhklpIFRw9p-AnFgp2RqAxBtp1ETylJOoOLBcfSyMssgAUjM9C9YZclHxDXuLZgYlpvafRd4_i7qzBqSpB15Ubrjg Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: bd7d995ea79e4de7ace9373cb4100356 Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1252894086 Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:02.796367 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd7d995ea79e4de7ace9373cb4100356", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd7d995ea79e4de7ace9373cb4100356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7d995ea79e4de7ace9373cb4100356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7d995ea79e4de7ace9373cb4100356"}]}] Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1252894086 Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: bd7d995ea79e4de7ace9373cb4100356 Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1252894086 Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiagnosticsNegativeTest-1252894086-project Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cc32e95900cc40fdaf525e102ed1651b Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1252894086-project Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:10:02.797733 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '8d47aea9-05a3-4ccb-b9f3-1a705de09ada'} Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:10:02.798504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:02.799641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:02.801535 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b18437b-d4d1-4291-af86-0a084cac5c0f tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.131266 Aug 30 04:10:02.804802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 243/511] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:10:02 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada/diagnostics => generated 117 bytes in 137 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:10:02.835754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:02.836501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:02.845363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.846175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.846771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.847779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:02.848408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:02.849525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:02.887793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:10:02.959666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:02.977765 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c6229b9-4219-45c4-a949-0da01119efc0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1268 microversion: 2.1 time: 0.310429 Aug 30 04:10:02.979118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 269/512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:02 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1268 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:03.043237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:03.055590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:03.067795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:03.085822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:03.086659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:03.087096 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df3eeeb5-3f2c-404e-8f50-12347bb70dca tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 204 len: 0 microversion: 2.1 time: 0.264504 Aug 30 04:10:03.087308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:03.089900 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 244/513] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:10:02 2022] DELETE /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:10:03.093807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:03.094581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:03.095236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:03.103196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:03.106064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:03.121689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:03.122360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:03.125590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:03.127193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:03.129473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:03.130238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:03.143434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:03.144577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:03.145133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:03.145943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lazy-loading 'fault' on Instance uuid 215b4756-43b0-407e-b08b-30e65eeddc9c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:03.248889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa1ee60b2ee34adbabf8c02804bfcfec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af56332dd1924e84b4bd25806a8592c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:03.261413 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-73e6c004-a275-4235-ad2e-b6cc30d01b9b tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 200 len: 1303 microversion: 2.1 time: 0.211454 Aug 30 04:10:03.271188 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 270/514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:03 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 1303 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:03.283789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:03.284830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:03.291854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:03.292722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:03.293403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:03.294523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:03.295413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:03.296189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.045719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:04.054661 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ee9d5e6-5976-440e-aae9-b9c673203b24 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1478 microversion: 2.1 time: 0.959817 Aug 30 04:10:04.058036 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 245/515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:03 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1478 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:04.076157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:04.076779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:04.092615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.094285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.094919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.095886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.096631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.104771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.128450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:04.142551 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a5cb5b5-9572-4f35-a961-7eb55755609b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.869851 Aug 30 04:10:04.143139 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 271/516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:03 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:04.147975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:04.161923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:04.176886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.177412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.177852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.178650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.178995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.179422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.258212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:04.270189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:04.271967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:04.284426 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-302c1cb0-86b7-4604-b709-b2e56251e032 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.216736 Aug 30 04:10:04.293905 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 246/517] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:04 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:04.306916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:04.307540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] [instance: 215b4756-43b0-407e-b08b-30e65eeddc9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:04.315638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.316134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.316882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.317630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:04.318225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:04.318658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:04.327163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:04.343868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bcc6d3c4-8733-4da1-8601-b6d03a9bfa2e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1268 microversion: 2.1 time: 0.198924 Aug 30 04:10:04.345414 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] HTTP exception thrown: Instance 215b4756-43b0-407e-b08b-30e65eeddc9c could not be found. Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Request method failure captured: Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c HTTP/1.1 Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2C1SH5zO-BXPsgMcgNmr9223NRc1vZID3Wy9NQwozcumKTqxPI557aizrMqt7JdJNvbLIefZFLZXWlJRb1TVuWjp6I1BPG32grBl-M6cGv2S8dQ6hfu8wt9wdB7oQYYWGAdEH8XPWSoMgNw4DvvSYaZcA0xo0fg1vAhvV3C_zEhoI Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: af56332dd1924e84b4bd25806a8592c4 Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TenantUsagesTestJSON-372833170 Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:04.347438 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_af56332dd1924e84b4bd25806a8592c4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/af56332dd1924e84b4bd25806a8592c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af56332dd1924e84b4bd25806a8592c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/af56332dd1924e84b4bd25806a8592c4"}]}] Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TenantUsagesTestJSON-372833170 Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: af56332dd1924e84b4bd25806a8592c4 Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TenantUsagesTestJSON-372833170 Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TenantUsagesTestJSON-372833170-project Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: fa1ee60b2ee34adbabf8c02804bfcfec Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TenantUsagesTestJSON-372833170-project Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 215b4756-43b0-407e-b08b-30e65eeddc9c could not be found. Aug 30 04:10:04.348884 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '215b4756-43b0-407e-b08b-30e65eeddc9c'} Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 215b4756-43b0-407e-b08b-30e65eeddc9c could not be found. Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:04.351553 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 215b4756-43b0-407e-b08b-30e65eeddc9c could not be found. Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 215b4756-43b0-407e-b08b-30e65eeddc9c could not be found. Aug 30 04:10:04.353237 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:04.354376 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 272/518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:04 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1268 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:04.355264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] Returning 404 to user: Instance 215b4756-43b0-407e-b08b-30e65eeddc9c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:04.360896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99193062-9248-4093-a53a-8c83a45b13dc tempest-TenantUsagesTestJSON-372833170 tempest-TenantUsagesTestJSON-372833170-project] 10.222.0.27 "GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c" status: 404 len: 111 microversion: 2.1 time: 0.065628 Aug 30 04:10:04.361505 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 247/519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:04 2022] GET /compute/v2.1/servers/215b4756-43b0-407e-b08b-30e65eeddc9c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:04.639452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1489991739", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "53a6551e-d2ba-4522-9e05-7aab6e168494"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:04.725862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] validate_networks() for [('53a6551e-d2ba-4522-9e05-7aab6e168494', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:05.079313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:05.080829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:05.092365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.093254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.094077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.094885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.096327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.099252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.586250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:05.587447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:05.588175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:05.614184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:05.616247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:05.638775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:05.646737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.647225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.647662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.648402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.650131 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-48cd156e-f57d-49eb-9a81-5dd12fc2dff6 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1478 microversion: 2.1 time: 0.574753 Aug 30 04:10:05.659563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.665591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.668184 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 248/520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:05 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1478 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:05.673815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:05.674755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:05.681955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.682674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.683432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.684681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.685310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.686051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.704292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:05.716834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Getting quotas for project 2a5c0e60926a43fcb53b148a2de0aea1. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:05.731971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Getting quotas for user 62349d5dce2c4d08bb0671425b2d8ec6 and project 2a5c0e60926a43fcb53b148a2de0aea1. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:05.760491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:10:05.762555 n-d-854925-5 devstack@n-api.service[122403]: WARNING nova.utils [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1489991739 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-148999173 Aug 30 04:10:05.764228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:10:05.847344 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3067899e-8160-42ab-ac8b-4a51e8adc415 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.407821 Aug 30 04:10:05.850211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 273/521] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:10:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:10:05.866611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:05.868718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:05.914192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.916484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.917164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:05.919560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:05.927871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:05.929917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.368762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:06.383678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:06.393138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:06.396584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63e293e4-b504-4935-b6f7-4700bc041a8e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.723485 Aug 30 04:10:06.397214 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 249/522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:05 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:06.405542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:06.421987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:06.424680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:06.429752 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f9111b9-6aa1-4d92-b572-e76182d7749b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.575153 Aug 30 04:10:06.432325 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 274/523] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:05 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:06.436034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.436712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.438447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.449031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.450170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.451782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.467083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81104289-2ec8-458e-9582-9df80469657d tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:06.468227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81104289-2ec8-458e-9582-9df80469657d tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:06.626112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-81104289-2ec8-458e-9582-9df80469657d tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:06.641384 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81104289-2ec8-458e-9582-9df80469657d tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1232 microversion: 2.1 time: 0.187555 Aug 30 04:10:06.643680 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 275/524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:06 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1232 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:06.657965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-dc0c0f39-50f6-41c8-abd0-1f13f4870fcf req-5fe65da6-78e2-4ab9-a26e-b1abb0a43321 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d47aea9-05a3-4ccb-b9f3-1a705de09ada", "name": "network-vif-deleted", "tag": "b7267744-b2d6-4b27-96d6-da6626934486"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:06.683730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-dc0c0f39-50f6-41c8-abd0-1f13f4870fcf req-5fe65da6-78e2-4ab9-a26e-b1abb0a43321 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.684230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-dc0c0f39-50f6-41c8-abd0-1f13f4870fcf req-5fe65da6-78e2-4ab9-a26e-b1abb0a43321 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.684720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-dc0c0f39-50f6-41c8-abd0-1f13f4870fcf req-5fe65da6-78e2-4ab9-a26e-b1abb0a43321 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.714292 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-dc0c0f39-50f6-41c8-abd0-1f13f4870fcf req-5fe65da6-78e2-4ab9-a26e-b1abb0a43321 service nova] Creating event network-vif-deleted:b7267744-b2d6-4b27-96d6-da6626934486 for instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada on n-h1-854925-5 Aug 30 04:10:06.732790 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-dc0c0f39-50f6-41c8-abd0-1f13f4870fcf req-5fe65da6-78e2-4ab9-a26e-b1abb0a43321 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087824 Aug 30 04:10:06.737222 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 276/525] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:06.754429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:06.756288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:06.772386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.775438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.779388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.783486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.784714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.785171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.839211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.840123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.841605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.841605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lazy-loading 'fault' on Instance uuid 8d47aea9-05a3-4ccb-b9f3-1a705de09ada {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:06.891806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:06.916060 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49b9e5b9-7a10-4ddc-8b97-df3573da71bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.502486 Aug 30 04:10:06.923653 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 250/526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:06 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:06.929068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b9ccd43d-f3a2-46cf-a411-3ebc904b1e18 req-39cbfef1-f27f-423e-a195-ccefaee9584d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e31325-5353-4171-b6c2-384cd56f13ca", "tag": "ccee229a-2293-49ad-9b55-ab06dfa3a92c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:06.956674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9ccd43d-f3a2-46cf-a411-3ebc904b1e18 req-39cbfef1-f27f-423e-a195-ccefaee9584d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:06.960864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9ccd43d-f3a2-46cf-a411-3ebc904b1e18 req-39cbfef1-f27f-423e-a195-ccefaee9584d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:06.962540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9ccd43d-f3a2-46cf-a411-3ebc904b1e18 req-39cbfef1-f27f-423e-a195-ccefaee9584d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:06.997602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc32e95900cc40fdaf525e102ed1651b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd7d995ea79e4de7ace9373cb4100356', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.009513 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98a9e548-a237-426a-9ff5-15e1a134731c tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 200 len: 1312 microversion: 2.1 time: 0.268681 Aug 30 04:10:07.010059 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b9ccd43d-f3a2-46cf-a411-3ebc904b1e18 req-39cbfef1-f27f-423e-a195-ccefaee9584d service nova] Creating event network-changed:ccee229a-2293-49ad-9b55-ab06dfa3a92c for instance 19e31325-5353-4171-b6c2-384cd56f13ca on n-h2-854925-5 Aug 30 04:10:07.012040 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 277/527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:06 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 1312 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:07.016730 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b9ccd43d-f3a2-46cf-a411-3ebc904b1e18 req-39cbfef1-f27f-423e-a195-ccefaee9584d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091588 Aug 30 04:10:07.017696 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 251/528] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:07.420291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:07.421408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:07.434219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.435031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.436566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.438141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.441726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.442372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.446344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Calling method '.version_select at 0x7fe96a8b48b0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:07.448448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.448934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.449793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.467688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.468794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.469420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.481560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.482320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.482905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.490461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1431fce3-0758-402c-8b20-88dd2b018715 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.215433 Aug 30 04:10:07.497361 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 278/529] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:10:07 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:07.504462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:07.505311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:07.511758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.512540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.513149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.514051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.514651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.515783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.610001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.620118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.620852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.628696 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14d66c37-41db-4451-b457-91a5a758d641 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.129933 Aug 30 04:10:07.642441 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 279/530] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:07 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:07.714877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.731519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-afa0207a-d28f-4975-b0b6-552f892c62ba tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.311527 Aug 30 04:10:07.732337 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 252/531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:07 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:07.738248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:07.742242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:07.757114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.757680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.758121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.759015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.759583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.760018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.916095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.929963 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4490750f-ea58-48a0-bc6f-332716cdb442 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1284 microversion: 2.1 time: 0.196209 Aug 30 04:10:07.942353 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 253/532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:07 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:07.955754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:07.962331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:07.975504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.976294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.976954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.977900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:07.978884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:07.979478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:07.993498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc5139b7-d68e-49e1-b97f-da5fb941f6c1 tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Calling method '.version_select at 0x7fe96a8555e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:07.995737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc5139b7-d68e-49e1-b97f-da5fb941f6c1 tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '92b262125b384c4982daaec06831f4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7fde3253c294b138d023188dc3d8a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc5139b7-d68e-49e1-b97f-da5fb941f6c1 tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Request method failure captured: Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hypervisors/n-h2-854925-5/search HTTP/1.1 Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2dE4JIpuO8DMXYloFmuL0X4_rBw9ZJ9teGg0RP8BPmeI3Cea8I6I7iFdrBMpWreBx4VS-Mu_dIYoks1LG7o2XszBoirUvjtiDdQvIOkjBBk5iTnfqPnTUhxzIrXTI3bJteci6xsjnaaouznbGBENE6WcAEWV4KBskgLwntCN3KWi4 Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e7fde3253c294b138d023188dc3d8a77 Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1734713687 Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:10:07.997532 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7fde3253c294b138d023188dc3d8a77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7fde3253c294b138d023188dc3d8a77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7fde3253c294b138d023188dc3d8a77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7fde3253c294b138d023188dc3d8a77"}]}] Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1734713687 Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e7fde3253c294b138d023188dc3d8a77 Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1734713687 Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 92b262125b384c4982daaec06831f4b2 Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 04:10:07.998768 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'n-h2-854925-5'} Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:10:08.000065 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 30 04:10:08.001126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.002220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc5139b7-d68e-49e1-b97f-da5fb941f6c1 tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:08.002220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc5139b7-d68e-49e1-b97f-da5fb941f6c1 tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/n-h2-854925-5/search" status: 403 len: 117 microversion: 2.1 time: 0.355429 Aug 30 04:10:08.009963 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 280/533] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Aug 30 04:10:07 2022] GET /compute/v2.1/os-hypervisors/n-h2-854925-5/search => generated 117 bytes in 367 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:08.017556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Calling method '.version_select at 0x7fe96a941280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.021849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.022475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.023187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.033948 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Request method failure captured: Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2ft-uVn6_KbILrSPgDYPEHqVI2_D0bl-q7bxs7OoW9GRd3c_qXLlwObT8CLZ0sbo8jt2yGaMvNkeFuGKtWZbvsw89U9bnp5GHbESWX9Bdt4jHtnD-t9q6nnQwY-inR_VuHNiNcsIH9cXeniBU3DdzZ6C5eu3jBqvf-721CMtSrR88 Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: d2522b442e134b72a4d5b5707e6cb87b Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-178305161 Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:10:08.036926 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2522b442e134b72a4d5b5707e6cb87b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2522b442e134b72a4d5b5707e6cb87b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2522b442e134b72a4d5b5707e6cb87b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2522b442e134b72a4d5b5707e6cb87b"}]}] Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-178305161 Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: d2522b442e134b72a4d5b5707e6cb87b Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-178305161 Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 6d34dcd73cb740668852012d58c169e3 Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 04:10:08.038404 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.039150 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.041078 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.041078 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:08.041078 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:08.041078 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 30 04:10:08.041078 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.042795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:08.044185 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06cb15c3-004e-4de0-86bc-fd7976a57131 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.032353 Aug 30 04:10:08.045610 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 281/534] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:08.053078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.054261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] [instance: 8d47aea9-05a3-4ccb-b9f3-1a705de09ada] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:08.062894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.063987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.064695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.065819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.066378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.067234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.089460 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] HTTP exception thrown: Instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada could not be found. Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Request method failure captured: Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada HTTP/1.1 Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2Gke6AH6vAvbiF-MkwQaVI397JGhDEg0hLT5Z7eqVIUmQLIQJeX1MwLp2OSJlmAv3cqZE3tWS0pPPKLSCOVpbhklpIFRw9p-AnFgp2RqAxBtp1ETylJOoOLBcfSyMssgAUjM9C9YZclHxDXuLZgYlpvafRd4_i7qzBqSpB15Ubrjg Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: bd7d995ea79e4de7ace9373cb4100356 Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1252894086 Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:10:08.091723 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bd7d995ea79e4de7ace9373cb4100356", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bd7d995ea79e4de7ace9373cb4100356"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7d995ea79e4de7ace9373cb4100356"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bd7d995ea79e4de7ace9373cb4100356"}]}] Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1252894086 Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: bd7d995ea79e4de7ace9373cb4100356 Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1252894086 Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerDiagnosticsNegativeTest-1252894086-project Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cc32e95900cc40fdaf525e102ed1651b Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1252894086-project Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada could not be found. Aug 30 04:10:08.092991 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '8d47aea9-05a3-4ccb-b9f3-1a705de09ada'} Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada could not be found. Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:08.093867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada could not be found. Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada could not be found. Aug 30 04:10:08.096238 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.098491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] Returning 404 to user: Instance 8d47aea9-05a3-4ccb-b9f3-1a705de09ada could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:08.099353 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-009f3fa9-697e-4950-894e-a50b7d051636 tempest-ServerDiagnosticsNegativeTest-1252894086 tempest-ServerDiagnosticsNegativeTest-1252894086-project] 10.222.0.27 "GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada" status: 404 len: 111 microversion: 2.1 time: 0.051632 Aug 30 04:10:08.099915 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 282/535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/servers/8d47aea9-05a3-4ccb-b9f3-1a705de09ada => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:08.106315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Calling method '.version_select at 0x7fe96aa9c3a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.110382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.111677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.112395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.132132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.132909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.133580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.149698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.150300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.151228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.158926 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-45b96d43-065b-47fc-9c25-79b831c8591e tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057745 Aug 30 04:10:08.160162 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 283/536] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:08.173300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a82438f-dd66-42b1-8046-fa3603fd4add tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Calling method '.version_select at 0x7fe96a89c670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.176868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2a82438f-dd66-42b1-8046-fa3603fd4add tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '92b262125b384c4982daaec06831f4b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7fde3253c294b138d023188dc3d8a77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a82438f-dd66-42b1-8046-fa3603fd4add tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Request method failure captured: Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2dE4JIpuO8DMXYloFmuL0X4_rBw9ZJ9teGg0RP8BPmeI3Cea8I6I7iFdrBMpWreBx4VS-Mu_dIYoks1LG7o2XszBoirUvjtiDdQvIOkjBBk5iTnfqPnTUhxzIrXTI3bJteci6xsjnaaouznbGBENE6WcAEWV4KBskgLwntCN3KWi4 Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e7fde3253c294b138d023188dc3d8a77 Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1734713687 Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:10:08.178910 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7fde3253c294b138d023188dc3d8a77", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7fde3253c294b138d023188dc3d8a77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7fde3253c294b138d023188dc3d8a77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7fde3253c294b138d023188dc3d8a77"}]}] Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1734713687 Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e7fde3253c294b138d023188dc3d8a77 Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1734713687 Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 92b262125b384c4982daaec06831f4b2 Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 04:10:08.180230 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1'} Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:10:08.180951 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 30 04:10:08.182219 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.183467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a82438f-dd66-42b1-8046-fa3603fd4add tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:08.184271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2a82438f-dd66-42b1-8046-fa3603fd4add tempest-HypervisorAdminNegativeUnderV252Test-1734713687 tempest-HypervisorAdminNegativeUnderV252Test-1734713687-project] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017138 Aug 30 04:10:08.184934 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 284/537] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:08.197687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Calling method '.version_select at 0x7fe96a83a9d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.201005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.203606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.205149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.213910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:08.216300 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] HTTP exception thrown: No hypervisor matching '7073607f-981d-4d0a-a0de-81a8aaa64dd9' could be found. Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Request method failure captured: Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-hypervisors/7073607f-981d-4d0a-a0de-81a8aaa64dd9/servers HTTP/1.1 Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2ft-uVn6_KbILrSPgDYPEHqVI2_D0bl-q7bxs7OoW9GRd3c_qXLlwObT8CLZ0sbo8jt2yGaMvNkeFuGKtWZbvsw89U9bnp5GHbESWX9Bdt4jHtnD-t9q6nnQwY-inR_VuHNiNcsIH9cXeniBU3DdzZ6C5eu3jBqvf-721CMtSrR88 Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: d2522b442e134b72a4d5b5707e6cb87b Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-178305161 Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:10:08.220010 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2522b442e134b72a4d5b5707e6cb87b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2522b442e134b72a4d5b5707e6cb87b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2522b442e134b72a4d5b5707e6cb87b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2522b442e134b72a4d5b5707e6cb87b"}]}] Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-178305161 Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: d2522b442e134b72a4d5b5707e6cb87b Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-178305161 Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 6d34dcd73cb740668852012d58c169e3 Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: exception: No hypervisor matching '7073607f-981d-4d0a-a0de-81a8aaa64dd9' could be found. Aug 30 04:10:08.221525 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7073607f-981d-4d0a-a0de-81a8aaa64dd9'} Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '7073607f-981d-4d0a-a0de-81a8aaa64dd9' could be found. Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.222287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:08.223358 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:08.223358 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:08.223358 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:08.223358 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:08.223358 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '7073607f-981d-4d0a-a0de-81a8aaa64dd9' could be found. Aug 30 04:10:08.223358 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:08.226232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] Returning 404 to user: No hypervisor matching '7073607f-981d-4d0a-a0de-81a8aaa64dd9' could be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:08.227713 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f71bf5d7-6617-4285-b7d8-fcf2ef709f94 tempest-HypervisorAdminNegativeUnderV252Test-178305161 tempest-HypervisorAdminNegativeUnderV252Test-178305161-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors/7073607f-981d-4d0a-a0de-81a8aaa64dd9/servers" status: 404 len: 123 microversion: 2.1 time: 0.037248 Aug 30 04:10:08.228852 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 285/538] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/os-hypervisors/7073607f-981d-4d0a-a0de-81a8aaa64dd9/servers => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:10:08.228985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:08.238606 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0318d96-8b77-4030-9772-841e2c94c792 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.294782 Aug 30 04:10:08.239199 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 254/539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:07 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:08.657182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.658381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:08.679032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.682413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.683235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.684172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.684643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.688642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.754788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.755574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:08.772220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.772988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.773821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.775062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.775990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.776718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.786590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:08.799706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:08.803224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:08.821055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b5279c8-128b-4e90-8a13-af85916b2e19 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.168526 Aug 30 04:10:08.824080 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 286/540] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:08.959914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:08.959914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:08.969288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.970321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.973577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:08.974752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:08.975451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:08.976106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:09.069130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:09.082785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-457b5985-6fb9-40c7-88d5-75367219af5c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.331764 Aug 30 04:10:09.085990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 255/541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:09.177574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:09.193288 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-11458b8d-a614-4755-9c6a-6f7e2b30c97a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1290 microversion: 2.1 time: 0.238822 Aug 30 04:10:09.195016 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 287/542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:08 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1290 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:09.268111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:09.268734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:09.289582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:09.295757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:09.298180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:09.299445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:09.300846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:09.301564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:09.711399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:09.720459 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34892075-ca41-460f-a686-7f56f0778370 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.464997 Aug 30 04:10:09.721053 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 256/543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:09 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:09.848903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:09.850314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:09.857785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:09.858560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:09.859832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:09.860714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:09.861349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:09.861927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:10.078757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:10.102696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:10.104477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:10.111870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:10.114134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:10.120532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:10.120677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ffeab4ac-cc96-4916-b37e-ebd508120387 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.274868 Aug 30 04:10:10.143118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:10.143673 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 288/544] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:09 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:10.150987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:10.157491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:10.158176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:10.159158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:10.167915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:10.168623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:10.216406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:10.217053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:10.229597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:10.231337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:10.233140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:10.236541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:10.238344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:10.241751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:10.413988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:10.427797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9ce7de1-188c-46cd-a212-8dd86f45a08a tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1290 microversion: 2.1 time: 0.215360 Aug 30 04:10:10.432390 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 289/545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:10 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1290 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:10.542841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:10.560245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f520bd64-8909-46fc-8979-a93ab94a693e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.453396 Aug 30 04:10:10.562960 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 257/546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:10 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:10.740995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:10.741704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:10.752914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:10.753632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:10.754267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:10.755094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:10.765724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:10.766504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.030797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:11.040119 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-70ff189f-f6e5-47ee-9975-497bb8c30a6e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.303112 Aug 30 04:10:11.044099 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 290/547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:10 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:11.154168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:11.155365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:11.169281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.169281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.169281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.174447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.174939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.175384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.306189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:11.319502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:11.322132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:11.328885 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e096291a-40ec-41cf-889f-b8720c2eba72 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.178439 Aug 30 04:10:11.329858 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 258/548] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:11 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:10:11.453739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:11.454498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:11.465687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.467792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.469520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.470465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.472101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.474206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.585667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:11.587140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:11.602241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.602742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.603623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.605087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:11.605667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:11.606457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:11.928437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:11.957972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b1bbd96-ce26-4160-8567-cfc22650ae44 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.507235 Aug 30 04:10:11.961738 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 291/549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:11 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:12.064876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:12.065687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:12.068233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:12.070603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:12.083302 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-47d22622-9705-4449-a5c0-7cb61aa1b9cf tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.503129 Aug 30 04:10:12.084576 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 259/550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:11 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:12.089757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:12.091352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:12.094624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:12.095534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:12.097181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:12.098591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:12.310680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:12.322019 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9e04644f-cf27-4deb-9dc0-b36b124fd9ee tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.259297 Aug 30 04:10:12.322616 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 292/551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:12 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:12.355021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:12.355890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:12.369041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:12.370011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:12.371044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:12.371947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:12.373084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:12.373761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:12.503076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:12.524391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:12.525621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:12.534166 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b08e009-e3c9-4243-8ca5-27bd1b2d98dd tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.183536 Aug 30 04:10:12.535065 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 260/552] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:12 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:12.981749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:12.982358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:12.996590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:12.997083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.004102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.005872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.006348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.006786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.233641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Action: 'update', calling method: .version_select at 0x7fe96b0a0040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:13.243219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.248580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.249247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.265725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.277694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.279825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.296873 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] HTTP exception thrown: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Request method failure captured: Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 HTTP/1.1 Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 56 Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2kLkMgTjUEqUSTcNpVrwsP5SbkAgW0LrKtdIPaczg1SDuFmnN2bcSxWvBzuz6_O25fmcAh6jHSCHtxOLPfh5Wms4ZB8pj0a8556nTAu0t0ct8ah0UQet-Rd-n_w89Q5_EDPi_0tLLpgXjcSEbPHXXlWsmXlnu0ajQXnWyPB-1Zu9U Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 697675046a62411ca2574d7acfa0bb9c Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:10:13.299962 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697675046a62411ca2574d7acfa0bb9c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697675046a62411ca2574d7acfa0bb9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697675046a62411ca2574d7acfa0bb9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697675046a62411ca2574d7acfa0bb9c"}]}] Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 697675046a62411ca2574d7acfa0bb9c Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 223e0638fb9f4c98a1b2cb5fa3ba970e Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:10:13.301727 n-d-854925-5 devstack@n-api.service[122402]: exception: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a5ea1db9-3a41-4f5a-8baa-52cc2e894a08', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.302731 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:13.304319 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:13.305809 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:13.305809 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.305809 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.308175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Returning 404 to user: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:13.309756 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ee9fc8e-2f16-4de6-a02b-db1bdbe623f2 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08" status: 404 len: 110 microversion: 2.53 time: 0.253766 Aug 30 04:10:13.310504 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 261/553] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Aug 30 04:10:13 2022] PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 => generated 110 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:10:13.318777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d463bde9-a8d4-4b12-8c8d-fc16e44dfdb2 req-d50a4727-1ecb-48da-afcb-7dbe738fdd7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7561c30-d399-4711-96ca-e495d55f96c4", "tag": "adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:13.333483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d463bde9-a8d4-4b12-8c8d-fc16e44dfdb2 req-d50a4727-1ecb-48da-afcb-7dbe738fdd7c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.334271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d463bde9-a8d4-4b12-8c8d-fc16e44dfdb2 req-d50a4727-1ecb-48da-afcb-7dbe738fdd7c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.335107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d463bde9-a8d4-4b12-8c8d-fc16e44dfdb2 req-d50a4727-1ecb-48da-afcb-7dbe738fdd7c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.351918 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d463bde9-a8d4-4b12-8c8d-fc16e44dfdb2 req-d50a4727-1ecb-48da-afcb-7dbe738fdd7c service nova] Creating event network-changed:adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a for instance c7561c30-d399-4711-96ca-e495d55f96c4 on n-h2-854925-5 Aug 30 04:10:13.357559 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d463bde9-a8d4-4b12-8c8d-fc16e44dfdb2 req-d50a4727-1ecb-48da-afcb-7dbe738fdd7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044924 Aug 30 04:10:13.360398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 262/554] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:13.366251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:13.366951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:13.374019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.375402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.376048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.376784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.377244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.377717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.898929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:13.915387 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d6fa056f-e08f-46da-9036-b94bf2aa3a6a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.552163 Aug 30 04:10:13.915666 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 263/555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:13 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:13.917318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:13.927511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aa84ca0>, body: {"status": "disabled"} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:13.932849 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d134b2da-860d-4baf-82c9-a858621cb562 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.954615 Aug 30 04:10:13.937462 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 293/556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:12 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:13.939585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.942644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:13.945088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.945938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:13.946440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.961052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.961818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.962578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.963298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.964182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:13.964612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.966027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.969559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:13.970118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:13.983187 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] HTTP exception thrown: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Request method failure captured: Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 HTTP/1.1 Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 22 Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2kLkMgTjUEqUSTcNpVrwsP5SbkAgW0LrKtdIPaczg1SDuFmnN2bcSxWvBzuz6_O25fmcAh6jHSCHtxOLPfh5Wms4ZB8pj0a8556nTAu0t0ct8ah0UQet-Rd-n_w89Q5_EDPi_0tLLpgXjcSEbPHXXlWsmXlnu0ajQXnWyPB-1Zu9U Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 697675046a62411ca2574d7acfa0bb9c Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:10:13.994124 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697675046a62411ca2574d7acfa0bb9c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697675046a62411ca2574d7acfa0bb9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697675046a62411ca2574d7acfa0bb9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697675046a62411ca2574d7acfa0bb9c"}]}] Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 697675046a62411ca2574d7acfa0bb9c Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 223e0638fb9f4c98a1b2cb5fa3ba970e Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: {"status": "disabled"} Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: exception: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.995752 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a5ea1db9-3a41-4f5a-8baa-52cc2e894a08', 'body': {'status': 'disabled'}} Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.996769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:13.998440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:14.000005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:14.000005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.001436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Returning 404 to user: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:14.002502 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-52f271c3-f57c-40c8-9920-648206ea3f83 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08" status: 404 len: 110 microversion: 2.53 time: 0.084193 Aug 30 04:10:14.010351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 264/557] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Aug 30 04:10:13 2022] PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 => generated 110 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:10:14.026054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.027108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:14.043636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.045753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.048042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.052403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.053074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.054311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.216229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:14.224938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:14.226423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:14.231769 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9600a81f-64aa-4cab-beaf-af7401d08ba7 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.219667 Aug 30 04:10:14.232637 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 265/558] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:14.237292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-230d79bb-258b-4024-95ef-8ce14f3b570b req-178214b8-d857-48cb-a1a9-7d980b599ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e31325-5353-4171-b6c2-384cd56f13ca", "name": "network-vif-plugged", "status": "completed", "tag": "ccee229a-2293-49ad-9b55-ab06dfa3a92c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:14.246862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-230d79bb-258b-4024-95ef-8ce14f3b570b req-178214b8-d857-48cb-a1a9-7d980b599ea5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.247824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-230d79bb-258b-4024-95ef-8ce14f3b570b req-178214b8-d857-48cb-a1a9-7d980b599ea5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.248466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-230d79bb-258b-4024-95ef-8ce14f3b570b req-178214b8-d857-48cb-a1a9-7d980b599ea5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.261736 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-230d79bb-258b-4024-95ef-8ce14f3b570b req-178214b8-d857-48cb-a1a9-7d980b599ea5 service nova] Creating event network-vif-plugged:ccee229a-2293-49ad-9b55-ab06dfa3a92c for instance 19e31325-5353-4171-b6c2-384cd56f13ca on n-h2-854925-5 Aug 30 04:10:14.269189 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-230d79bb-258b-4024-95ef-8ce14f3b570b req-178214b8-d857-48cb-a1a9-7d980b599ea5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035147 Aug 30 04:10:14.270191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 266/559] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:14.278717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aa844c0>, body: {"status": "enabled"} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:14.283021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.283915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.284432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.291369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.291946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.292462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.295013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:14.297993 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] HTTP exception thrown: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Request method failure captured: Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 HTTP/1.1 Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 21 Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2kLkMgTjUEqUSTcNpVrwsP5SbkAgW0LrKtdIPaczg1SDuFmnN2bcSxWvBzuz6_O25fmcAh6jHSCHtxOLPfh5Wms4ZB8pj0a8556nTAu0t0ct8ah0UQet-Rd-n_w89Q5_EDPi_0tLLpgXjcSEbPHXXlWsmXlnu0ajQXnWyPB-1Zu9U Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 697675046a62411ca2574d7acfa0bb9c Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:10:14.301304 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697675046a62411ca2574d7acfa0bb9c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697675046a62411ca2574d7acfa0bb9c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697675046a62411ca2574d7acfa0bb9c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697675046a62411ca2574d7acfa0bb9c"}]}] Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 697675046a62411ca2574d7acfa0bb9c Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261 Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 223e0638fb9f4c98a1b2cb5fa3ba970e Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: {"status": "enabled"} Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: exception: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:14.302625 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a5ea1db9-3a41-4f5a-8baa-52cc2e894a08', 'body': {'status': 'enabled'}} Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6205, in service_get_by_id Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6065, in _find_service_in_cell Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:14.303450 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:14.304621 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:14.305774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. Aug 30 04:10:14.305774 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.306667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Returning 404 to user: Service a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:14.306965 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa63ab70-3835-4f36-b854-01ef295c438c tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08" status: 404 len: 110 microversion: 2.53 time: 0.035458 Aug 30 04:10:14.311530 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 267/560] 10.222.0.27 () {62 vars in 1309 bytes} [Tue Aug 30 04:10:14 2022] PUT /compute/v2.1/os-services/a5ea1db9-3a41-4f5a-8baa-52cc2e894a08 => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:10:14.314638 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-272796bb-53b7-4ba0-bc54-a713a1233104 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.379553 Aug 30 04:10:14.315517 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 294/561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:13 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:14.320412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.325589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.326310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.327102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.328710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.329414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.330022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.365868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d55f17f3-0db9-49c4-a099-82b18cd0acc5 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.049131 Aug 30 04:10:14.366633 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 295/562] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:14.379654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.384106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.384736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.385438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.386279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.386841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.387367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.413411 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bfc7bfc5-1971-4b98-8a78-fd253b67092d tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.037222 Aug 30 04:10:14.423059 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 296/563] 10.222.0.27 () {60 vars in 1211 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:10:14.428188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.432939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.433769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.434446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.435481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.436508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.437769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.465187 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47c4fb34-69fc-4b43-bebd-307ed52da4db tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040625 Aug 30 04:10:14.466189 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 297/564] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:14.478808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d867d3f4-8d51-422c-9702-6a239e10dcf0 tempest-NetworksTest-1508539907 tempest-NetworksTest-1508539907-project-admin] Calling method '.version_select at 0x7fe96aa4d4c0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.479365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.483170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.483969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.485239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.486035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.486533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.486939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.525600 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-003731ed-2cc4-44ef-be18-80e14c7d07de tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-854925-5&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.050430 Aug 30 04:10:14.533615 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 298/565] 10.222.0.27 () {60 vars in 1235 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-services?host=n-d-854925-5&binary=xxx => generated 16 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:14.539584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.543474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.543970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.544417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.545186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.545652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.546080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.576410 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9b03dfd9-90ea-4457-97c0-5805b3a27665 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.040850 Aug 30 04:10:14.578028 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 299/566] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:14.590103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.593910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.594407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.594852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.595596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.596049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.596475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.622021 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f795f50a-2a58-4945-b752-036fbd380483 tempest-ServicesAdminNegativeV253TestJSON-1414195261 tempest-ServicesAdminNegativeV253TestJSON-1414195261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.035635 Aug 30 04:10:14.622813 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 300/567] 10.222.0.27 () {60 vars in 1239 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:14.649394 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d867d3f4-8d51-422c-9702-6a239e10dcf0 tempest-NetworksTest-1508539907 tempest-NetworksTest-1508539907-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6068 microversion: 2.1 time: 0.340756 Aug 30 04:10:14.650480 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 268/568] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-networks => generated 6068 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:14.659028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f334e2c0-014d-4340-8052-dfb1de25d30e tempest-NetworksTest-1508539907 tempest-NetworksTest-1508539907-project-admin] Calling method '.version_select at 0x7fe96a99e670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.786815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f334e2c0-014d-4340-8052-dfb1de25d30e tempest-NetworksTest-1508539907 tempest-NetworksTest-1508539907-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks/0107d3fc-9cf7-4a32-9d50-0265c857149b" status: 200 len: 652 microversion: 2.1 time: 0.131689 Aug 30 04:10:14.788505 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 269/569] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-networks/0107d3fc-9cf7-4a32-9d50-0265c857149b => generated 652 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:14.800533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20658964-a3d9-4043-87b0-17b204b74d20 tempest-ServicesAdminNegativeV253TestJSON-1958628738 tempest-ServicesAdminNegativeV253TestJSON-1958628738-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.804805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20658964-a3d9-4043-87b0-17b204b74d20 tempest-ServicesAdminNegativeV253TestJSON-1958628738 tempest-ServicesAdminNegativeV253TestJSON-1958628738-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '97527a214fe84b0489ff3fb375f6f664', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db3ee9c3c083436f8b7f8849b3ec4158', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:14.805426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c83ca3f4-2e98-4ed5-9ba3-aadd8a1994d9 tempest-NetworksTest-1508539907 tempest-NetworksTest-1508539907-project-admin] Calling method '.version_select at 0x7fe96aa4d550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20658964-a3d9-4043-87b0-17b204b74d20 tempest-ServicesAdminNegativeV253TestJSON-1958628738 tempest-ServicesAdminNegativeV253TestJSON-1958628738-project] Request method failure captured: Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2kSFduSm19fTEOKCyL38ureKvdJmqrFZBpGC7nzYjZi-JSGwoDpOC8Lr_oHzK9Jo24Ja1T7abKJ1TiNsIdvQvPHRdcV5hHNTvGhqO8Nmz-QxRV6f5M3juXefs6iQANC_S_OTmyuRArklA9YLr36RnTGiBnOdT5NycSaeb7QZdJvR8 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.53 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: db3ee9c3c083436f8b7f8849b3ec4158 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1958628738 Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:10:14.807146 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_db3ee9c3c083436f8b7f8849b3ec4158", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/db3ee9c3c083436f8b7f8849b3ec4158"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db3ee9c3c083436f8b7f8849b3ec4158"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/db3ee9c3c083436f8b7f8849b3ec4158"}]}] Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1958628738 Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: db3ee9c3c083436f8b7f8849b3ec4158 Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1958628738 Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1958628738-project Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97527a214fe84b0489ff3fb375f6f664 Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1958628738-project Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 04:10:14.808813 n-d-854925-5 devstack@n-api.service[122403]: action_args: {} Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:10:14.809763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 04:10:14.811155 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:14.814198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20658964-a3d9-4043-87b0-17b204b74d20 tempest-ServicesAdminNegativeV253TestJSON-1958628738 tempest-ServicesAdminNegativeV253TestJSON-1958628738-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:14.815825 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20658964-a3d9-4043-87b0-17b204b74d20 tempest-ServicesAdminNegativeV253TestJSON-1958628738 tempest-ServicesAdminNegativeV253TestJSON-1958628738-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.183983 Aug 30 04:10:14.816825 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 301/570] 10.222.0.27 () {60 vars in 1178 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-services => generated 112 bytes in 185 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:10:14.936749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.937565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:14.954039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.954528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.955056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.955814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.956225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.956692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.964203 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c83ca3f4-2e98-4ed5-9ba3-aadd8a1994d9 tempest-NetworksTest-1508539907 tempest-NetworksTest-1508539907-project-admin] 10.222.0.27 "GET /compute/v2.1/os-networks" status: 200 len: 6068 microversion: 2.1 time: 0.169228 Aug 30 04:10:14.969166 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 270/571] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/os-networks => generated 6068 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:14.973218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:14.973982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:14.991398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.991910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.993047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:14.993801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:14.994262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:14.994694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:15.449925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:15.459603 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa036775-d8e2-459a-b0b0-40aaca16f4e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.493206 Aug 30 04:10:15.463378 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 271/572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:15.472685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:15.486577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:15.499809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:15.502731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:15.505158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:15.506083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:15.506544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:15.507009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:15.650589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:15.662198 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16e4f46b-2834-40c2-be51-fac7d4eb9027 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.729683 Aug 30 04:10:15.663337 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 302/573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:14 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:15.668522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:15.669432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:15.683053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:15.694805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:15.695278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:15.706202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:15.707130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:15.707777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:15.732569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:15.743993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:15.748850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:15.761802 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf4854e5-beff-4f36-b21e-f468f6f83ff5 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.294763 Aug 30 04:10:15.762853 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 272/574] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:15 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:15.964221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:15.972705 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b97ac8f9-4e47-4a86-aa36-fc26f4a21ab7 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.308068 Aug 30 04:10:15.981725 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 303/575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:15 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:16.488179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:16.488802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:16.501577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.503743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.504821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.507706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.508516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.509154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.525098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:16.684702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:16.685354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:16.689284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:16.702013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.704386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.707025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.710765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.711247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.713414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.799729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:16.814266 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2c693e2-9300-4bc9-9b61-66d0678cf7d4 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.329850 Aug 30 04:10:16.815059 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 273/576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:16 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:16.819474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:16.820062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:16.836314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.836679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.837416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.838288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:16.839256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:16.840345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:16.998855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:17.034263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:17.035539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:17.041782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:17.043122 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c2bb0708-4c75-4b6a-9ac7-1734d34cf890 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.363230 Aug 30 04:10:17.043707 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 304/577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:16 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:17.051810 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c86930c-259a-4d95-b5eb-f63a58e001ed tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1446 microversion: 2.75 time: 0.234578 Aug 30 04:10:17.053547 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 274/578] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:16 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1446 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:17.057531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:17.071275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:17.099183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:17.099833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:17.100294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:17.101066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:17.101534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:17.101966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:17.436704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:17.444785 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff48688e-cea0-4748-81d0-41f41dd708bf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1310 microversion: 2.1 time: 0.400043 Aug 30 04:10:17.451138 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 305/579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:17 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1310 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:17.857139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:17.857902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:17.874227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:17.874227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:17.874227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:17.875519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:17.880208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:17.880809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.075981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:18.076958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:18.088588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.089081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.089663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.090737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.091844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.094164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.149215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:18.158926 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be146cc8-5686-49f6-a611-ddec8a996d91 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.323981 Aug 30 04:10:18.160268 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 275/580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:17 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:18.166186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:18.166954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:18.174687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.175427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.176024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.176891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.177841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.178412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.353198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:18.365399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:18.367165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:18.374080 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-96e73b7c-7fd3-406b-9dbf-b1e220469cca tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1452 microversion: 2.75 time: 0.212513 Aug 30 04:10:18.375501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 276/581] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:18 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:18.408544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:18.418822 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41433dfc-c6b3-46ce-8b69-9944ae7fabd0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.357833 Aug 30 04:10:18.423823 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 306/582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:18 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:18.476481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:18.477861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:18.485172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.485896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.486443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.487244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.487795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.488666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.659540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:18.667845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5dac5d3b-679e-4008-a369-9e73dad7a1dc tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1493 microversion: 2.1 time: 0.195291 Aug 30 04:10:18.668468 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 277/583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:18 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1493 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:18.689107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:18.690212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:18.697725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.698506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.699111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.700105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.700718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.701307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.723063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:18.860567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d3307aeb-5c1d-4439-a1dc-ad46f62fa798 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1644 microversion: 2.1 time: 0.175101 Aug 30 04:10:18.861728 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 307/584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:18 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1644 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:18.896137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:18.898353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:18.909382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.911251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.912233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:18.914837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:18.916235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:18.919197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.178458 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-93c47ab2-8a0b-4f0b-8b1b-68171ade5d26 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1644 microversion: 2.1 time: 0.283470 Aug 30 04:10:19.179357 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 278/585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:18 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1644 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:19.190584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:19.193638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:19.210390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.211104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.211873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.212802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.214977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:19.220765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.222034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.223144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.223939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.224507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.226305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.227338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.228524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.282611 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d22ffb22-6eee-4e73-9aff-8d999690a28f tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.074317 Aug 30 04:10:19.297023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 279/586] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:10:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:19.309281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:19.311037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:19.323383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.324513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.325825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.327286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.329000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.329999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.524547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7ce75de7-8ff1-4668-b083-7ff277a8ff6b tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca/action" status: 202 len: 0 microversion: 2.1 time: 0.224795 Aug 30 04:10:19.532827 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 280/587] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:19 2022] POST /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:10:19.553768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:19.558557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:19.588169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.591918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.592943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.596232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.597993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.599761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.685258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:19.726830 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4733d704-6047-41a3-8b40-e95dc653db7c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.548929 Aug 30 04:10:19.731588 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 308/588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:19 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:19.755120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:19.756661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:19.783829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.800157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.802590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.804173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.809765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:19.809949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.812553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.826947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:19.834606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:19.847962 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5bb9564b-5879-4d74-8bfe-6b56641aadc0 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1452 microversion: 2.75 time: 0.310455 Aug 30 04:10:19.862080 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 281/589] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:19 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1452 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:19.866757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:19.866757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:19.885716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.887470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.888611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:19.892705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:19.893759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:19.894661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:20.304131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:20.322867 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75fce4fe-dacf-4da1-8dc0-7d029fa8894e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1475 microversion: 2.1 time: 0.586839 Aug 30 04:10:20.323835 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 309/590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:19 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1475 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:20.359911 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ecbbbfd8-712b-463a-82fc-ec7be0b05419 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1649 microversion: 2.1 time: 0.502607 Aug 30 04:10:20.361304 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 282/591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:19 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1649 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:20.661756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5b2ce5ff-7fab-4a99-9818-7ebd6cb6f00d req-18f46065-8d8e-4dca-8455-1ac89c00bc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7561c30-d399-4711-96ca-e495d55f96c4", "name": "network-vif-plugged", "status": "completed", "tag": "adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:20.686421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5b2ce5ff-7fab-4a99-9818-7ebd6cb6f00d req-18f46065-8d8e-4dca-8455-1ac89c00bc2a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:20.687694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5b2ce5ff-7fab-4a99-9818-7ebd6cb6f00d req-18f46065-8d8e-4dca-8455-1ac89c00bc2a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:20.690745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5b2ce5ff-7fab-4a99-9818-7ebd6cb6f00d req-18f46065-8d8e-4dca-8455-1ac89c00bc2a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:20.748946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5b2ce5ff-7fab-4a99-9818-7ebd6cb6f00d req-18f46065-8d8e-4dca-8455-1ac89c00bc2a service nova] Creating event network-vif-plugged:adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a for instance c7561c30-d399-4711-96ca-e495d55f96c4 on n-h2-854925-5 Aug 30 04:10:20.764084 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5b2ce5ff-7fab-4a99-9818-7ebd6cb6f00d req-18f46065-8d8e-4dca-8455-1ac89c00bc2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106704 Aug 30 04:10:20.766849 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 310/592] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:20.791096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:20.791826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:20.813803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:20.814302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:20.814742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:20.815450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:20.815904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:20.824946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.002128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6ae900b0-71cc-44e1-9af5-b7a2ae5e995d tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] Calling method '.version_select at 0x7fe96a99e040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:21.034428 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6ae900b0-71cc-44e1-9af5-b7a2ae5e995d tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.317988 Aug 30 04:10:21.035658 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 283/593] 10.222.0.27 () {60 vars in 1226 bytes} [Tue Aug 30 04:10:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:10:21.041615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:21.042293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:21.051223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.051728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.052967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.054733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.055221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.055661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.177706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:21.186505 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4091135-e3c9-4e6a-894b-39c562a7a846 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.418405 Aug 30 04:10:21.200718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 311/594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:20 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:21.205932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-34902278-46a0-4d21-b0d9-194d6f3b159e tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a80d5e0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:21.222387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:21.244856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:21.246834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:21.257799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b6ceb4f-3c5f-440e-999d-472435ac8f07 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1452 microversion: 2.75 time: 0.220580 Aug 30 04:10:21.262223 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 284/595] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:21 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1452 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:21.357139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:21.359708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:21.383019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.383667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.384276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.385399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.386862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.387660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.435305 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-34902278-46a0-4d21-b0d9-194d6f3b159e tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.232824 Aug 30 04:10:21.436081 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 312/596] 10.222.0.27 () {62 vars in 1247 bytes} [Tue Aug 30 04:10:21 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:10:21.441341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:21.442349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:21.450365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.451002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.451639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.453098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.453679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.454243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.783135 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47c89529-7473-4053-96b8-5c4d35c40a89 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1629 microversion: 2.1 time: 0.345554 Aug 30 04:10:21.783817 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 313/597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:21 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1629 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:21.783817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89299572-ee02-439b-9270-419716d8b8cf tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] Calling method '.version_select at 0x7fe96a8181f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:21.797712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:21.798994 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a71fb680-88d2-4f26-a900-7506b456ab1a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1474 microversion: 2.1 time: 0.458305 Aug 30 04:10:21.799754 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 285/598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:21 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1474 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:21.820976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854925-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:21.824379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:21.834480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.835224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.835847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.837632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:21.838660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:21.839357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:21.850239 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-89299572-ee02-439b-9270-419716d8b8cf tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.065351 Aug 30 04:10:21.851011 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 314/599] 10.222.0.27 () {60 vars in 1226 bytes} [Tue Aug 30 04:10:21 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:10:21.861928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f13b95e6-56bb-4d9e-b3a3-8a19b4225f8e tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a818040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:21.947660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lazy-loading 'flavor' on Instance uuid 19e31325-5353-4171-b6c2-384cd56f13ca {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:22.015695 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f13b95e6-56bb-4d9e-b3a3-8a19b4225f8e tempest-QuotaClassesAdmin257Test-505133217 tempest-QuotaClassesAdmin257Test-505133217-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.156847 Aug 30 04:10:22.021070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Going to try to live migrate instance to n-h1-854925-5 {{(pid=122402) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:10:22.022705 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 315/600] 10.222.0.27 () {62 vars in 1247 bytes} [Tue Aug 30 04:10:21 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:10:22.232614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:22.236122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:22.273916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:22.275097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:22.276863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:22.278992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:22.280517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:22.281727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:22.723769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:22.735818 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0a76032a-4e7c-4f20-b404-e5631e004b5b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1332 microversion: 2.1 time: 0.531319 Aug 30 04:10:22.736444 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 316/601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:22 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1332 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:22.770376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:22.771169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:22.783300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:22.784121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:22.786835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:22.789929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:22.790654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:22.792440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:22.979917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:22.989395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:22.990858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:23.000704 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-067ec346-46b3-4f19-818e-f3d56d32b8bc tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1437 microversion: 2.75 time: 0.242646 Aug 30 04:10:23.004536 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 317/602] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:22 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1437 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:23.033811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:23.035716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:23.051518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:23.054313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:23.055426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:23.056394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:23.057142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:23.057777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:24.524847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:24.533884 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-220a4b3b-f7d7-4061-a188-53ffe82bdb85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1474 microversion: 2.1 time: 1.527830 Aug 30 04:10:24.546861 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 318/603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:23 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1474 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:24.603144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=20 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:24.981227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:24.996380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:25.000901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:25.023359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:25.024712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:25.025814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:25.028073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:25.032445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:25.033234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:25.279830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:25.282126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:25.286290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:25.286875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:25.287432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:25.428276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:25.444893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:25.461952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:25.462860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:25.464115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:25.465132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:25.466609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:26.056852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:26.183711 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7e82e3f-bcae-401e-a83e-f9ba586536c8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c/action" status: 202 len: 1940 microversion: 2.75 time: 1.635617 Aug 30 04:10:26.184705 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 319/604] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:10:24 2022] POST /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c/action => generated 1940 bytes in 1637 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 04:10:26.198129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-afd81103-ee77-4a55-8c67-cd65786302eb req-1946d091-ba22-430c-ac41-9f890e27a356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5b231b-2496-4cc0-a8c9-908714605d2b", "name": "network-vif-unplugged", "status": "completed", "tag": "ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:26.226749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-afd81103-ee77-4a55-8c67-cd65786302eb req-1946d091-ba22-430c-ac41-9f890e27a356 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:26.237871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-afd81103-ee77-4a55-8c67-cd65786302eb req-1946d091-ba22-430c-ac41-9f890e27a356 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:26.238326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-afd81103-ee77-4a55-8c67-cd65786302eb req-1946d091-ba22-430c-ac41-9f890e27a356 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:26.261020 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-afd81103-ee77-4a55-8c67-cd65786302eb req-1946d091-ba22-430c-ac41-9f890e27a356 service nova] Creating event network-vif-unplugged:ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748 for instance 5f5b231b-2496-4cc0-a8c9-908714605d2b on n-h1-854925-5 Aug 30 04:10:26.295169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-afd81103-ee77-4a55-8c67-cd65786302eb req-1946d091-ba22-430c-ac41-9f890e27a356 service nova] Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:10:26.353515 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-afd81103-ee77-4a55-8c67-cd65786302eb req-1946d091-ba22-430c-ac41-9f890e27a356 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167377 Aug 30 04:10:26.357834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 320/605] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:26.379700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:26.381219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:26.402334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:26.403274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:26.404936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:26.407978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:26.409857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:26.410629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:26.420924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b863d40-6c9a-4e08-9e54-2e3a5ebffa02 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca/action" status: 202 len: 0 microversion: 2.1 time: 4.609591 Aug 30 04:10:26.421554 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 286/606] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:21 2022] POST /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca/action => generated 0 bytes in 4611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:10:26.427795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:26.429067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:26.456225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:26.459960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:26.465765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:26.467999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:26.469176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:26.470299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:26.472778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:27.134162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:27.188450 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-67e6c183-f18c-4819-8716-0555672db625 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1536 microversion: 2.1 time: 0.827528 Aug 30 04:10:27.209220 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 321/607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:26 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1536 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:27.223412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:27.229291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:27.243929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:27.244535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:27.245303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:27.247727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:27.248532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:27.249301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:27.454438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:27.457449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:27.468146 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f749b8d4-017e-4ff2-a7f1-d7c842c1af38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1474 microversion: 2.1 time: 1.045440 Aug 30 04:10:27.485373 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 287/608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:26 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1474 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:27.494880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:27.495511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:27.503563 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5e8f17a-c425-4a8b-887c-133ede70bb84 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.287472 Aug 30 04:10:27.504216 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 322/609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:27 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:27.519973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:27.520484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:27.521012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:27.529420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:27.531448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:27.531731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94ab9301-9ef4-43a0-9f7e-3df85553c04f tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'create', calling method: .version_select at 0x7fe96a80d430>, body: {"pool": "0107d3fc-9cf7-4a32-9d50-0265c857149b"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:27.532239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:27.578679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:28.021357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:28.031567 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bafc91e2-d44b-4b7b-981b-3225f095071e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1503 microversion: 2.1 time: 0.547553 Aug 30 04:10:28.032634 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 288/610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:27 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1503 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:28.384136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-25ef7648-f8cc-4ce4-ad58-427e5393af0a req-52658bd5-2205-4d2d-a465-0a2cce961f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f5b231b-2496-4cc0-a8c9-908714605d2b", "tag": "ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:28.400652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-25ef7648-f8cc-4ce4-ad58-427e5393af0a req-52658bd5-2205-4d2d-a465-0a2cce961f60 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:28.401540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-25ef7648-f8cc-4ce4-ad58-427e5393af0a req-52658bd5-2205-4d2d-a465-0a2cce961f60 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:28.401902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-25ef7648-f8cc-4ce4-ad58-427e5393af0a req-52658bd5-2205-4d2d-a465-0a2cce961f60 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:28.416979 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-25ef7648-f8cc-4ce4-ad58-427e5393af0a req-52658bd5-2205-4d2d-a465-0a2cce961f60 service nova] Creating event network-changed:ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748 for instance 5f5b231b-2496-4cc0-a8c9-908714605d2b on n-h1-854925-5 Aug 30 04:10:28.433941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-25ef7648-f8cc-4ce4-ad58-427e5393af0a req-52658bd5-2205-4d2d-a465-0a2cce961f60 service nova] Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:10:28.446146 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-25ef7648-f8cc-4ce4-ad58-427e5393af0a req-52658bd5-2205-4d2d-a465-0a2cce961f60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066261 Aug 30 04:10:28.446867 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 289/611] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:10:28.839826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-472120ea-284f-4ddc-aae1-c3a456aa2a4c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Action: 'create', calling method: .version_select at 0x7fe96a7e71f0>, body: {"keypair": {"name": "tempest-keypair-2132059478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0j0uap8Strups3gT8domoKIVey3XOYsYHZuOhR3Hu0QQ1qqPQyrFywG+htG3CL+3KntPYfr6n3zbYH4tEoir1CLZypLKo3854MiyNK/2kP2uZzX3i+p6Gq5BbSW8hKZg=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:28.871830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-472120ea-284f-4ddc-aae1-c3a456aa2a4c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Getting quotas for project b44a575fabe74c81a44e2ae1cd33ce66. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:28.886120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-472120ea-284f-4ddc-aae1-c3a456aa2a4c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Getting quotas for user ef42627af9c446b2ac60d9fc9f01a019 and project b44a575fabe74c81a44e2ae1cd33ce66. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:28.941709 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-472120ea-284f-4ddc-aae1-c3a456aa2a4c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.493463 Aug 30 04:10:28.942507 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 290/612] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:10:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:28.947252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:28.948058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:28.955226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:28.955890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:28.956666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:28.957549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:28.958151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:28.958724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:29.247464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:29.445593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:29.466673 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c05b0196-0b45-46c8-b683-6d612d88b275 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1472 microversion: 2.1 time: 0.520985 Aug 30 04:10:29.469069 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 291/613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:28 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:29.493853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:29.498106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:29.517272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:29.517801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:29.519396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:29.520184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:29.520596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:29.525653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:29.825389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:29.992688 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8dd6a51e-a216-4b3e-bdae-91901a4b3a85 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.519888 Aug 30 04:10:29.994019 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 292/614] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:29 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:30.003745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:30.007576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:30.022787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.023483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.025173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.028069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:30.028715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:30.029893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:30.753202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:30.771847 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-edb7f369-ad9b-46bc-b87e-1243c0e676ab tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1503 microversion: 2.1 time: 0.774103 Aug 30 04:10:30.773031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 293/615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:29 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1503 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:31.097560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-113fd790-d74c-4a78-ba1a-9fbf1ab14c04 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Calling method '.version_select at 0x7fe96a905ca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:31.232623 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-113fd790-d74c-4a78-ba1a-9fbf1ab14c04 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 371 microversion: 2.1 time: 0.458177 Aug 30 04:10:31.233117 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 294/616] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:10:30 2022] GET /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 371 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:31.241400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:31.246885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:31.267399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:31.267913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:31.268480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:31.307921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:31.308525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:31.308986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:31.663792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94ab9301-9ef4-43a0-9f7e-3df85553c04f tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.144624 Aug 30 04:10:31.665624 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 323/617] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:10:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:31.673226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:31.676469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:31.698289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:31.700710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:31.701456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:31.706004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:31.709404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:31.711293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:31.811400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:31.826149 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e8d4805a-27ce-407d-8449-ab322ce9bc37 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1469 microversion: 2.1 time: 0.588531 Aug 30 04:10:31.857488 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 295/618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:31 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:31.865564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a8048b0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:31.877376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:31.930920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a4381c2-d7c0-4637-bc37-34f1861cf62e tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.263247 Aug 30 04:10:31.945063 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 324/619] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:31 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:31.963917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'action', calling method: .version_select at 0x7fe96c977ca0>, body: {"addFloatingIp": {"address": "172.25.2.198"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:31.973228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:32.025766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.026630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.027387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.031185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.031774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=12,nova_cell0:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:32.034081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.034771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.037768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.040185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.040689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.041477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.042052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.042520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.203313 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a02908da-8cbc-4d40-a43f-77c83209ee45 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 328 microversion: 2.1 time: 0.342419 Aug 30 04:10:32.204439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 296/620] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:10:31 2022] PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 328 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:32.209688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:32.210316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:32.227299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.228680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.230690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.231748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.233235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.234744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.646608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:32.652719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:10:32.653542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquired lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:10:32.659548 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b03e152b-b937-4278-a2d5-806618bd7616 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1503 microversion: 2.1 time: 0.453784 Aug 30 04:10:32.660362 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 297/621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:32 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1503 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:32.678792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:32.679329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:32.698056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.698552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.698994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.699697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:32.700482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:32.700901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:32.880075 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3d7e1f22-25b7-4fbf-b347-d1473a867f27 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b/action" status: 204 len: 0 microversion: 2.1 time: 0.210441 Aug 30 04:10:32.883742 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 298/622] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:32 2022] POST /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b/action => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:10:33.029384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1652371461", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:33.120656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:34.299147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:34.300311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:34.301070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:34.301706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:34.302475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:34.326956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:34.327743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:34.328180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:34.328922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:34.329405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:34.329847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:34.367840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Getting quotas for project fe0e7b24d98e43f889d4e5d3d57c3f92. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:34.374166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Getting quotas for user d6a358137ece4d6480adcf869809385e and project fe0e7b24d98e43f889d4e5d3d57c3f92. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:34.403096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.utils [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] cores quota exceeded for fe0e7b24d98e43f889d4e5d3d57c3f92, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122402) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 04:10:34.406436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Request method failure captured: Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 145 Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY20wwD__w5ZxuQc7-ZDGHl_pSkQdZw3OqL6bYcWT4dQm3PN6ya2vY_Xc4ABwTmmE6OxPwNz5Oc-lkNfNmBKPiKwOu0pOfTmSIjs1ZXyrvoWfaMyeWEyqAbk1yWAiMlddY_PO5_76-PCddB_1Ey5Y2ysst5L9hBFerjbqhdJzMUlgxg Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:34.413471 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe0e7b24d98e43f889d4e5d3d57c3f92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}] Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d6a358137ece4d6480adcf869809385e Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1652371461", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} Aug 30 04:10:34.414970 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1652371461', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452'}}} Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 04:10:34.415755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:34.416933 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.420603 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:34.424901 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:34.424901 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:34.424901 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:34.424901 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:34.424901 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 30 04:10:34.424901 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:34.429099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:34.430542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06e15002-93dd-4120-ad15-e46dc946be85 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.548146 Aug 30 04:10:34.457267 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 299/623] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:10:32 2022] POST /compute/v2.1/servers => generated 111 bytes in 1576 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:34.463999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:34.467925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:34.478236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:34.479061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:34.479704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:34.487369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:34.488141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:34.488754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.051572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:35.063318 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-631e0f4a-b2a4-4210-b365-8dc1737e3436 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1469 microversion: 2.1 time: 0.603720 Aug 30 04:10:35.079172 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 300/624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:34 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1469 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:35.086395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:35.087280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:35.105166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.106993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.108227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.109232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.110103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.110702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.262146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:35.324072 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6b93a5e8-28b9-4a99-88f4-c07133f4c668 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.243382 Aug 30 04:10:35.326355 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 301/625] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:35 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:35.342006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9a645a12-1d85-46df-9dc6-d232e3efb126 req-fd0a7b3d-88e6-428a-af65-f8ebe2064fbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e31325-5353-4171-b6c2-384cd56f13ca", "name": "network-vif-unplugged", "status": "completed", "tag": "ccee229a-2293-49ad-9b55-ab06dfa3a92c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:35.376012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9a645a12-1d85-46df-9dc6-d232e3efb126 req-fd0a7b3d-88e6-428a-af65-f8ebe2064fbf service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.379281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9a645a12-1d85-46df-9dc6-d232e3efb126 req-fd0a7b3d-88e6-428a-af65-f8ebe2064fbf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.382684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9a645a12-1d85-46df-9dc6-d232e3efb126 req-fd0a7b3d-88e6-428a-af65-f8ebe2064fbf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.406241 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9a645a12-1d85-46df-9dc6-d232e3efb126 req-fd0a7b3d-88e6-428a-af65-f8ebe2064fbf service nova] Creating event network-vif-unplugged:ccee229a-2293-49ad-9b55-ab06dfa3a92c for instance 19e31325-5353-4171-b6c2-384cd56f13ca on n-h2-854925-5 Aug 30 04:10:35.418349 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9a645a12-1d85-46df-9dc6-d232e3efb126 req-fd0a7b3d-88e6-428a-af65-f8ebe2064fbf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090315 Aug 30 04:10:35.420897 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 302/626] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:35.434907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:35.438003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:35.454580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.455332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.455922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.456894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:35.457710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:35.458925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:35.986216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:35.994024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ad7c2d91-8f15-4f69-8015-619c0043394f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1503 microversion: 2.1 time: 0.568994 Aug 30 04:10:35.995871 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 303/627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:35 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1503 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:36.005902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cb2c126d-1b18-4f76-b94a-4366a2e24da6 req-7b2347b5-d840-4239-8830-c740939eb78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5b231b-2496-4cc0-a8c9-908714605d2b", "name": "network-vif-plugged", "status": "completed", "tag": "ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:36.017911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cb2c126d-1b18-4f76-b94a-4366a2e24da6 req-7b2347b5-d840-4239-8830-c740939eb78e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:36.018388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cb2c126d-1b18-4f76-b94a-4366a2e24da6 req-7b2347b5-d840-4239-8830-c740939eb78e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:36.018983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cb2c126d-1b18-4f76-b94a-4366a2e24da6 req-7b2347b5-d840-4239-8830-c740939eb78e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:36.035951 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cb2c126d-1b18-4f76-b94a-4366a2e24da6 req-7b2347b5-d840-4239-8830-c740939eb78e service nova] Creating event network-vif-plugged:ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748 for instance 5f5b231b-2496-4cc0-a8c9-908714605d2b on n-h1-854925-5 Aug 30 04:10:36.042393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-cb2c126d-1b18-4f76-b94a-4366a2e24da6 req-7b2347b5-d840-4239-8830-c740939eb78e service nova] Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:10:36.062841 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cb2c126d-1b18-4f76-b94a-4366a2e24da6 req-7b2347b5-d840-4239-8830-c740939eb78e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063256 Aug 30 04:10:36.064917 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 304/628] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:36.074553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-975651642", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "e0b8dfa8-162d-42c1-8f88-ea11a6791fad"}], "security_groups": [{"name": "tempest-securitygroup--600977481"}], "key_name": "tempest-keypair-2132059478", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:36.288416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] validate_networks() for [('e0b8dfa8-162d-42c1-8f88-ea11a6791fad', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:36.436102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Building network info cache for instance {{(pid=122403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:10:36.442900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:37.186292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:37.186828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:37.187374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:37.187784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:37.188244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:37.207359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.207878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.211021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:37.212020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.213769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.214371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:37.268647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Getting quotas for project b44a575fabe74c81a44e2ae1cd33ce66. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:37.295412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Getting quotas for user ef42627af9c446b2ac60d9fc9f01a019 and project b44a575fabe74c81a44e2ae1cd33ce66. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:37.320658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:10:37.323142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:10:37.383542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4623f5ef-390a-450a-93c2-876b8a9bdc85 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.316660 Aug 30 04:10:37.384728 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 305/629] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:10:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:10:37.389973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aa4ea60>, body: {"quota_set": {"cores": 20}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:37.721379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.724985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.725537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:37.729196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.731414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.732325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:37.741436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Updating instance_info_cache with network_info: [{"id": "adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a", "address": "fa:16:3e:b3:04:ed", "network": {"id": "53a6551e-d2ba-4522-9e05-7aab6e168494", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-669411254-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2a5c0e60926a43fcb53b148a2de0aea1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapadf2d7f5-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:10:37.771570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Releasing lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:10:37.772722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3063f9c4-8723-4c82-a521-29bdba34955b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action" status: 202 len: 0 microversion: 2.1 time: 5.826193 Aug 30 04:10:37.774061 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 325/630] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:31 2022] POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action => generated 0 bytes in 5828 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:10:37.783464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:37.784484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:37.794873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.797195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.797870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:37.798860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.799401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.799907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:37.842610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:37.911308 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c29c142c-7747-4f91-b0fb-ff5e8f4ccb91 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 329 microversion: 2.1 time: 0.524630 Aug 30 04:10:37.912184 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 306/631] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:10:37 2022] PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 329 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:37.917167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:37.917729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:37.928767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.929379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.932231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:37.933246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:37.935946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:37.936407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:38.144468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:38.145027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:38.156633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-892168aa-9fbb-4621-8672-8845a8bc4cf3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1461 microversion: 2.1 time: 0.380942 Aug 30 04:10:38.159276 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 326/632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:37 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1461 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:38.173529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-126b9ea1-29ae-4ef9-a9c8-c96994cae858 req-addf1371-c3ae-478f-a913-22caf17cb601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7561c30-d399-4711-96ca-e495d55f96c4", "tag": "adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:38.190182 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-98024058-a0ac-43e7-8d30-a8545fcced18 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.276554 Aug 30 04:10:38.195959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-126b9ea1-29ae-4ef9-a9c8-c96994cae858 req-addf1371-c3ae-478f-a913-22caf17cb601 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:38.196743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-126b9ea1-29ae-4ef9-a9c8-c96994cae858 req-addf1371-c3ae-478f-a913-22caf17cb601 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:38.197405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-126b9ea1-29ae-4ef9-a9c8-c96994cae858 req-addf1371-c3ae-478f-a913-22caf17cb601 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:38.204163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 307/633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:37 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:38.221160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:38.222069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:38.228680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:38.229014 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-126b9ea1-29ae-4ef9-a9c8-c96994cae858 req-addf1371-c3ae-478f-a913-22caf17cb601 service nova] Creating event network-changed:adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a for instance c7561c30-d399-4711-96ca-e495d55f96c4 on n-h2-854925-5 Aug 30 04:10:38.229211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:38.229635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:38.230453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:38.230809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:38.231209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:38.242785 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-126b9ea1-29ae-4ef9-a9c8-c96994cae858 req-addf1371-c3ae-478f-a913-22caf17cb601 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082055 Aug 30 04:10:38.244111 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 327/634] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:38.255523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:38.256352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:38.266239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:38.266678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:38.267477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:38.268342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:38.269165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:38.270011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:38.440890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:38.448970 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3adc0f31-ea59-4856-9bbc-e9cefd49ecc9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1245 microversion: 2.1 time: 0.203433 Aug 30 04:10:38.449598 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 328/635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:38 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1245 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:38.466525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b409892e-4bad-465a-b36c-4c63ec902297 req-0578a767-0e8f-418e-a0db-20783a1fe8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e31325-5353-4171-b6c2-384cd56f13ca", "tag": "ccee229a-2293-49ad-9b55-ab06dfa3a92c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:38.485897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b409892e-4bad-465a-b36c-4c63ec902297 req-0578a767-0e8f-418e-a0db-20783a1fe8f6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:38.486385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b409892e-4bad-465a-b36c-4c63ec902297 req-0578a767-0e8f-418e-a0db-20783a1fe8f6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:38.486821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b409892e-4bad-465a-b36c-4c63ec902297 req-0578a767-0e8f-418e-a0db-20783a1fe8f6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:38.512886 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b409892e-4bad-465a-b36c-4c63ec902297 req-0578a767-0e8f-418e-a0db-20783a1fe8f6 service nova] Creating event network-changed:ccee229a-2293-49ad-9b55-ab06dfa3a92c for instance 19e31325-5353-4171-b6c2-384cd56f13ca on n-h2-854925-5 Aug 30 04:10:38.519806 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b409892e-4bad-465a-b36c-4c63ec902297 req-0578a767-0e8f-418e-a0db-20783a1fe8f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068713 Aug 30 04:10:38.521041 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 329/636] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:38.528091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-97856e29-0681-40d1-9fdd-3e414dd5278c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'create', calling method: .version_select at 0x7fe96a7fce50>, body: {"pool": "0107d3fc-9cf7-4a32-9d50-0265c857149b"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:38.693873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:38.711068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:38.736266 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-41ff2efb-cb85-4827-889c-9cb884041691 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1503 microversion: 2.1 time: 0.526712 Aug 30 04:10:38.775786 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 308/637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:38 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1503 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:38.781007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-35c88387-80a9-484b-a444-18ac15638c89 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Calling method '.version_select at 0x7fe96b086040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:38.986251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-35c88387-80a9-484b-a444-18ac15638c89 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 371 microversion: 2.1 time: 0.208952 Aug 30 04:10:39.034671 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 309/638] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:10:38 2022] GET /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:39.043792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:39.050236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:39.058220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:39.059681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:39.060392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:39.061383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:39.062636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:39.063270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:40.523766 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c25b258c-52a2-4c74-8986-c3170649beda tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1612 microversion: 2.1 time: 1.483595 Aug 30 04:10:40.528957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 310/639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:39 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1612 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:40.533882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Action: 'update', calling method: .version_select at 0x7fe96aff7d30>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:40.712036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:40.712526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:40.718000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:40.718927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:40.719411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:40.719844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:40.889627 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4700b9c4-d289-478c-b5e4-4ee2911592bf tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 328 microversion: 2.1 time: 0.359278 Aug 30 04:10:40.892393 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 311/640] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:10:40 2022] PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 328 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:40.907309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:40.916855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:40.932763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:40.933254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:40.933718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:40.934419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:40.934872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:40.935295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:41.573051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:41.627720 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b028ad3-2508-4398-b16f-6dd5115d3886 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.733023 Aug 30 04:10:41.628241 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 312/641] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:40 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:41.632958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:41.637777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:41.655533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:41.656211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:41.656855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:41.657906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:41.658518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:41.659082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:41.858614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:41.871593 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2a813fc-f567-458f-882f-c9de363abb11 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1299 microversion: 2.1 time: 0.241875 Aug 30 04:10:41.874712 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 313/642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:41 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1299 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:41.880165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:41.881056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:41.890880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:41.891707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:41.892336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:41.893106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:41.893668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:41.894304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:42.385661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:42.394011 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0feb406c-adca-4f3e-986f-090a4e683784 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1503 microversion: 2.1 time: 0.517919 Aug 30 04:10:42.394952 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 314/643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:41 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1503 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:42.400692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-840df10c-1f89-45d2-ae8e-80c66800f6df tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '.version_select at 0x7fe96a8fda60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:42.405236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-840df10c-1f89-45d2-ae8e-80c66800f6df tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:42.406652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-840df10c-1f89-45d2-ae8e-80c66800f6df tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:42.407367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-840df10c-1f89-45d2-ae8e-80c66800f6df tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:42.418897 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-840df10c-1f89-45d2-ae8e-80c66800f6df tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.022509 Aug 30 04:10:42.419518 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 315/644] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:10:42 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:42.424876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-204818858", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:42.502195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:43.123655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:43.126799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:43.127501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:43.128091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:43.130356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:43.151468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:43.154685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:43.158120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:43.163121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:43.166849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:43.167720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:43.193969 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-97856e29-0681-40d1-9fdd-3e414dd5278c tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.671465 Aug 30 04:10:43.195051 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 330/645] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:10:38 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:43.202884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1737107546", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:43.219053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Getting quotas for project fe0e7b24d98e43f889d4e5d3d57c3f92. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:43.234277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Getting quotas for user d6a358137ece4d6480adcf869809385e and project fe0e7b24d98e43f889d4e5d3d57c3f92. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:43.302009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.utils [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] instances quota exceeded for fe0e7b24d98e43f889d4e5d3d57c3f92, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122402) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 04:10:43.302830 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Request method failure captured: Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 144 Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY20wwD__w5ZxuQc7-ZDGHl_pSkQdZw3OqL6bYcWT4dQm3PN6ya2vY_Xc4ABwTmmE6OxPwNz5Oc-lkNfNmBKPiKwOu0pOfTmSIjs1ZXyrvoWfaMyeWEyqAbk1yWAiMlddY_PO5_76-PCddB_1Ey5Y2ysst5L9hBFerjbqhdJzMUlgxg Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:43.305189 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe0e7b24d98e43f889d4e5d3d57c3f92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}] Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d6a358137ece4d6480adcf869809385e Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-204818858", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} Aug 30 04:10:43.306850 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-204818858', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452'}}} Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 04:10:43.307786 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:43.309148 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:43.311348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:43.314114 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:43.314114 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:43.314114 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:43.314114 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:43.314114 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 30 04:10:43.314114 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:43.317065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:43.318201 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88aba2d7-5394-4726-8555-4852b031863b tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.897682 Aug 30 04:10:43.322411 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 316/646] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:10:42 2022] POST /compute/v2.1/servers => generated 119 bytes in 902 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:43.329128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:43.330528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:43.339059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:43.339919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:43.340584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:43.341570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:43.342226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:43.342444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:43.343603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:43.543676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:43.588598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-554a8edc-2d1a-4e9a-8069-07565aa353b9 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.264733 Aug 30 04:10:43.590214 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 317/647] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:43 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:43.594470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:43.598090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:43.616353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:43.616941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:43.617557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:43.618340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:43.618856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:43.619528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:44.134391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:44.144197 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1c675bb-03d8-4661-ae70-88aa593ba825 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.553891 Aug 30 04:10:44.151713 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 318/648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:43 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:44.156782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'action', calling method: .version_select at 0x7fe96c977ca0>, body: {"addFloatingIp": {"address": "172.25.2.241"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:44.164224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:44.185475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:44.187824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:44.187824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:44.187824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:44.189356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:44.189356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:44.294646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:44.295183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:44.295537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:44.296945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:44.297852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:44.309942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:10:44.310600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquired lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:10:44.314961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:44.315647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:44.316446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:44.318633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:44.319290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:44.319892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:44.396840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:44.451504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for user 7ead040764484d059aa9a82f0714373f and project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:44.474365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:10:44.486274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:10:44.574483 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a634ab6-d31f-4b13-8ad6-ab9e5b887dbb tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377629 Aug 30 04:10:44.575781 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 331/649] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1380 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:10:44.584370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a912670>, body: {"quota_set": {"instances": 10}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:44.762018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:44.762531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:44.762981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:44.763738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:44.764194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:44.765262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:45.078496 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7caf7c46-f0db-42d5-b0e7-2d61cf20a184 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 329 microversion: 2.1 time: 0.500620 Aug 30 04:10:45.078880 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 332/650] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:10:44 2022] PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 329 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:45.093858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:45.094556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:45.112668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b.", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:10:45.113921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Releasing lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:10:45.114829 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b. Aug 30 04:10:45.114829 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-a5f5e85f-a304-4ce8-ad38-168c299e8e9b'] Aug 30 04:10:45.120786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:45.121312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:45.121834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:45.122451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:45.122904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:45.123331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Request method failure captured: Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action HTTP/1.1 Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 46 Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2ci4qIiOd-99kLI3sxMDBKmYZxlzdUHmdCgD9sUmjxSuSUAlNjhg84SXOoqklhSjx2oYDvgBoaMHI1-Ztqn5jn3WAOr8lFyrbPm25--LmkAYjxn7JEpQQOM-tHZgjV99RLI9-N5GxnrzRTkkqw5i5zXp4PL7JjOkPgRsYMy1I4mqw Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:45.140191 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a5c0e60926a43fcb53b148a2de0aea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}] Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 62349d5dce2c4d08bb0671425b2d8ec6 Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: {"addFloatingIp": {"address": "172.25.2.241"}} Aug 30 04:10:45.142236 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: exception: Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b. Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-a5f5e85f-a304-4ce8-ad38-168c299e8e9b'] Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c7561c30-d399-4711-96ca-e495d55f96c4', 'body': {'addFloatingIp': {'address': '172.25.2.241'}}} Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:10:45.142983 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:10:45.144772 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b. Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f5e85f-a304-4ce8-ad38-168c299e8e9b'] Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b. Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f5e85f-a304-4ce8-ad38-168c299e8e9b'] Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:45.146734 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b. Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f5e85f-a304-4ce8-ad38-168c299e8e9b'] Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:45.148716 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b. Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a5f5e85f-a304-4ce8-ad38-168c299e8e9b'] Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Returning 400 to user: Cannot associate floating IP 172.25.2.241 (263ee977-10ae-499b-ab0a-86cf4f267f5b) with port adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network 0107d3fc-9cf7-4a32-9d50-0265c857149b. Aug 30 04:10:45.150827 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-a5f5e85f-a304-4ce8-ad38-168c299e8e9b'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:45.152160 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-13c2059f-ae16-4393-acf8-8ac51ce630ca tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action" status: 400 len: 382 microversion: 2.1 time: 0.989003 Aug 30 04:10:45.152160 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 319/651] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:44 2022] POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action => generated 382 bytes in 995 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:10:45.161400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a01dcf7-9985-4de9-8026-7deee7d312e3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:45.162045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4a01dcf7-9985-4de9-8026-7deee7d312e3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:45.376002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a01dcf7-9985-4de9-8026-7deee7d312e3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:45.387589 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a01dcf7-9985-4de9-8026-7deee7d312e3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1213 microversion: 2.1 time: 0.239166 Aug 30 04:10:45.399845 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 320/652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:45 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1213 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:45.405139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:45.406128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:45.417135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:45.417919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:45.418979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:45.419890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:45.420623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:45.421277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:45.528111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:45.543307 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8696b9b6-fbb5-4d46-a605-0c9f49b11812 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1478 microversion: 2.1 time: 0.462837 Aug 30 04:10:45.544041 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 333/653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:45 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1478 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:45.550288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33057fde-6691-45bc-adc7-4dcfe6217b70 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Calling method '.version_select at 0x7fe96a8b4ca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:45.759065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33057fde-6691-45bc-adc7-4dcfe6217b70 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 371 microversion: 2.1 time: 0.213645 Aug 30 04:10:45.767202 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 334/654] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:10:45 2022] GET /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:45.782070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8cdbde58-0c01-4b16-bb9b-ccec3f52e933 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '.version_select at 0x7fe96a9df550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:46.014570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:46.054634 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68b9a22f-9016-461a-af3c-e55a7256e0e4 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.653225 Aug 30 04:10:46.065743 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 321/655] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:45 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:46.086431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:46.087285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:46.098918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:46.100060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:46.104978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:46.105891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:46.106471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:46.107004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:46.549731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:46.572713 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-566c2ca0-fcea-4a5b-a598-e023cf7cf495 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.504825 Aug 30 04:10:46.599070 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 322/656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:46 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:46.629544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e06f007d-08c5-446c-a068-e90f900598f2 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '.version_select at 0x7fe96a9bf700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:46.639061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e06f007d-08c5-446c-a068-e90f900598f2 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:46.640890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e06f007d-08c5-446c-a068-e90f900598f2 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:46.641610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e06f007d-08c5-446c-a068-e90f900598f2 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:46.655160 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e06f007d-08c5-446c-a068-e90f900598f2 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1177 microversion: 2.1 time: 0.053036 Aug 30 04:10:46.657289 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 323/657] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:10:46 2022] GET /compute/v2.1/os-migrations => generated 1177 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:46.671160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a5825e0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:46.789681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:46.790523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:46.791124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:46.792061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:46.793594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:46.796092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:46.914452 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ccf15d3-c569-474c-946c-b488a29bb815 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 325 microversion: 2.1 time: 0.255517 Aug 30 04:10:46.921756 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 324/658] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:10:46 2022] PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:46.926850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:46.927475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:46.939987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:46.940309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:46.940754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:46.941498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:46.942074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:46.942622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:47.186362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:47.200420 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef913eea-b299-4d38-9a2a-d9a9fbd57288 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1283 microversion: 2.1 time: 0.277235 Aug 30 04:10:47.201514 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 325/659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:46 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1283 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:47.208472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:47.210054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:47.226007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:47.227474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:47.229509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:47.230772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:47.233679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:47.233679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:47.672242 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e8d7f830-6adb-4e15-969b-ce46ce7688f0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1629 microversion: 2.1 time: 0.468522 Aug 30 04:10:47.682074 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 326/660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:47 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1629 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:47.700810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-688836651", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:47.773809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:48.265922 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8cdbde58-0c01-4b16-bb9b-ccec3f52e933 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/263ee977-10ae-499b-ab0a-86cf4f267f5b" status: 202 len: 0 microversion: 2.1 time: 2.497119 Aug 30 04:10:48.272038 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 335/661] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:10:45 2022] DELETE /compute/v2.1/os-floating-ips/263ee977-10ae-499b-ab0a-86cf4f267f5b => generated 0 bytes in 2504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:10:48.285072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:48.285982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:48.294696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.295739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.296940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.297915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.298978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.300193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.408622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:48.409165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:48.409765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:48.410276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:48.410961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:48.422815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.423440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.424104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.425043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.425605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.426096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.448075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Getting quotas for project fe0e7b24d98e43f889d4e5d3d57c3f92. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:48.454029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Getting quotas for user d6a358137ece4d6480adcf869809385e and project fe0e7b24d98e43f889d4e5d3d57c3f92. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:48.464260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:48.469603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:48.470018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.utils [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] ram quota exceeded for fe0e7b24d98e43f889d4e5d3d57c3f92, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122402) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 30 04:10:48.470824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Request method failure captured: Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 144 Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY20wwD__w5ZxuQc7-ZDGHl_pSkQdZw3OqL6bYcWT4dQm3PN6ya2vY_Xc4ABwTmmE6OxPwNz5Oc-lkNfNmBKPiKwOu0pOfTmSIjs1ZXyrvoWfaMyeWEyqAbk1yWAiMlddY_PO5_76-PCddB_1Ey5Y2ysst5L9hBFerjbqhdJzMUlgxg Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:48.473174 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe0e7b24d98e43f889d4e5d3d57c3f92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}] Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d6a358137ece4d6480adcf869809385e Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-688836651", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} Aug 30 04:10:48.474627 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-688836651', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452'}}} Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 04:10:48.475522 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:48.476813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:48.479303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:48.481778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:48.481778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:48.481778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:48.481778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:48.481778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 30 04:10:48.481778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:48.484513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:48.485628 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-56340809-6e96-4cf8-9c1f-7ea05d8eca59 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.802297 Aug 30 04:10:48.490227 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 327/662] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:10:47 2022] POST /compute/v2.1/servers => generated 110 bytes in 807 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:48.496608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:48.497559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:48.507318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.508076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.514978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.514978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.514978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.514978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.535467 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5d95b2a-8e70-45bd-a8ed-66a4767a4d96 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.262069 Aug 30 04:10:48.548010 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 336/663] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:48 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:48.563075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5e75317c-fab7-44eb-9417-9dab847e0940 req-29c7ffc4-7a16-47ce-96f7-99d99f933af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7e450c-101b-43a5-96ef-e8e35901e3b2", "tag": "457ebde2-e320-4370-9d9b-77ba6f31e833"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:48.582211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5e75317c-fab7-44eb-9417-9dab847e0940 req-29c7ffc4-7a16-47ce-96f7-99d99f933af1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.583115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5e75317c-fab7-44eb-9417-9dab847e0940 req-29c7ffc4-7a16-47ce-96f7-99d99f933af1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.583742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5e75317c-fab7-44eb-9417-9dab847e0940 req-29c7ffc4-7a16-47ce-96f7-99d99f933af1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.599249 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5e75317c-fab7-44eb-9417-9dab847e0940 req-29c7ffc4-7a16-47ce-96f7-99d99f933af1 service nova] Creating event network-changed:457ebde2-e320-4370-9d9b-77ba6f31e833 for instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 on n-h1-854925-5 Aug 30 04:10:48.604310 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5e75317c-fab7-44eb-9417-9dab847e0940 req-29c7ffc4-7a16-47ce-96f7-99d99f933af1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054250 Aug 30 04:10:48.605291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 337/664] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:48.611313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-205dd57f-a603-4c14-866b-838932e64e4d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Action: 'create', calling method: .version_select at 0x7fe96a7fc940>, body: {"keypair": {"name": "tempest-keypair-934377995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNstqlS7T3yry8Ki7X6KeJtRWFzL1tS2K6IUi1Vq2nHM0bcYwenSiOk4GRAVIq4Jt40N123DNPi6QxwPmzF6hRBLPP5UnPZkVKgEM64jMfOd2btT3PoJaDdaNvTJE/qq6Q=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:48.638763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-205dd57f-a603-4c14-866b-838932e64e4d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for project 7b74886057a041a0afd0d14497424b41. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:48.644696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-205dd57f-a603-4c14-866b-838932e64e4d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for user c05146c8ea7b425eb8eda0088841dd8a and project 7b74886057a041a0afd0d14497424b41. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:48.677972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-205dd57f-a603-4c14-866b-838932e64e4d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.071262 Aug 30 04:10:48.678939 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 338/665] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:10:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:48.683723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:48.688453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:48.724226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.730928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.731608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.732526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:48.736369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:48.738526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:48.911281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:48.922929 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-427e71d7-66a6-4eda-a8ca-407469c54f9f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.430953 Aug 30 04:10:48.925031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 328/666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:48 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:48.953777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'action', calling method: .version_select at 0x7fe96c89dc10>, body: {"removeFloatingIp": {"address": "172.25.2.198"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:49.031560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:49.045025 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2843d06e-865d-447c-b17b-fcc803f46c32 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1271 microversion: 2.1 time: 0.364773 Aug 30 04:10:49.045947 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 339/667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:48 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1271 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:49.065157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Action: 'update', calling method: .version_select at 0x7fe96ab051f0>, body: {"quota_set": {"ram": 51200}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:49.214683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:49.215499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:49.216725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:49.219392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:49.219848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:49.220286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:49.384600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:49.392684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:49.393455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:49.394107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:49.397301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:49.398171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:49.398817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:49.419399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:49.444886 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b66fb3e2-c68a-4a5f-bd08-a6e57c9b3687 tempest-QuotasAdminNegativeTest-174647623 tempest-QuotasAdminNegativeTest-174647623-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 200 len: 329 microversion: 2.1 time: 0.389802 Aug 30 04:10:49.446588 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 340/668] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:10:49 2022] PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 329 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:49.461626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be205134-a5ae-49ff-aace-193880734478 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Action: 'update', calling method: .version_select at 0x7fe96ab0af70>, body: {"quota_set": {"ram": 0}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:49.468844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be205134-a5ae-49ff-aace-193880734478 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'd6a358137ece4d6480adcf869809385e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0e7b24d98e43f889d4e5d3d57c3f92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be205134-a5ae-49ff-aace-193880734478 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Request method failure captured: Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 HTTP/1.1 Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 25 Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY20wwD__w5ZxuQc7-ZDGHl_pSkQdZw3OqL6bYcWT4dQm3PN6ya2vY_Xc4ABwTmmE6OxPwNz5Oc-lkNfNmBKPiKwOu0pOfTmSIjs1ZXyrvoWfaMyeWEyqAbk1yWAiMlddY_PO5_76-PCddB_1Ey5Y2ysst5L9hBFerjbqhdJzMUlgxg Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:10:49.471294 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fe0e7b24d98e43f889d4e5d3d57c3f92", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fe0e7b24d98e43f889d4e5d3d57c3f92"}]}] Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: fe0e7b24d98e43f889d4e5d3d57c3f92 Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-743613017 Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d6a358137ece4d6480adcf869809385e Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-QuotasAdminNegativeTest-743613017-project Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: {"quota_set": {"ram": 0}} Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 04:10:49.472882 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'fe0e7b24d98e43f889d4e5d3d57c3f92', 'body': {'quota_set': {'ram': 0}}} Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:49.473936 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:49.475374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:49.476864 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:49.476864 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:49.476864 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:10:49.476864 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:10:49.476864 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 30 04:10:49.476864 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:10:49.481802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be205134-a5ae-49ff-aace-193880734478 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:49.485321 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be205134-a5ae-49ff-aace-193880734478 tempest-QuotasAdminNegativeTest-743613017 tempest-QuotasAdminNegativeTest-743613017-project] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92" status: 403 len: 116 microversion: 2.1 time: 0.025876 Aug 30 04:10:49.486918 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 341/669] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:10:49 2022] PUT /compute/v2.1/os-quota-sets/fe0e7b24d98e43f889d4e5d3d57c3f92 => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:49.579782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:49.581066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:49.594463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:49.599846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:49.600669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:49.602580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:49.603267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:49.605638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:50.217106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:50.255641 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-34414491-f09c-4d48-9595-1c06d50e251c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.681908 Aug 30 04:10:50.256778 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 342/670] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:49 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:50.270953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:50.271742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:50.282636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:50.283129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:50.283572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:50.284281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:50.284730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:50.285154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:50.535207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:10:50.536284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquired lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:10:50.806986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:50.836145 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b36b7679-0134-4058-bf56-ae408c2f6c7c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.574876 Aug 30 04:10:50.838591 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 343/671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:50 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:50.869259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:50.877454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:50.898473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:50.902598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:50.903250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:50.904007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:50.904428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:50.907140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:51.445375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:51.489468 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f47526e2-616f-47b0-80ba-6ca6a3a3dfed tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1313 microversion: 2.1 time: 0.637740 Aug 30 04:10:51.508199 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 344/672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:50 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1313 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:51.513050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:51.515451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:51.542167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:51.542648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:51.543088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:51.543799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:51.544256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:51.544675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:51.729561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:51.755919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51e199ef-c4e7-44dc-a13e-c7dc4e630eb8 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.246037 Aug 30 04:10:51.757374 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 345/673] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:51 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:51.851903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2016944586", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "c3c9ddd9-fb5e-49c2-b881-772d074b19d2"}], "security_groups": [{"name": "tempest-securitygroup--1176773785"}], "key_name": "tempest-keypair-934377995", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:52.081314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] validate_networks() for [('c3c9ddd9-fb5e-49c2-b881-772d074b19d2', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:10:52.505519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Building network info cache for instance {{(pid=122402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:10:53.956672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:10:53.957298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:10:53.957592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:10:53.958099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:10:53.958509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:10:53.991937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:53.992910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:53.993588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:53.995008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:53.996652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:53.997838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.059936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:10:54.074713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for user c05146c8ea7b425eb8eda0088841dd8a and project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:10:54.132330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:10:54.143495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:10:54.308898 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-477e7593-4e53-4e06-875c-52d33a5bc1e2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.437752 Aug 30 04:10:54.320010 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 346/674] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:10:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 2468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:10:54.333263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:54.339123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:54.358837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:54.359462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:54.359916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.360966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:54.361616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:54.370374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.763263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:54.775228 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-56ed44cd-5f9a-44cb-bd8b-e8f05b2cf2d8 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.459902 Aug 30 04:10:54.776429 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 347/675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:54 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:54.795502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4c72f27a-fe09-4d65-9d9e-905876536705 req-078a5af9-ee71-4eb7-8ef7-cb01c611bdcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99d5732-f708-40b1-877b-6ca9f90a19cc", "tag": "0c1b811a-98a7-46e9-a3a3-fe244fb67722"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:54.823661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c72f27a-fe09-4d65-9d9e-905876536705 req-078a5af9-ee71-4eb7-8ef7-cb01c611bdcd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:54.824430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c72f27a-fe09-4d65-9d9e-905876536705 req-078a5af9-ee71-4eb7-8ef7-cb01c611bdcd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:54.825033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c72f27a-fe09-4d65-9d9e-905876536705 req-078a5af9-ee71-4eb7-8ef7-cb01c611bdcd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.846593 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4c72f27a-fe09-4d65-9d9e-905876536705 req-078a5af9-ee71-4eb7-8ef7-cb01c611bdcd service nova] Creating event network-changed:0c1b811a-98a7-46e9-a3a3-fe244fb67722 for instance a99d5732-f708-40b1-877b-6ca9f90a19cc on n-h2-854925-5 Aug 30 04:10:54.863934 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4c72f27a-fe09-4d65-9d9e-905876536705 req-078a5af9-ee71-4eb7-8ef7-cb01c611bdcd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086076 Aug 30 04:10:54.869424 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 348/676] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:54.884386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:54.885418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:54.889950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Updating instance_info_cache with network_info: [{"id": "adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a", "address": "fa:16:3e:b3:04:ed", "network": {"id": "53a6551e-d2ba-4522-9e05-7aab6e168494", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-669411254-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2a5c0e60926a43fcb53b148a2de0aea1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapadf2d7f5-11", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:10:54.894971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:54.895947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:54.896567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.897535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:54.909907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:54.910630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.915323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Releasing lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:10:54.916641 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d0f0c064-e970-430a-9c5a-3e40ec6daf23 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action" status: 202 len: 0 microversion: 2.1 time: 5.977292 Aug 30 04:10:54.921578 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 329/677] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:48 2022] POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action => generated 0 bytes in 5982 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:10:54.937503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:54.938599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:54.951948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:54.952760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:54.953706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.954535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:54.955121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:54.955655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:54.977991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:55.050488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:55.088857 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ad4bed2-1a47-42ed-987f-e9539c55957c tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.158228 Aug 30 04:10:55.090256 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 330/678] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:54 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:55.097086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d6eb71f6-a2a9-44e7-8209-682b2c8a7e3b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.107765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d6eb71f6-a2a9-44e7-8209-682b2c8a7e3b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:55.206455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:55.214148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d6eb71f6-a2a9-44e7-8209-682b2c8a7e3b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:55.214403 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d305cf7e-2752-4079-a4d3-a0e9f780b4af tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1313 microversion: 2.1 time: 0.343162 Aug 30 04:10:55.221623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=69 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:55.223375 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d6eb71f6-a2a9-44e7-8209-682b2c8a7e3b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1234 microversion: 2.1 time: 0.131549 Aug 30 04:10:55.224385 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 331/679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1234 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:55.225043 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 349/680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:54 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:55.250310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-553cde47-9440-44d3-a41d-0699268241c8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '.version_select at 0x7fe96abb6430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.423187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.428934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.429403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.429853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.431023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.431659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.432255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.464465 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a48c5565-c45c-4134-b502-9354d6fb34ed tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.238578 Aug 30 04:10:55.465416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 332/681] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:55.481592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.485973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.487075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.487327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.489097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.489756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.490373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.530058 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6b24f0dc-88f5-4cef-82ca-deda94db1c6a tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.054436 Aug 30 04:10:55.531808 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 333/682] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:55.554561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.563611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.564478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.565458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.566688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.568746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.570378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.615665 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49c9def5-1d2a-4373-a50f-52ab9178b819 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.074990 Aug 30 04:10:55.622878 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 334/683] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:55.628604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.632251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.632739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.633348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.634102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.634780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.634983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.668747 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3ecc98e-d075-4c4b-a098-fe056a4d47e6 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-854925-5&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.044558 Aug 30 04:10:55.670073 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 335/684] 10.222.0.27 () {58 vars in 1194 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/os-services?host=n-d-854925-5&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:10:55.681605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.686461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.686888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.687325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.688056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.688506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.689041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.714865 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d4c402d-c26f-4272-a1b4-bf6423cc8be4 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.037186 Aug 30 04:10:55.715983 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 336/685] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/os-services => generated 944 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:10:55.728041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.731582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.732072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.732504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.733231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.734118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.734118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.757099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6cd3dfab-84ec-42da-8897-359674978705 tempest-ServicesAdminNegativeTestJSON-136802849 tempest-ServicesAdminNegativeTestJSON-136802849-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.032647 Aug 30 04:10:55.757733 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 337/686] 10.222.0.27 () {58 vars in 1198 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:10:55.927254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b885994c-9d11-41cb-aec9-2378240a97b8 tempest-ServicesAdminNegativeTestJSON-797229321 tempest-ServicesAdminNegativeTestJSON-797229321-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.932657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b885994c-9d11-41cb-aec9-2378240a97b8 tempest-ServicesAdminNegativeTestJSON-797229321 tempest-ServicesAdminNegativeTestJSON-797229321-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b3a64ccc7fb94644b3fdd839e4d9f947', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c85ba6044e140dfb45d8fdf78e27047', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b885994c-9d11-41cb-aec9-2378240a97b8 tempest-ServicesAdminNegativeTestJSON-797229321 tempest-ServicesAdminNegativeTestJSON-797229321-project] Request method failure captured: Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3NpnWxTUHnryJCgsWrevUqhu3r5MRbkY0Onc9z2_x5-1KALKqieQTCXe7z75qXhkZgoJaBMptHGmc4jHHl3EOFymoW2G7eKiI3asOuUnXcXXAnuBabRkFT9FUBD6akSAXu6jjgIxrJe2hs7a1W2Zfkycoj0GlKqJ8pUKva4H5hgiI Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 6c85ba6044e140dfb45d8fdf78e27047 Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-797229321 Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:55.934950 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c85ba6044e140dfb45d8fdf78e27047", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c85ba6044e140dfb45d8fdf78e27047"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c85ba6044e140dfb45d8fdf78e27047"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c85ba6044e140dfb45d8fdf78e27047"}]}] Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-797229321 Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 6c85ba6044e140dfb45d8fdf78e27047 Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-797229321 Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServicesAdminNegativeTestJSON-797229321-project Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b3a64ccc7fb94644b3fdd839e4d9f947 Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-797229321-project Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 04:10:55.936358 n-d-854925-5 devstack@n-api.service[122402]: action_args: {} Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:10:55.937732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 30 04:10:55.938923 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:55.942076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b885994c-9d11-41cb-aec9-2378240a97b8 tempest-ServicesAdminNegativeTestJSON-797229321 tempest-ServicesAdminNegativeTestJSON-797229321-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:55.944879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b885994c-9d11-41cb-aec9-2378240a97b8 tempest-ServicesAdminNegativeTestJSON-797229321 tempest-ServicesAdminNegativeTestJSON-797229321-project] 10.222.0.27 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.178399 Aug 30 04:10:55.951857 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 338/687] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/os-services => generated 112 bytes in 186 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:10:55.957843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:55.958832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:55.972934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.975936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.976813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:55.977934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:55.980629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:55.981446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.416163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:56.427207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5e4f0d9-0bba-4519-b694-c19cfa552e4f tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.473924 Aug 30 04:10:56.428774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 339/688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:55 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:56.441471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:56.446249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:56.473151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.476121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.477088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.478523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.479195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.481183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.529024 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-553cde47-9440-44d3-a41d-0699268241c8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/3ecffba1-ff5a-4cd4-8da2-32751fbb1479" status: 202 len: 0 microversion: 2.1 time: 1.302780 Aug 30 04:10:56.535319 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 350/689] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:10:55 2022] DELETE /compute/v2.1/os-floating-ips/3ecffba1-ff5a-4cd4-8da2-32751fbb1479 => generated 0 bytes in 1309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:10:56.540333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:56.541227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:56.550864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.552105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.553211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.554854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.559204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.560799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.578979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:56.602631 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-57671cf5-ef6e-45e2-b227-3d5394247acd tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.171623 Aug 30 04:10:56.604777 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 340/690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:56 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:56.611012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:56.611623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:56.622096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.622949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.623485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.624336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.624856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.625482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.765149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:56.777864 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e0e95b26-073d-4ce5-a75c-a6e4beceb85f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1286 microversion: 2.1 time: 0.170181 Aug 30 04:10:56.781695 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 341/691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:56 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1286 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:56.793345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-838b88d8-b4af-4193-8a93-f3c4367bb355 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-838b88d8-b4af-4193-8a93-f3c4367bb355 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Request method failure captured: Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action HTTP/1.1 Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 34 Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2ci4qIiOd-99kLI3sxMDBKmYZxlzdUHmdCgD9sUmjxSuSUAlNjhg84SXOoqklhSjx2oYDvgBoaMHI1-Ztqn5jn3WAOr8lFyrbPm25--LmkAYjxn7JEpQQOM-tHZgjV99RLI9-N5GxnrzRTkkqw5i5zXp4PL7JjOkPgRsYMy1I4mqw Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:56.807009 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a5c0e60926a43fcb53b148a2de0aea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}] Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 62349d5dce2c4d08bb0671425b2d8ec6 Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: {"addFloatingIp": {"address": ""}} Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:10:56.808359 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c7561c30-d399-4711-96ca-e495d55f96c4', 'body': {'addFloatingIp': {'address': ''}}} Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi '' Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:56.809185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:10:56.810689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:10:56.811955 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 30 04:10:56.811955 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:56.811955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-838b88d8-b4af-4193-8a93-f3c4367bb355 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:56.811955 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-838b88d8-b4af-4193-8a93-f3c4367bb355 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action" status: 400 len: 142 microversion: 2.1 time: 0.027234 Aug 30 04:10:56.818269 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 342/692] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:56 2022] POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action => generated 142 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:10:56.829037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:56.836181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:56.857808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.859838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.860382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.864833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:56.865634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:56.866266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:56.934866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:10:56.938149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquired lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:10:57.056076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:57.066801 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec51be1a-ef65-4c6d-83aa-91e34457882e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1313 microversion: 2.1 time: 0.530201 Aug 30 04:10:57.072932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 351/693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:56 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1313 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:57.079686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c18138ff-3d3f-492e-a026-be49c1f6f793 req-af356af1-f1af-4d07-9ed2-73fc18ea6706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7561c30-d399-4711-96ca-e495d55f96c4", "tag": "adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:57.116618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c18138ff-3d3f-492e-a026-be49c1f6f793 req-af356af1-f1af-4d07-9ed2-73fc18ea6706 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.117123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c18138ff-3d3f-492e-a026-be49c1f6f793 req-af356af1-f1af-4d07-9ed2-73fc18ea6706 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.119897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c18138ff-3d3f-492e-a026-be49c1f6f793 req-af356af1-f1af-4d07-9ed2-73fc18ea6706 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:57.131078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:10:57.188509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c18138ff-3d3f-492e-a026-be49c1f6f793 req-af356af1-f1af-4d07-9ed2-73fc18ea6706 service nova] Creating event network-changed:adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a for instance c7561c30-d399-4711-96ca-e495d55f96c4 on n-h2-854925-5 Aug 30 04:10:57.230956 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c18138ff-3d3f-492e-a026-be49c1f6f793 req-af356af1-f1af-4d07-9ed2-73fc18ea6706 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155470 Aug 30 04:10:57.231867 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 352/694] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:57.245835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9aaceb40-c351-4c5c-9885-8657302af44f req-3d21996e-e2e7-490e-bf3d-6ade8248ffee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7e450c-101b-43a5-96ef-e8e35901e3b2", "name": "network-vif-plugged", "status": "completed", "tag": "457ebde2-e320-4370-9d9b-77ba6f31e833"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:57.268378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9aaceb40-c351-4c5c-9885-8657302af44f req-3d21996e-e2e7-490e-bf3d-6ade8248ffee service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.274244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9aaceb40-c351-4c5c-9885-8657302af44f req-3d21996e-e2e7-490e-bf3d-6ade8248ffee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.275875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9aaceb40-c351-4c5c-9885-8657302af44f req-3d21996e-e2e7-490e-bf3d-6ade8248ffee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:57.296912 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9aaceb40-c351-4c5c-9885-8657302af44f req-3d21996e-e2e7-490e-bf3d-6ade8248ffee service nova] Creating event network-vif-plugged:457ebde2-e320-4370-9d9b-77ba6f31e833 for instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 on n-h1-854925-5 Aug 30 04:10:57.300429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Releasing lock "refresh_cache-c7561c30-d399-4711-96ca-e495d55f96c4" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:10:57.301030 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] HTTP exception thrown: floating IP not found Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Request method failure captured: Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action HTTP/1.1 Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 41 Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2ci4qIiOd-99kLI3sxMDBKmYZxlzdUHmdCgD9sUmjxSuSUAlNjhg84SXOoqklhSjx2oYDvgBoaMHI1-Ztqn5jn3WAOr8lFyrbPm25--LmkAYjxn7JEpQQOM-tHZgjV99RLI9-N5GxnrzRTkkqw5i5zXp4PL7JjOkPgRsYMy1I4mqw Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:57.302862 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a5c0e60926a43fcb53b148a2de0aea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}] Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 62349d5dce2c4d08bb0671425b2d8ec6 Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:10:57.304178 n-d-854925-5 devstack@n-api.service[122402]: exception: floating IP not found Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c7561c30-d399-4711-96ca-e495d55f96c4', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:57.304977 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 30 04:10:57.306215 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.307445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Returning 404 to user: floating IP not found {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:57.307445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e02fb52-fc5e-4447-b7be-f6f77b7e6295 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action" status: 404 len: 67 microversion: 2.1 time: 0.485389 Aug 30 04:10:57.310886 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9aaceb40-c351-4c5c-9885-8657302af44f req-3d21996e-e2e7-490e-bf3d-6ade8248ffee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077384 Aug 30 04:10:57.311052 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 343/695] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:56 2022] POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action => generated 67 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:10:57.316643 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 353/696] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:10:57.320289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39e0eacd-48be-4162-b299-f901c856fe8b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:10:57.412544 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-39e0eacd-48be-4162-b299-f901c856fe8b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39e0eacd-48be-4162-b299-f901c856fe8b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Request method failure captured: Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action HTTP/1.1 Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 44 Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2ci4qIiOd-99kLI3sxMDBKmYZxlzdUHmdCgD9sUmjxSuSUAlNjhg84SXOoqklhSjx2oYDvgBoaMHI1-Ztqn5jn3WAOr8lFyrbPm25--LmkAYjxn7JEpQQOM-tHZgjV99RLI9-N5GxnrzRTkkqw5i5zXp4PL7JjOkPgRsYMy1I4mqw Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:10:57.414159 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a5c0e60926a43fcb53b148a2de0aea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}] Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 62349d5dce2c4d08bb0671425b2d8ec6 Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:10:57.415782 n-d-854925-5 devstack@n-api.service[122402]: exception: Floating IP not found for address 0.0.0.0. Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c7561c30-d399-4711-96ca-e495d55f96c4', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:10:57.416740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 30 04:10:57.418160 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:10:57.421854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39e0eacd-48be-4162-b299-f901c856fe8b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:10:57.421854 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-39e0eacd-48be-4162-b299-f901c856fe8b tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action" status: 404 len: 88 microversion: 2.1 time: 0.103023 Aug 30 04:10:57.421854 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 344/697] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:10:57 2022] POST /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4/action => generated 88 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:10:57.428771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:57.429717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:57.441614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.448930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:57.450966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:57.455115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.457058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:57.460647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.461849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.465027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.465914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:57.473715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.477478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:57.478505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.480633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.481514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:57.528964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:10:57.709967 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17d21695-99af-408b-b231-e2b4cd968262 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 204 len: 0 microversion: 2.1 time: 0.285903 Aug 30 04:10:57.711080 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 354/698] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:10:57 2022] DELETE /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:10:57.722683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:57.725966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:57.747223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.748613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.749861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:57.750769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:57.752262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:57.752998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:58.243904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:58.310482 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a275bf8-b30c-4f9a-94b0-6211c1dd2d75 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1927 microversion: 2.75 time: 0.597922 Aug 30 04:10:58.311088 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 355/699] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:57 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1927 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:58.315821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:58.316448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:58.324136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:58.324866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:58.326068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:58.327383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:58.328691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:58.329517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:58.454151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:58.465096 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-60624a5f-6984-4626-9e95-756319ecd572 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 1.019876 Aug 30 04:10:58.467256 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 345/700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:57 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:10:58.472121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:58.472733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:58.478704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:58.479179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:58.479779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:58.480637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:58.481380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:58.482036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:58.583215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:58.595024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d381ec0-bae6-4851-bb67-9687136d0914 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1292 microversion: 2.1 time: 0.126444 Aug 30 04:10:58.600494 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 346/701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:58 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:58.615339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:58.616714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:58.635953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:58.638226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:58.639242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:58.641357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:58.642142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:58.642777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:58.653170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:58.664040 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e48eb58-be53-4ba5-80a9-8b9fbcd1b3f6 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1542 microversion: 2.1 time: 0.351845 Aug 30 04:10:58.670289 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 356/702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:58 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1542 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:58.852273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:58.868953 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be4e06ac-19e8-461d-b4b1-ad667b7ac15b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1313 microversion: 2.1 time: 0.267067 Aug 30 04:10:58.869575 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 347/703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:58 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:59.350900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:59.351563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:59.371845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.372297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.372747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:59.373498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.380993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.381502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:59.486617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:59.487230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:59.500797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.501664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.502305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:59.503090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.503622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.504110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:59.527969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:10:59.595878 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e1488309-55d8-40bf-a9f8-70de0ba97bfe tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1933 microversion: 2.75 time: 0.255543 Aug 30 04:10:59.603937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 357/704] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:10:59 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1933 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:10:59.624532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:59.625964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:59.651687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.652186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.652633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:59.653487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.653951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.654384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:59.798551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:10:59.847701 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1289c23e-06be-4ff6-89f2-29fa08eaf3b3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1292 microversion: 2.1 time: 0.226874 Aug 30 04:10:59.848894 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 358/705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:59 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1292 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:10:59.860680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:10:59.861301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:10:59.871951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.872447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.874459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:10:59.875882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:10:59.876536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:10:59.878083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:00.125824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:00.136394 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c1126a7f-4d49-4ed2-b640-ff04982a9a0b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.653540 Aug 30 04:11:00.137089 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 348/706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:59 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:00.282594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:00.293226 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-157ce23f-f64b-4cd0-8bfe-c723519d00fc tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1542 microversion: 2.1 time: 0.443113 Aug 30 04:11:00.304083 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 359/707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:10:59 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1542 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:00.309204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5366eb6f-e040-4dac-ae7e-462f9b651ead req-f8050fdf-00af-4258-82fd-1c7ffa4bddd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d5732-f708-40b1-877b-6ca9f90a19cc", "name": "network-vif-plugged", "status": "completed", "tag": "0c1b811a-98a7-46e9-a3a3-fe244fb67722"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:00.326429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1349570388", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:00.331523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5366eb6f-e040-4dac-ae7e-462f9b651ead req-f8050fdf-00af-4258-82fd-1c7ffa4bddd8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:00.332010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5366eb6f-e040-4dac-ae7e-462f9b651ead req-f8050fdf-00af-4258-82fd-1c7ffa4bddd8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:00.332434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5366eb6f-e040-4dac-ae7e-462f9b651ead req-f8050fdf-00af-4258-82fd-1c7ffa4bddd8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:00.354665 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5366eb6f-e040-4dac-ae7e-462f9b651ead req-f8050fdf-00af-4258-82fd-1c7ffa4bddd8 service nova] Creating event network-vif-plugged:0c1b811a-98a7-46e9-a3a3-fe244fb67722 for instance a99d5732-f708-40b1-877b-6ca9f90a19cc on n-h2-854925-5 Aug 30 04:11:00.360498 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5366eb6f-e040-4dac-ae7e-462f9b651ead req-f8050fdf-00af-4258-82fd-1c7ffa4bddd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055014 Aug 30 04:11:00.361818 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 360/708] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:00.368914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:00.369856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:00.390277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:00.391590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:00.392418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:00.393592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:00.402794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:11:00.405872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:00.406517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:00.952060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:00.962390 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4648857a-9728-4567-8aea-b819851ac26f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1313 microversion: 2.1 time: 0.597471 Aug 30 04:11:00.974548 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 361/709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:00 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:00.982800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:00.984359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:00.992738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:00.993244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:00.993904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:00.994790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:00.995429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:00.996021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.081046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:11:01.082196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:11:01.082889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:11:01.083635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:11:01.084824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:11:01.096020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.096821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.097526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.098517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.099200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.099836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.126806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=29 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:01.142417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Getting quotas for project 06c46e03b3724660b056f47cf14eb3eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:01.148035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:11:01.149456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Getting quotas for user 4b364e890c394b5e9d89d82270783d4a and project 06c46e03b3724660b056f47cf14eb3eb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:01.176567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b557f933-bef6-4bfa-a3ab-6b718c5c4f5d tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1933 microversion: 2.75 time: 0.200447 Aug 30 04:11:01.177164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 362/710] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:11:00 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1933 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:11:01.182186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:11:01.184353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:11:01.198380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:01.199018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:01.212969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.213496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.213935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.214641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.215093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.215521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.353497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cdd77660-32da-438d-ab7f-266ce1b489a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187989 Aug 30 04:11:01.354949 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 349/711] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:11:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:11:01.393513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a2b8dd9c-61a6-403f-ae84-605c0a6e667b req-a34555e2-7691-4a69-b99b-25772479426c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7561c30-d399-4711-96ca-e495d55f96c4", "name": "network-vif-deleted", "tag": "adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:01.419437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a2b8dd9c-61a6-403f-ae84-605c0a6e667b req-a34555e2-7691-4a69-b99b-25772479426c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.420236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a2b8dd9c-61a6-403f-ae84-605c0a6e667b req-a34555e2-7691-4a69-b99b-25772479426c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.420923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a2b8dd9c-61a6-403f-ae84-605c0a6e667b req-a34555e2-7691-4a69-b99b-25772479426c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.436272 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a2b8dd9c-61a6-403f-ae84-605c0a6e667b req-a34555e2-7691-4a69-b99b-25772479426c service nova] Creating event network-vif-deleted:adf2d7f5-1179-4ccc-956e-90ca0a3d7e1a for instance c7561c30-d399-4711-96ca-e495d55f96c4 on n-h2-854925-5 Aug 30 04:11:01.444142 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a2b8dd9c-61a6-403f-ae84-605c0a6e667b req-a34555e2-7691-4a69-b99b-25772479426c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087495 Aug 30 04:11:01.445490 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 350/712] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:01.451062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:01.452521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:01.460004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.460953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.462500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.463451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.464178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.464800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:01.935163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:01.948950 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb78845f-e0e9-4ad2-9875-d23b09fab46b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1360 microversion: 2.1 time: 0.770672 Aug 30 04:11:01.951124 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 363/713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:01 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1360 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:01.965733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:01.966559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:01.984170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:01.998406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:01.998872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.005710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.007099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.007860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.028614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:02.040293 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c50e5ac9-d749-4fde-a9ef-f6073ca5628e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1366 microversion: 2.1 time: 0.593395 Aug 30 04:11:02.053788 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 351/714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:01 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1366 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:02.055872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.056689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.057342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.058018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lazy-loading 'fault' on Instance uuid c7561c30-d399-4711-96ca-e495d55f96c4 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:11:02.059777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6ce25e4f-d41a-45cd-8cfe-840aeb6ff6de tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:02.060411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6ce25e4f-d41a-45cd-8cfe-840aeb6ff6de tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:02.517763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6ce25e4f-d41a-45cd-8cfe-840aeb6ff6de tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:02.533142 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6ce25e4f-d41a-45cd-8cfe-840aeb6ff6de tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1217 microversion: 2.1 time: 0.477899 Aug 30 04:11:02.535034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 352/715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:02 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1217 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:02.542210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:02.543365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:02.555095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.556616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.557539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.558432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.559086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.560019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.639330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62349d5dce2c4d08bb0671425b2d8ec6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a5c0e60926a43fcb53b148a2de0aea1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:02.660321 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a83ffa36-b74e-47d4-9ab2-78b3a9f278c3 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 200 len: 1322 microversion: 2.1 time: 0.705863 Aug 30 04:11:02.663493 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 364/716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:01 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 1322 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:02.672632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:02.673989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:02.686182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.704189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.704668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.705477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.708146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.708818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.753643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:11:02.891148 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9db1fd6-14ba-41d2-bc41-1381e24e412a tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 204 len: 0 microversion: 2.1 time: 0.225885 Aug 30 04:11:02.891767 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 365/717] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:11:02 2022] DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:11:02.914692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:02.915540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:02.930033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.930531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.930966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.931791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:02.932463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:02.933520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:02.967670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:02.981067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:02.995644 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4b20461-9aeb-4855-a730-61ffde1df790 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1463 microversion: 2.1 time: 0.456827 Aug 30 04:11:03.010964 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 353/718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:02 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1463 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:03.023542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:03.026388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:03.037259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:03.042090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:03.042821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:03.044833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:03.045540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:03.046932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:03.181033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:11:03.202147 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1378c99b-7622-453f-a016-6d28eee8f931 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1933 microversion: 2.75 time: 0.308992 Aug 30 04:11:03.205472 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 366/719] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:11:02 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1933 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:11:03.214481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:03.218223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:03.225799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:03.226855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:03.227453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:03.228481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:03.229297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:03.230063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:03.300410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:03.309465 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a351c0b-668a-4a4b-b2d0-08a0942bee28 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1360 microversion: 2.1 time: 0.293771 Aug 30 04:11:03.325372 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 354/720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:03 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1360 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:03.332761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:03.333437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:03.346460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:03.349098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:03.350790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:03.351482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:03.352431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:03.353215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:03.358090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:03.358362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:11:03.368664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:11:03.369092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:11:03.369606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:11:03.370028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:11:03.370450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:11:03.571711 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da276d4a-0933-4f1b-8b07-12db23f7c144 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc/action" status: 202 len: 0 microversion: 2.1 time: 0.361207 Aug 30 04:11:03.573113 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 367/721] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:11:03 2022] POST /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:11:03.584191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-618892409", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "2135024539", "adminPass": "***", "networks": [{"uuid": "091b2e9f-1ebd-4352-add9-2ffd7934e943"}], "security_groups": [{"name": "tempest-securitygroup--190180249"}], "key_name": "tempest-keypair-284590994", "user_data": "}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:03.595505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:03.848345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] validate_networks() for [('091b2e9f-1ebd-4352-add9-2ffd7934e943', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:11:03.983354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:03.993107 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b825ce1-8148-4e8e-8bd9-e749975bf29c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1556 microversion: 2.1 time: 0.668587 Aug 30 04:11:04.008922 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 355/722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:03 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1556 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:04.014400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ccccc26a-6d20-45f4-a15b-0947f08eb7c2 req-a468fb93-925d-4e94-9a7a-551d5c2b41ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a98f78-a3b5-45ac-b93b-72c766284dbd", "tag": "b4cc38e1-ad5b-4717-b289-318c740668e6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:04.026385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:04.040263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ccccc26a-6d20-45f4-a15b-0947f08eb7c2 req-a468fb93-925d-4e94-9a7a-551d5c2b41ed service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:04.040892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ccccc26a-6d20-45f4-a15b-0947f08eb7c2 req-a468fb93-925d-4e94-9a7a-551d5c2b41ed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:04.041503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ccccc26a-6d20-45f4-a15b-0947f08eb7c2 req-a468fb93-925d-4e94-9a7a-551d5c2b41ed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:04.057548 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ccccc26a-6d20-45f4-a15b-0947f08eb7c2 req-a468fb93-925d-4e94-9a7a-551d5c2b41ed service nova] Creating event network-changed:b4cc38e1-ad5b-4717-b289-318c740668e6 for instance b3a98f78-a3b5-45ac-b93b-72c766284dbd on n-h2-854925-5 Aug 30 04:11:04.065673 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ccccc26a-6d20-45f4-a15b-0947f08eb7c2 req-a468fb93-925d-4e94-9a7a-551d5c2b41ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054770 Aug 30 04:11:04.067983 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 356/723] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:04.078927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:04.079778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:04.086611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:04.088185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:04.088723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:04.090761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:04.091396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:04.092082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:04.110979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:04.112620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=34 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:04.234497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:04.264459 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dd85dd82-e96c-4bea-982a-fe58d2e48769 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1275 microversion: 2.1 time: 0.192611 Aug 30 04:11:04.267475 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 357/724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:04 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1275 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:04.284179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:04.285465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:04.299582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:04.300425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:04.301081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:04.302218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:04.303127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:04.303775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.175174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:05.207038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c6e054f-bc5a-4d18-aa47-e0c29ce55dce tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1472 microversion: 2.1 time: 0.930299 Aug 30 04:11:05.209744 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 358/725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:04 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1472 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:05.224481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:05.226444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] [instance: c7561c30-d399-4711-96ca-e495d55f96c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:05.238131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.238638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.239373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.240642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.241190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.241695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.259841 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] HTTP exception thrown: Instance c7561c30-d399-4711-96ca-e495d55f96c4 could not be found. Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Request method failure captured: Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 HTTP/1.1 Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY2ci4qIiOd-99kLI3sxMDBKmYZxlzdUHmdCgD9sUmjxSuSUAlNjhg84SXOoqklhSjx2oYDvgBoaMHI1-Ztqn5jn3WAOr8lFyrbPm25--LmkAYjxn7JEpQQOM-tHZgjV99RLI9-N5GxnrzRTkkqw5i5zXp4PL7JjOkPgRsYMy1I4mqw Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:11:05.263308 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2a5c0e60926a43fcb53b148a2de0aea1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2a5c0e60926a43fcb53b148a2de0aea1"}]}] Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 2a5c0e60926a43fcb53b148a2de0aea1 Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634 Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 62349d5dce2c4d08bb0671425b2d8ec6 Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:11:05.265222 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c7561c30-d399-4711-96ca-e495d55f96c4 could not be found. Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c7561c30-d399-4711-96ca-e495d55f96c4'} Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7561c30-d399-4711-96ca-e495d55f96c4 could not be found. Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:05.265922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7561c30-d399-4711-96ca-e495d55f96c4 could not be found. Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7561c30-d399-4711-96ca-e495d55f96c4 could not be found. Aug 30 04:11:05.267100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:05.268231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] Returning 404 to user: Instance c7561c30-d399-4711-96ca-e495d55f96c4 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:05.268231 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2f53c7a-4c13-47ab-8520-988085d2e7e8 tempest-FloatingIPsAssociationNegativeTestJSON-198443634 tempest-FloatingIPsAssociationNegativeTestJSON-198443634-project] 10.222.0.27 "GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4" status: 404 len: 111 microversion: 2.1 time: 0.054474 Aug 30 04:11:05.275281 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 359/726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:05 2022] GET /compute/v2.1/servers/c7561c30-d399-4711-96ca-e495d55f96c4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:11:05.283097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:05.283603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:05.291853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.292819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.293517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.295844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.297046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.298141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.437709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:11:05.438290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:11:05.438680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:11:05.439093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:11:05.439503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:11:05.460478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.460990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.461491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.473452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.474302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.476096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.542968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Getting quotas for project 9b96459442a54f3caa87eb12f10d85b0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:05.552757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Getting quotas for user b102593edbd9489883889617591d412d and project 9b96459442a54f3caa87eb12f10d85b0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:05.555167 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b71b4b6-8d64-4a71-b437-bc367515ecd9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.278364 Aug 30 04:11:05.555983 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 360/727] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:11:05 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:05.567359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:05.568242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:05.585874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:11:05.586929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.587496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.587953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.588711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.589236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.589712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.590724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:11:05.728115 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff9dd1e2-0ede-40e0-997a-decad01377f3 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.149955 Aug 30 04:11:05.729430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 368/728] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:11:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:11:05.745244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:05.747369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:05.766759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.767521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.768140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:05.769032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:05.770544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:05.771419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:06.199663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] Lazy-loading 'services' on Instance uuid 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:11:06.245667 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c0d97e1-253a-4ecb-bb01-a1b0c5bb7a77 tempest-ServersAdmin275Test-1439573286 tempest-ServersAdmin275Test-1439573286-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1918 microversion: 2.75 time: 0.688261 Aug 30 04:11:06.261967 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 361/729] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:11:05 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1918 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:11:06.275971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:06.277771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:06.288244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:06.290840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:06.291762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:06.292443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:06.293458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:06.294398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:06.296482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:06.573319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:06.582164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:06.598756 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-73c6445c-20a0-4b38-92b8-a679143e1d55 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1360 microversion: 2.1 time: 0.867761 Aug 30 04:11:06.601995 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 369/730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:05 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1360 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:06.618645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:06.622388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:06.627541 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1957f3f-0d8c-474d-99e9-6c311a18af9f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1275 microversion: 2.1 time: 0.364164 Aug 30 04:11:06.628195 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 362/731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:06 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1275 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:06.644222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:06.645000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:06.645759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:06.647024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:06.648083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:06.648771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:06.669724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:06.673212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:06.697459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:06.697878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:06.698332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:06.699048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:06.705440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:06.706414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.127798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:07.136308 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78e5348c-a4d4-42f4-aff8-07e92d5a4e49 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1267 microversion: 2.1 time: 0.532651 Aug 30 04:11:07.149430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 370/732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:06 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1267 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:07.158280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:07.158821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:07.166545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.167054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.170917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.172257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.178558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.179527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.250679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:11:07.423512 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1ea07916-f4d4-4098-a45d-4d4a403ce65b tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 204 len: 0 microversion: 2.75 time: 0.270582 Aug 30 04:11:07.425302 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 371/733] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:07 2022] DELETE /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:11:07.436898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:07.438208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:07.446926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.447781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.448605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.449754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.450431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.453761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.759336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:07.775136 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4e7d08a7-7c66-4b6e-aba9-265726913f85 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1472 microversion: 2.1 time: 1.141907 Aug 30 04:11:07.776228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 363/734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:06 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1472 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:07.783147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:07.784173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:07.791299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.792072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.792726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.793855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.794538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.795180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.857607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:07.872905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:07.876999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:07.895354 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5882b877-d9d2-497c-ae4e-0796e27cfff3 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1443 microversion: 2.75 time: 0.465516 Aug 30 04:11:07.902993 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 372/735] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:11:07 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1443 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:11:07.922890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:07.924267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:07.941764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.943063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.943540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:07.944288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:07.944752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:07.948101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:09.240842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:09.250532 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25bc0c65-ebd1-4920-9bd4-7b3b319b6b58 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 1.344749 Aug 30 04:11:09.252342 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 373/736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:07 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:09.258633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:09.265618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:09.279774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:09.287723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:09.291846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:09.292917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:09.293685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:09.296884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:09.600490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:09.621196 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f60975f3-8612-403d-a301-1f5dd47ad60c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1360 microversion: 2.1 time: 1.843706 Aug 30 04:11:09.622869 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 364/737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:07 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1360 bytes in 1846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:09.631471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:09.632500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:09.645557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:09.650363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:09.651125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:09.652304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:09.654226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:09.654948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:09.875162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:09.884451 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3405c6a9-6910-4c75-a643-9be86653ca50 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1321 microversion: 2.1 time: 0.630897 Aug 30 04:11:09.885047 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 374/738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:09 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1321 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:09.914184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:09.919004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:09.967068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:09.973566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:09.975265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:09.978250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:09.978733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:09.979189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:10.414851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:10.429377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:10.430833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '307eec7d0fcc497ca7599e3c6a9ef37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2f6317237414bfaa2620e4aed248f9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:10.442858 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f79413d-2e2f-4cb4-bc85-af60896f3b6c tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 200 len: 1443 microversion: 2.75 time: 0.542410 Aug 30 04:11:10.443687 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 375/739] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:11:09 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 1443 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:11:10.456859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9b121d26-dfee-4ab0-9860-773a9baba9c0 req-c156dd75-db5d-4229-ba99-a8a01fbbe15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7921f451-2ab5-4c56-8efe-31230544542f", "name": "network-vif-unplugged", "status": "completed", "tag": "d2517cf5-e55a-4cec-b014-eabf985f3f86"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:10.479477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b121d26-dfee-4ab0-9860-773a9baba9c0 req-c156dd75-db5d-4229-ba99-a8a01fbbe15d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:10.479994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b121d26-dfee-4ab0-9860-773a9baba9c0 req-c156dd75-db5d-4229-ba99-a8a01fbbe15d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:10.480424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b121d26-dfee-4ab0-9860-773a9baba9c0 req-c156dd75-db5d-4229-ba99-a8a01fbbe15d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:10.492513 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9b121d26-dfee-4ab0-9860-773a9baba9c0 req-c156dd75-db5d-4229-ba99-a8a01fbbe15d service nova] Creating event network-vif-unplugged:d2517cf5-e55a-4cec-b014-eabf985f3f86 for instance 7921f451-2ab5-4c56-8efe-31230544542f on n-h1-854925-5 Aug 30 04:11:10.503030 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9b121d26-dfee-4ab0-9860-773a9baba9c0 req-c156dd75-db5d-4229-ba99-a8a01fbbe15d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053059 Aug 30 04:11:10.503274 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 376/740] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:10.509664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:10.510580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:10.520318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:10.520997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:10.521656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:10.522561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:10.523183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:10.523782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:11.143209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:11.603275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:11.616557 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b6bf04c0-817c-430e-8d47-b8518d7dd0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1472 microversion: 2.1 time: 1.992351 Aug 30 04:11:11.617141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 365/741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:09 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1472 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:11.647290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:11.659216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:11.686687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:11.690150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:11.692946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:11.694830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:11.698074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:11.701498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:11.846286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:11.879262 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cad10731-e6cd-46f2-90f5-f8dd6b7f5878 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 1.374111 Aug 30 04:11:11.886983 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 377/742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:10 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:11.908476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:11.909670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:11.916419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:11.916912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:11.917371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:11.918274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:11.918892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:11.919482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.524580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=9 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:12.709959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:12.709959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-42a8d310-72b3-4f98-941b-21666db7a10a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1360 microversion: 2.1 time: 1.032239 Aug 30 04:11:12.709959 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 366/743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:11 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1360 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:12.709959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:12.711004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] [instance: 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:12.711004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.711004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.711004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.711507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.711507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.711507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.711507 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] HTTP exception thrown: Instance 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c could not be found. Aug 30 04:11:12.711507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Request method failure captured: Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c HTTP/1.1 Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY18PppPwcCC4CK06G4RhJvJ5AEKsWMyEws2URnE3Kj2MXOJsbKZ2YpDcX0-1BwRyvR2owyIlS6juenkvfKBIJYkHMW-pCksUTFkZg5UD7Y3zLxBtoRnUNogn9nWrgyRKUnTguWA2F4JoAAlWLiko-WczsxWMiNZVryb_N7w--5Axug Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.75 Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: d2f6317237414bfaa2620e4aed248f9e Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersAdmin275Test-1502289790 Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:11:12.711840 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d2f6317237414bfaa2620e4aed248f9e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d2f6317237414bfaa2620e4aed248f9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2f6317237414bfaa2620e4aed248f9e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d2f6317237414bfaa2620e4aed248f9e"}]}] Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersAdmin275Test-1502289790 Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: d2f6317237414bfaa2620e4aed248f9e Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersAdmin275Test-1502289790 Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersAdmin275Test-1502289790-project Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 307eec7d0fcc497ca7599e3c6a9ef37b Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersAdmin275Test-1502289790-project Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c could not be found. Aug 30 04:11:12.713069 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c'} Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c could not be found. Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:12.715139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c could not be found. Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c could not be found. Aug 30 04:11:12.716371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:12.717646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] Returning 404 to user: Instance 0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:12.717646 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3d0e77a2-5d91-413f-bac5-127b3fa71e10 tempest-ServersAdmin275Test-1502289790 tempest-ServersAdmin275Test-1502289790-project] 10.222.0.27 "GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c" status: 404 len: 111 microversion: 2.75 time: 0.037262 Aug 30 04:11:12.717646 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 367/744] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:11:12 2022] GET /compute/v2.1/servers/0654a752-4a74-4dcf-8ebc-e69ac2ed3c3c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:11:12.717646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-20433e75-d453-4b01-8f36-6364cc4c9aed req-01def413-6753-4834-8e9d-bb8445cc5ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a98f78-a3b5-45ac-b93b-72c766284dbd", "name": "network-vif-plugged", "status": "completed", "tag": "b4cc38e1-ad5b-4717-b289-318c740668e6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:12.744154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:12.755494 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-212b2595-a0bb-432f-91f0-03137748abef tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1388 microversion: 2.1 time: 0.866541 Aug 30 04:11:12.780302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-20433e75-d453-4b01-8f36-6364cc4c9aed req-01def413-6753-4834-8e9d-bb8445cc5ae9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.781779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-20433e75-d453-4b01-8f36-6364cc4c9aed req-01def413-6753-4834-8e9d-bb8445cc5ae9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.782558 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 378/745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:11 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1388 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:12.785039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-20433e75-d453-4b01-8f36-6364cc4c9aed req-01def413-6753-4834-8e9d-bb8445cc5ae9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.821874 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-20433e75-d453-4b01-8f36-6364cc4c9aed req-01def413-6753-4834-8e9d-bb8445cc5ae9 service nova] Creating event network-vif-plugged:b4cc38e1-ad5b-4717-b289-318c740668e6 for instance b3a98f78-a3b5-45ac-b93b-72c766284dbd on n-h2-854925-5 Aug 30 04:11:12.832778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-20433e75-d453-4b01-8f36-6364cc4c9aed req-01def413-6753-4834-8e9d-bb8445cc5ae9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133049 Aug 30 04:11:12.834054 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 368/746] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:12.855479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-665965b7-c2ef-46a1-ba06-bfefcc22841a req-c4c07257-1f75-43be-92af-337a6b6e690c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7921f451-2ab5-4c56-8efe-31230544542f", "name": "network-vif-deleted", "tag": "d2517cf5-e55a-4cec-b014-eabf985f3f86"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:12.871616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-665965b7-c2ef-46a1-ba06-bfefcc22841a req-c4c07257-1f75-43be-92af-337a6b6e690c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.872348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:12.873269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-665965b7-c2ef-46a1-ba06-bfefcc22841a req-c4c07257-1f75-43be-92af-337a6b6e690c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.875299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-665965b7-c2ef-46a1-ba06-bfefcc22841a req-c4c07257-1f75-43be-92af-337a6b6e690c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.882204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:12.893494 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-665965b7-c2ef-46a1-ba06-bfefcc22841a req-c4c07257-1f75-43be-92af-337a6b6e690c service nova] Creating event network-vif-deleted:d2517cf5-e55a-4cec-b014-eabf985f3f86 for instance 7921f451-2ab5-4c56-8efe-31230544542f on n-h1-854925-5 Aug 30 04:11:12.900613 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-665965b7-c2ef-46a1-ba06-bfefcc22841a req-c4c07257-1f75-43be-92af-337a6b6e690c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054543 Aug 30 04:11:12.908003 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 369/747] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:12.915844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:12.917414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:12.922593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.928828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.931803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.932415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.934206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.939466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.940138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.940489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.940934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:12.941109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:12.942940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:12.943664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:14.291053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:14.304386 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a544ddc1-44ba-40ae-88b7-43b50e869bee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 1.492698 Aug 30 04:11:14.324509 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 379/748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:12 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:14.341723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b7cac51e-0171-42e0-bd5e-99ab6adb0327 req-2d3a9505-e63e-4d7d-8707-93ad8e263dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ce3cd4-5293-4b7d-9f09-bf710b97dbb5", "tag": "38df6bec-3dcd-4963-b904-7a1edc19ee06"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:14.379994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b7cac51e-0171-42e0-bd5e-99ab6adb0327 req-2d3a9505-e63e-4d7d-8707-93ad8e263dbd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:14.380521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b7cac51e-0171-42e0-bd5e-99ab6adb0327 req-2d3a9505-e63e-4d7d-8707-93ad8e263dbd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:14.383026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b7cac51e-0171-42e0-bd5e-99ab6adb0327 req-2d3a9505-e63e-4d7d-8707-93ad8e263dbd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:14.409939 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b7cac51e-0171-42e0-bd5e-99ab6adb0327 req-2d3a9505-e63e-4d7d-8707-93ad8e263dbd service nova] Creating event network-changed:38df6bec-3dcd-4963-b904-7a1edc19ee06 for instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 on n-h2-854925-5 Aug 30 04:11:14.421067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:14.431629 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e8570cb-2726-4ab2-945e-f016782558f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 1.520830 Aug 30 04:11:14.433647 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 370/749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:12 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:14.433789 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b7cac51e-0171-42e0-bd5e-99ab6adb0327 req-2d3a9505-e63e-4d7d-8707-93ad8e263dbd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107078 Aug 30 04:11:14.434540 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 380/750] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:14.438845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:14.439671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:14.446985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:14.450550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:14.452853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:14.452853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:14.453444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:14.453585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:14.453920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:14.454328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:14.467056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:14.467568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:14.468628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:14.469564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:14.470225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:14.470883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:14.492973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:14.953805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:14.965456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a257737-9325-4f8e-a28f-5f35d0d09cba tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1360 microversion: 2.1 time: 0.530293 Aug 30 04:11:14.970766 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 371/751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:14 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1360 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:15.082500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:15.096001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42365614-fb3f-466b-b78d-222ba938a48b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1388 microversion: 2.1 time: 0.659930 Aug 30 04:11:15.096718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 381/752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:14 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1388 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:15.102837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-55267158-b3f8-4734-9295-06e91e342cfc req-cc4d866e-77e9-469d-9e8d-0ada96bdebc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7e450c-101b-43a5-96ef-e8e35901e3b2", "tag": "457ebde2-e320-4370-9d9b-77ba6f31e833"}, {"name": "network-changed", "server_uuid": "ab4dc36b-832a-4978-945a-fc9fe6be51ab", "tag": "861b971b-13a8-4aa1-bcb2-2c8faa20a585"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:15.115686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-55267158-b3f8-4734-9295-06e91e342cfc req-cc4d866e-77e9-469d-9e8d-0ada96bdebc6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:15.117414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-55267158-b3f8-4734-9295-06e91e342cfc req-cc4d866e-77e9-469d-9e8d-0ada96bdebc6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:15.117670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-55267158-b3f8-4734-9295-06e91e342cfc req-cc4d866e-77e9-469d-9e8d-0ada96bdebc6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:15.136402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-55267158-b3f8-4734-9295-06e91e342cfc req-cc4d866e-77e9-469d-9e8d-0ada96bdebc6 service nova] Creating event network-changed:457ebde2-e320-4370-9d9b-77ba6f31e833 for instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 on n-h1-854925-5 Aug 30 04:11:15.137600 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-55267158-b3f8-4734-9295-06e91e342cfc req-cc4d866e-77e9-469d-9e8d-0ada96bdebc6 service nova] Creating event network-changed:861b971b-13a8-4aa1-bcb2-2c8faa20a585 for instance ab4dc36b-832a-4978-945a-fc9fe6be51ab on n-h2-854925-5 Aug 30 04:11:15.193911 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-55267158-b3f8-4734-9295-06e91e342cfc req-cc4d866e-77e9-469d-9e8d-0ada96bdebc6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091666 Aug 30 04:11:15.199799 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 382/753] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:15.333391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:15.335142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:15.355764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:15.357639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:15.362641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:15.367124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:15.367971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:15.369956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:15.502234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:15.571409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:15.581531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3525a785-6a86-4aa9-8f33-058edb16074f tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Action: 'create', calling method: .version_select at 0x7fe96a5aad30>, body: {"keypair": {"name": "tempest-keypair-1015403446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK/ICV7mmIL5J8NCx4XokiBBjd+XTlizEKkTZFyWw8DwL2Msp+ECHSiT2Y4VPzcXGam0Yp2miyvrE2ORk5p1DRRlRIKnci6yU80JMK8UtO267irJ7nVam2Cx7CowJWEK+A=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:15.634917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3525a785-6a86-4aa9-8f33-058edb16074f tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Getting quotas for project b8e48071560647d1b0684dea4cbb0883. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:15.650640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3525a785-6a86-4aa9-8f33-058edb16074f tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Getting quotas for user e24aec83db374898a8fbbe3da7407cc1 and project b8e48071560647d1b0684dea4cbb0883. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:15.692669 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3525a785-6a86-4aa9-8f33-058edb16074f tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.718533 Aug 30 04:11:15.693723 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 372/754] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:15.699505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:15.701823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:15.723148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:15.724877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:15.725813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:15.728328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:15.729907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:15.731868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:15.990693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:16.000477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f78b99c-28fc-4188-8e30-0e0b5983a508 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 0.675777 Aug 30 04:11:16.007871 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 383/755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:15 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:16.018256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:16.019250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:16.041077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:16.041840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:16.042266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:16.043159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:16.043683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:16.044227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:16.196214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:16.209874 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4d227e9e-a5d5-4f1d-9af1-1d036583e255 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 0.514737 Aug 30 04:11:16.210982 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 373/756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:15 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:16.233016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:16.234683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:16.244122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:16.245065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:16.247714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:16.250919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:16.253004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:16.254225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:16.372052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:16.382847 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ade1b406-7810-4593-adcf-f925b6947a57 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1543 microversion: 2.1 time: 0.372473 Aug 30 04:11:16.384283 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 384/757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:16 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1543 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:16.404927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:16.406841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:16.417257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:16.418061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:16.418854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:16.420412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:16.422071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:16.422887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:16.634554 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-160eb1d2-2fb7-4102-b78a-ec03b4c6caf3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.232816 Aug 30 04:11:16.637656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:16.649211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 385/758] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:11:16 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:16.649501 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2aeea2e-e858-4df2-ba67-cb8f33c1e4b1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1388 microversion: 2.1 time: 0.436957 Aug 30 04:11:16.650067 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 374/759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:16 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1388 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:17.035871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:17.037124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:17.046848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:17.048522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:17.049230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:17.050413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:17.052653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:17.053370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:17.235834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:17.237065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:17.247601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:17.253448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:17.254631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:17.256279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:17.259898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:17.264977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:17.700554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:17.712734 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27408a70-774d-4a7e-b510-2edde7910487 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 0.684159 Aug 30 04:11:17.713570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 386/760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:17 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:17.723998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:17.730196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:17.748935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:17.749799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:17.750431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:17.751334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:17.751972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:17.752586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:17.902665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:17.922625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8e2f5b7-bb7a-4139-b354-bafbe94de1f2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 0.694683 Aug 30 04:11:17.923225 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 375/761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:17 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:18.133556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] Calling method '.version_select at 0x7fe96aa4e0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:18.148959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:18.149315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:18.150016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:18.151975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:18.152760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:18.153541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:18.179625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6845e857-fca2-4a41-9c54-97f824287b63 tempest-AbsoluteLimitsTestJSON-780094540 tempest-AbsoluteLimitsTestJSON-780094540-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.255274 Aug 30 04:11:18.180924 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 376/762] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 04:11:17 2022] GET /compute/v2.1/limits => generated 511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:18.195642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:18.211867 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-68d1bcef-3cd0-4914-9f3c-7717f1d1eed2 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1388 microversion: 2.1 time: 0.489578 Aug 30 04:11:18.213994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 387/763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:17 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1388 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:18.270687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7f8b127-a7ac-4a40-82ae-6eaca0b2334f tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a6f3280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:18.328677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7f8b127-a7ac-4a40-82ae-6eaca0b2334f tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660" status: 200 len: 637 microversion: 2.1 time: 0.062095 Aug 30 04:11:18.329841 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 377/764] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:18 2022] GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660 => generated 637 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:18.347462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddbed751-2314-40bc-9d9b-0ed009513f9c tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update_all', calling method: .version_select at 0x7fe96a80d4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:18.421028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ddbed751-2314-40bc-9d9b-0ed009513f9c tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:18.428998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ddbed751-2314-40bc-9d9b-0ed009513f9c tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:18.741229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:18.742277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:18.750887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:18.751632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:18.753172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:18.753774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:18.754404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:18.755357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:18.829688 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ddbed751-2314-40bc-9d9b-0ed009513f9c tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 61 microversion: 2.1 time: 0.485962 Aug 30 04:11:18.830901 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 388/765] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:18 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 61 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:11:18.842309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-04ce667f-ae73-4555-9168-8d4292bf822f tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a561310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:19.046984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:19.060176 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b35d0ec7-6207-4478-9149-c1d55d620b76 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 0.320886 Aug 30 04:11:19.060868 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 378/766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:18 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:19.069504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-42d25f8f-8259-4b31-8548-0b5a80168f0e req-7dd656fe-7248-4f36-8838-3c3a42eeea39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a98f78-a3b5-45ac-b93b-72c766284dbd", "tag": "b4cc38e1-ad5b-4717-b289-318c740668e6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:19.090344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-42d25f8f-8259-4b31-8548-0b5a80168f0e req-7dd656fe-7248-4f36-8838-3c3a42eeea39 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:19.090896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-42d25f8f-8259-4b31-8548-0b5a80168f0e req-7dd656fe-7248-4f36-8838-3c3a42eeea39 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:19.091497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-42d25f8f-8259-4b31-8548-0b5a80168f0e req-7dd656fe-7248-4f36-8838-3c3a42eeea39 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:19.131354 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-42d25f8f-8259-4b31-8548-0b5a80168f0e req-7dd656fe-7248-4f36-8838-3c3a42eeea39 service nova] Creating event network-changed:b4cc38e1-ad5b-4717-b289-318c740668e6 for instance b3a98f78-a3b5-45ac-b93b-72c766284dbd on n-h2-854925-5 Aug 30 04:11:19.137252 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-42d25f8f-8259-4b31-8548-0b5a80168f0e req-7dd656fe-7248-4f36-8838-3c3a42eeea39 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074480 Aug 30 04:11:19.139785 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 379/767] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:19.148978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:19.152178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:19.164845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:19.166718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:19.167393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:19.168342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:19.169021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:19.169650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:19.175968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:19.240429 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-04ce667f-ae73-4555-9168-8d4292bf822f tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "DELETE /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.403360 Aug 30 04:11:19.244606 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 389/768] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Aug 30 04:11:18 2022] DELETE /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata/os_version => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:11:19.255889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:19.257524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:19.271044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:19.272266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:19.273257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:19.274830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:19.275873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:19.276957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:20.086820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:20.100845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:20.101434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e310d76a-9789-4826-8e6c-2c09cc86e128 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1388 microversion: 2.1 time: 0.854733 Aug 30 04:11:20.103634 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 390/769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:19 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1388 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:20.115737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75e29058-0a14-41ac-ac57-8f891fa2b4bb tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a561940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:20.126698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f7119cd-5fd9-49b5-9859-0051a4a7fde3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 0.985602 Aug 30 04:11:20.129661 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 380/770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:19 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:20.139979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-413909106", "imageRef": "e83feb5f-bd35-4c03-b214-dc0b321d60e9", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "07a97b48-98e8-4ee2-821b-8937f46b8eb7"}], "security_groups": [{"name": "tempest-securitygroup--568841937"}], "key_name": "tempest-keypair-1015403446", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:20.207959 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75e29058-0a14-41ac-ac57-8f891fa2b4bb tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 37 microversion: 2.1 time: 0.103238 Aug 30 04:11:20.208552 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 391/771] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:11:20 2022] GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 37 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:20.221944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:20.222868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:20.242658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:20.244064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:20.245096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:20.247366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:20.249134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:20.251181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:20.492175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] validate_networks() for [('07a97b48-98e8-4ee2-821b-8937f46b8eb7', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:11:20.631179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:20.642244 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41f8c1f3-048e-4316-96d9-893ddb1d0680 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 0.431782 Aug 30 04:11:20.665404 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 392/772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:20 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:20.670899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29f4a312-ab06-4e78-baca-010283bce1b1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update_all', calling method: .version_select at 0x7fe96a5d3e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:20.730841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-29f4a312-ab06-4e78-baca-010283bce1b1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:20.741648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-29f4a312-ab06-4e78-baca-010283bce1b1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:21.092056 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29f4a312-ab06-4e78-baca-010283bce1b1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 61 microversion: 2.1 time: 0.425278 Aug 30 04:11:21.092696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 393/773] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:20 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 61 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:21.097444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c9e0bd21-48e2-42b8-aaa6-14582a31d96e req-baa94900-98da-4fce-aa15-919196d14c69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ce3cd4-5293-4b7d-9f09-bf710b97dbb5", "name": "network-vif-plugged", "status": "completed", "tag": "38df6bec-3dcd-4963-b904-7a1edc19ee06"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:21.121038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9e0bd21-48e2-42b8-aaa6-14582a31d96e req-baa94900-98da-4fce-aa15-919196d14c69 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.121633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9e0bd21-48e2-42b8-aaa6-14582a31d96e req-baa94900-98da-4fce-aa15-919196d14c69 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.122079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9e0bd21-48e2-42b8-aaa6-14582a31d96e req-baa94900-98da-4fce-aa15-919196d14c69 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.135088 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c9e0bd21-48e2-42b8-aaa6-14582a31d96e req-baa94900-98da-4fce-aa15-919196d14c69 service nova] Creating event network-vif-plugged:38df6bec-3dcd-4963-b904-7a1edc19ee06 for instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 on n-h2-854925-5 Aug 30 04:11:21.142212 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c9e0bd21-48e2-42b8-aaa6-14582a31d96e req-baa94900-98da-4fce-aa15-919196d14c69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048001 Aug 30 04:11:21.143579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:11:21.144683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:11:21.145153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:11:21.145877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:11:21.147344 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 394/774] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:21.147823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:11:21.156593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5cae8e3-06fb-4443-9bb5-632eff0dd7e3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a5cad30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:21.158517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.159065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.159638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.160164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.160668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.161139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.191868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Getting quotas for project b8e48071560647d1b0684dea4cbb0883. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:21.198806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Getting quotas for user e24aec83db374898a8fbbe3da7407cc1 and project b8e48071560647d1b0684dea4cbb0883. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:21.213731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:11:21.216453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e83feb5f-bd35-4c03-b214-dc0b321d60e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:11:21.244992 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5cae8e3-06fb-4443-9bb5-632eff0dd7e3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.095279 Aug 30 04:11:21.254387 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 395/775] 10.222.0.27 () {58 vars in 1290 bytes} [Tue Aug 30 04:11:21 2022] GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata/os_distro => generated 33 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:21.261649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:21.262984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:21.271801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.272666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.273797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.274784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.276041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.276712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.331249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4f7f23d-6435-4f77-9023-3e36f7d56e24 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.199209 Aug 30 04:11:21.332953 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 381/776] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:11:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:11:21.343513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:21.344390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:21.354745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.355239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.355890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.356761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:21.357710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:21.358639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:21.723030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:21.737678 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bbfff451-a22a-47af-8951-95b0361746bb tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1388 microversion: 2.1 time: 0.479905 Aug 30 04:11:21.739305 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 396/777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:21 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1388 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:21.750922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb2a75b3-567d-4315-bf4d-8cbde1d178f3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update_all', calling method: .version_select at 0x7fe96a5cadc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:21.811407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-eb2a75b3-567d-4315-bf4d-8cbde1d178f3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:21.818257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-eb2a75b3-567d-4315-bf4d-8cbde1d178f3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:21.821245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:21.842900 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-828b42d5-857d-4b0e-84bf-2bedd0fe1285 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 0.507650 Aug 30 04:11:21.843514 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 382/778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:21 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:21.860125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4e1c0d4e-8a2d-41bb-880a-c66b8c7b7bd7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:21.860125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4e1c0d4e-8a2d-41bb-880a-c66b8c7b7bd7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:22.010280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4e1c0d4e-8a2d-41bb-880a-c66b8c7b7bd7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:22.019944 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4e1c0d4e-8a2d-41bb-880a-c66b8c7b7bd7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1245 microversion: 2.1 time: 0.175071 Aug 30 04:11:22.041538 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 383/779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:21 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1245 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:22.049646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:22.051923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:22.057915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb2a75b3-567d-4315-bf4d-8cbde1d178f3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 61 microversion: 2.1 time: 0.317415 Aug 30 04:11:22.058537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 397/780] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:21 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 61 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:22.060584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.061092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.062133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.062853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.063307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.063806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.071052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2c972d5-1c0e-4e96-91a7-3ad09343cde0 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a5ca280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:22.129294 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d2c972d5-1c0e-4e96-91a7-3ad09343cde0 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 61 microversion: 2.1 time: 0.062128 Aug 30 04:11:22.130192 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 398/781] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:11:22 2022] GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 61 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:11:22.144617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8352e4f8-5c6b-4d30-b0a9-99f83f66fb6a tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update_all', calling method: .version_select at 0x7fe96ab0a940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:22.221841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8352e4f8-5c6b-4d30-b0a9-99f83f66fb6a tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:22.231521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:22.232163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:22.239014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8352e4f8-5c6b-4d30-b0a9-99f83f66fb6a tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:22.243179 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30bd0b0a-d2fa-4255-a3df-21303ab77a42 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 0.200719 Aug 30 04:11:22.244383 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 384/782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:22 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:22.484997 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8352e4f8-5c6b-4d30-b0a9-99f83f66fb6a tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 61 microversion: 2.1 time: 0.345456 Aug 30 04:11:22.487298 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 399/783] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:22 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 61 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:22.496568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b9af7dee-1cc3-4280-8592-81d0260ba9e2 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update_all', calling method: .version_select at 0x7fe96a71a700>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:22.552244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b9af7dee-1cc3-4280-8592-81d0260ba9e2 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:22.559128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b9af7dee-1cc3-4280-8592-81d0260ba9e2 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:22.769985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:22.771044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:22.792615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.794235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.795445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.796728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.799653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.800855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:22.975759 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b9af7dee-1cc3-4280-8592-81d0260ba9e2 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 64 microversion: 2.1 time: 0.483084 Aug 30 04:11:22.976608 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 385/784] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:22 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 64 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:22.985029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:22.986100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:22.996558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:22.996992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:22.997816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:22.998590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:23.000105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:23.000804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:23.001662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:23.008568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3417eca1-ab2e-4011-bf5a-a00cfc7613bc tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1388 microversion: 2.1 time: 0.244560 Aug 30 04:11:23.009161 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 400/785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:22 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1388 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:23.015863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ad8c8aa-dc99-4552-b938-d8233c6cc934 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a5cab80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:23.133677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7ad8c8aa-dc99-4552-b938-d8233c6cc934 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 64 microversion: 2.1 time: 0.122877 Aug 30 04:11:23.134327 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 401/786] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:11:23 2022] GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 64 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:23.158818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:23.159814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:23.171529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:23.172145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:23.172527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:23.173252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:23.173744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:23.174181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:23.203870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:23.214005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf0ec14c-76fe-43e6-910f-2b28334a447e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 0.236046 Aug 30 04:11:23.215026 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 386/787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:22 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:23.222388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58e79d5b-4515-450c-bc28-72036127ac61 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update_all', calling method: .version_select at 0x7fe96a905820>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:23.321409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-58e79d5b-4515-450c-bc28-72036127ac61 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:23.329031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-58e79d5b-4515-450c-bc28-72036127ac61 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:23.335800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:23.354494 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c0cdf448-01f5-45c6-af1d-7dc94c770903 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1297 microversion: 2.1 time: 0.218847 Aug 30 04:11:23.371345 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 402/788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:23 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1297 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:23.377680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:23.382070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:23.397622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:23.398662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:23.400032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:23.401593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:23.402855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:23.403601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:23.753317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:23.766976 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7a6af6d-e8b0-4404-97ea-f78578eb41f4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 0.390565 Aug 30 04:11:23.771870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 403/789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:23 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:23.957282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3f7fd1d9-7077-458d-8177-b9272280af2e req-59216250-5a82-4211-a988-b83f09024e17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4dc36b-832a-4978-945a-fc9fe6be51ab", "name": "network-vif-plugged", "status": "completed", "tag": "861b971b-13a8-4aa1-bcb2-2c8faa20a585"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:23.966185 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-58e79d5b-4515-450c-bc28-72036127ac61 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 61 microversion: 2.1 time: 0.749835 Aug 30 04:11:23.966784 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 387/790] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:23 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 61 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:23.976783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-789a5093-104c-4bdb-9a66-58f70330bfc3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update', calling method: .version_select at 0x7fe96a9050d0>, body: {"meta": {"os_version": "alt"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:23.986664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3f7fd1d9-7077-458d-8177-b9272280af2e req-59216250-5a82-4211-a988-b83f09024e17 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:23.987728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3f7fd1d9-7077-458d-8177-b9272280af2e req-59216250-5a82-4211-a988-b83f09024e17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:23.989485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3f7fd1d9-7077-458d-8177-b9272280af2e req-59216250-5a82-4211-a988-b83f09024e17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.016329 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3f7fd1d9-7077-458d-8177-b9272280af2e req-59216250-5a82-4211-a988-b83f09024e17 service nova] Creating event network-vif-plugged:861b971b-13a8-4aa1-bcb2-2c8faa20a585 for instance ab4dc36b-832a-4978-945a-fc9fe6be51ab on n-h2-854925-5 Aug 30 04:11:24.028001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3f7fd1d9-7077-458d-8177-b9272280af2e req-59216250-5a82-4211-a988-b83f09024e17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075555 Aug 30 04:11:24.031511 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 404/791] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:24.049417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:24.052825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:24.067351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.069596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.070385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.071349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.072171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.072971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.117495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-789a5093-104c-4bdb-9a66-58f70330bfc3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:24.131057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-789a5093-104c-4bdb-9a66-58f70330bfc3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:24.156444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:24.569472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:24.586116 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28850836-c0fe-4dd0-8782-cfbe823a7827 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1585 microversion: 2.1 time: 0.549189 Aug 30 04:11:24.587995 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 405/792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:24 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1585 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:24.601067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:24.604057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:24.621040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.622574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.625487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.627791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.629489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.630551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.674233 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-789a5093-104c-4bdb-9a66-58f70330bfc3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.700610 Aug 30 04:11:24.679467 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 388/793] 10.222.0.27 () {60 vars in 1313 bytes} [Tue Aug 30 04:11:23 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata/os_version => generated 31 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:11:24.680352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:24.681020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:24.703103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.706052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.710999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.714872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.715482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.715935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.956478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:24.970401 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73de06dc-0a55-4b01-b592-6e222ccc9405 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1303 microversion: 2.1 time: 0.293245 Aug 30 04:11:24.971290 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 389/794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:24 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1303 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:24.978571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:24.979360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:24.986341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.988296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.989299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:24.990922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:24.993115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:24.994224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:25.089488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:25.101238 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42cc4243-41f2-4453-9ef4-be2d4848dd0e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1317 microversion: 2.1 time: 0.508024 Aug 30 04:11:25.102227 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 406/795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:24 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:25.113948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8631960d-c07a-4bfe-b817-a0001a7eb35f tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a89ca60>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:25.190301 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ffb98236-7864-4709-9965-a1202b2d6d5c tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.214748 Aug 30 04:11:25.194252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 390/796] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:11:24 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5/os-interface => generated 284 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:25.209355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:25.216472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:25.227457 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8631960d-c07a-4bfe-b817-a0001a7eb35f tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 58 microversion: 2.1 time: 0.123887 Aug 30 04:11:25.228144 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 407/797] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:11:25 2022] GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 58 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:25.230542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:25.231424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:25.232287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:25.234196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:25.235396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:25.239425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:25.241091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cc373b0-5d68-4dca-8d4c-ebff390221b3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'update_all', calling method: .version_select at 0x7fe96a5788b0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:25.396281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7cc373b0-5d68-4dca-8d4c-ebff390221b3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:25.411266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7cc373b0-5d68-4dca-8d4c-ebff390221b3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:26.196610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:26.206996 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cc373b0-5d68-4dca-8d4c-ebff390221b3 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 61 microversion: 2.1 time: 0.969968 Aug 30 04:11:26.209697 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e6acacfb-a067-48f1-9719-9816b9f872d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 1.013193 Aug 30 04:11:26.212457 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 408/798] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:11:25 2022] PUT /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 61 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:11:26.220509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:26.224270 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 391/799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:25 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:26.226178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:26.230431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:26.231385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:26.239374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:26.240205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:26.240875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:26.241930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:26.242615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:26.243267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:26.250094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:26.250617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:26.251067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:26.257269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:26.257923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:26.261737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:27.891041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:27.904311 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dbbe25c7-7b49-426b-a4ab-a3a1202b532a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1467 microversion: 2.1 time: 1.678543 Aug 30 04:11:27.911271 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 392/800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:26 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1467 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:27.917384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7413c43-57bb-45ae-870b-2af9657065c1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Action: 'create', calling method: .version_select at 0x7fe96a7e7040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:28.028783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:28.029814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b7413c43-57bb-45ae-870b-2af9657065c1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:28.037400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b7413c43-57bb-45ae-870b-2af9657065c1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Getting quotas for user 9c4decdfbf6e455c9138a103d127f916 and project a9f2423f95a1455ead3bacca5301567b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:28.042465 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-133d181c-8e92-4b6b-a550-ad96149247f6 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 1.828465 Aug 30 04:11:28.045098 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 409/801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:26 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:28.059526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:28.062069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:28.081151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:28.084148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:28.085597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:28.089716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:28.091803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:28.093006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:28.698269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:28.731779 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0aea74f5-7896-4ce5-830e-f626be56c55f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1477 microversion: 2.1 time: 0.667445 Aug 30 04:11:28.735291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 410/802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:28 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1477 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:28.737844 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7413c43-57bb-45ae-870b-2af9657065c1 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "POST /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 85 microversion: 2.1 time: 0.824368 Aug 30 04:11:28.738971 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 393/803] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Aug 30 04:11:27 2022] POST /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 85 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:28.749082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6741b21f-62df-4a59-b809-6988b36dbf72 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] Calling method '.version_select at 0x7fe96a4eac10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:28.758586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1884749405", "metadata": {"image_type": "test"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:28.774787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:28.795466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:28.798003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:28.799925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:28.803804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:28.804646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:28.813187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:28.844649 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6741b21f-62df-4a59-b809-6988b36dbf72 tempest-ImagesMetadataTestJSON-857948601 tempest-ImagesMetadataTestJSON-857948601-project] 10.222.0.27 "GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata" status: 200 len: 85 microversion: 2.1 time: 0.099829 Aug 30 04:11:28.846393 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 394/804] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:11:28 2022] GET /compute/v2.1/images/eaf0ec1d-0ee2-4098-b54b-b7a8ad778660/metadata => generated 85 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:28.875747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:28.962781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Getting quotas for project 06c46e03b3724660b056f47cf14eb3eb. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:29.000993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Getting quotas for user 4b364e890c394b5e9d89d82270783d4a and project 06c46e03b3724660b056f47cf14eb3eb. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:29.074710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:29.075597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:29.101818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:29.102739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:29.104040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:29.107342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:29.108030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:29.110564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:29.918323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:29.930171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b494c8c-9ce0-444a-a08b-3f3d0f78adc5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.862563 Aug 30 04:11:29.930767 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 395/805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:29 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:29.957100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:29.957794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:29.986921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:29.987700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:29.988313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:29.989180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:29.989860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:29.990443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:30.074780 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-54f9bed4-f5c5-4373-a8ab-96e7bdcf8010 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "POST /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab/action" status: 202 len: 0 microversion: 2.1 time: 1.334486 Aug 30 04:11:30.081461 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 411/806] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:11:28 2022] POST /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab/action => generated 0 bytes in 1344 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:11:30.648977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2048c5b6-64be-40ac-a982-80e6fc4b3e09 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96a578790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-754569002", "description": "tempest-description-1878681836"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:30.734937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:30.746826 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3038745-3fde-4a79-b6b2-38c785a033ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1476 microversion: 2.1 time: 0.801562 Aug 30 04:11:30.747680 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 396/807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:29 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1476 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:30.760304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-46b8114f-a870-47e4-842b-982e53ee47e7 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96aa84e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:30.843566 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-46b8114f-a870-47e4-842b-982e53ee47e7 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.090569 Aug 30 04:11:30.845200 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 397/808] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:30 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:30.953673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:30.954910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:30.980451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:30.986108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:30.986834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:30.988338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:30.989216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:30.997876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:31.169810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:32.220727 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2048c5b6-64be-40ac-a982-80e6fc4b3e09 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.128904 Aug 30 04:11:32.220727 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 412/809] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:11:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:32.237471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:32.240923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:32.273406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:32.274374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:32.275247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:32.276314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:32.279536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:32.280495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:32.314424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:32.349031 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e411e1e8-dc50-402c-ba60-b8e22b9ebca0 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 1.399413 Aug 30 04:11:32.353193 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 398/810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:30 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:32.368489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-eff2599a-c074-4b5c-a27f-6f032a6217cb req-e0eb5678-409d-47e1-aa49-fdc2cd64078e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ce3cd4-5293-4b7d-9f09-bf710b97dbb5", "tag": "38df6bec-3dcd-4963-b904-7a1edc19ee06"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:32.404393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eff2599a-c074-4b5c-a27f-6f032a6217cb req-e0eb5678-409d-47e1-aa49-fdc2cd64078e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:32.407488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eff2599a-c074-4b5c-a27f-6f032a6217cb req-e0eb5678-409d-47e1-aa49-fdc2cd64078e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:32.410589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eff2599a-c074-4b5c-a27f-6f032a6217cb req-e0eb5678-409d-47e1-aa49-fdc2cd64078e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:32.441902 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-eff2599a-c074-4b5c-a27f-6f032a6217cb req-e0eb5678-409d-47e1-aa49-fdc2cd64078e service nova] Creating event network-changed:38df6bec-3dcd-4963-b904-7a1edc19ee06 for instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 on n-h2-854925-5 Aug 30 04:11:32.450745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-eff2599a-c074-4b5c-a27f-6f032a6217cb req-e0eb5678-409d-47e1-aa49-fdc2cd64078e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095699 Aug 30 04:11:32.452620 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 399/811] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:32.460404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:32.462164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:32.473031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:32.474448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:32.475262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:32.477080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:32.478955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:32.479815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:33.616799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:33.630156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1be4f8ba-7aae-440b-a9cb-daf21ea49b4e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1585 microversion: 2.1 time: 1.409648 Aug 30 04:11:33.652899 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 413/812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:32 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1585 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:33.699041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92f170b1-08cc-42ed-8267-4c45f150e4de tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a743160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:33.800360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-92f170b1-08cc-42ed-8267-4c45f150e4de tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.144294 Aug 30 04:11:33.801559 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 414/813] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:33 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:33.811080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b3af4bf9-ff49-4cee-ac62-23ceecd22798 req-a863360a-6c77-4013-9d23-3e51a5e19a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d5732-f708-40b1-877b-6ca9f90a19cc", "name": "network-vif-unplugged", "status": "completed", "tag": "0c1b811a-98a7-46e9-a3a3-fe244fb67722"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:33.854476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3af4bf9-ff49-4cee-ac62-23ceecd22798 req-a863360a-6c77-4013-9d23-3e51a5e19a6e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:33.855204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3af4bf9-ff49-4cee-ac62-23ceecd22798 req-a863360a-6c77-4013-9d23-3e51a5e19a6e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:33.856524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3af4bf9-ff49-4cee-ac62-23ceecd22798 req-a863360a-6c77-4013-9d23-3e51a5e19a6e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:33.916871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b3af4bf9-ff49-4cee-ac62-23ceecd22798 req-a863360a-6c77-4013-9d23-3e51a5e19a6e service nova] Creating event network-vif-unplugged:0c1b811a-98a7-46e9-a3a3-fe244fb67722 for instance a99d5732-f708-40b1-877b-6ca9f90a19cc on n-h2-854925-5 Aug 30 04:11:33.926326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-b3af4bf9-ff49-4cee-ac62-23ceecd22798 req-a863360a-6c77-4013-9d23-3e51a5e19a6e service nova] Instance a99d5732-f708-40b1-877b-6ca9f90a19cc is migrating within the same cell, copying events to all relevant hosts: {'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:11:33.942313 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b3af4bf9-ff49-4cee-ac62-23ceecd22798 req-a863360a-6c77-4013-9d23-3e51a5e19a6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.133673 Aug 30 04:11:33.947465 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 415/814] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:33.956396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:33.960589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d81e0098-4762-42e8-8de3-52da67a3b162 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96ac5b310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-960434650", "description": "tempest-description-1071385221"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:33.964745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-296f0095-9163-4d55-9e42-305199c548e4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1476 microversion: 2.1 time: 1.510135 Aug 30 04:11:33.968949 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 400/815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:32 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1476 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:33.978033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:33.982215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:34.007750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:34.008345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:34.008853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:34.009666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:34.010189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:34.010758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:34.666413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:34.691236 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9699ceec-1c65-4ece-b8ea-dded257b3297 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.716404 Aug 30 04:11:34.697965 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 401/816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:33 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:34.716976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-44f7f6f9-ef65-45ec-9196-8fc89b71eca5 req-99ec3ced-f1b1-4345-8dd0-5c8aafbf66d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa0d49a-b773-4919-bc1f-237caf6c7381", "tag": "5c09ea82-bb1e-4bab-8464-cf3672c4c351"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:34.742348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-44f7f6f9-ef65-45ec-9196-8fc89b71eca5 req-99ec3ced-f1b1-4345-8dd0-5c8aafbf66d0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:34.743557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-44f7f6f9-ef65-45ec-9196-8fc89b71eca5 req-99ec3ced-f1b1-4345-8dd0-5c8aafbf66d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:34.744678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-44f7f6f9-ef65-45ec-9196-8fc89b71eca5 req-99ec3ced-f1b1-4345-8dd0-5c8aafbf66d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:34.774869 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-44f7f6f9-ef65-45ec-9196-8fc89b71eca5 req-99ec3ced-f1b1-4345-8dd0-5c8aafbf66d0 service nova] Creating event network-changed:5c09ea82-bb1e-4bab-8464-cf3672c4c351 for instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 on n-h1-854925-5 Aug 30 04:11:34.787630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-44f7f6f9-ef65-45ec-9196-8fc89b71eca5 req-99ec3ced-f1b1-4345-8dd0-5c8aafbf66d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086831 Aug 30 04:11:34.790724 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 402/817] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:34.955697 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d81e0098-4762-42e8-8de3-52da67a3b162 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.006872 Aug 30 04:11:34.956682 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 416/818] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:11:33 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:34.961554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c3b56df-3396-4dce-911a-401d52b0d2c0 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a8e24c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:35.093478 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c3b56df-3396-4dce-911a-401d52b0d2c0 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.135476 Aug 30 04:11:35.095306 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 417/819] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:34 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:35.113579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:35.118834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:35.138287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:35.141889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:35.142927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:35.149062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:35.149881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:35.151523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:35.188135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f37c1a06-7dcf-4135-aad0-b6a5d2fbe9a7 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96aa86ca0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyNWJ0i/ZIrCNYWMZTzfOvpTBF8aIZLs/PQOCZ5N/5wDQQYN8+PG2PgcE6RtYfSdI7JwUpKM5XN5/1/nuDJdpMQfEwkFpT/gbKAIHnigWIhL9BdJslvCYY7jjW/NT2WgQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f37c1a06-7dcf-4135-aad0-b6a5d2fbe9a7 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 257 Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:11:35.192842 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:11:35.194408 n-d-854925-5 devstack@n-api.service[122402]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyNWJ0i/ZIrCNYWMZTzfOvpTBF8aIZLs/PQOCZ5N/5wDQQYN8+PG2PgcE6RtYfSdI7JwUpKM5XN5/1/nuDJdpMQfEwkFpT/gbKAIHnigWIhL9BdJslvCYY7jjW/NT2WgQ=="}} Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyNWJ0i/ZIrCNYWMZTzfOvpTBF8aIZLs/PQOCZ5N/5wDQQYN8+PG2PgcE6RtYfSdI7JwUpKM5XN5/1/nuDJdpMQfEwkFpT/gbKAIHnigWIhL9BdJslvCYY7jjW/NT2WgQ=='}}} Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.195182 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:35.196324 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:11:35.197888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:11:35.199074 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 30 04:11:35.199074 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.199074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f37c1a06-7dcf-4135-aad0-b6a5d2fbe9a7 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:35.199074 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f37c1a06-7dcf-4135-aad0-b6a5d2fbe9a7 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.404589 Aug 30 04:11:35.203689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 403/820] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 412 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:11:35.220049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-919573610", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "880d6011-807f-438c-bb69-6d826bcadb07"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:35.317685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] validate_networks() for [('880d6011-807f-438c-bb69-6d826bcadb07', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:11:35.424074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=20 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:35.760716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:35.781764 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a24ad142-ac6d-4a2c-86a7-542b9ba6002d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1474 microversion: 2.1 time: 0.684884 Aug 30 04:11:35.782724 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 418/821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:35 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1474 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:35.794811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e00026d8-ffc8-4511-b73a-dc628b6fab40 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96a743160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-632944161", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:35.851452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e00026d8-ffc8-4511-b73a-dc628b6fab40 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:35.865381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e00026d8-ffc8-4511-b73a-dc628b6fab40 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for user ed0775ac2e0842e09f65bf5fb044f870 and project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:35.931550 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e00026d8-ffc8-4511-b73a-dc628b6fab40 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e00026d8-ffc8-4511-b73a-dc628b6fab40 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 2166 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-632944161", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:11:35.966446 n-d-854925-5 devstack@n-api.service[122403]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-632944161', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:35.969483 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e00026d8-ffc8-4511-b73a-dc628b6fab40 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e00026d8-ffc8-4511-b73a-dc628b6fab40 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.184252 Aug 30 04:11:35.972091 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 419/822] 10.222.0.27 () {60 vars in 1160 bytes} [Tue Aug 30 04:11:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 186 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:35.976722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:35.977380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:35.998298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:35.999388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:35.999842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:36.000615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:36.001114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:36.008728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:36.744192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:36.757796 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f8509c1-d580-42f7-82bc-906a9eaa80eb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.786923 Aug 30 04:11:36.759122 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 420/823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:35 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:36.773825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e2e5ede7-5937-41df-9db3-1fa8221c1ba2 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96a80d280>, body: {"keypair": {"name": "tempest-keypair-653863987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrPbjH+IOpN4kPOsvQqG0zPJQN078kj47x54LuPhgJAyWSI7m4ZWm3T3QVSz+iRL90YxkeyDv4SLDIjnklM90jkpjcd/P85BFNKLVpkT/Hg//uZMLQ96Wq4TVwjzOoE0w=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:36.793930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e2e5ede7-5937-41df-9db3-1fa8221c1ba2 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:36.801963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e2e5ede7-5937-41df-9db3-1fa8221c1ba2 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for user ed0775ac2e0842e09f65bf5fb044f870 and project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:36.855347 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e2e5ede7-5937-41df-9db3-1fa8221c1ba2 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094418 Aug 30 04:11:36.866421 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 421/824] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:36.884115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d73867d5-46a6-45a6-9782-49a6243a4e00 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a556790>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:36.935996 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d73867d5-46a6-45a6-9782-49a6243a4e00 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.056265 Aug 30 04:11:36.937128 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 422/825] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:36 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:36.947101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:36.948083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:36.957881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:36.958805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:36.959281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:36.960097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:36.960801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:36.961470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:36.984776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:11:36.986166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:11:36.987043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:11:36.987685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:11:36.988383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:11:37.001396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.002169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.002789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.003747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.004468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.005286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.044393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Getting quotas for project 24b389a23eb7413d9228460edde080a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:37.053046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Getting quotas for user 0f14c4b1487b456586f06a011b459b38 and project 24b389a23eb7413d9228460edde080a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:37.070552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:11:37.073042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:11:37.127814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:37.132544 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-edf1046d-295a-4929-bb62-f4f6e9e50459 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.925415 Aug 30 04:11:37.133607 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 404/826] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:11:37.138891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b931953-b9a3-42ee-90cf-0448cc52f53b tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96a4eaee0>, body: {"keypair": {"name": "tempest-keypair-653863987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr7DOwKpNElY8s7oyqK9qL9WYjSjt1hCuKwyUCcuUFZO/Q6cV4dPeBxCAhKGZP03wO+9P+CH+1ZxlSzl1YjNXiMHhF7JVAeXNVWzS0JdpRMt3DfxH6Hw603H9P3Wd6x3w=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:37.145143 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4d7157d-4760-4b90-980e-f42ffd839845 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1471 microversion: 2.1 time: 0.207318 Aug 30 04:11:37.161690 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 423/827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:36 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1471 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:37.172132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75ade992-8cf7-4cf3-9641-e7ee10bd1f27 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:37.174575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6b931953-b9a3-42ee-90cf-0448cc52f53b tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:37.175770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75ade992-8cf7-4cf3-9641-e7ee10bd1f27 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:37.194147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6b931953-b9a3-42ee-90cf-0448cc52f53b tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for user ed0775ac2e0842e09f65bf5fb044f870 and project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:37.254970 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6b931953-b9a3-42ee-90cf-0448cc52f53b tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] HTTP exception thrown: Key pair 'tempest-keypair-653863987' already exists. Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b931953-b9a3-42ee-90cf-0448cc52f53b tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 272 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: {"keypair": {"name": "tempest-keypair-653863987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr7DOwKpNElY8s7oyqK9qL9WYjSjt1hCuKwyUCcuUFZO/Q6cV4dPeBxCAhKGZP03wO+9P+CH+1ZxlSzl1YjNXiMHhF7JVAeXNVWzS0JdpRMt3DfxH6Hw603H9P3Wd6x3w=="}} Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: exception: Key pair 'tempest-keypair-653863987' already exists. Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-653863987', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr7DOwKpNElY8s7oyqK9qL9WYjSjt1hCuKwyUCcuUFZO/Q6cV4dPeBxCAhKGZP03wO+9P+CH+1ZxlSzl1YjNXiMHhF7JVAeXNVWzS0JdpRMt3DfxH6Hw603H9P3Wd6x3w=='}}} Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result.read() Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'ed0775ac2e0842e09f65bf5fb044f870-tempest-keypair-653863987' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 04:11:37.279066 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result.read() Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 04:11:37.284740 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'ed0775ac2e0842e09f65bf5fb044f870-tempest-keypair-653863987' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 4, 11, 37, 240960), 'updated_at': None, 'name': 'tempest-keypair-653863987', 'user_id': 'ed0775ac2e0842e09f65bf5fb044f870', 'fingerprint': 'c9:ef:05:e1:a0:57:50:ea:8e:d4:2f:a1:8c:aa:33:58', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr7DOwKpNElY8s7oyqK9qL9WYjSjt1hCuKwyUCcuUFZO/Q6cV4dPeBxCAhKGZP03wO+9P+CH+1ZxlSzl1YjNXiMHhF7JVAeXNVWzS0JdpRMt3DfxH6Hw603H9P3Wd6x3w==', 'type': 'ssh'}] Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6775, in import_key_pair Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi keypair.create() Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._create() Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-653863987' already exists. Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 30 04:11:37.291650 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-653863987' already exists. Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-653863987' already exists. Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b931953-b9a3-42ee-90cf-0448cc52f53b tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 409 to user: Key pair 'tempest-keypair-653863987' already exists. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:37.298624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6b931953-b9a3-42ee-90cf-0448cc52f53b tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.160445 Aug 30 04:11:37.301416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 405/828] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:37 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 166 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:11:37.309310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:37.310759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:37.319371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.321451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.322627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.323840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.324614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.326046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.344425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-75ade992-8cf7-4cf3-9641-e7ee10bd1f27 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:37.368667 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75ade992-8cf7-4cf3-9641-e7ee10bd1f27 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1215 microversion: 2.1 time: 0.202427 Aug 30 04:11:37.372110 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 424/829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:37 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:37.403410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f145b7cf-6658-481b-9bbd-0154f6bde204 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Calling method '.version_select at 0x7fe96a5981f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:37.434614 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d699e316-431e-4d6a-8626-44e0ab4285d1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc/action" status: 204 len: 0 microversion: 2.1 time: 0.131556 Aug 30 04:11:37.435816 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 406/830] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:11:37 2022] POST /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc/action => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:11:37.457384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:37.458950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:37.471019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.472056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.474569 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f145b7cf-6658-481b-9bbd-0154f6bde204 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653863987" status: 202 len: 0 microversion: 2.1 time: 0.086228 Aug 30 04:11:37.474825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.475178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 425/831] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653863987 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:11:37.482564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.482564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.482564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.488351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aba0c08b-290e-4367-b05f-fae73d4dfbfb tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96a598ca0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz3QRfYZoLC5VbiVAVIc+qMVOZ+Yo32QRHs9f2U7XdWizaXUIMlpdyWk+WGE8iCNTWWA3XKnHIoEiX/bAsaCo2kDXdG66v/OYZGo7o4nqItLu5b2iwDMY3UGK1tpTWXWw=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aba0c08b-290e-4367-b05f-fae73d4dfbfb tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 247 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz3QRfYZoLC5VbiVAVIc+qMVOZ+Yo32QRHs9f2U7XdWizaXUIMlpdyWk+WGE8iCNTWWA3XKnHIoEiX/bAsaCo2kDXdG66v/OYZGo7o4nqItLu5b2iwDMY3UGK1tpTWXWw=="}} Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz3QRfYZoLC5VbiVAVIc+qMVOZ+Yo32QRHs9f2U7XdWizaXUIMlpdyWk+WGE8iCNTWWA3XKnHIoEiX/bAsaCo2kDXdG66v/OYZGo7o4nqItLu5b2iwDMY3UGK1tpTWXWw=='}}} Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi '' Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:11:37.492112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aba0c08b-290e-4367-b05f-fae73d4dfbfb tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:37.497162 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aba0c08b-290e-4367-b05f-fae73d4dfbfb tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009911 Aug 30 04:11:37.509831 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 426/832] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:37 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:11:37.521650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:37.526147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7da8ab70-f500-4cf4-8ef9-2e028b78c52d tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96a53be50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-128148517", "public_key": " "}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:37.570946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7da8ab70-f500-4cf4-8ef9-2e028b78c52d tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:37.589130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7da8ab70-f500-4cf4-8ef9-2e028b78c52d tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for user ed0775ac2e0842e09f65bf5fb044f870 and project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:37.627915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7da8ab70-f500-4cf4-8ef9-2e028b78c52d tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7da8ab70-f500-4cf4-8ef9-2e028b78c52d tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 94 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-128148517", "public_key": " "}} Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-128148517', 'public_key': ' '}}} Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.633120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.637867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.644954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7da8ab70-f500-4cf4-8ef9-2e028b78c52d tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:37.646074 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7da8ab70-f500-4cf4-8ef9-2e028b78c52d tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.135309 Aug 30 04:11:37.646848 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 427/833] 10.222.0.27 () {60 vars in 1158 bytes} [Tue Aug 30 04:11:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:37.677499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd7c5d00-380f-46aa-b01b-26aabdd2f073 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96aae7700>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0ErYDt+OTQTHP2UHx/nr6C6P3GJCvN0nJDcrVjXo6I2fs1SV5hOqCmpiEA7VUaTf65rvapXTgIfOPcubG7PaH2ywzLmG4Z8g83jASJyAM9EiuaLBSHYHpP5PPBHbzR4g=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd7c5d00-380f-46aa-b01b-26aabdd2f073 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 507 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0ErYDt+OTQTHP2UHx/nr6C6P3GJCvN0nJDcrVjXo6I2fs1SV5hOqCmpiEA7VUaTf65rvapXTgIfOPcubG7PaH2ywzLmG4Z8g83jASJyAM9EiuaLBSHYHpP5PPBHbzR4g=="}} Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0ErYDt+OTQTHP2UHx/nr6C6P3GJCvN0nJDcrVjXo6I2fs1SV5hOqCmpiEA7VUaTf65rvapXTgIfOPcubG7PaH2ywzLmG4Z8g83jASJyAM9EiuaLBSHYHpP5PPBHbzR4g=='}}} Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 30 04:11:37.691349 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 30 04:11:37.694673 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.702956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd7c5d00-380f-46aa-b01b-26aabdd2f073 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:37.704177 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd7c5d00-380f-46aa-b01b-26aabdd2f073 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.040527 Aug 30 04:11:37.704971 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 428/834] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:37 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:11:37.715933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3612fe43-aa90-48af-899d-dac2e42d12f4 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Action: 'create', calling method: .version_select at 0x7fe96a598ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1296505367", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:37.752811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3612fe43-aa90-48af-899d-dac2e42d12f4 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:37.764933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3612fe43-aa90-48af-899d-dac2e42d12f4 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Getting quotas for user ed0775ac2e0842e09f65bf5fb044f870 and project 668978a7816a4f0a86141ad0ada851c7. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:37.812661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:37.813013 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3612fe43-aa90-48af-899d-dac2e42d12f4 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3612fe43-aa90-48af-899d-dac2e42d12f4 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 118 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1296505367", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: exception: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1296505367', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6845, in _generate_fingerprint Aug 30 04:11:37.817083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.822229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3612fe43-aa90-48af-899d-dac2e42d12f4 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:37.826202 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3612fe43-aa90-48af-899d-dac2e42d12f4 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.115784 Aug 30 04:11:37.832281 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 429/835] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:11:37.832409 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63d27f37-7f4d-4153-a620-28f330b89824 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1471 microversion: 2.1 time: 0.388999 Aug 30 04:11:37.833316 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 407/836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:37 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1471 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:37.837995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:37.838750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db5427a3-1e4d-46ba-bf77-66d8123cbd20 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Calling method '.version_select at 0x7fe96a7e78b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:37.838911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:37.841079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:37.851394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.852042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.852777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.853660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:37.854228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:37.855061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:37.887614 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-db5427a3-1e4d-46ba-bf77-66d8123cbd20 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2042808861 not found for user ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db5427a3-1e4d-46ba-bf77-66d8123cbd20 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Request method failure captured: Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2042808861 HTTP/1.1 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY322n3xABdBwoWEQQBw2FccppXUfs9PBFcE_5SP-n9G3yqD6oVUvyGS6g1dELfJe44yVwfhbZrtQjeCHeO82W00TtedJB7stdLU_IdIfZgGvI0PTzyDJ4PS5g3RM37EyfYXiZHpNo_r5qJ26Gpv2eXXgrtjSsCpFTWnaDpHo4aLk8E Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_668978a7816a4f0a86141ad0ada851c7", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/668978a7816a4f0a86141ad0ada851c7"}]}] Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 668978a7816a4f0a86141ad0ada851c7 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-2131283876 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-KeyPairsNegativeTestJSON-2131283876-project Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: exception: Keypair tempest-keypair-non-existent-2042808861 not found for user ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'tempest-keypair-non-existent-2042808861'} Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6859, in delete_key_pair Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6880, in get_key_pair Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2042808861 not found for user ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.893642 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2042808861 not found for user ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2042808861 not found for user ed0775ac2e0842e09f65bf5fb044f870 Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db5427a3-1e4d-46ba-bf77-66d8123cbd20 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2042808861 not found for user ed0775ac2e0842e09f65bf5fb044f870 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-db5427a3-1e4d-46ba-bf77-66d8123cbd20 tempest-KeyPairsNegativeTestJSON-2131283876 tempest-KeyPairsNegativeTestJSON-2131283876-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2042808861" status: 404 len: 145 microversion: 2.1 time: 0.060831 Aug 30 04:11:37.902617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 408/837] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:11:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2042808861 => generated 145 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:11:37.950657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a26d3456-dcb4-45d7-ae1d-d0b1c530391b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a568dc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:38.067631 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a26d3456-dcb4-45d7-ae1d-d0b1c530391b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.120639 Aug 30 04:11:38.082163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 409/838] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:37 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:38.237234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:38.246043 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff81cc30-e573-4619-8821-ba65d584b7dd tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.416760 Aug 30 04:11:38.250483 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 430/839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:37 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:38.394404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:38.395727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:38.412670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:38.417833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:38.420296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:38.421882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:38.423367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:38.428932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:38.578557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:38.594291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b473c7c-b642-4d92-93df-6badc4214c16 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1219 microversion: 2.1 time: 0.205854 Aug 30 04:11:38.595547 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 410/840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:38 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1219 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:38.595898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1bd16df0-79b2-4331-a1a0-f0b8e3c39cd6 req-29ff8526-4374-4cdb-9c25-bba925a75c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4dc36b-832a-4978-945a-fc9fe6be51ab", "name": "network-vif-plugged", "status": "completed", "tag": "861b971b-13a8-4aa1-bcb2-2c8faa20a585"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:38.613290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1bd16df0-79b2-4331-a1a0-f0b8e3c39cd6 req-29ff8526-4374-4cdb-9c25-bba925a75c9a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:38.630142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1bd16df0-79b2-4331-a1a0-f0b8e3c39cd6 req-29ff8526-4374-4cdb-9c25-bba925a75c9a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:38.631004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1bd16df0-79b2-4331-a1a0-f0b8e3c39cd6 req-29ff8526-4374-4cdb-9c25-bba925a75c9a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:38.648944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1bd16df0-79b2-4331-a1a0-f0b8e3c39cd6 req-29ff8526-4374-4cdb-9c25-bba925a75c9a service nova] Creating event network-vif-plugged:861b971b-13a8-4aa1-bcb2-2c8faa20a585 for instance ab4dc36b-832a-4978-945a-fc9fe6be51ab on n-h2-854925-5 Aug 30 04:11:38.681994 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1bd16df0-79b2-4331-a1a0-f0b8e3c39cd6 req-29ff8526-4374-4cdb-9c25-bba925a75c9a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087380 Aug 30 04:11:38.684940 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 431/841] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:38.851906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:38.852702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:38.917684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:38.920532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:38.921611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:38.924726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:38.926867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:38.928821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.091674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-629b7f07-56a7-432d-9142-69632fd2adce tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a5ca280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:39.175553 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-629b7f07-56a7-432d-9142-69632fd2adce tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.089204 Aug 30 04:11:39.182472 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 432/842] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:39 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:39.275863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:39.277388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:39.295425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.299027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.299729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.301726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.303358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.304530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.412575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:39.440822 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-300d7c08-a036-4089-a808-8657de200ec1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1471 microversion: 2.1 time: 0.593627 Aug 30 04:11:39.447446 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 411/843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:38 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1471 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:39.633702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:39.634326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:39.657433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.658263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.662890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.668200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:39.673277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:39.676193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:39.997985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:40.021696 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f5b3761d-5141-4948-8d3e-1da09d8115bc tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1267 microversion: 2.1 time: 0.397377 Aug 30 04:11:40.022699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 412/844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:39 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1267 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:40.022824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:40.031393 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb1eda50-58bb-4281-a9af-923baa837e94 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.759659 Aug 30 04:11:40.047587 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 433/845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:39 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:40.193083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef56b258-205c-486f-ad56-dc3e0346c76c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96ad38820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:40.296128 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef56b258-205c-486f-ad56-dc3e0346c76c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.107293 Aug 30 04:11:40.296791 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 413/846] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:40 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:40.472772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:40.475233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:40.494300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:40.496016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:40.498709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:40.500577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:40.501831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:40.503843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:40.716199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-973baa08-7e4a-4901-8d79-08e1fc06c4c4 req-6da78158-6049-44d7-8cc2-b66c2a8ab806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d5732-f708-40b1-877b-6ca9f90a19cc", "name": "network-vif-plugged", "status": "completed", "tag": "0c1b811a-98a7-46e9-a3a3-fe244fb67722"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:40.748456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-973baa08-7e4a-4901-8d79-08e1fc06c4c4 req-6da78158-6049-44d7-8cc2-b66c2a8ab806 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:40.749600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-973baa08-7e4a-4901-8d79-08e1fc06c4c4 req-6da78158-6049-44d7-8cc2-b66c2a8ab806 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:40.750012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-973baa08-7e4a-4901-8d79-08e1fc06c4c4 req-6da78158-6049-44d7-8cc2-b66c2a8ab806 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:40.774247 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-973baa08-7e4a-4901-8d79-08e1fc06c4c4 req-6da78158-6049-44d7-8cc2-b66c2a8ab806 service nova] Creating event network-vif-plugged:0c1b811a-98a7-46e9-a3a3-fe244fb67722 for instance a99d5732-f708-40b1-877b-6ca9f90a19cc on n-h2-854925-5 Aug 30 04:11:40.792912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:40.806003 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-973baa08-7e4a-4901-8d79-08e1fc06c4c4 req-6da78158-6049-44d7-8cc2-b66c2a8ab806 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092550 Aug 30 04:11:40.807918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 414/847] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:40.808914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5eb7359-1f67-4555-8a97-d723bfa4ea15 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1471 microversion: 2.1 time: 0.341439 Aug 30 04:11:40.810710 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 434/848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:40 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1471 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:41.054705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:41.057001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:41.058049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:41.060747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:41.083074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:41.085960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:41.086891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:41.087298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:41.087752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:41.088494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:41.088979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:41.089394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:41.093966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:41.094978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:41.095607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:41.096218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:41.256670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:41.265291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-113d9250-7fff-444f-971a-4cab488c80b6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1267 microversion: 2.1 time: 0.221245 Aug 30 04:11:41.275960 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 415/849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:41 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:41.313872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ade22c95-1851-4a5b-9b21-cac1a8134ce1 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a6e2040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:41.406878 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ade22c95-1851-4a5b-9b21-cac1a8134ce1 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.099227 Aug 30 04:11:41.408937 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 416/850] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:41 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:41.417177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:41.427669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95542fe7-c981-4ef9-919e-c4fb2d73b6bb tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.377954 Aug 30 04:11:41.437990 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 435/851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:41 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:41.834520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:41.835247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:41.847522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:41.849936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:41.852112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:41.853035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:41.853688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:41.855493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.100930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:42.116762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19c6b4ec-9455-424b-b4a2-c6d27acd5826 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1463 microversion: 2.1 time: 0.287732 Aug 30 04:11:42.129962 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 417/852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:41 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:42.144057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:42.145292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:42.153712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.154691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.154976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.155714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.156169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.156763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.315960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:42.318276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:42.320858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:42.331911 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4318691d-0a76-48a3-bf81-abd57e0427a7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1463 microversion: 2.1 time: 0.192154 Aug 30 04:11:42.333476 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 436/853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:42 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1463 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:42.342163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.347865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.350021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.353778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.356823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-404da172-c655-42f5-817c-2252a364112c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'create', calling method: .version_select at 0x7fe96a5370d0>, body: {"keypair": {"name": "tempest-keypair-120982653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwvR6AR2aqH/0LT2mWVQOlDdJNFvd6FSvVJhtTpubXLtOrQOjcvs/15cn/tqslBkCtVKp1XBzO+/uulqbOGpwFBR0u+e95f3O2An5VqOq7bwn9gLYgE3RsfWE9X0Ernwg=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:42.361174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.363052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.375797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-404da172-c655-42f5-817c-2252a364112c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for project 7b1c9a3949b2461aaefac288f381241c. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:42.383848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-404da172-c655-42f5-817c-2252a364112c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for user 7ead040764484d059aa9a82f0714373f and project 7b1c9a3949b2461aaefac288f381241c. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:42.415955 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-404da172-c655-42f5-817c-2252a364112c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063297 Aug 30 04:11:42.421635 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 437/854] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:11:42.433378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9977a3e1-b8c0-4a55-a2d1-15db9d46a46a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a8e23a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:42.507058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9977a3e1-b8c0-4a55-a2d1-15db9d46a46a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.083829 Aug 30 04:11:42.516483 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 438/855] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:42 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:42.523379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:42.524409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:42.537376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:42.555618 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adf5bbce-9a0f-42af-80eb-57fadf0e60b4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1267 microversion: 2.1 time: 0.246963 Aug 30 04:11:42.573594 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 418/856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:42 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:42.579662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.582307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.584512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.585621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:42.587125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:42.587857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:42.934426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:42.946244 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b127b37-f472-4062-a681-cb71d30300b8 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.427627 Aug 30 04:11:42.947612 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 439/857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:42 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:43.531973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c4e6b20-a6db-4f1a-b473-883b93b441db tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a5681f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:43.581963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:43.583231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:43.590369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:43.605661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:43.606965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:43.608051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:43.608705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:43.609371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:43.624952 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c4e6b20-a6db-4f1a-b473-883b93b441db tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.105320 Aug 30 04:11:43.633117 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 419/858] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:43 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:43.801480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:43.814575 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6b31d11-e91a-4dfe-be9c-eb9f72379f24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1273 microversion: 2.1 time: 0.238101 Aug 30 04:11:43.815557 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 440/859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:43 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:43.969057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:43.970299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:43.995417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:43.995908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:43.996586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:43.997388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:43.997847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:43.998443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:44.476477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:44.491816 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ccf46e0-2593-438b-ace8-fdcba79dd3b7 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.526396 Aug 30 04:11:44.492454 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 420/860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:43 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:44.649808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-189563e1-06ba-41e8-9553-ca0a04cfa04b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a5ca940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:44.740809 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-189563e1-06ba-41e8-9553-ca0a04cfa04b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.103382 Aug 30 04:11:44.742356 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 441/861] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:44 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:44.838215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:44.838827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:44.844996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b92c5f3a-a12c-4c1d-a44e-ee16b4b7fcec tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '.version_select at 0x7fe96a568550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:44.850346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b92c5f3a-a12c-4c1d-a44e-ee16b4b7fcec tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:44.850853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b92c5f3a-a12c-4c1d-a44e-ee16b4b7fcec tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:44.851303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b92c5f3a-a12c-4c1d-a44e-ee16b4b7fcec tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:44.859954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:44.860489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:44.860957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:44.862582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:44.864499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:44.866145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:44.879245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b92c5f3a-a12c-4c1d-a44e-ee16b4b7fcec tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.048268 Aug 30 04:11:44.896845 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 421/862] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:11:44 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:44.926796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-42125d6b-4fcc-434f-bafd-c36c9c71dc29 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:44.944667 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-42125d6b-4fcc-434f-bafd-c36c9c71dc29 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027652 Aug 30 04:11:44.954668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 422/863] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:11:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:44.972107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf24bdbb-5df8-48c3-9a3c-8486fbce44db tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-94505654", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:45.001207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf24bdbb-5df8-48c3-9a3c-8486fbce44db tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 497 microversion: 2.1 time: 0.044076 Aug 30 04:11:45.002233 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 423/864] 10.222.0.27 () {60 vars in 1146 bytes} [Tue Aug 30 04:11:44 2022] POST /compute/v2.1/flavors => generated 497 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:45.023489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d336155-2646-498e-9056-948dcdb6c56d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:45.047081 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d336155-2646-498e-9056-948dcdb6c56d tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.035648 Aug 30 04:11:45.050612 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 424/865] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Aug 30 04:11:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:11:45.236716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1401842313", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "08cb9ab5-51a9-4519-aa38-574d90fbdbc1"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:45.320986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:11:45.936442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:45.947316 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-802e941e-1e93-44e3-b46e-b4e66c42c93b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 1.112764 Aug 30 04:11:45.948268 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 442/866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:44 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:45.956094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:45.956710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:45.967851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:45.968853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:45.969519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:45.970496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:45.971117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:45.971726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.325423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:11:46.326093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:11:46.326301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:11:46.327752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:11:46.328212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:11:46.351679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=41 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:46.353582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.355461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.355461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.355773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.357030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.357746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.385756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:46.392810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for user 7ead040764484d059aa9a82f0714373f and project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:46.413033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:46.421127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:11:46.424218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:11:46.493298 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9fd8758-7a3e-45db-9501-39377a3c6175 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.261349 Aug 30 04:11:46.497908 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 425/867] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:11:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:11:46.509207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36b48cf2-3b3e-4561-9445-f278156414af tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96af57e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:46.561702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:46.581633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb11dfb3-2f13-4848-9532-9333247cb87c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.631655 Aug 30 04:11:46.582817 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 443/868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:45 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:46.584513 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36b48cf2-3b3e-4561-9445-f278156414af tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.084451 Aug 30 04:11:46.588033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-584e6b4f-14d9-418b-9dd3-ce2af79f6b2f req-9a04ba20-e103-4476-b75b-e00115b664f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa0d49a-b773-4919-bc1f-237caf6c7381", "name": "network-vif-plugged", "status": "completed", "tag": "5c09ea82-bb1e-4bab-8464-cf3672c4c351"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:46.592433 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 426/869] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:46 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:46.614315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5a532dd0-b66e-465d-b2de-0a051dc5af83 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:46.615001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5a532dd0-b66e-465d-b2de-0a051dc5af83 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:46.622233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-584e6b4f-14d9-418b-9dd3-ce2af79f6b2f req-9a04ba20-e103-4476-b75b-e00115b664f3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.622969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-584e6b4f-14d9-418b-9dd3-ce2af79f6b2f req-9a04ba20-e103-4476-b75b-e00115b664f3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.623633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-584e6b4f-14d9-418b-9dd3-ce2af79f6b2f req-9a04ba20-e103-4476-b75b-e00115b664f3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.627467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:46.651077 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-584e6b4f-14d9-418b-9dd3-ce2af79f6b2f req-9a04ba20-e103-4476-b75b-e00115b664f3 service nova] Creating event network-vif-plugged:5c09ea82-bb1e-4bab-8464-cf3672c4c351 for instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 on n-h1-854925-5 Aug 30 04:11:46.663509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-584e6b4f-14d9-418b-9dd3-ce2af79f6b2f req-9a04ba20-e103-4476-b75b-e00115b664f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079253 Aug 30 04:11:46.673715 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 444/870] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:46.765219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5a532dd0-b66e-465d-b2de-0a051dc5af83 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:46.773218 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5a532dd0-b66e-465d-b2de-0a051dc5af83 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1279 microversion: 2.1 time: 0.169764 Aug 30 04:11:46.774026 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 427/871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:46 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:46.972234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:46.973624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:46.990465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.991654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.992264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:46.993173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:46.997997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:46.998710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:47.377646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:47.393946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5826527f-e6c4-4f06-ab6e-4c5371bc1dde tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.428169 Aug 30 04:11:47.401493 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 445/872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:46 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:47.600135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1deb4bd2-4609-4fc5-8fd5-727de9ddfd35 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a9bf700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:47.602972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:47.603594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:47.615337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:47.617888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:47.619589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:47.619589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:47.619589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:47.619965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:47.676707 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1deb4bd2-4609-4fc5-8fd5-727de9ddfd35 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.080813 Aug 30 04:11:47.677617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 428/873] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:47 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:47.795864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:47.796493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:47.804785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:47.805294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:47.805772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:47.806501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:47.806964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:47.815707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:47.968897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:47.993062 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d3519a0-3499-49fa-8429-2279635a52f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1275 microversion: 2.1 time: 0.201068 Aug 30 04:11:47.993729 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 429/874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:47 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1275 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:48.009594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a6e13459-2907-4156-82eb-8daa08dbfb79 req-76453977-4837-43c6-8025-f8e7b66abbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e66e97-cc16-4abe-a475-ac63c384e8ad", "tag": "80be55f6-b4e1-4f6b-a650-d5d75e877f8d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:48.035472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a6e13459-2907-4156-82eb-8daa08dbfb79 req-76453977-4837-43c6-8025-f8e7b66abbb1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:48.035976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a6e13459-2907-4156-82eb-8daa08dbfb79 req-76453977-4837-43c6-8025-f8e7b66abbb1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:48.036416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a6e13459-2907-4156-82eb-8daa08dbfb79 req-76453977-4837-43c6-8025-f8e7b66abbb1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:48.049181 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a6e13459-2907-4156-82eb-8daa08dbfb79 req-76453977-4837-43c6-8025-f8e7b66abbb1 service nova] Creating event network-changed:80be55f6-b4e1-4f6b-a650-d5d75e877f8d for instance 36e66e97-cc16-4abe-a475-ac63c384e8ad on n-h1-854925-5 Aug 30 04:11:48.067171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a6e13459-2907-4156-82eb-8daa08dbfb79 req-76453977-4837-43c6-8025-f8e7b66abbb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072161 Aug 30 04:11:48.067835 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 430/875] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:48.075929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:48.097894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2fa82096-b271-43dc-b648-4fbe2dd3e863 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1370 microversion: 2.1 time: 0.498901 Aug 30 04:11:48.100709 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 446/876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:47 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1370 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:48.433676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:48.434905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:48.442297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:48.443111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:48.443764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:48.444708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:48.445502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:48.446120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:48.692969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6826d960-e4f7-407e-9e91-7f0538f2a95b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a53b820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:48.739153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:48.747427 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-afe383d3-75e1-45dc-bef3-b677bdc5a708 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.319571 Aug 30 04:11:48.748051 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 431/877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:48 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:48.811728 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6826d960-e4f7-407e-9e91-7f0538f2a95b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.117996 Aug 30 04:11:48.812540 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 447/878] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:48 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:49.027335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:49.028347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:49.036554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.037314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.038060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.039006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.039686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.040449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.129220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:49.131473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:49.135106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:49.150848 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68c1fba0-0c8e-4163-8231-26133120e129 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1331 microversion: 2.1 time: 0.126098 Aug 30 04:11:49.151702 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 432/879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:49 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1331 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:49.153149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.153916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.154563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.155675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.156382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.157038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.490689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:49.505222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ca627be-7ee2-4082-856b-10d576be1d2b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1556 microversion: 2.1 time: 0.383465 Aug 30 04:11:49.506577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 448/880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:49 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1556 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:49.529201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:49.529774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:49.536353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.537170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.540729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.541977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.542954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.543683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.712793 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e7fb565-22f0-4f99-ad7c-247d5e6bab80 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187545 Aug 30 04:11:49.714246 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 433/881] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:11:49 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:49.770654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:49.771423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:49.788938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.789539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.790518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.792047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:49.793034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:49.793934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:49.827574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b8da8fe-8cb9-435c-b1e1-dd5c8e74d2e7 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a8c93a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:49.948756 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b8da8fe-8cb9-435c-b1e1-dd5c8e74d2e7 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.124878 Aug 30 04:11:49.952172 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 434/882] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:49 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:50.172656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:50.173366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:50.196157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:50.196710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:50.197151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:50.198062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:50.198694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:50.199274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:50.792084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:50.800634 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-17f11a68-4aab-4878-8fda-74425450ff87 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1331 microversion: 2.1 time: 0.632931 Aug 30 04:11:50.817220 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 435/883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:50 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1331 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:50.825894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:50.836037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f5614f9-f890-46bc-a8e6-dcc02d9b8600 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 1.069863 Aug 30 04:11:50.851758 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 449/884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:49 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:50.966144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e292441-310c-478b-9180-3122b3312bc2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96ad83ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:51.056528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e292441-310c-478b-9180-3122b3312bc2 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.092019 Aug 30 04:11:51.057143 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 436/885] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:50 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:51.516463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-62b87c19-2612-4618-ace1-d6c6b2f38704 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Action: 'create', calling method: .version_select at 0x7fe96a53bee0>, body: {"keypair": {"name": "tempest-keypair-1974094931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPj+RVwxhqR+VoM5E+oFqGjBMBJXxF5SXODaCLCAKRtxwqnClRYHQnx8sGJilonIIA0psvUy4QD3Z7Kw3DhUZ8YPpXhoJMvXCWbDoaeGqpXJbl375G70sR5WICd56HnFng=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:51.535400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-62b87c19-2612-4618-ace1-d6c6b2f38704 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Getting quotas for project 4f140908f88a44eeb9e6d8474d8280f4. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:51.549238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-62b87c19-2612-4618-ace1-d6c6b2f38704 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Getting quotas for user a8da6aeff6a74f909fb618eeb54253a9 and project 4f140908f88a44eeb9e6d8474d8280f4. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:51.580181 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-62b87c19-2612-4618-ace1-d6c6b2f38704 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.277781 Aug 30 04:11:51.580784 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 450/886] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:11:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:51.828295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:51.829462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:51.860125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:51.861371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:51.865935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:51.866442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:51.866886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:51.867612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:51.868084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:51.868537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:51.881155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:51.884011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:51.884639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:51.886239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:51.888029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:51.890331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:52.309454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:52.322100 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c3c75ac5-39c2-4d5b-a040-68c6fd266e19 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1331 microversion: 2.1 time: 0.497936 Aug 30 04:11:52.339926 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 437/887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:51 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1331 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:52.362018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1ad6bc2-b92d-4e5d-af94-665a1d3067c5 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a6e2040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:52.500233 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1ad6bc2-b92d-4e5d-af94-665a1d3067c5 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.159098 Aug 30 04:11:52.503378 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 438/888] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:52 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:52.729514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:52.741147 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e44247e9-ebd4-4a36-b3af-9baa19fce6e1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.885543 Aug 30 04:11:52.741770 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 451/889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:51 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:52.786898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c874127d-6f0b-4a05-9565-539c56cfd209 req-10ebcab1-f9d3-4522-ac8c-60aacf0dddfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa0d49a-b773-4919-bc1f-237caf6c7381", "tag": "5c09ea82-bb1e-4bab-8464-cf3672c4c351"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:52.803742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c874127d-6f0b-4a05-9565-539c56cfd209 req-10ebcab1-f9d3-4522-ac8c-60aacf0dddfc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:52.804263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c874127d-6f0b-4a05-9565-539c56cfd209 req-10ebcab1-f9d3-4522-ac8c-60aacf0dddfc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:52.804686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c874127d-6f0b-4a05-9565-539c56cfd209 req-10ebcab1-f9d3-4522-ac8c-60aacf0dddfc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:52.834396 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c874127d-6f0b-4a05-9565-539c56cfd209 req-10ebcab1-f9d3-4522-ac8c-60aacf0dddfc service nova] Creating event network-changed:5c09ea82-bb1e-4bab-8464-cf3672c4c351 for instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 on n-h1-854925-5 Aug 30 04:11:52.841056 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c874127d-6f0b-4a05-9565-539c56cfd209 req-10ebcab1-f9d3-4522-ac8c-60aacf0dddfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058287 Aug 30 04:11:52.842618 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 439/890] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:53.344807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:53.345446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:53.360853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:53.361366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:53.365920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:53.366707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:53.367367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:53.367870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:53.489378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:53.498390 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d35e246-d470-479e-b4c7-52387f55ffbc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1337 microversion: 2.1 time: 0.158022 Aug 30 04:11:53.503257 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 452/891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:53 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1337 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:53.518989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bed5be12-bcea-413e-b2a2-eb01660b551d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a8fdb80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:53.590691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bed5be12-bcea-413e-b2a2-eb01660b551d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.077783 Aug 30 04:11:53.591917 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 440/892] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:53 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:53.766876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:53.767660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:53.776743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:53.786020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:53.787507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:53.788375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:53.788947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:53.789515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:54.245428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:54.254245 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f56b6bb2-90d8-46e6-a31b-b8df197648d3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.491881 Aug 30 04:11:54.262243 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 453/893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:53 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:54.347733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1534190585", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d0db0ef1-4a77-43e8-819c-b0d2f9e55de6"}], "security_groups": [{"name": "tempest-securitygroup--2036760443"}], "key_name": "tempest-keypair-1974094931", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:54.527484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:54.529357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:54.558642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:54.561957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:54.562440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:54.565433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:54.565913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:54.569186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:54.583294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] validate_networks() for [('d0db0ef1-4a77-43e8-819c-b0d2f9e55de6', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:11:55.079608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:55.090431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79235694-71e6-418f-8f9b-a0291ae96dae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.567781 Aug 30 04:11:55.105993 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 454/894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:54 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:55.112475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ca0fe36b-1628-422a-adb7-eea5587e39c3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a52b9d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:55.223108 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ca0fe36b-1628-422a-adb7-eea5587e39c3 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.115203 Aug 30 04:11:55.224531 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 455/895] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:55 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:55.275980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:55.278865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:55.297266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:55.298135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:55.298810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:55.300872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:55.302378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:55.307508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:55.645762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:55.656317 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df2e3514-395d-4789-aec5-753bee7c38f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.385022 Aug 30 04:11:55.664156 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 456/896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:55 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:55.721263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Getting quotas for project 4f140908f88a44eeb9e6d8474d8280f4. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:55.728969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Getting quotas for user a8da6aeff6a74f909fb618eeb54253a9 and project 4f140908f88a44eeb9e6d8474d8280f4. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:55.755543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:11:55.755972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:11:55.756452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:11:55.756873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:11:55.757285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:11:55.782886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:55.783383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:55.783816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:55.788067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:55.789827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:55.790577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:55.839774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Getting quotas for project 4f140908f88a44eeb9e6d8474d8280f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:11:55.853757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Getting quotas for user a8da6aeff6a74f909fb618eeb54253a9 and project 4f140908f88a44eeb9e6d8474d8280f4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:11:55.881691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:11:55.885104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:11:55.956225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0bbe8585-39ae-4f32-839d-f0202e30a953 req-90c57826-b61e-4263-b012-fa175f353333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c70b4a-4c6a-4137-a2c3-a02b16b5a369", "tag": "acbaf2e5-9af3-4cbd-b7cc-9d2045334073"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:55.986488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0bbe8585-39ae-4f32-839d-f0202e30a953 req-90c57826-b61e-4263-b012-fa175f353333 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:55.988947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0bbe8585-39ae-4f32-839d-f0202e30a953 req-90c57826-b61e-4263-b012-fa175f353333 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:55.991310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0bbe8585-39ae-4f32-839d-f0202e30a953 req-90c57826-b61e-4263-b012-fa175f353333 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:55.995222 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7fbc1b15-9648-4469-86c4-c1b6a7f93d20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.649878 Aug 30 04:11:55.997990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 441/897] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:11:54 2022] POST /compute/v2.1/servers => generated 407 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:11:56.021574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-05b5ecc6-e418-4d4d-acdb-65e8cec341fd tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:56.028552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05b5ecc6-e418-4d4d-acdb-65e8cec341fd tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:56.048157 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0bbe8585-39ae-4f32-839d-f0202e30a953 req-90c57826-b61e-4263-b012-fa175f353333 service nova] Creating event network-changed:acbaf2e5-9af3-4cbd-b7cc-9d2045334073 for instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 on n-h1-854925-5 Aug 30 04:11:56.075766 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0bbe8585-39ae-4f32-839d-f0202e30a953 req-90c57826-b61e-4263-b012-fa175f353333 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118520 Aug 30 04:11:56.078434 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 457/898] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:11:56.130833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:56.132430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:56.150351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:56.151154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:56.152186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:56.163415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:56.164134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:56.165314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:56.263614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-05b5ecc6-e418-4d4d-acdb-65e8cec341fd tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:56.272284 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-05b5ecc6-e418-4d4d-acdb-65e8cec341fd tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1270 microversion: 2.1 time: 0.266526 Aug 30 04:11:56.303097 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 442/899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:56 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1270 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:56.319680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4353ba27-4aef-43e5-89a1-bdc9e74b01f4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a7e7160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:56.433890 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4353ba27-4aef-43e5-89a1-bdc9e74b01f4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1424 microversion: 2.1 time: 0.127445 Aug 30 04:11:56.434491 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 443/900] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:56 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1424 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:56.487764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:56.499574 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5aacd7e1-9da6-4bd6-90c4-bcfc14737fe0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.374747 Aug 30 04:11:56.513573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 458/901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:56 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:56.684692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:56.685567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:56.705374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:56.706176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:56.709002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:56.710465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:56.711172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:56.711801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:56.858789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:56.866945 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-16530d88-3ad5-436b-a659-df4fc2b6905a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.190674 Aug 30 04:11:56.867541 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 444/902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:56 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:57.305676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.306293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:57.314197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.314681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.315116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:57.315807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.316261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.316689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:57.378796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:57.386716 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-241d5d21-606b-45e2-8d9e-5aec76543297 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1322 microversion: 2.1 time: 0.084827 Aug 30 04:11:57.387272 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 459/903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1322 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:57.448652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6619cf2d-8141-4b2f-8e18-4198b8d68d8e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a93eee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.495809 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6619cf2d-8141-4b2f-8e18-4198b8d68d8e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1433 microversion: 2.1 time: 0.051306 Aug 30 04:11:57.496398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 445/904] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1433 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:57.509061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ac3afbd6-d320-4adb-be73-6d13d7676fda tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a537310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.520534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.521144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:57.527437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.527992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.528496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:57.529251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.529732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.530710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:57.549719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:57.555462 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ac3afbd6-d320-4adb-be73-6d13d7676fda tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 200 len: 1433 microversion: 2.1 time: 0.050089 Aug 30 04:11:57.556041 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 460/905] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 1433 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:57.577221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.577221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:57.581396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.581988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.582301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:57.582998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.583566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.584015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:57.729125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:57.738237 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3244ead1-e424-4178-a3a2-d4b8d3d4625b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.222236 Aug 30 04:11:57.738827 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 446/906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:57.755844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:57.763595 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6a9127b-7128-4a2a-8913-6b7b4a4d8fca tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1467 microversion: 2.1 time: 0.193350 Aug 30 04:11:57.764801 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 461/907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1467 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:57.784937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd52102d-b981-4e1a-a3ca-f48dcfe1b5f6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96aa4d3a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.834399 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd52102d-b981-4e1a-a3ca-f48dcfe1b5f6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/b5ae2bcd-efca-4003-b452-ab36e7c230c2" status: 200 len: 784 microversion: 2.1 time: 0.054732 Aug 30 04:11:57.835351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 447/908] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/images/b5ae2bcd-efca-4003-b452-ab36e7c230c2 => generated 784 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:57.849662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-773189f8-1c7e-4347-9d90-ec247e031bc4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.859767 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-773189f8-1c7e-4347-9d90-ec247e031bc4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013960 Aug 30 04:11:57.860594 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 462/909] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:57.873120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3472ccb-4dc7-498d-be36-50a8a4a59a1c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a7e7940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.890240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:57.892138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:57.902203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.903465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.904172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:57.906667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:57.907178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:57.907646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.101108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:58.110058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40d094df-9b8c-4fb4-91c8-914d1488c488 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.225852 Aug 30 04:11:58.110845 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 463/910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:57 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:58.139919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-67eec52d-7782-4836-a517-532ae419f4c0 req-b2296a94-41ed-4cbf-bb92-01a611c36365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e66e97-cc16-4abe-a475-ac63c384e8ad", "name": "network-vif-plugged", "status": "completed", "tag": "80be55f6-b4e1-4f6b-a650-d5d75e877f8d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:58.161781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-67eec52d-7782-4836-a517-532ae419f4c0 req-b2296a94-41ed-4cbf-bb92-01a611c36365 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:58.162272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-67eec52d-7782-4836-a517-532ae419f4c0 req-b2296a94-41ed-4cbf-bb92-01a611c36365 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:58.162875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-67eec52d-7782-4836-a517-532ae419f4c0 req-b2296a94-41ed-4cbf-bb92-01a611c36365 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.185491 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-67eec52d-7782-4836-a517-532ae419f4c0 req-b2296a94-41ed-4cbf-bb92-01a611c36365 service nova] Creating event network-vif-plugged:80be55f6-b4e1-4f6b-a650-d5d75e877f8d for instance 36e66e97-cc16-4abe-a475-ac63c384e8ad on n-h1-854925-5 Aug 30 04:11:58.191278 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-67eec52d-7782-4836-a517-532ae419f4c0 req-b2296a94-41ed-4cbf-bb92-01a611c36365 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068131 Aug 30 04:11:58.192309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 464/911] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:58.410171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:58.411224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:58.419712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:58.420444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:58.421083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.421817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:58.422499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:58.423235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.488134 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3472ccb-4dc7-498d-be36-50a8a4a59a1c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "DELETE /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 204 len: 0 microversion: 2.1 time: 0.619901 Aug 30 04:11:58.488961 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 448/912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:57 2022] DELETE /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:11:58.497052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f4059640-149a-43ae-ab4b-fbe2f6541cae tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a93e280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:58.513649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:58.521015 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f4059640-149a-43ae-ab4b-fbe2f6541cae tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] HTTP exception thrown: Image not found. Aug 30 04:11:58.523376 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9b852fd8-63d1-4a22-a089-8032dd524977 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1328 microversion: 2.1 time: 0.119483 Aug 30 04:11:58.524038 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 465/913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:58 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f4059640-149a-43ae-ab4b-fbe2f6541cae tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Request method failure captured: Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d HTTP/1.1 Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3Td0mSji3dDRRAS6rLXcX5n5-9LKXjp-3HNRRGoLySDETf1joW9hxa_xgxig08P4lRzTN8S2A_C50DZxl1tdtXdo5EGeJz0xj5OsZ8fmREe_l6VFewFaRb9dufX_s0yEFoULeD0WGLzPqv_RbC6SKkBJK_rYYN6xgKabdUnH4_prk Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 06c46e03b3724660b056f47cf14eb3eb Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06c46e03b3724660b056f47cf14eb3eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06c46e03b3724660b056f47cf14eb3eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06c46e03b3724660b056f47cf14eb3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06c46e03b3724660b056f47cf14eb3eb"}]}] Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 06c46e03b3724660b056f47cf14eb3eb Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerTestJSON-1236379326-project Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4b364e890c394b5e9d89d82270783d4a Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerTestJSON-1236379326-project Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '16997879-6576-49cb-a0b5-224a56328c6d'} Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 16997879-6576-49cb-a0b5-224a56328c6d Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:11:58.544307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16997879-6576-49cb-a0b5-224a56328c6d could not be found. Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f4059640-149a-43ae-ab4b-fbe2f6541cae tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f4059640-149a-43ae-ab4b-fbe2f6541cae tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 404 len: 62 microversion: 2.1 time: 0.053481 Aug 30 04:11:58.548815 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 449/914] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:58 2022] GET /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:11:58.558721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-219766635"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:58.561815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:58.567874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:58.568430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:58.568983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.569775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:58.570222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:58.570641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.733726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:11:58.759934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:58.760782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:58.764464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e32684a-4aa0-4e11-bf7b-f3c7dceb577a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "POST /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab/action" status: 202 len: 0 microversion: 2.1 time: 0.209511 Aug 30 04:11:58.765926 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 466/915] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:11:58 2022] POST /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:11:58.772603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:58.773345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:58.773945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.774847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:58.775463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:58.776049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:58.777857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a183aabf-5cd1-4730-a45a-c14fb59aeb2a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a578550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:58.854829 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a183aabf-5cd1-4730-a45a-c14fb59aeb2a tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.081984 Aug 30 04:11:58.856158 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 467/916] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:58 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:58.955766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:58.964604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59f913bf-156c-4686-a0d1-a70e007baeb2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.209928 Aug 30 04:11:58.977966 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 450/917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:58 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:59.135113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:59.135962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:59.147580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:59.148487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:59.149112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:59.150391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:59.151240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:59.151894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:59.307453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:59.315557 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61ed18c8-db3f-4867-828f-e70389971bd1 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.184763 Aug 30 04:11:59.316365 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 468/918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:59 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:59.547056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:59.547691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:59.554086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:59.554585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:59.555021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:59.555728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:59.556185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:59.556608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:59.747208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:11:59.756798 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14b50e60-8954-4d2d-adc5-cd2e3ce701ee tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.214960 Aug 30 04:11:59.757472 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 451/919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:59 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:11:59.836054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2163998c-1f7f-486a-922f-c295cc65f675 req-812d5838-b9f7-416f-812e-5947a5e1ccc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f792ab5-e7c6-40dc-8164-02b879d5a30d", "tag": "774dd0b2-d77d-464b-9176-c29007e52568"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:11:59.850089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2163998c-1f7f-486a-922f-c295cc65f675 req-812d5838-b9f7-416f-812e-5947a5e1ccc9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:59.850711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2163998c-1f7f-486a-922f-c295cc65f675 req-812d5838-b9f7-416f-812e-5947a5e1ccc9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:59.851295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2163998c-1f7f-486a-922f-c295cc65f675 req-812d5838-b9f7-416f-812e-5947a5e1ccc9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:59.871961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b0c8eeb-c481-4c43-ad0b-f366cc4e0223 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a9bf700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:59.872707 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2163998c-1f7f-486a-922f-c295cc65f675 req-812d5838-b9f7-416f-812e-5947a5e1ccc9 service nova] Creating event network-changed:774dd0b2-d77d-464b-9176-c29007e52568 for instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d on n-h2-854925-5 Aug 30 04:11:59.878431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2163998c-1f7f-486a-922f-c295cc65f675 req-812d5838-b9f7-416f-812e-5947a5e1ccc9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053276 Aug 30 04:11:59.879695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 469/920] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:11:59.928356 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b0c8eeb-c481-4c43-ad0b-f366cc4e0223 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.060877 Aug 30 04:11:59.929524 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 452/921] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:11:59 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:11:59.985709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:11:59.986408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:11:59.992546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:59.993028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:59.993487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:11:59.994240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:11:59.994632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:11:59.995051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:00.138928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:00.147097 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4624608c-1107-48ca-9692-b77dcbd542ae tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.166101 Aug 30 04:12:00.147673 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 470/922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:11:59 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:00.208231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-71bde506-8257-4b02-b657-3bd74bf162ca req-eb57eeeb-847b-4559-9774-ac640b65c22a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4dc36b-832a-4978-945a-fc9fe6be51ab", "name": "network-vif-unplugged", "status": "completed", "tag": "861b971b-13a8-4aa1-bcb2-2c8faa20a585"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:00.218681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-71bde506-8257-4b02-b657-3bd74bf162ca req-eb57eeeb-847b-4559-9774-ac640b65c22a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:00.219239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-71bde506-8257-4b02-b657-3bd74bf162ca req-eb57eeeb-847b-4559-9774-ac640b65c22a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:00.219712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-71bde506-8257-4b02-b657-3bd74bf162ca req-eb57eeeb-847b-4559-9774-ac640b65c22a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:00.230434 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-71bde506-8257-4b02-b657-3bd74bf162ca req-eb57eeeb-847b-4559-9774-ac640b65c22a service nova] Creating event network-vif-unplugged:861b971b-13a8-4aa1-bcb2-2c8faa20a585 for instance ab4dc36b-832a-4978-945a-fc9fe6be51ab on n-h2-854925-5 Aug 30 04:12:00.235976 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-71bde506-8257-4b02-b657-3bd74bf162ca req-eb57eeeb-847b-4559-9774-ac640b65c22a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034064 Aug 30 04:12:00.236747 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 453/923] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:00.337432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:00.338042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:00.344606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:00.345087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:00.345546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:00.346238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:00.346684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:00.347102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:00.473766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:00.481597 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-716e3790-f97d-4dcc-83b5-769e80d138a7 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1315 microversion: 2.1 time: 0.148000 Aug 30 04:12:00.482197 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 471/924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:00 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:00.778931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:00.779751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:00.786570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:00.787005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:00.787448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:00.788146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:00.788602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:00.789030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:00.928116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:00.936013 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c3d8c55-3fa7-4216-8305-890e2203ae91 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.161338 Aug 30 04:12:00.936594 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 454/925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:00 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:00.950743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-921f6b6b-60ac-45e3-9f96-4a5e690a720f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a51f310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:00.997929 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-921f6b6b-60ac-45e3-9f96-4a5e690a720f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.051012 Aug 30 04:12:00.998502 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 472/926] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:00 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:01.167710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:01.168247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:01.174406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.174893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.175331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:01.176026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.176480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.176906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:01.309715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:01.318169 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-194d709e-cf2a-4a0e-8f0d-b1d8240653d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.154431 Aug 30 04:12:01.318766 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 455/927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:01 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:01.503161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:01.503776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:01.512561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.513045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.513518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:01.514717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.515175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.515657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:01.559510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=26 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:01.649611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:01.658084 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-348c52e3-57e4-4ef9-a871-16d1db8af5ba tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1503 microversion: 2.1 time: 0.158823 Aug 30 04:12:01.658655 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 473/928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:01 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:01.678255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-754569002"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:01.678790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:01.684632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.685109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.685573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:01.686318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.686770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.687511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:01.812475 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.network.security_group_api [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Adding security group a3755480-c984-42ab-ba40-93b9021cb0fa to port 80be55f6-b4e1-4f6b-a650-d5d75e877f8d Aug 30 04:12:01.957814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:01.958500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:01.966140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.966966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.967801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:01.968751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:01.969279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:01.969827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:02.190781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:02.200561 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-56972355-55b0-43cb-9fc0-4e595d30989e tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.247407 Aug 30 04:12:02.201179 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 474/929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:01 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:02.206640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78e70330-1496-4883-b1de-395d108a12a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96ab0a280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:02.229005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2421c38e-a9a8-4778-9383-802c8a43a735 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad/action" status: 202 len: 0 microversion: 2.1 time: 0.553837 Aug 30 04:12:02.230592 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 456/930] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:01 2022] POST /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:02.240077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1fa39d1d-e99d-4f00-98d4-d35342a69878 req-af6fa086-913a-4629-a7ca-fc42e130e18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e66e97-cc16-4abe-a475-ac63c384e8ad", "tag": "80be55f6-b4e1-4f6b-a650-d5d75e877f8d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:02.253706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1fa39d1d-e99d-4f00-98d4-d35342a69878 req-af6fa086-913a-4629-a7ca-fc42e130e18a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:02.254262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1fa39d1d-e99d-4f00-98d4-d35342a69878 req-af6fa086-913a-4629-a7ca-fc42e130e18a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:02.254930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1fa39d1d-e99d-4f00-98d4-d35342a69878 req-af6fa086-913a-4629-a7ca-fc42e130e18a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:02.255304 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78e70330-1496-4883-b1de-395d108a12a4 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.052235 Aug 30 04:12:02.256219 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 475/931] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:02 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:02.262011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-960434650"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:02.262608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:02.268911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:02.269353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:02.269806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:02.270221 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1fa39d1d-e99d-4f00-98d4-d35342a69878 req-af6fa086-913a-4629-a7ca-fc42e130e18a service nova] Creating event network-changed:80be55f6-b4e1-4f6b-a650-d5d75e877f8d for instance 36e66e97-cc16-4abe-a475-ac63c384e8ad on n-h1-854925-5 Aug 30 04:12:02.270667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:02.271136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:02.271572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:02.277226 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1fa39d1d-e99d-4f00-98d4-d35342a69878 req-af6fa086-913a-4629-a7ca-fc42e130e18a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043319 Aug 30 04:12:02.278324 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 457/932] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:02.340571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:02.341378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:02.348968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:02.349875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:02.350492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:02.351368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:02.351986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:02.352577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:02.777529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Adding security group 091c85f6-7b42-4207-baca-d51ec83f1b8b to port 80be55f6-b4e1-4f6b-a650-d5d75e877f8d Aug 30 04:12:02.782144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:02.790651 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e30e10f4-33e1-49d5-9678-b6dbb2b09da1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.454298 Aug 30 04:12:02.791637 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 458/933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:02 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:03.161410 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-53ec6eb3-e628-4ee8-98ce-f6ddf896bd90 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad/action" status: 202 len: 0 microversion: 2.1 time: 0.903523 Aug 30 04:12:03.167073 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 476/934] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:02 2022] POST /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad/action => generated 0 bytes in 910 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:03.171793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.172486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:03.179231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:03.179927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:03.180526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:03.181462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:03.182128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:03.182707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:03.224078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.224692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:03.231288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:03.232013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:03.232624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:03.234199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:03.234836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:03.235258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:03.419669 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a415a41-e937-42c0-9cb0-7fff9c61a9f0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.252400 Aug 30 04:12:03.420400 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 459/935] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Aug 30 04:12:03 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad/os-security-groups => generated 1157 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:03.427710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4eb35b7-75fe-4ffa-8713-74b7383f779e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96af57ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.438050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:03.446639 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3db3e13d-4d5e-4e02-8727-afd1e0638fa9 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.227237 Aug 30 04:12:03.447263 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 477/936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:03 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:03.465803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f8476bf-459a-4668-b861-02cc4393ca31 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96a6e9f70>, body: {"security_group": {"name": " tempest-securitygroup -1151740288 ", "description": "tempest-description-1555599152"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:03.489275 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4eb35b7-75fe-4ffa-8713-74b7383f779e tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.065900 Aug 30 04:12:03.490352 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 460/937] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:03 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:03.616686 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f8476bf-459a-4668-b861-02cc4393ca31 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.155084 Aug 30 04:12:03.617676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 478/938] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:12:03 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:03.630918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5c84fe73-47ea-4ae4-aada-115dc4f2c489 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a568790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.681551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5c84fe73-47ea-4ae4-aada-115dc4f2c489 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea" status: 200 len: 224 microversion: 2.1 time: 0.054917 Aug 30 04:12:03.682239 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 461/939] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:12:03 2022] GET /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea => generated 224 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:03.694708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bdbe12d7-940c-4d9a-95be-59907e26d784 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a50b670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.812149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.812827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:03.821598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:03.822098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:03.822543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:03.823259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:03.823703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:03.824132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:03.921562 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bdbe12d7-940c-4d9a-95be-59907e26d784 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea" status: 202 len: 0 microversion: 2.1 time: 0.230565 Aug 30 04:12:03.922733 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 479/940] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:03 2022] DELETE /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:03.931672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a376a7b2-3088-489e-ada7-8ca25c8c5e86 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a50ba60>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:03.977484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-a376a7b2-3088-489e-ada7-8ca25c8c5e86 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:03.978085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-a376a7b2-3088-489e-ada7-8ca25c8c5e86 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group 36269f5f-c7db-4640-8138-2104513fb1ea not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:03.979374 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a376a7b2-3088-489e-ada7-8ca25c8c5e86 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:03.979374 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-ff249df6-3770-47db-95c6-0c638d70a155'] Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a376a7b2-3088-489e-ada7-8ca25c8c5e86 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea HTTP/1.1 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-ff249df6-3770-47db-95c6-0c638d70a155'] Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '36269f5f-c7db-4640-8138-2104513fb1ea'} Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:03.999628 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff249df6-3770-47db-95c6-0c638d70a155'] Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff249df6-3770-47db-95c6-0c638d70a155'] Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff249df6-3770-47db-95c6-0c638d70a155'] Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff249df6-3770-47db-95c6-0c638d70a155'] Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a376a7b2-3088-489e-ada7-8ca25c8c5e86 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:04.006981 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-ff249df6-3770-47db-95c6-0c638d70a155'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:04.011507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:04.015052 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a376a7b2-3088-489e-ada7-8ca25c8c5e86 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea" status: 404 len: 194 microversion: 2.1 time: 0.078538 Aug 30 04:12:04.015717 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 480/941] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:12:03 2022] GET /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea => generated 194 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:04.022231 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-80a29d4b-9219-4c44-a474-271a09c11835 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.214003 Aug 30 04:12:04.022963 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 462/942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:03 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:04.025764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd9f6203-0271-4904-afae-d10e74e01119 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96a496c10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-947939410", "description": "tempest-description-1788524389"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:04.119714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b6063e22-7731-4d10-a47d-79ced2cc45cb req-78521186-a436-4fc8-8ac4-aff7d534d476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4dc36b-832a-4978-945a-fc9fe6be51ab", "name": "network-vif-plugged", "status": "completed", "tag": "861b971b-13a8-4aa1-bcb2-2c8faa20a585"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:04.130532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6063e22-7731-4d10-a47d-79ced2cc45cb req-78521186-a436-4fc8-8ac4-aff7d534d476 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:04.131302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6063e22-7731-4d10-a47d-79ced2cc45cb req-78521186-a436-4fc8-8ac4-aff7d534d476 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:04.131790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6063e22-7731-4d10-a47d-79ced2cc45cb req-78521186-a436-4fc8-8ac4-aff7d534d476 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:04.147738 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b6063e22-7731-4d10-a47d-79ced2cc45cb req-78521186-a436-4fc8-8ac4-aff7d534d476 service nova] Creating event network-vif-plugged:861b971b-13a8-4aa1-bcb2-2c8faa20a585 for instance ab4dc36b-832a-4978-945a-fc9fe6be51ab on n-h2-854925-5 Aug 30 04:12:04.153314 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b6063e22-7731-4d10-a47d-79ced2cc45cb req-78521186-a436-4fc8-8ac4-aff7d534d476 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037736 Aug 30 04:12:04.154403 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 463/943] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:04.180891 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd9f6203-0271-4904-afae-d10e74e01119 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.158830 Aug 30 04:12:04.181845 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 481/944] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:12:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:04.195427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e63c3471-8356-4d1d-8e3a-87b16d8d6a24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96a4ea280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1498021274", "description": "tempest-description-1492017778"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:04.299522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-625a0648-f5ea-48df-9ed0-194eef617803 req-e2696302-8d27-4922-b23c-abbef2a4483b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36e66e97-cc16-4abe-a475-ac63c384e8ad", "tag": "80be55f6-b4e1-4f6b-a650-d5d75e877f8d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:04.311904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-625a0648-f5ea-48df-9ed0-194eef617803 req-e2696302-8d27-4922-b23c-abbef2a4483b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:04.311904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-625a0648-f5ea-48df-9ed0-194eef617803 req-e2696302-8d27-4922-b23c-abbef2a4483b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:04.312246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-625a0648-f5ea-48df-9ed0-194eef617803 req-e2696302-8d27-4922-b23c-abbef2a4483b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:04.324936 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-625a0648-f5ea-48df-9ed0-194eef617803 req-e2696302-8d27-4922-b23c-abbef2a4483b service nova] Creating event network-changed:80be55f6-b4e1-4f6b-a650-d5d75e877f8d for instance 36e66e97-cc16-4abe-a475-ac63c384e8ad on n-h1-854925-5 Aug 30 04:12:04.330789 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-625a0648-f5ea-48df-9ed0-194eef617803 req-e2696302-8d27-4922-b23c-abbef2a4483b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034946 Aug 30 04:12:04.331494 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 482/945] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:04.344606 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e63c3471-8356-4d1d-8e3a-87b16d8d6a24 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.153732 Aug 30 04:12:04.345209 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 464/946] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:12:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:04.365908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc041109-898e-441c-8909-a4d24b9d02f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96a436670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-640210036", "description": "tempest-description-1055513423"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:04.468254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:04.469436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:04.476754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:04.477405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:04.477960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:04.478789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:04.479497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:04.480027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:04.535826 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc041109-898e-441c-8909-a4d24b9d02f6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.181445 Aug 30 04:12:04.536860 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 483/947] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:12:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:04.541933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27978f90-a575-4ada-b312-efb04ceb83cd tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a496af0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:04.595992 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27978f90-a575-4ada-b312-efb04ceb83cd tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.057652 Aug 30 04:12:04.603723 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 484/948] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:04 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:04.603723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-66ebc0e9-8c0b-4cab-b592-f8928aaaab5b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a436160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:04.688466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:04.696691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5376da53-ab6e-4e1f-b235-c0ff7da78192 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.232602 Aug 30 04:12:04.698023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 465/949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:04 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:04.849138 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-66ebc0e9-8c0b-4cab-b592-f8928aaaab5b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.251314 Aug 30 04:12:04.850342 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 485/950] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:12:04 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:04.864131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3bfde68f-1063-47d5-a790-397598f67804 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a4ea790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.046643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.047114 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3bfde68f-1063-47d5-a790-397598f67804 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6" status: 202 len: 0 microversion: 2.1 time: 0.186434 Aug 30 04:12:05.047516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:05.047849 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 466/951] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:04 2022] DELETE /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:05.054677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:05.056448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6815f407-2fe6-4be9-8bcb-40a54a142e6f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a4eadc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.057117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:05.057624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:05.058069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:05.058760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:05.059257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:05.059688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:05.088218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-6815f407-2fe6-4be9-8bcb-40a54a142e6f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:05.088957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-6815f407-2fe6-4be9-8bcb-40a54a142e6f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 not found {{(pid=122402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:05.089620 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6815f407-2fe6-4be9-8bcb-40a54a142e6f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:05.089620 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-2c357f7e-96bc-4987-9dcb-eec4490e8f0b'] Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6815f407-2fe6-4be9-8bcb-40a54a142e6f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6 HTTP/1.1 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-2c357f7e-96bc-4987-9dcb-eec4490e8f0b'] Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6854ac49-6ad4-41e3-94fe-80743ce23ba6'} Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:05.093265 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c357f7e-96bc-4987-9dcb-eec4490e8f0b'] Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c357f7e-96bc-4987-9dcb-eec4490e8f0b'] Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c357f7e-96bc-4987-9dcb-eec4490e8f0b'] Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2c357f7e-96bc-4987-9dcb-eec4490e8f0b'] Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6815f407-2fe6-4be9-8bcb-40a54a142e6f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:05.097964 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-2c357f7e-96bc-4987-9dcb-eec4490e8f0b'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:05.113971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6815f407-2fe6-4be9-8bcb-40a54a142e6f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6" status: 404 len: 194 microversion: 2.1 time: 0.042926 Aug 30 04:12:05.117878 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 467/952] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:12:05 2022] GET /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:12:05.122748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b079dcc8-ecf3-4be8-a781-4bc831e90c12 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a52cc10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.294493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:05.308847 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3dac90da-a5cd-4b34-a848-c838be1914bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.267872 Aug 30 04:12:05.310583 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 486/953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:05 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:05.412875 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b079dcc8-ecf3-4be8-a781-4bc831e90c12 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f" status: 202 len: 0 microversion: 2.1 time: 0.293794 Aug 30 04:12:05.414417 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 468/954] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:05 2022] DELETE /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:05.423701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc68b67e-d96a-490e-b305-4c5a6b857ab6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a439280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.451433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-dc68b67e-d96a-490e-b305-4c5a6b857ab6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:05.452792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-dc68b67e-d96a-490e-b305-4c5a6b857ab6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group e0f484b5-2d71-444a-b1f6-efea903e301f not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:05.453311 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-dc68b67e-d96a-490e-b305-4c5a6b857ab6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:05.453311 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-2ae37381-2af2-44eb-9777-84a957c4f98b'] Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc68b67e-d96a-490e-b305-4c5a6b857ab6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f HTTP/1.1 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-2ae37381-2af2-44eb-9777-84a957c4f98b'] Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'e0f484b5-2d71-444a-b1f6-efea903e301f'} Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:05.455290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae37381-2af2-44eb-9777-84a957c4f98b'] Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae37381-2af2-44eb-9777-84a957c4f98b'] Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae37381-2af2-44eb-9777-84a957c4f98b'] Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae37381-2af2-44eb-9777-84a957c4f98b'] Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc68b67e-d96a-490e-b305-4c5a6b857ab6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-2ae37381-2af2-44eb-9777-84a957c4f98b'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dc68b67e-d96a-490e-b305-4c5a6b857ab6 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f" status: 404 len: 194 microversion: 2.1 time: 0.038320 Aug 30 04:12:05.460029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 487/955] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:12:05 2022] GET /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:05.465682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-641790b8-8016-46c0-858a-8b48d0edd035 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96aa86040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.611368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ba10911-61e4-4397-a99d-b2bbc553fb33 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a436e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.686950 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ba10911-61e4-4397-a99d-b2bbc553fb33 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.079112 Aug 30 04:12:05.688920 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 488/956] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:05 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:05.693212 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-641790b8-8016-46c0-858a-8b48d0edd035 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e" status: 202 len: 0 microversion: 2.1 time: 0.231218 Aug 30 04:12:05.694685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 469/957] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:05 2022] DELETE /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:05.706678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-465236e2-0472-4e73-9485-d8bb9cb6a3ac tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a4391f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.718420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.719600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:05.727283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:05.727781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:05.728223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:05.728931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:05.729464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:05.730022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:05.750566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-465236e2-0472-4e73-9485-d8bb9cb6a3ac tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:05.751642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-465236e2-0472-4e73-9485-d8bb9cb6a3ac tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:05.752449 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-465236e2-0472-4e73-9485-d8bb9cb6a3ac tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:05.752449 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-d9303a48-4222-4222-ab17-4b6e334ba217'] Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-465236e2-0472-4e73-9485-d8bb9cb6a3ac tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e HTTP/1.1 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-d9303a48-4222-4222-ab17-4b6e334ba217'] Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5a6de78b-6601-42e8-a9cb-5c5cb44c680e'} Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:05.754793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9303a48-4222-4222-ab17-4b6e334ba217'] Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9303a48-4222-4222-ab17-4b6e334ba217'] Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9303a48-4222-4222-ab17-4b6e334ba217'] Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9303a48-4222-4222-ab17-4b6e334ba217'] Aug 30 04:12:05.761086 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:05.767738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-465236e2-0472-4e73-9485-d8bb9cb6a3ac tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:05.767738 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-d9303a48-4222-4222-ab17-4b6e334ba217'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:05.769394 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-465236e2-0472-4e73-9485-d8bb9cb6a3ac tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e" status: 404 len: 194 microversion: 2.1 time: 0.067579 Aug 30 04:12:05.773495 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 489/958] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:12:05 2022] GET /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:05.779382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-346618e4-2b68-47db-a4f3-85db76a6bbb0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a43f310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:05.801375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:05.943281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:05.952947 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df9c2aca-8a6a-4b75-81b3-62f71dae51b3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.237733 Aug 30 04:12:05.958651 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 470/959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:05 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:06.101275 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-346618e4-2b68-47db-a4f3-85db76a6bbb0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.326379 Aug 30 04:12:06.102003 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 490/960] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:12:05 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:06.118487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c5a9525-35ad-49a5-b50d-9a01079d4926 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96ae7a940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-872021771", "description": "tempest-description-1780928173"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:06.175997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c428837d-fe94-4ef2-9da7-13293e7fa581 req-081508f7-52d4-4898-ad87-a7c4bcf5ded9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c70b4a-4c6a-4137-a2c3-a02b16b5a369", "name": "network-vif-plugged", "status": "completed", "tag": "acbaf2e5-9af3-4cbd-b7cc-9d2045334073"}, {"server_uuid": "1f792ab5-e7c6-40dc-8164-02b879d5a30d", "name": "network-vif-plugged", "status": "completed", "tag": "774dd0b2-d77d-464b-9176-c29007e52568"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:06.187874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c428837d-fe94-4ef2-9da7-13293e7fa581 req-081508f7-52d4-4898-ad87-a7c4bcf5ded9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:06.188653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c428837d-fe94-4ef2-9da7-13293e7fa581 req-081508f7-52d4-4898-ad87-a7c4bcf5ded9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:06.189301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c428837d-fe94-4ef2-9da7-13293e7fa581 req-081508f7-52d4-4898-ad87-a7c4bcf5ded9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:06.203334 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c428837d-fe94-4ef2-9da7-13293e7fa581 req-081508f7-52d4-4898-ad87-a7c4bcf5ded9 service nova] Creating event network-vif-plugged:acbaf2e5-9af3-4cbd-b7cc-9d2045334073 for instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 on n-h1-854925-5 Aug 30 04:12:06.204288 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c428837d-fe94-4ef2-9da7-13293e7fa581 req-081508f7-52d4-4898-ad87-a7c4bcf5ded9 service nova] Creating event network-vif-plugged:774dd0b2-d77d-464b-9176-c29007e52568 for instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d on n-h2-854925-5 Aug 30 04:12:06.212909 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c428837d-fe94-4ef2-9da7-13293e7fa581 req-081508f7-52d4-4898-ad87-a7c4bcf5ded9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041873 Aug 30 04:12:06.219209 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 491/961] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:06.272052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=19 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:06.335352 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c5a9525-35ad-49a5-b50d-9a01079d4926 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.221529 Aug 30 04:12:06.336294 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 471/962] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:12:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:06.340322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:06.341019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:06.350553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53091dd1-c964-4200-883d-57487e62c058 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96aa84af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1410267292", "description": "tempest-description-1414628378"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:06.359701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:06.361019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:06.361672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:06.362545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:06.363165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:06.363768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:06.578687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:06.587894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5178dd57-cf07-4802-bec4-1dbe7e79e8f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.251793 Aug 30 04:12:06.588490 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 492/963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:06 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:06.627558 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-53091dd1-c964-4200-883d-57487e62c058 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.282275 Aug 30 04:12:06.628415 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 472/964] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:12:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:06.702917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c77e67e7-0f9c-4724-818f-ca0f4a521e61 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a439820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:06.760507 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c77e67e7-0f9c-4724-818f-ca0f4a521e61 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.062168 Aug 30 04:12:06.770219 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 493/965] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:06 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:06.773236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1974967977", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "880d6011-807f-438c-bb69-6d826bcadb07"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:06.851774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] validate_networks() for [('880d6011-807f-438c-bb69-6d826bcadb07', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:12:06.981830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:06.982861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:06.990663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:06.991430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:06.992160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:06.993211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:06.993900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:06.994492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:07.242739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:07.259459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c92f0280-8091-4186-ad89-e724e6766db0 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.281599 Aug 30 04:12:07.260709 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 494/966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:06 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:07.375335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:12:07.375971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:12:07.376666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:12:07.377138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:12:07.377576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:12:07.387117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:07.388227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:07.388829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:07.390311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:07.391014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:07.391542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:07.413250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Getting quotas for project 24b389a23eb7413d9228460edde080a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:12:07.420738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Getting quotas for user 0f14c4b1487b456586f06a011b459b38 and project 24b389a23eb7413d9228460edde080a6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:12:07.436659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:12:07.439005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:12:07.470360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:07.504181 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f359220d-905c-411a-a44e-dd9cf85bf214 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741156 Aug 30 04:12:07.512300 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 473/967] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:12:07.517679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b714681f-c91e-40bc-b8a7-bd77dfe5210f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:07.518292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b714681f-c91e-40bc-b8a7-bd77dfe5210f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:07.577369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b714681f-c91e-40bc-b8a7-bd77dfe5210f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:07.586271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b714681f-c91e-40bc-b8a7-bd77dfe5210f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1216 microversion: 2.1 time: 0.072320 Aug 30 04:12:07.587652 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 495/968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:07 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:07.612289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:07.613021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:07.622926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:07.624254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:07.624969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:07.625970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:07.626507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:07.627013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:07.776431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80187d75-bee6-4574-986d-0fafaf52586f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a50b040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:07.822253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:07.845434 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b01e2e6-dce6-49d8-aa56-f6a201c5b512 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1379 microversion: 2.1 time: 0.238691 Aug 30 04:12:07.846391 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 474/969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:07 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1379 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:07.862444 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80187d75-bee6-4574-986d-0fafaf52586f tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.090007 Aug 30 04:12:07.863440 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 496/970] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:07 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:08.284744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:08.286086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:08.294302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.294798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.295409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:08.296169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.296830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.297451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:08.463525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:08.472502 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba3b0877-065c-4c1f-b328-94e9ee8aa6b8 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1396 microversion: 2.1 time: 0.195476 Aug 30 04:12:08.473112 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 475/971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:08 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1396 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:08.607880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:08.608873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:08.619211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.619802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.622009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:08.622737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.623199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.624538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:08.715349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:08.728125 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc620c14-d77a-418c-9f9c-db706fb1f712 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1212 microversion: 2.1 time: 0.124599 Aug 30 04:12:08.733782 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 497/972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:08 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1212 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:08.867335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:08.868657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:08.878294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.879199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.880168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:08.881122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:08.881942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:08.882385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:08.883950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41e7d842-23a7-4952-a7c1-f72a873453fd tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a561550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:08.950744 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41e7d842-23a7-4952-a7c1-f72a873453fd tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.075568 Aug 30 04:12:08.954213 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 498/973] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:08 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:09.065517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:09.074674 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e2e72de-98eb-4e51-8814-d9ba502c81a4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1528 microversion: 2.1 time: 0.211219 Aug 30 04:12:09.076398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 476/974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:08 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1528 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:09.096391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.098237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:09.105908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.106666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.107104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.107810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.109115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.109599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.255058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:09.264873 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7cc1d2e-228f-4e89-b40b-042db6241749 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1528 microversion: 2.1 time: 0.172524 Aug 30 04:12:09.265814 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 499/975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1528 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:09.286092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a5a9297-77af-4a97-984a-43e6d5d7317f tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.305491 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a5a9297-77af-4a97-984a-43e6d5d7317f tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/08cb9ab5-51a9-4519-aa38-574d90fbdbc1" status: 202 len: 0 microversion: 2.1 time: 0.022944 Aug 30 04:12:09.306207 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 477/976] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:09 2022] DELETE /compute/v2.1/flavors/08cb9ab5-51a9-4519-aa38-574d90fbdbc1 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:09.314622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b4eee5a-6565-44ac-bfa5-f91dd0de0969 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.338999 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b4eee5a-6565-44ac-bfa5-f91dd0de0969 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.028573 Aug 30 04:12:09.340160 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 500/977] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:09.358879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:09.361940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:09.369841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.370424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.370935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.371737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.372267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.372763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.469210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:09.476597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Old instance type tempest-test_resize_flavor_-94505654, new instance type m1.heat {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:12:09.489678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:12:09.490340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:12:09.490856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:12:09.493294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:12:09.493294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:12:09.493683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.494497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:09.506914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.515950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.516705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.517655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.519548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.521827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.673477 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59ef408c-561e-47de-8afd-d62dd17c02b9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369/action" status: 202 len: 0 microversion: 2.1 time: 0.318372 Aug 30 04:12:09.674145 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 478/978] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:09 2022] POST /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:09.684491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.685609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:09.693054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:09.695748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.696335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.696896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.699664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.700409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.700957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.704625 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-009aeab5-47d1-4a2f-9ddc-734a286f9b35 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1577 microversion: 2.1 time: 0.214488 Aug 30 04:12:09.706917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:09.710251 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 501/979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:09.736847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.737645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:09.763485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.764539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.765142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.766460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.771223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.771933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.929173 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d6fca9a-2a5b-4f37-a48c-0b6748e7cccb tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.197060 Aug 30 04:12:09.930079 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 502/980] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d/os-interface => generated 284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:09.935562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:09.938543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:09.956697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.957176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.957654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:09.958516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:09.959000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:09.959413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:10.002253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:10.018331 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4514eafe-e505-46b8-9c74-b6d257d4795e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1537 microversion: 2.1 time: 0.339689 Aug 30 04:12:10.018934 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 479/981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1537 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:10.029706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5e979bb3-352a-4fe9-8ed2-aa89f7442b03 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a9bfc10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:10.086143 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5e979bb3-352a-4fe9-8ed2-aa89f7442b03 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.066033 Aug 30 04:12:10.088650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 480/982] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:10 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:10.103021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:10.113286 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bfb0721e-3824-470b-8d54-577c3d6ff251 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1274 microversion: 2.1 time: 0.181968 Aug 30 04:12:10.127966 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 503/983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:09 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:11.043419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:11.044432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:11.054447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:11.055082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:11.055752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:11.059285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:11.060203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:11.060880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:11.105145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-785d52bc-3018-4077-886e-91f2dc1eb83b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a52b9d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:11.203892 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-785d52bc-3018-4077-886e-91f2dc1eb83b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.103720 Aug 30 04:12:11.212411 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 504/984] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:11 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:11.218789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:11.219421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:11.229765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:11.231194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:11.231860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:11.232803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:11.233527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:11.234149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:11.322074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:11.325597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:11.333872 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b40f9bf-0f07-4560-a19c-94d8e9642cef tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1274 microversion: 2.1 time: 0.119986 Aug 30 04:12:11.334727 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 505/985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:11 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:11.349606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:11.360639 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3cad2c35-1928-479a-b773-cd63a447c52b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1537 microversion: 2.1 time: 0.322263 Aug 30 04:12:11.362142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 481/986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:11 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1537 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:12.113642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:12.114675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:12.121885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-72ec08ad-1974-4f7c-9a2f-e5c0b986de88 req-437731a5-ecfe-4ad4-bc67-05dfc7719bfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f792ab5-e7c6-40dc-8164-02b879d5a30d", "tag": "774dd0b2-d77d-464b-9176-c29007e52568"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:12.134361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.135223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.135647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.136000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.136457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.136884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.139036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-72ec08ad-1974-4f7c-9a2f-e5c0b986de88 req-437731a5-ecfe-4ad4-bc67-05dfc7719bfa service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.150515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-72ec08ad-1974-4f7c-9a2f-e5c0b986de88 req-437731a5-ecfe-4ad4-bc67-05dfc7719bfa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.150515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-72ec08ad-1974-4f7c-9a2f-e5c0b986de88 req-437731a5-ecfe-4ad4-bc67-05dfc7719bfa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.161898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-72ec08ad-1974-4f7c-9a2f-e5c0b986de88 req-437731a5-ecfe-4ad4-bc67-05dfc7719bfa service nova] Creating event network-changed:774dd0b2-d77d-464b-9176-c29007e52568 for instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d on n-h2-854925-5 Aug 30 04:12:12.167847 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-72ec08ad-1974-4f7c-9a2f-e5c0b986de88 req-437731a5-ecfe-4ad4-bc67-05dfc7719bfa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050092 Aug 30 04:12:12.169051 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 482/987] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:12.219140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f81a8244-ca69-41c6-81f2-b8401ad20696 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96ae7ac10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:12.312263 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f81a8244-ca69-41c6-81f2-b8401ad20696 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.096344 Aug 30 04:12:12.313946 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 483/988] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:12 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:12.355852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:12.356947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:12.374407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.376604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.377249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.379823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.380501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.382165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.636622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:12.660891 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce669748-22e3-40ee-8d25-ad6a563fc287 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1577 microversion: 2.1 time: 0.545548 Aug 30 04:12:12.668486 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 506/989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:12 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1577 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:12.682644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:12.683554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:12.693964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.695808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.696930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.699151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:12.699799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:12.700397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:12.746444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:12.757871 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fbdc7e68-cf6b-4453-9ec8-8ebe544dfcb3 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.406245 Aug 30 04:12:12.769858 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 484/990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:12 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:12.994262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:13.005122 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c7d9c7e-e3fb-4eb5-af4b-443bc9e9fda8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1537 microversion: 2.1 time: 0.332795 Aug 30 04:12:13.006050 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 507/991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:12 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1537 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:13.329212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32e8c0ba-0f6f-45d2-bf12-2f9ec51adf9d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a5971f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:13.403474 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32e8c0ba-0f6f-45d2-bf12-2f9ec51adf9d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.079163 Aug 30 04:12:13.404070 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 485/992] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:13 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:13.785640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:13.786497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:13.804928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:13.805455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:13.806119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:13.806848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:13.809876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:13.810921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:14.027752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:14.028710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:14.042486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:14.048678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:14.054258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:14.055454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:14.057290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:14.061163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:14.170045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:14.188313 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c5181d2-8915-4d3d-ad1c-62badfa7b85c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.408209 Aug 30 04:12:14.201442 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 508/993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:13 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:14.252476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-af5a4604-9926-4831-b50f-ef56decc8882 req-5676c702-8c65-497a-b811-5282c6259507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842e53c0-570d-4988-a56b-8d1e14f20ce4", "tag": "5a806254-26be-4503-a046-7b6b5d0850c2"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:14.266080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af5a4604-9926-4831-b50f-ef56decc8882 req-5676c702-8c65-497a-b811-5282c6259507 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:14.266869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af5a4604-9926-4831-b50f-ef56decc8882 req-5676c702-8c65-497a-b811-5282c6259507 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:14.267484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af5a4604-9926-4831-b50f-ef56decc8882 req-5676c702-8c65-497a-b811-5282c6259507 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:14.283339 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-af5a4604-9926-4831-b50f-ef56decc8882 req-5676c702-8c65-497a-b811-5282c6259507 service nova] Creating event network-changed:5a806254-26be-4503-a046-7b6b5d0850c2 for instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 on n-h2-854925-5 Aug 30 04:12:14.289216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-af5a4604-9926-4831-b50f-ef56decc8882 req-5676c702-8c65-497a-b811-5282c6259507 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040569 Aug 30 04:12:14.291168 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 509/994] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:14.336229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:14.345863 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5be6fe3d-e877-42aa-9b05-182815baf83b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1537 microversion: 2.1 time: 0.322988 Aug 30 04:12:14.346711 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 486/995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:14 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1537 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:14.421494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4adea0d-2c6e-4c8e-9d75-9d18a274d6f7 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a43fb80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:14.489722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a4adea0d-2c6e-4c8e-9d75-9d18a274d6f7 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.074562 Aug 30 04:12:14.493233 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 510/996] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:14 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:15.212923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:15.214297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:15.220665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.223855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.224443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.225279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.225989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.226519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.368021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:15.370033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:15.378028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.378742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.379465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.380351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.380823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.381256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.396206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:15.411543 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c67b908-0c9f-481a-aa20-6890c23b591f tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.202441 Aug 30 04:12:15.429374 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 487/997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:15 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:15.499167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:15.500159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:15.506861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.507436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.507937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.508897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.509605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.510184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.538835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:15.548324 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-120490b1-3ab2-49ef-8e65-95495ec93df5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.184910 Aug 30 04:12:15.548926 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 511/998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:15 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:15.554023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e88b795-5fba-463d-8c32-2f58f4f564dd tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a43f0d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:15.613065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e88b795-5fba-463d-8c32-2f58f4f564dd tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1428 microversion: 2.1 time: 0.062866 Aug 30 04:12:15.613714 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 512/999] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:15 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1428 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:15.675565 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-97834b07-bfad-4816-ad12-aed9bdecc6de tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1813 microversion: 2.1 time: 0.180960 Aug 30 04:12:15.676354 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 488/1000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:15 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:15.696716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:15.700472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.700971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.701453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.702955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:15.703411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:15.703840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:15.729844 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be5aef49-7c31-46cb-b63b-9003f7bc40e5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036764 Aug 30 04:12:15.730578 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 513/1001] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:12:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:16.436856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:16.437585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:16.444121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.444679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.445177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:16.446165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.446770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.447399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:16.571442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:16.571818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:16.584233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.584922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.585602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:16.586635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.587298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.587880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:16.740034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:16.751205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fff326c7-42e4-4ba9-8530-c60abf6b7bcb tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.315634 Aug 30 04:12:16.762088 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 489/1002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:16 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:16.769618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-79c5111e-24d4-41a8-931c-870dbf86df0b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a582e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:16.818082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:16.828001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7f0b51b-c3ca-4867-ae75-22abc5be926d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.259909 Aug 30 04:12:16.828871 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 514/1003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:16 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:16.832088 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-79c5111e-24d4-41a8-931c-870dbf86df0b tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1437 microversion: 2.1 time: 0.068503 Aug 30 04:12:16.832665 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 490/1004] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:16 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1437 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:16.845732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-795f7ce5-6af2-42d9-b833-e04834857b9d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a52b430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:16.894366 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-795f7ce5-6af2-42d9-b833-e04834857b9d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 200 len: 1437 microversion: 2.1 time: 0.052538 Aug 30 04:12:16.895175 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 515/1005] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:12:16 2022] GET /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 1437 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:16.919885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:16.920956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:16.930065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.931142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.931700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:16.932703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:16.933211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:16.933714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:17.145118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:17.153057 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a39db58a-8453-4552-8461-c23aad499213 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1467 microversion: 2.1 time: 0.237151 Aug 30 04:12:17.162037 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 491/1006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:16 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1467 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:17.176439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76f2a9ac-c559-4107-9067-3b2756f00982 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a4391f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:17.582915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:17.597368 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76f2a9ac-c559-4107-9067-3b2756f00982 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "DELETE /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801" status: 204 len: 0 microversion: 2.1 time: 0.424812 Aug 30 04:12:17.598230 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 516/1007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:17 2022] DELETE /compute/v2.1/images/40ef09ca-3aca-4fc4-b402-f5148b260801 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:12:17.606318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f157e555-3c1a-4cf9-a8a1-c3817a58eb41 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '.version_select at 0x7fe96a4ea820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:17.612513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:17.613265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:17.658997 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f157e555-3c1a-4cf9-a8a1-c3817a58eb41 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] HTTP exception thrown: Image not found. Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f157e555-3c1a-4cf9-a8a1-c3817a58eb41 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Request method failure captured: Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d HTTP/1.1 Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3Td0mSji3dDRRAS6rLXcX5n5-9LKXjp-3HNRRGoLySDETf1joW9hxa_xgxig08P4lRzTN8S2A_C50DZxl1tdtXdo5EGeJz0xj5OsZ8fmREe_l6VFewFaRb9dufX_s0yEFoULeD0WGLzPqv_RbC6SKkBJK_rYYN6xgKabdUnH4_prk Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 06c46e03b3724660b056f47cf14eb3eb Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06c46e03b3724660b056f47cf14eb3eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06c46e03b3724660b056f47cf14eb3eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06c46e03b3724660b056f47cf14eb3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06c46e03b3724660b056f47cf14eb3eb"}]}] Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 06c46e03b3724660b056f47cf14eb3eb Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerTestJSON-1236379326-project Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4b364e890c394b5e9d89d82270783d4a Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerTestJSON-1236379326-project Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '16997879-6576-49cb-a0b5-224a56328c6d'} Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 16997879-6576-49cb-a0b5-224a56328c6d to delete Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 16997879-6576-49cb-a0b5-224a56328c6d could not be found. Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:17.660869 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f157e555-3c1a-4cf9-a8a1-c3817a58eb41 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f157e555-3c1a-4cf9-a8a1-c3817a58eb41 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "DELETE /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d" status: 404 len: 62 microversion: 2.1 time: 0.059867 Aug 30 04:12:17.669070 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 492/1008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:17 2022] DELETE /compute/v2.1/images/16997879-6576-49cb-a0b5-224a56328c6d => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:12:17.672413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:17.673152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:17.679957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:17.680426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:17.680864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:17.691034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:17.691588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:17.692046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:17.719084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:12:17.772459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:17.773196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:17.785282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:17.785765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:17.786210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:17.786927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:17.790033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:17.790946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:17.810825 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a0baa10-0d33-4fa8-a814-4a426c9762eb tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 204 len: 0 microversion: 2.1 time: 0.143041 Aug 30 04:12:17.811687 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 517/1009] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:17 2022] DELETE /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:12:17.823698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:17.824405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:17.830780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:17.831221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:17.831646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:17.832431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:17.833026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:17.833492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:18.027995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:18.035427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:18.036535 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-41694db0-b9cd-4b58-8fec-f6d26e4f2763 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.268243 Aug 30 04:12:18.037404 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 493/1010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:17 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:18.050051 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ed2530fa-a0d4-4e5a-bb62-5ae74eb8b9d8 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1473 microversion: 2.1 time: 0.229708 Aug 30 04:12:18.053557 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 518/1011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:17 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1473 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:18.056201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:18.057073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:18.063256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:18.063992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:18.064640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:18.065711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:18.066410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:18.067064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:18.215345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:18.224044 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ddfe2b2-fe14-4efd-bec7-0122154987f7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.172553 Aug 30 04:12:18.224621 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 494/1012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:18 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:18.803921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34adc4e0-747f-4bee-a316-1f9c751e473e", "device": "/dev/xvdb"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:18.806853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:18.814183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:18.814663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:18.815102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:18.815784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:18.816234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:18.816653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.057498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:19.058114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:19.065259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.065773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.066213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.066901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.067354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.067775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.196158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:19.204047 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-db55ca3a-34f1-4d4a-879d-9b73277e5e0d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.150498 Aug 30 04:12:19.204608 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 495/1013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:19 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:19.208880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:19.209501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:19.214862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.215337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.215771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.216448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.216896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.217933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.344548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:19.352717 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3c576f8-53b8-4800-b427-fb98682f8668 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1473 microversion: 2.1 time: 0.147187 Aug 30 04:12:19.353283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 496/1014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:19 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1473 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:19.357594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:19.359077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:19.364458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.364934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.365391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.366078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:19.366535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:19.366957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:19.492086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:19.499759 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d71b81d2-c5ac-4212-8b97-4da6ea628ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.145522 Aug 30 04:12:19.500325 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 497/1015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:19 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:20.039230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2556391d-fdc3-4e22-9d18-b7ef6f3715c9 req-dcebbdaa-ea83-4ca0-a5f8-959699ea36a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842e53c0-570d-4988-a56b-8d1e14f20ce4", "name": "network-vif-plugged", "status": "completed", "tag": "5a806254-26be-4503-a046-7b6b5d0850c2"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:20.050390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2556391d-fdc3-4e22-9d18-b7ef6f3715c9 req-dcebbdaa-ea83-4ca0-a5f8-959699ea36a7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:20.050881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2556391d-fdc3-4e22-9d18-b7ef6f3715c9 req-dcebbdaa-ea83-4ca0-a5f8-959699ea36a7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:20.051312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2556391d-fdc3-4e22-9d18-b7ef6f3715c9 req-dcebbdaa-ea83-4ca0-a5f8-959699ea36a7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:20.063374 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2556391d-fdc3-4e22-9d18-b7ef6f3715c9 req-dcebbdaa-ea83-4ca0-a5f8-959699ea36a7 service nova] Creating event network-vif-plugged:5a806254-26be-4503-a046-7b6b5d0850c2 for instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 on n-h2-854925-5 Aug 30 04:12:20.068587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2556391d-fdc3-4e22-9d18-b7ef6f3715c9 req-dcebbdaa-ea83-4ca0-a5f8-959699ea36a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033092 Aug 30 04:12:20.069183 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 498/1016] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:20.225180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:20.226003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:20.232168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:20.232644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:20.233080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:20.233800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:20.234256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:20.234678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:20.364989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:20.372522 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e6ad79d3-b51b-4dc9-a410-b005819d465b tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.151660 Aug 30 04:12:20.373086 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 499/1017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:20 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:20.377406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:20.378004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:20.383400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:20.383855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:20.384287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:20.384969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:20.385561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:20.385981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:20.520619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:20.528311 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-165be673-3861-4773-ad81-34f18b7761ec tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1473 microversion: 2.1 time: 0.154266 Aug 30 04:12:20.528887 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 500/1018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:20 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1473 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:20.533908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:20.534509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:20.539972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:20.540451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:20.540884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:20.541592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:20.542043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:20.542467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:20.709301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:20.717406 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-80bfe62e-4761-4f9a-9c72-498679b705cc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.187405 Aug 30 04:12:20.717993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 501/1019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:20 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:20.839346 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ca8bead-75a0-44d6-8483-5d235bfd6dcf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "POST /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.039175 Aug 30 04:12:20.839961 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 519/1020] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:12:18 2022] POST /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 194 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:21.393031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:21.393691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:21.400313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:21.400806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:21.401248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:21.401969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:21.402428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:21.402857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:21.407447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:21.512843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-014f6705-717b-4bf1-ab0a-eae4e035ebe8 req-fab447d7-638b-4e4d-8186-478a6abcd78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4dc36b-832a-4978-945a-fc9fe6be51ab", "name": "network-vif-deleted", "tag": "861b971b-13a8-4aa1-bcb2-2c8faa20a585"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:21.522875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-014f6705-717b-4bf1-ab0a-eae4e035ebe8 req-fab447d7-638b-4e4d-8186-478a6abcd78b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:21.523272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-014f6705-717b-4bf1-ab0a-eae4e035ebe8 req-fab447d7-638b-4e4d-8186-478a6abcd78b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:21.523865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-014f6705-717b-4bf1-ab0a-eae4e035ebe8 req-fab447d7-638b-4e4d-8186-478a6abcd78b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:21.534762 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-014f6705-717b-4bf1-ab0a-eae4e035ebe8 req-fab447d7-638b-4e4d-8186-478a6abcd78b service nova] Creating event network-vif-deleted:861b971b-13a8-4aa1-bcb2-2c8faa20a585 for instance ab4dc36b-832a-4978-945a-fc9fe6be51ab on n-h2-854925-5 Aug 30 04:12:21.539535 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-014f6705-717b-4bf1-ab0a-eae4e035ebe8 req-fab447d7-638b-4e4d-8186-478a6abcd78b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031160 Aug 30 04:12:21.540127 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 520/1021] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:21.549180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:21.550650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:21.551365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:21.557771 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af085aac-aa31-4ec3-beaf-8a352d9308ca tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.168515 Aug 30 04:12:21.558259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:21.558376 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 502/1022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:21 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:21.558748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:21.559187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:21.559890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:21.560341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:21.560769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:21.623821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:21.631454 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ba47b81-b1b9-4285-8009-3b7d511720d6 tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1431 microversion: 2.1 time: 0.084923 Aug 30 04:12:21.632019 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 521/1023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:21 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1431 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:21.738772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:21.739447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:21.745783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:21.746263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:21.746693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:21.747586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:21.748017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:21.748606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:21.885259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:21.893807 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9b63e50-05ab-4c0f-8c73-09881eabc866 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.159119 Aug 30 04:12:21.894569 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 503/1024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:21 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:22.087655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3ddb564f-37e2-4965-be6c-4e36db2b34f3 req-780a151b-42f6-4cbd-8e3b-c30ca9e098dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab4dc36b-832a-4978-945a-fc9fe6be51ab", "name": "network-vif-unplugged", "status": "completed", "tag": "861b971b-13a8-4aa1-bcb2-2c8faa20a585"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:22.097729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3ddb564f-37e2-4965-be6c-4e36db2b34f3 req-780a151b-42f6-4cbd-8e3b-c30ca9e098dd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.098200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3ddb564f-37e2-4965-be6c-4e36db2b34f3 req-780a151b-42f6-4cbd-8e3b-c30ca9e098dd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.098621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3ddb564f-37e2-4965-be6c-4e36db2b34f3 req-780a151b-42f6-4cbd-8e3b-c30ca9e098dd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.109056 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3ddb564f-37e2-4965-be6c-4e36db2b34f3 req-780a151b-42f6-4cbd-8e3b-c30ca9e098dd service nova] Creating event network-vif-unplugged:861b971b-13a8-4aa1-bcb2-2c8faa20a585 for instance ab4dc36b-832a-4978-945a-fc9fe6be51ab on n-h2-854925-5 Aug 30 04:12:22.114024 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3ddb564f-37e2-4965-be6c-4e36db2b34f3 req-780a151b-42f6-4cbd-8e3b-c30ca9e098dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029903 Aug 30 04:12:22.114601 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 522/1025] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:22.578806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:22.579497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:22.586386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.586944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.587442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.588497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.589442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.589888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.654400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:22.655610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:22.666835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.667330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.667766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.668471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.669291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.669405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.706448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.706930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.707365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.707812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lazy-loading 'fault' on Instance uuid ab4dc36b-832a-4978-945a-fc9fe6be51ab {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:22.737672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:22.745605 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b494067-0a78-44e3-942f-2db46e2e6e99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1316 microversion: 2.1 time: 0.171254 Aug 30 04:12:22.746285 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 504/1026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:22 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:22.754299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b364e890c394b5e9d89d82270783d4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06c46e03b3724660b056f47cf14eb3eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:22.762023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2897b7ad-5833-4596-8598-c4ea0ef3b31d tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 200 len: 1307 microversion: 2.1 time: 0.113886 Aug 30 04:12:22.762788 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 523/1027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:22 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 1307 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:22.914916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:22.915641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:22.922270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.922754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.923190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:22.923888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:22.924346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:22.924799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:23.067671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:23.075976 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45bf44d9-3f55-47c1-b6b5-29fccd7f4143 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.164901 Aug 30 04:12:23.076774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 505/1028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:22 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:23.768065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:23.768584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:23.775564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:23.776070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:23.776489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:23.778770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:23.779232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:23.779686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:23.784915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:23.784915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] [instance: ab4dc36b-832a-4978-945a-fc9fe6be51ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:23.791492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:23.792107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:23.792801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:23.793659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:23.794194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:23.794634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:23.808778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] HTTP exception thrown: Instance ab4dc36b-832a-4978-945a-fc9fe6be51ab could not be found. Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Request method failure captured: Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab HTTP/1.1 Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3Td0mSji3dDRRAS6rLXcX5n5-9LKXjp-3HNRRGoLySDETf1joW9hxa_xgxig08P4lRzTN8S2A_C50DZxl1tdtXdo5EGeJz0xj5OsZ8fmREe_l6VFewFaRb9dufX_s0yEFoULeD0WGLzPqv_RbC6SKkBJK_rYYN6xgKabdUnH4_prk Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 06c46e03b3724660b056f47cf14eb3eb Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_06c46e03b3724660b056f47cf14eb3eb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/06c46e03b3724660b056f47cf14eb3eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06c46e03b3724660b056f47cf14eb3eb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/06c46e03b3724660b056f47cf14eb3eb"}]}] Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 06c46e03b3724660b056f47cf14eb3eb Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1236379326 Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerTestJSON-1236379326-project Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4b364e890c394b5e9d89d82270783d4a Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerTestJSON-1236379326-project Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance ab4dc36b-832a-4978-945a-fc9fe6be51ab could not be found. Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'ab4dc36b-832a-4978-945a-fc9fe6be51ab'} Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab4dc36b-832a-4978-945a-fc9fe6be51ab could not be found. Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab4dc36b-832a-4978-945a-fc9fe6be51ab could not be found. Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:23.810668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab4dc36b-832a-4978-945a-fc9fe6be51ab could not be found. Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] Returning 404 to user: Instance ab4dc36b-832a-4978-945a-fc9fe6be51ab could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e43b31b8-91b6-428a-af47-4d4a88de208c tempest-ImagesOneServerTestJSON-1236379326 tempest-ImagesOneServerTestJSON-1236379326-project] 10.222.0.27 "GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab" status: 404 len: 111 microversion: 2.1 time: 0.033175 Aug 30 04:12:23.816002 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 506/1029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:23 2022] GET /compute/v2.1/servers/ab4dc36b-832a-4978-945a-fc9fe6be51ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:12:23.935291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:23.944232 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-09dd3b31-f78f-4509-9d8c-c394bf1a8fd0 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1504 microversion: 2.1 time: 0.180746 Aug 30 04:12:23.944817 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 524/1030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:23 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:23.966556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-872021771"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:23.967400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:23.973673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:23.974164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:23.974790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:23.975762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:23.976407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:23.976996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:24.100666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:24.101561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:24.113822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:24.114613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:24.115157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:24.115958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:24.116577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:24.117654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:24.139365 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.network.security_group_api [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Adding security group fe8a267e-b132-412d-9862-3f078c3e2b2f to port 5a806254-26be-4503-a046-7b6b5d0850c2 Aug 30 04:12:24.389180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:24.392954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:24.403437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0fc3578e-7cb0-4e06-9d46-a540f5cb430d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.308751 Aug 30 04:12:24.405517 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 525/1031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:24 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:24.623566 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ed9505e-760f-46c2-b45e-5a21483e8f57 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.661173 Aug 30 04:12:24.624569 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 507/1032] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:23 2022] POST /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:24.633303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f56aad0-733d-44cb-b6cd-dd98761a3868 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a3c2430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:24.637636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-8c15b11b-ccce-452a-a19c-38d771ecdf71 req-17cdcc52-5160-4429-9a41-006629abaa4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842e53c0-570d-4988-a56b-8d1e14f20ce4", "tag": "5a806254-26be-4503-a046-7b6b5d0850c2"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:24.655862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8c15b11b-ccce-452a-a19c-38d771ecdf71 req-17cdcc52-5160-4429-9a41-006629abaa4e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:24.656346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8c15b11b-ccce-452a-a19c-38d771ecdf71 req-17cdcc52-5160-4429-9a41-006629abaa4e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:24.656774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8c15b11b-ccce-452a-a19c-38d771ecdf71 req-17cdcc52-5160-4429-9a41-006629abaa4e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:24.682279 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-8c15b11b-ccce-452a-a19c-38d771ecdf71 req-17cdcc52-5160-4429-9a41-006629abaa4e service nova] Creating event network-changed:5a806254-26be-4503-a046-7b6b5d0850c2 for instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 on n-h2-854925-5 Aug 30 04:12:24.689027 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-8c15b11b-ccce-452a-a19c-38d771ecdf71 req-17cdcc52-5160-4429-9a41-006629abaa4e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055418 Aug 30 04:12:24.690466 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 508/1033] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:24.822941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-0f56aad0-733d-44cb-b6cd-dd98761a3868 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use.", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:24.824474 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0f56aad0-733d-44cb-b6cd-dd98761a3868 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use. Aug 30 04:12:24.824474 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-76798c5d-c51f-460a-a1d6-22371885119f'] Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f56aad0-733d-44cb-b6cd-dd98761a3868 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f HTTP/1.1 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: exception: Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use. Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-76798c5d-c51f-460a-a1d6-22371885119f'] Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'fe8a267e-b132-412d-9862-3f078c3e2b2f'} Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:24.827335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use. Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76798c5d-c51f-460a-a1d6-22371885119f'] Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use. Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76798c5d-c51f-460a-a1d6-22371885119f'] Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use. Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76798c5d-c51f-460a-a1d6-22371885119f'] Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use. Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76798c5d-c51f-460a-a1d6-22371885119f'] Aug 30 04:12:24.831685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:24.835072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f56aad0-733d-44cb-b6cd-dd98761a3868 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 400 to user: Security Group fe8a267e-b132-412d-9862-3f078c3e2b2f in use. Aug 30 04:12:24.835072 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-76798c5d-c51f-460a-a1d6-22371885119f'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:24.835495 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f56aad0-733d-44cb-b6cd-dd98761a3868 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f" status: 400 len: 185 microversion: 2.1 time: 0.206450 Aug 30 04:12:24.839258 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 526/1034] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:24 2022] DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f => generated 185 bytes in 209 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:12:24.847525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:24.850171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:24.858248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:24.859001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:24.859676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:24.860535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:24.861134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:24.861741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:24.983237 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be90a84f-116c-4cd1-bfb7-e15807902030 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4/action" status: 202 len: 0 microversion: 2.1 time: 0.138344 Aug 30 04:12:24.988489 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 509/1035] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:24 2022] POST /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:24.993647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:24.994926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:25.007506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:25.011533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:25.012098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:25.012893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:25.013390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:25.015230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:25.223659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:25.244548 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f38a3a7b-0949-43b9-9de2-939f2c115e60 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1574 microversion: 2.1 time: 0.255676 Aug 30 04:12:25.245731 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 527/1036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:24 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1574 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:25.427838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:25.428584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:25.435753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:25.437375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:25.438022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:25.438940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:25.439616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:25.440315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:25.664981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:25.673913 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e18e954-7508-46fe-a458-975640ebd58b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.251129 Aug 30 04:12:25.688658 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 510/1037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:25 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:26.267164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:26.267852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:26.272968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:26.280494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:26.286523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:26.287162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:26.288224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:26.289819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:26.291532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:26.485570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:26.494744 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-476da39d-a038-4d6c-8479-100aa3ab3f0c tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1574 microversion: 2.1 time: 0.232258 Aug 30 04:12:26.508782 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 528/1038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:26 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:26.695908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:26.696534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:26.713850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:26.714463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:26.714916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:26.715633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:26.716105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:26.716549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:26.778146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:26.778645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:26.799998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:26.801714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:26.802475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:26.804499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:26.805413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:26.806390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:26.854996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:12:26.971708 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-985e9780-2a69-495d-aec2-15d47724e54d tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "DELETE /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 204 len: 0 microversion: 2.1 time: 0.195719 Aug 30 04:12:26.973039 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 529/1039] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:26 2022] DELETE /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:12:26.985850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:26.987630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:27.001383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:27.001901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:27.002340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:27.003213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:27.003670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:27.004094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:27.246727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:27.260132 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff3786e1-893b-4f82-a01a-506c452a1fe1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.568086 Aug 30 04:12:27.263987 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 511/1040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:26 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:27.368332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:27.380390 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e834f65-ac4d-4a38-94b0-8c28bde36db1 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1709 microversion: 2.1 time: 0.403008 Aug 30 04:12:27.383272 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 530/1041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:26 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1709 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:27.516491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:27.517262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:27.535980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:27.536476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:27.536911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:27.537660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:27.538112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:27.538535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:28.090379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:28.109709 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f889535-e4a7-4ad2-b2f1-1bb298afa426 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1572 microversion: 2.1 time: 0.597144 Aug 30 04:12:28.111483 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 512/1042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:27 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1572 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:28.132164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1410267292"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:28.132995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:28.139459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:28.140153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:28.140801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:28.141716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:28.142327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:28.142906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:28.284217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:28.284846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:28.291021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:28.291702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:28.292142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:28.292840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:28.293297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:28.293747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:28.394952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Adding security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 to port 5a806254-26be-4503-a046-7b6b5d0850c2 Aug 30 04:12:28.662209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:28.672419 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4692e6a3-8510-48a8-95f7-a16183ee4423 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.392471 Aug 30 04:12:28.673595 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 513/1043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:28 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:28.678707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:28.679499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:28.686645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:28.687523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:28.688355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:28.689086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:28.689565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:28.691103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.088432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:29.104182 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8e1c1bda-d87b-4d52-99a2-21a587adf8ff tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1709 microversion: 2.1 time: 0.429250 Aug 30 04:12:29.118126 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 514/1044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:28 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1709 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:29.125615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b548fda2-d8f4-4d9f-97db-c0ac73e4fd5d"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:29.128888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:29.135582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.136081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.136712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.137475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.138319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.138755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.235345 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-054ecd85-c317-4096-9326-12d3826c26df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4/action" status: 202 len: 0 microversion: 2.1 time: 1.106994 Aug 30 04:12:29.236826 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 531/1045] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:28 2022] POST /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4/action => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:29.246184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5eabe494-94c9-42cb-86e0-6fc4a1960f73 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a36bca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:29.574832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-5eabe494-94c9-42cb-86e0-6fc4a1960f73 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use.", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:29.575572 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-5eabe494-94c9-42cb-86e0-6fc4a1960f73 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use. Aug 30 04:12:29.575572 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-eeb0292d-cec4-424b-8f1d-cb02ed659d03'] Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5eabe494-94c9-42cb-86e0-6fc4a1960f73 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 HTTP/1.1 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: exception: Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use. Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-eeb0292d-cec4-424b-8f1d-cb02ed659d03'] Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56'} Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:29.579369 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use. Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeb0292d-cec4-424b-8f1d-cb02ed659d03'] Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use. Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeb0292d-cec4-424b-8f1d-cb02ed659d03'] Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use. Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeb0292d-cec4-424b-8f1d-cb02ed659d03'] Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use. Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eeb0292d-cec4-424b-8f1d-cb02ed659d03'] Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5eabe494-94c9-42cb-86e0-6fc4a1960f73 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 400 to user: Security Group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 in use. Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-eeb0292d-cec4-424b-8f1d-cb02ed659d03'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5eabe494-94c9-42cb-86e0-6fc4a1960f73 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56" status: 400 len: 185 microversion: 2.1 time: 0.339792 Aug 30 04:12:29.584223 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 532/1046] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:29 2022] DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 => generated 185 bytes in 341 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:12:29.592492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0049acbc-cec1-438b-8db6-e38fba6b56bd req-7810acde-87d4-4c20-bde5-a7b428659d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "842e53c0-570d-4988-a56b-8d1e14f20ce4", "tag": "5a806254-26be-4503-a046-7b6b5d0850c2"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:29.617818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0049acbc-cec1-438b-8db6-e38fba6b56bd req-7810acde-87d4-4c20-bde5-a7b428659d82 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.620537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0049acbc-cec1-438b-8db6-e38fba6b56bd req-7810acde-87d4-4c20-bde5-a7b428659d82 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.621287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0049acbc-cec1-438b-8db6-e38fba6b56bd req-7810acde-87d4-4c20-bde5-a7b428659d82 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.634580 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b27e2edd-785c-4363-a4cd-5896df7b2ae0 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "POST /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514199 Aug 30 04:12:29.635594 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 515/1047] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:12:29 2022] POST /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 194 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:29.664554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:29.666245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:29.669299 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0049acbc-cec1-438b-8db6-e38fba6b56bd req-7810acde-87d4-4c20-bde5-a7b428659d82 service nova] Creating event network-changed:5a806254-26be-4503-a046-7b6b5d0850c2 for instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 on n-h2-854925-5 Aug 30 04:12:29.681798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.682571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.683479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.684914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0049acbc-cec1-438b-8db6-e38fba6b56bd req-7810acde-87d4-4c20-bde5-a7b428659d82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098627 Aug 30 04:12:29.685303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.686763 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 533/1048] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:29.687750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.688509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.703208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:29.707941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:29.723844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.724357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.724800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.725547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.737788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.737788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.773194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:12:29.869372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:29.939150 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca869433-ff6b-4d25-9a26-af8d1b175277 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 204 len: 0 microversion: 2.1 time: 0.301932 Aug 30 04:12:29.940553 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 516/1049] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:29 2022] DELETE /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:12:29.949512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:29.950484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:29.968080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.968838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.971217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:29.972113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:29.973887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:29.974629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:30.217186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:30.226397 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0a1f586-9f31-44fc-83db-67b4192eda2b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.534560 Aug 30 04:12:30.241182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 534/1050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:29 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:30.245485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:30.246357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:30.254559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:30.255138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:30.255647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:30.256419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:30.256956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:30.257539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:30.879865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:30.888899 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f299d3d1-db8a-4f8d-8dbd-8d2d40c20b2b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1642 microversion: 2.1 time: 0.652096 Aug 30 04:12:30.894027 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 535/1051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:30 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1642 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:30.996867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:31.021545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df3edae6-2740-4fdc-b30a-13ed9b61776a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1647 microversion: 2.1 time: 1.075554 Aug 30 04:12:31.023597 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 517/1052] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:29 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1647 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:31.249206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:31.250098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:31.262688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.263602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.264310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:31.265244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.265929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.266557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:31.515053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-41a2b56d-5a78-4f05-9f42-66f928af350d req-8357a78a-0713-4042-ad84-0282617eb53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ce3cd4-5293-4b7d-9f09-bf710b97dbb5", "name": "network-vif-deleted", "tag": "38df6bec-3dcd-4963-b904-7a1edc19ee06"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:31.527894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:31.537581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-41a2b56d-5a78-4f05-9f42-66f928af350d req-8357a78a-0713-4042-ad84-0282617eb53e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.542841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-41a2b56d-5a78-4f05-9f42-66f928af350d req-8357a78a-0713-4042-ad84-0282617eb53e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.545449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-41a2b56d-5a78-4f05-9f42-66f928af350d req-8357a78a-0713-4042-ad84-0282617eb53e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:31.546050 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-764264cf-658b-4454-a3c2-84cd4ce65ac1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.300615 Aug 30 04:12:31.548886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 536/1053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:31 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:31.601819 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-41a2b56d-5a78-4f05-9f42-66f928af350d req-8357a78a-0713-4042-ad84-0282617eb53e service nova] Creating event network-vif-deleted:38df6bec-3dcd-4963-b904-7a1edc19ee06 for instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 on n-h2-854925-5 Aug 30 04:12:31.624216 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-41a2b56d-5a78-4f05-9f42-66f928af350d req-8357a78a-0713-4042-ad84-0282617eb53e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113364 Aug 30 04:12:31.632974 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 518/1054] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:31.915498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:31.915916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:31.935302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.951419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.952485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:31.953515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:31.954317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:31.954914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:32.056859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:32.058921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:32.083052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:32.089791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:32.091545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:32.092415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:32.092875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:32.093309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:32.109704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:32.110390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:32.111359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:32.112142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lazy-loading 'fault' on Instance uuid 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:32.396294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b102593edbd9489883889617591d412d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b96459442a54f3caa87eb12f10d85b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:32.407335 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7cab5d9-cc73-43d0-a48a-6d152ec25f0f tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 200 len: 1353 microversion: 2.1 time: 0.496161 Aug 30 04:12:32.407932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 537/1055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:31 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 1353 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:32.571040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:32.571675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:32.599378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:32.599878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:32.600401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:32.601121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:32.602034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:32.609626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:32.768240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:32.813084 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-78716986-75e3-45cf-bcf0-fa8b8caac34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1647 microversion: 2.1 time: 0.769792 Aug 30 04:12:32.817464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 519/1056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:32 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1647 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:33.252696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:33.266983 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d99d0a80-a3ce-480c-887e-6ac72ff18185 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.701202 Aug 30 04:12:33.272493 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 538/1057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:32 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:33.431258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:33.432056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:33.447443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.450007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.453448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.454343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.455514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.457403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.503353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] HTTP exception thrown: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Request method failure captured: Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 HTTP/1.1 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY06UEuVfvrJvk6SlaJnZv-MLkY30VzKWSy4QhfUG4QSR-YjaW7ohFhDNQ0CZHMVjCE5UJ45KKI_JkmJCNKJJuRbq2wu09aOmBKJL7y3DdVEgFNZvbMkszAOMr4bMktRlZYUWnVVT1cM7pX8urKPSjQH058MzEk0qI_7EGLWxayuA6Y Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b96459442a54f3caa87eb12f10d85b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}] Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b102593edbd9489883889617591d412d Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '97ce3cd4-5293-4b7d-9f09-bf710b97dbb5'} Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:33.510020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:33.515345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.516562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Returning 404 to user: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:33.519444 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73ddd274-27cc-4499-8b2b-9213afec1639 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 404 len: 111 microversion: 2.1 time: 0.093719 Aug 30 04:12:33.523382 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 520/1058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:33 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:33.530165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:33.531268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:33.540852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.541919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.542827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.543828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.544508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.545220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.585487 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] HTTP exception thrown: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Request method failure captured: Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f HTTP/1.1 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY06UEuVfvrJvk6SlaJnZv-MLkY30VzKWSy4QhfUG4QSR-YjaW7ohFhDNQ0CZHMVjCE5UJ45KKI_JkmJCNKJJuRbq2wu09aOmBKJL7y3DdVEgFNZvbMkszAOMr4bMktRlZYUWnVVT1cM7pX8urKPSjQH058MzEk0qI_7EGLWxayuA6Y Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b96459442a54f3caa87eb12f10d85b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}] Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b102593edbd9489883889617591d412d Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7921f451-2ab5-4c56-8efe-31230544542f'} Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:33.587509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.591390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.597536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Returning 404 to user: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:33.598898 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cdf059ce-d5b6-45fe-81d8-e44338facfe4 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 404 len: 111 microversion: 2.1 time: 0.072873 Aug 30 04:12:33.599985 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 539/1059] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:33 2022] DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:33.608522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:33.609515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:33.613261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:33.628132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.628132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.628792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.643880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-442d18ed-8819-4391-a4bd-c83d8eb395af req-419ab1cd-3e61-40f1-a257-6a0c51721d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "842e53c0-570d-4988-a56b-8d1e14f20ce4", "name": "network-vif-deleted", "tag": "5a806254-26be-4503-a046-7b6b5d0850c2"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:33.647667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.647885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.650381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.661011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:33.665373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-442d18ed-8819-4391-a4bd-c83d8eb395af req-419ab1cd-3e61-40f1-a257-6a0c51721d77 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.666246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-442d18ed-8819-4391-a4bd-c83d8eb395af req-419ab1cd-3e61-40f1-a257-6a0c51721d77 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.666973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-442d18ed-8819-4391-a4bd-c83d8eb395af req-419ab1cd-3e61-40f1-a257-6a0c51721d77 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.693771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-442d18ed-8819-4391-a4bd-c83d8eb395af req-419ab1cd-3e61-40f1-a257-6a0c51721d77 service nova] Creating event network-vif-deleted:5a806254-26be-4503-a046-7b6b5d0850c2 for instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 on n-h2-854925-5 Aug 30 04:12:33.703452 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-442d18ed-8819-4391-a4bd-c83d8eb395af req-419ab1cd-3e61-40f1-a257-6a0c51721d77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062989 Aug 30 04:12:33.711309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 540/1060] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:33.712344 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] HTTP exception thrown: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Request method failure captured: Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f HTTP/1.1 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY06UEuVfvrJvk6SlaJnZv-MLkY30VzKWSy4QhfUG4QSR-YjaW7ohFhDNQ0CZHMVjCE5UJ45KKI_JkmJCNKJJuRbq2wu09aOmBKJL7y3DdVEgFNZvbMkszAOMr4bMktRlZYUWnVVT1cM7pX8urKPSjQH058MzEk0qI_7EGLWxayuA6Y Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b96459442a54f3caa87eb12f10d85b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}] Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b102593edbd9489883889617591d412d Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '7921f451-2ab5-4c56-8efe-31230544542f'} Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.716447 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:33.720794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:33.722393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Returning 404 to user: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:33.724612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88c15e20-21f7-43e4-90a6-cf23490ec688 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 404 len: 111 microversion: 2.1 time: 0.120425 Aug 30 04:12:33.731714 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 521/1061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:33 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:33.741117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f143330a-9c05-49e7-a869-504640b2465b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '.version_select at 0x7fe96a4563a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:33.791480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f143330a-9c05-49e7-a869-504640b2465b tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-284590994" status: 202 len: 0 microversion: 2.1 time: 0.055754 Aug 30 04:12:33.792119 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 541/1062] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-284590994 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:33.847158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:33.848122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:33.862961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.863735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.866360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.868045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.869181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.869944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.946166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:33.946947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:33.948150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:33.949257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lazy-loading 'fault' on Instance uuid 842e53c0-570d-4988-a56b-8d1e14f20ce4 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:34.080396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:34.094487 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6426316-9d40-447c-9ec9-1cb4a1108ee4 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1306 microversion: 2.1 time: 0.258322 Aug 30 04:12:34.114903 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 522/1063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:33 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1306 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:34.292847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:34.293714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:34.307324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:34.308276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:34.308718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:34.309465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:34.309927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:34.313438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:34.582505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:34.594123 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b933fe57-55cd-445a-aedd-3e8fe5651a31 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.304799 Aug 30 04:12:34.595141 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 542/1064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:34 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:34.780281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c63bd99e-0756-4fc4-af06-498df289f3cb tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:34.805947 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c63bd99e-0756-4fc4-af06-498df289f3cb tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/148429225" status: 202 len: 0 microversion: 2.1 time: 0.028751 Aug 30 04:12:34.806932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 543/1065] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:12:34 2022] DELETE /compute/v2.1/flavors/148429225 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:12:34.815434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83125f95-6377-4424-94fe-3217a70ad74c tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:34.849620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83125f95-6377-4424-94fe-3217a70ad74c tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.038315 Aug 30 04:12:34.851182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 544/1066] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:34 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:34.868327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-991e7c57-5498-47d9-b0fa-104866e25499 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:34.882868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-318261918", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "762873a3-4a4d-475f-83c3-c7f859ce784c"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:34.896356 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-991e7c57-5498-47d9-b0fa-104866e25499 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/2135024539" status: 202 len: 0 microversion: 2.1 time: 0.032177 Aug 30 04:12:34.902108 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 545/1067] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:12:34 2022] DELETE /compute/v2.1/flavors/2135024539 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:34.909067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c5dff6c-5915-4f54-a5a7-eab7d33496a2 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:34.938551 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c5dff6c-5915-4f54-a5a7-eab7d33496a2 tempest-ServersWithSpecificFlavorTestJSON-1468625245 tempest-ServersWithSpecificFlavorTestJSON-1468625245-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034766 Aug 30 04:12:34.939576 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 546/1068] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:34.957097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] validate_networks() for [('762873a3-4a4d-475f-83c3-c7f859ce784c', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:12:34.980707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:34.981577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:34.989658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:34.990555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:34.991373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:34.992980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:34.993694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:34.994344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.019662 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] HTTP exception thrown: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Request method failure captured: Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 HTTP/1.1 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY06UEuVfvrJvk6SlaJnZv-MLkY30VzKWSy4QhfUG4QSR-YjaW7ohFhDNQ0CZHMVjCE5UJ45KKI_JkmJCNKJJuRbq2wu09aOmBKJL7y3DdVEgFNZvbMkszAOMr4bMktRlZYUWnVVT1cM7pX8urKPSjQH058MzEk0qI_7EGLWxayuA6Y Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b96459442a54f3caa87eb12f10d85b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}] Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b102593edbd9489883889617591d412d Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '97ce3cd4-5293-4b7d-9f09-bf710b97dbb5'} Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:35.022256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.027123 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.033476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Returning 404 to user: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:35.035954 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd15dd36-1ce0-47dd-84fe-63f21096eed6 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "DELETE /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 404 len: 111 microversion: 2.1 time: 0.059851 Aug 30 04:12:35.037208 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 547/1069] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:34 2022] DELETE /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:35.048288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:35.050243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:35.058780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.060702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.061911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.064153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.064906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.065747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.082712 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] HTTP exception thrown: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Request method failure captured: Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 HTTP/1.1 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY06UEuVfvrJvk6SlaJnZv-MLkY30VzKWSy4QhfUG4QSR-YjaW7ohFhDNQ0CZHMVjCE5UJ45KKI_JkmJCNKJJuRbq2wu09aOmBKJL7y3DdVEgFNZvbMkszAOMr4bMktRlZYUWnVVT1cM7pX8urKPSjQH058MzEk0qI_7EGLWxayuA6Y Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b96459442a54f3caa87eb12f10d85b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}] Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b102593edbd9489883889617591d412d Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '97ce3cd4-5293-4b7d-9f09-bf710b97dbb5'} Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.084352 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Returning 404 to user: Instance 97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6297fc7-82a2-408c-a798-9e53aeb440ed tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5" status: 404 len: 111 microversion: 2.1 time: 0.044162 Aug 30 04:12:35.088225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 548/1070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:35 2022] GET /compute/v2.1/servers/97ce3cd4-5293-4b7d-9f09-bf710b97dbb5 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:35.095207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:35.095972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:35.102815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.103676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.104309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.105213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.105892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.106507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.123196 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] HTTP exception thrown: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Request method failure captured: Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f HTTP/1.1 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY06UEuVfvrJvk6SlaJnZv-MLkY30VzKWSy4QhfUG4QSR-YjaW7ohFhDNQ0CZHMVjCE5UJ45KKI_JkmJCNKJJuRbq2wu09aOmBKJL7y3DdVEgFNZvbMkszAOMr4bMktRlZYUWnVVT1cM7pX8urKPSjQH058MzEk0qI_7EGLWxayuA6Y Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b96459442a54f3caa87eb12f10d85b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}] Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b102593edbd9489883889617591d412d Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7921f451-2ab5-4c56-8efe-31230544542f'} Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:35.125846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Returning 404 to user: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-09154d0e-436d-4fb1-91e1-1b414cf98e5e tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 404 len: 111 microversion: 2.1 time: 0.036355 Aug 30 04:12:35.129635 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 549/1071] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:35 2022] DELETE /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:35.134562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:35.135182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:35.142597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.142597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.142597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.143141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.143492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.143916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.187827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.188776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.189404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.190215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lazy-loading 'fault' on Instance uuid 842e53c0-570d-4988-a56b-8d1e14f20ce4 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:35.283788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:35.296328 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c3aa1b8-340a-424a-9a86-896e40476dff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 200 len: 1473 microversion: 2.1 time: 0.166987 Aug 30 04:12:35.311750 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 550/1072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:35 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:35.312926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:35.313617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] [instance: 7921f451-2ab5-4c56-8efe-31230544542f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:35.320590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.321082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.321565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.324029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.324499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.325298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.351033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] HTTP exception thrown: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Request method failure captured: Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f HTTP/1.1 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY06UEuVfvrJvk6SlaJnZv-MLkY30VzKWSy4QhfUG4QSR-YjaW7ohFhDNQ0CZHMVjCE5UJ45KKI_JkmJCNKJJuRbq2wu09aOmBKJL7y3DdVEgFNZvbMkszAOMr4bMktRlZYUWnVVT1cM7pX8urKPSjQH058MzEk0qI_7EGLWxayuA6Y Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9b96459442a54f3caa87eb12f10d85b0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9b96459442a54f3caa87eb12f10d85b0"}]}] Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9b96459442a54f3caa87eb12f10d85b0 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751 Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b102593edbd9489883889617591d412d Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1976670751-project Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7921f451-2ab5-4c56-8efe-31230544542f'} Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.352600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] Returning 404 to user: Instance 7921f451-2ab5-4c56-8efe-31230544542f could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e73af971-c082-4149-8be7-ad54f5946868 tempest-ServersWithSpecificFlavorTestJSON-1976670751 tempest-ServersWithSpecificFlavorTestJSON-1976670751-project] 10.222.0.27 "GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f" status: 404 len: 111 microversion: 2.1 time: 0.045637 Aug 30 04:12:35.356679 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 551/1073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:35 2022] GET /compute/v2.1/servers/7921f451-2ab5-4c56-8efe-31230544542f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:35.469868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:12:35.470370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:12:35.471721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:12:35.473391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:12:35.474539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:12:35.484483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.485072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.485766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.486821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.487383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.487888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.510274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:12:35.517168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for user d9abb5b0dbb04242acaf957bd30cd5c1 and project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:12:35.545438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:12:35.547963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:12:35.616340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:35.616459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:35.625648 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f51df154-5548-495d-8eeb-5da0357af578 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.910322 Aug 30 04:12:35.629913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.630424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.633031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.633989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:35.634616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:35.636449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:35.642545 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 523/1074] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:12:35.645629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:35.647703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8aca7ed-7a5f-48e2-9adb-0c6b5cefcd7b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:35.648465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f8aca7ed-7a5f-48e2-9adb-0c6b5cefcd7b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:35.752238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f8aca7ed-7a5f-48e2-9adb-0c6b5cefcd7b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:35.760135 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f8aca7ed-7a5f-48e2-9adb-0c6b5cefcd7b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1224 microversion: 2.1 time: 0.116373 Aug 30 04:12:35.763395 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 524/1075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:35 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:35.952720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:35.961284 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-891cf41e-dc9c-465a-9107-6c807df22878 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.349805 Aug 30 04:12:35.961811 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 552/1076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:35 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:36.318882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:36.320259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:36.332098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:36.334387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:36.335094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:36.336073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:36.338572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:36.339492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:36.368153 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 HTTP/1.1 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '842e53c0-570d-4988-a56b-8d1e14f20ce4'} Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:36.370435 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:36.375295 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:36.375295 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:36.375295 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:36.375295 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:36.375295 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:36.375295 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:36.375295 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:36.377414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:36.378575 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31de1528-d852-43a3-ba4b-ba6f24fbce39 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 404 len: 111 microversion: 2.1 time: 0.063908 Aug 30 04:12:36.397308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1eb8a474-00c6-4fd0-9552-daf7ad3c9936 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a41a4c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:36.415540 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 525/1077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:36 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:36.695296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1eb8a474-00c6-4fd0-9552-daf7ad3c9936 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f" status: 202 len: 0 microversion: 2.1 time: 0.302367 Aug 30 04:12:36.696149 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 553/1078] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:36 2022] DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:36.706965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dd0a453-4886-4d52-9f02-8c94c32ce55a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a368040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:36.784470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:36.785144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:36.799691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:36.800325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:36.827081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:36.828218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:36.837443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:36.838129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.022975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:37.041471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c73bf21f-457e-4591-b693-0a715f261cf5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1220 microversion: 2.1 time: 0.260780 Aug 30 04:12:37.042932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 554/1079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:36 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1220 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:37.048968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:37.050786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:37.058022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:37.058508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:37.058940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.059780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:37.061814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:37.062306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.233938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dd0a453-4886-4d52-9f02-8c94c32ce55a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56" status: 202 len: 0 microversion: 2.1 time: 0.531627 Aug 30 04:12:37.234527 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 526/1080] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:36 2022] DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:37.250190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:37.250843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:37.266463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:37.266928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:37.267371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.268085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:37.268783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:37.268963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.400807 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98b72c42-d864-4f9e-bdf1-83abd4ea734e tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1859 microversion: 2.1 time: 0.353344 Aug 30 04:12:37.417070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 555/1081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:37 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1859 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:37.425957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-feaa60c0-6da1-4ab6-b98f-9ed6b71495ec tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'create', calling method: .version_select at 0x7fe96a8e24c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-335114261", "description": "tempest-description-1856573862"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:37.529043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:37.545966 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a16691f4-cbf4-47fc-863d-549330dcdc2c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.308787 Aug 30 04:12:37.547242 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 527/1082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:37 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:37.554433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854925-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:37.557932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:37.569847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:37.570337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:37.572544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.573279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:37.579222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:37.579791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:37.622878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lazy-loading 'flavor' on Instance uuid b3a98f78-a3b5-45ac-b93b-72c766284dbd {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:37.674985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Going to try to live migrate instance to n-h1-854925-5 {{(pid=122402) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:12:37.777039 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-feaa60c0-6da1-4ab6-b98f-9ed6b71495ec tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.358449 Aug 30 04:12:37.786584 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 556/1083] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:12:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:37.791646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e960b68-2088-4a1e-850f-1dcb1a89e497 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Action: 'update', calling method: .version_select at 0x7fe96a36b1f0>, body: {"security_group": {"name": "tempest-sg-hth-1699975876", "description": "tempest-description-hth-540219669"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:38.516919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e960b68-2088-4a1e-850f-1dcb1a89e497 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/de8dd433-51b5-4829-a6d0-efe4e96eb002" status: 200 len: 217 microversion: 2.1 time: 0.729038 Aug 30 04:12:38.526851 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 557/1084] 10.222.0.27 () {60 vars in 1290 bytes} [Tue Aug 30 04:12:37 2022] PUT /compute/v2.1/os-security-groups/de8dd433-51b5-4829-a6d0-efe4e96eb002 => generated 217 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:38.532673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:38.533302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:38.555827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:38.556728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:38.557721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:38.562044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:38.562864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:38.567125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:38.751036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:38.764033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6bc7e59-44db-41ef-9fd8-f1b9b859118f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1282 microversion: 2.1 time: 0.235825 Aug 30 04:12:38.767868 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 558/1085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:38 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1282 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:38.784622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e35f73d-12d0-4994-81da-05e4c19e5273 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a39a5e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:39.056791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e35f73d-12d0-4994-81da-05e4c19e5273 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/de8dd433-51b5-4829-a6d0-efe4e96eb002" status: 200 len: 217 microversion: 2.1 time: 0.287722 Aug 30 04:12:39.067593 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 559/1086] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:12:38 2022] GET /compute/v2.1/os-security-groups/de8dd433-51b5-4829-a6d0-efe4e96eb002 => generated 217 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:39.072827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:39.074297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:39.093117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:39.102085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:39.102928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:39.103973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:39.104683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:39.105377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:39.564059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:39.573526 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fcdb728e-16eb-4f8a-a8ed-ade0c687fa9d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.504412 Aug 30 04:12:39.574228 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 560/1087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:39 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:39.580108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-293709e8-dcb9-4b5d-8e4f-88b2ed5bc828 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a36b1f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:40.017009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-293709e8-dcb9-4b5d-8e4f-88b2ed5bc828 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/de8dd433-51b5-4829-a6d0-efe4e96eb002" status: 202 len: 0 microversion: 2.1 time: 0.441352 Aug 30 04:12:40.018225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 561/1088] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:39 2022] DELETE /compute/v2.1/os-security-groups/de8dd433-51b5-4829-a6d0-efe4e96eb002 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:40.024967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:40.025639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:40.052370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.052922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.053423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.054142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.056420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.057058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.316249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-378301fb-36d8-4a68-bdfc-8094c2768072 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/action" status: 202 len: 0 microversion: 2.1 time: 2.767557 Aug 30 04:12:40.317357 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 528/1089] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:37 2022] POST /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/action => generated 0 bytes in 2769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:40.322461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:40.323145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:40.331411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.332229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.333297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.334805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.335544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.336178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.357181 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 HTTP/1.1 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '842e53c0-570d-4988-a56b-8d1e14f20ce4'} Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:40.361888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.366224 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.370907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:40.372528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc355105-c526-4074-a231-d6a8134b5d28 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 404 len: 111 microversion: 2.1 time: 0.054143 Aug 30 04:12:40.373413 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 529/1090] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:40 2022] DELETE /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:40.378539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:40.379502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:40.401984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.403419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.404091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.405848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.406534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.407181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.914745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:40.926718 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17d54d7f-23ac-43ee-a93c-531b3a9540c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1324 microversion: 2.1 time: 0.906949 Aug 30 04:12:40.929065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 562/1091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:40 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1324 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:40.941761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:40.942647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 842e53c0-570d-4988-a56b-8d1e14f20ce4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:40.950219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.950982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.952157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.953295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.953918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:40.954502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:40.972201 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 HTTP/1.1 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '842e53c0-570d-4988-a56b-8d1e14f20ce4'} Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:40.974158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.978860 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:40.978860 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:40.978860 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:40.978860 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:40.978860 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:40.978860 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. Aug 30 04:12:40.978860 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:40.980276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Instance 842e53c0-570d-4988-a56b-8d1e14f20ce4 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:40.981302 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-07124580-4d80-4ab2-96e7-1b876468c1ae tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4" status: 404 len: 111 microversion: 2.1 time: 0.050429 Aug 30 04:12:40.982070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 563/1092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:40 2022] GET /compute/v2.1/servers/842e53c0-570d-4988-a56b-8d1e14f20ce4 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:40.990044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:40.990931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:40.998142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:40.999432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.000196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:41.001313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:41.001965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.002555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:41.121175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:41.134040 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ab766e9b-0331-453c-9123-196b8e5e81d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.759249 Aug 30 04:12:41.134545 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 530/1093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:40 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:41.139954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f497a010-83cd-44c5-81de-217a8914c472 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a2eec10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.256048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-f497a010-83cd-44c5-81de-217a8914c472 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:41.256743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-f497a010-83cd-44c5-81de-217a8914c472 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 not found {{(pid=122402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:41.257870 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f497a010-83cd-44c5-81de-217a8914c472 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist Aug 30 04:12:41.257870 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-14739364-96ef-494a-93c4-18d34ea8af3a'] Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f497a010-83cd-44c5-81de-217a8914c472 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 HTTP/1.1 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-14739364-96ef-494a-93c4-18d34ea8af3a'] Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56'} Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:41.260303 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14739364-96ef-494a-93c4-18d34ea8af3a'] Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14739364-96ef-494a-93c4-18d34ea8af3a'] Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14739364-96ef-494a-93c4-18d34ea8af3a'] Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14739364-96ef-494a-93c4-18d34ea8af3a'] Aug 30 04:12:41.264299 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.268910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f497a010-83cd-44c5-81de-217a8914c472 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 does not exist Aug 30 04:12:41.268910 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-14739364-96ef-494a-93c4-18d34ea8af3a'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:41.270124 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f497a010-83cd-44c5-81de-217a8914c472 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56" status: 404 len: 194 microversion: 2.1 time: 0.134472 Aug 30 04:12:41.270892 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 531/1094] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:41 2022] DELETE /compute/v2.1/os-security-groups/eb0ef0bb-1de8-44a7-9562-cc7b8a0a6e56 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:41.285079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51a19b23-c6df-4a09-9ba6-6ac6970145ff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a2eec10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.327302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:41.336290 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a63639e-941f-45e3-98d1-f56001ba46ea tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.350044 Aug 30 04:12:41.337122 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 564/1095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:40 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:41.348706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-51a19b23-c6df-4a09-9ba6-6ac6970145ff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:41.350170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-51a19b23-c6df-4a09-9ba6-6ac6970145ff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group fe8a267e-b132-412d-9862-3f078c3e2b2f not found {{(pid=122402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:41.350940 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-51a19b23-c6df-4a09-9ba6-6ac6970145ff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist Aug 30 04:12:41.350940 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-990a0e54-15a4-41ee-ab02-2cbb6fa581e3'] Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51a19b23-c6df-4a09-9ba6-6ac6970145ff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f HTTP/1.1 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-990a0e54-15a4-41ee-ab02-2cbb6fa581e3'] Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'fe8a267e-b132-412d-9862-3f078c3e2b2f'} Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:41.354184 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-990a0e54-15a4-41ee-ab02-2cbb6fa581e3'] Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-990a0e54-15a4-41ee-ab02-2cbb6fa581e3'] Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-990a0e54-15a4-41ee-ab02-2cbb6fa581e3'] Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-990a0e54-15a4-41ee-ab02-2cbb6fa581e3'] Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51a19b23-c6df-4a09-9ba6-6ac6970145ff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group fe8a267e-b132-412d-9862-3f078c3e2b2f does not exist Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-990a0e54-15a4-41ee-ab02-2cbb6fa581e3'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51a19b23-c6df-4a09-9ba6-6ac6970145ff tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f" status: 404 len: 194 microversion: 2.1 time: 0.080927 Aug 30 04:12:41.358585 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 532/1096] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:41 2022] DELETE /compute/v2.1/os-security-groups/fe8a267e-b132-412d-9862-3f078c3e2b2f => generated 194 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:12:41.373114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-188e8439-7fda-43d2-9eb9-b03735e4ba99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a36a1f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.463458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-188e8439-7fda-43d2-9eb9-b03735e4ba99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:41.464420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-188e8439-7fda-43d2-9eb9-b03735e4ba99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:41.465537 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-188e8439-7fda-43d2-9eb9-b03735e4ba99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:41.465537 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-a01954f2-481f-4283-9413-f86ad4665268'] Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-188e8439-7fda-43d2-9eb9-b03735e4ba99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e HTTP/1.1 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-a01954f2-481f-4283-9413-f86ad4665268'] Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5a6de78b-6601-42e8-a9cb-5c5cb44c680e'} Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:41.470151 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a01954f2-481f-4283-9413-f86ad4665268'] Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a01954f2-481f-4283-9413-f86ad4665268'] Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a01954f2-481f-4283-9413-f86ad4665268'] Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a01954f2-481f-4283-9413-f86ad4665268'] Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-188e8439-7fda-43d2-9eb9-b03735e4ba99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group 5a6de78b-6601-42e8-a9cb-5c5cb44c680e does not exist Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-a01954f2-481f-4283-9413-f86ad4665268'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:41.476014 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-188e8439-7fda-43d2-9eb9-b03735e4ba99 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e" status: 404 len: 194 microversion: 2.1 time: 0.103753 Aug 30 04:12:41.480918 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 565/1097] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:41 2022] DELETE /compute/v2.1/os-security-groups/5a6de78b-6601-42e8-a9cb-5c5cb44c680e => generated 194 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:41.491623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac74b7a1-a969-4068-b05d-ab46c9994121 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a33b430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.546735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-ac74b7a1-a969-4068-b05d-ab46c9994121 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:41.547876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-ac74b7a1-a969-4068-b05d-ab46c9994121 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group e0f484b5-2d71-444a-b1f6-efea903e301f not found {{(pid=122402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:41.548396 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ac74b7a1-a969-4068-b05d-ab46c9994121 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:41.548396 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-100f8f63-626c-49fd-9bea-324f75e56c8f'] Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac74b7a1-a969-4068-b05d-ab46c9994121 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f HTTP/1.1 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-100f8f63-626c-49fd-9bea-324f75e56c8f'] Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e0f484b5-2d71-444a-b1f6-efea903e301f'} Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:41.553156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-100f8f63-626c-49fd-9bea-324f75e56c8f'] Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-100f8f63-626c-49fd-9bea-324f75e56c8f'] Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-100f8f63-626c-49fd-9bea-324f75e56c8f'] Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-100f8f63-626c-49fd-9bea-324f75e56c8f'] Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac74b7a1-a969-4068-b05d-ab46c9994121 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group e0f484b5-2d71-444a-b1f6-efea903e301f does not exist Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-100f8f63-626c-49fd-9bea-324f75e56c8f'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:41.557371 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac74b7a1-a969-4068-b05d-ab46c9994121 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f" status: 404 len: 194 microversion: 2.1 time: 0.073179 Aug 30 04:12:41.565631 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 533/1098] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:41 2022] DELETE /compute/v2.1/os-security-groups/e0f484b5-2d71-444a-b1f6-efea903e301f => generated 194 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:41.568884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe366f5b-6b63-43e1-969d-1403c98618df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a3bcd30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.604318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-fe366f5b-6b63-43e1-969d-1403c98618df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:41.605175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-fe366f5b-6b63-43e1-969d-1403c98618df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:41.606099 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-fe366f5b-6b63-43e1-969d-1403c98618df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:41.606099 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-82fcd7e1-4587-4047-9bc4-d4f80dc4f118'] Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe366f5b-6b63-43e1-969d-1403c98618df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6 HTTP/1.1 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-82fcd7e1-4587-4047-9bc4-d4f80dc4f118'] Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '6854ac49-6ad4-41e3-94fe-80743ce23ba6'} Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:41.610731 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82fcd7e1-4587-4047-9bc4-d4f80dc4f118'] Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82fcd7e1-4587-4047-9bc4-d4f80dc4f118'] Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82fcd7e1-4587-4047-9bc4-d4f80dc4f118'] Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-82fcd7e1-4587-4047-9bc4-d4f80dc4f118'] Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe366f5b-6b63-43e1-969d-1403c98618df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group 6854ac49-6ad4-41e3-94fe-80743ce23ba6 does not exist Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-82fcd7e1-4587-4047-9bc4-d4f80dc4f118'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:41.615670 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fe366f5b-6b63-43e1-969d-1403c98618df tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6" status: 404 len: 194 microversion: 2.1 time: 0.047357 Aug 30 04:12:41.618724 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 566/1099] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:41 2022] DELETE /compute/v2.1/os-security-groups/6854ac49-6ad4-41e3-94fe-80743ce23ba6 => generated 194 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:12:41.626309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5bc86683-a9a0-4f35-947e-3b8465c083be tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a33bee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.682458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-5bc86683-a9a0-4f35-947e-3b8465c083be tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:12:41.683259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-5bc86683-a9a0-4f35-947e-3b8465c083be tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Neutron security group 36269f5f-c7db-4640-8138-2104513fb1ea not found {{(pid=122402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:12:41.683947 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-5bc86683-a9a0-4f35-947e-3b8465c083be tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:41.683947 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-e56ec4ba-6ed2-4737-bced-67deb0c7435d'] Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5bc86683-a9a0-4f35-947e-3b8465c083be tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea HTTP/1.1 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-e56ec4ba-6ed2-4737-bced-67deb0c7435d'] Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '36269f5f-c7db-4640-8138-2104513fb1ea'} Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:12:41.686231 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e56ec4ba-6ed2-4737-bced-67deb0c7435d'] Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e56ec4ba-6ed2-4737-bced-67deb0c7435d'] Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e56ec4ba-6ed2-4737-bced-67deb0c7435d'] Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e56ec4ba-6ed2-4737-bced-67deb0c7435d'] Aug 30 04:12:41.690700 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:41.694203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5bc86683-a9a0-4f35-947e-3b8465c083be tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Security group 36269f5f-c7db-4640-8138-2104513fb1ea does not exist Aug 30 04:12:41.694203 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-e56ec4ba-6ed2-4737-bced-67deb0c7435d'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:41.695317 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5bc86683-a9a0-4f35-947e-3b8465c083be tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea" status: 404 len: 194 microversion: 2.1 time: 0.075436 Aug 30 04:12:41.696041 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 534/1100] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:41 2022] DELETE /compute/v2.1/os-security-groups/36269f5f-c7db-4640-8138-2104513fb1ea => generated 194 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:41.704772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.705269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:41.741354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:41.741858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.746642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:41.747381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:41.747855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.748951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:41.812176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:12:41.949493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:41.950443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:41.973481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:41.977944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.978648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:41.983376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:41.984167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:41.984841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.015209 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23614c06-2826-456d-8635-491b7e149082 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 204 len: 0 microversion: 2.1 time: 0.313814 Aug 30 04:12:42.015926 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 567/1101] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:41 2022] DELETE /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:12:42.024601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9af3ed2b-4d29-4318-b66f-dc6f962d56b0 req-ea2c9efa-9209-4c87-aa5e-7316eac62d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9de95010-d595-4176-bae5-71fefb910fe7", "tag": "9a1ad777-3930-4162-ad15-7a3eecf20329"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:42.049035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9af3ed2b-4d29-4318-b66f-dc6f962d56b0 req-ea2c9efa-9209-4c87-aa5e-7316eac62d78 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.049919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9af3ed2b-4d29-4318-b66f-dc6f962d56b0 req-ea2c9efa-9209-4c87-aa5e-7316eac62d78 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.052769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9af3ed2b-4d29-4318-b66f-dc6f962d56b0 req-ea2c9efa-9209-4c87-aa5e-7316eac62d78 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.065801 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9af3ed2b-4d29-4318-b66f-dc6f962d56b0 req-ea2c9efa-9209-4c87-aa5e-7316eac62d78 service nova] Creating event network-changed:9a1ad777-3930-4162-ad15-7a3eecf20329 for instance 9de95010-d595-4176-bae5-71fefb910fe7 on n-h2-854925-5 Aug 30 04:12:42.071512 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9af3ed2b-4d29-4318-b66f-dc6f962d56b0 req-ea2c9efa-9209-4c87-aa5e-7316eac62d78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053904 Aug 30 04:12:42.072958 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 568/1102] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:42.079516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:42.080534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:42.088648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.089382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.090144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.093716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.094437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.095085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.336780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:42.346268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd176bcb-489a-4eb3-9efe-6a92354b2379 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1324 microversion: 2.1 time: 0.400936 Aug 30 04:12:42.347166 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 535/1103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:41 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:42.365811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:42.367193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:42.375487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.376903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.377590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.378541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.379280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.379945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.573131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:42.586099 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6363c24-fc96-4940-b909-821a561bffd9 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1645 microversion: 2.1 time: 0.511686 Aug 30 04:12:42.587058 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 569/1104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:42 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1645 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:42.609957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:42.610815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:42.619324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.620083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.620674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.621578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:42.622183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:42.622879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:42.754902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:42.770714 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eeca2868-f073-44c1-bd6c-35425de9ccd9 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.408631 Aug 30 04:12:42.771629 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 536/1105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:42 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:42.876005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:42.884015 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1eccf501-8ad5-4733-8339-7e66c4f5e29d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.278621 Aug 30 04:12:42.897295 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 570/1106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:42 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:43.367334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:43.368719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:43.375503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.376283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.376939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.377925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.378591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.379267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.538697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:43.547860 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5023b99-b2eb-41d9-a39a-029cac76eca3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1324 microversion: 2.1 time: 0.184267 Aug 30 04:12:43.548470 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 537/1107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:43 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1324 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:43.607279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:43.608677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:43.618100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.618826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.619426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.620365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.621147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.621758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.792382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:43.793007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:43.805166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.806494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.810498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.812052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.813923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.814587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.854062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:43.863189 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-058c9c97-232d-410c-a883-48736e5297fe tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1645 microversion: 2.1 time: 0.259462 Aug 30 04:12:43.864720 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 571/1108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:43 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1645 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:43.904163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:43.905319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:43.913218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.915168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.915824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:43.916571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:43.917193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:43.917739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:44.089645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:44.100197 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-520c19c2-a2f7-4858-acf0-fbdeec9f03e5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.311856 Aug 30 04:12:44.100797 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 538/1109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:43 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:44.225714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:44.234377 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99d64b5e-57b0-403c-af25-fb7121a5e550 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.334111 Aug 30 04:12:44.239924 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 572/1110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:43 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:44.572155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:44.573346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:44.581155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:44.581696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:44.582128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:44.589580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:44.589580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:44.589580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:44.877723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:44.885469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:44.887115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:44.896408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:44.897142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:44.897768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:44.898665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:44.899592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:44.900181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:44.907055 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19159b1a-67f5-4ad0-89bf-02291036b1bf tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1324 microversion: 2.1 time: 0.337951 Aug 30 04:12:44.908349 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 539/1111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:44 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1324 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:45.122587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.124467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:45.137770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:45.139759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:45.140518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:45.143049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:45.143677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:45.145946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:45.146639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:45.152503 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-15246f17-0a81-4c5c-968f-597cd27d5281 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1645 microversion: 2.1 time: 0.270820 Aug 30 04:12:45.153102 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 573/1112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:44 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1645 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:45.158110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-33124837-d2b2-4137-9892-776dfde5273e req-00502663-23df-4b86-b255-00fa5f472445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36e66e97-cc16-4abe-a475-ac63c384e8ad", "name": "network-vif-deleted", "tag": "80be55f6-b4e1-4f6b-a650-d5d75e877f8d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:45.173480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-33124837-d2b2-4137-9892-776dfde5273e req-00502663-23df-4b86-b255-00fa5f472445 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:45.174313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-33124837-d2b2-4137-9892-776dfde5273e req-00502663-23df-4b86-b255-00fa5f472445 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:45.175026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-33124837-d2b2-4137-9892-776dfde5273e req-00502663-23df-4b86-b255-00fa5f472445 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:45.227582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-33124837-d2b2-4137-9892-776dfde5273e req-00502663-23df-4b86-b255-00fa5f472445 service nova] Creating event network-vif-deleted:80be55f6-b4e1-4f6b-a650-d5d75e877f8d for instance 36e66e97-cc16-4abe-a475-ac63c384e8ad on n-h1-854925-5 Aug 30 04:12:45.241160 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-33124837-d2b2-4137-9892-776dfde5273e req-00502663-23df-4b86-b255-00fa5f472445 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086645 Aug 30 04:12:45.245941 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 574/1113] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:45.260972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.261729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:45.277051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:45.277607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:45.278056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:45.279496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:45.281947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:45.282303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:45.497955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.524241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:45.534460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.540569 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74999777-6aa9-452f-8fa9-5a0a42947268 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.423199 Aug 30 04:12:45.541186 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 540/1114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:45.566944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:45.576134 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a3ffbb33-3036-43af-9256-fe23d49339f8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.319387 Aug 30 04:12:45.577424 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 575/1115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:45.929133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:45.930913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:45.934432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:45.939693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:45.940417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:45.941072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:45.942117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:45.942755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:45.943526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.131218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:46.147540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cfd8f56f-6c7c-4fe2-be37-b38d955695a5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1324 microversion: 2.1 time: 0.222669 Aug 30 04:12:46.148533 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 541/1116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:45 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:46.177514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:46.178808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:46.187735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:46.188223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:46.188995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.189904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:46.190661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:46.191298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.196399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:46.251057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b7b7df00-d859-42a2-9b82-7f8d08885c83 req-55e9e5c8-1ec0-4ca9-ae56-23bb970d99d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de95010-d595-4176-bae5-71fefb910fe7", "name": "network-vif-plugged", "status": "completed", "tag": "9a1ad777-3930-4162-ad15-7a3eecf20329"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:46.261623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b7b7df00-d859-42a2-9b82-7f8d08885c83 req-55e9e5c8-1ec0-4ca9-ae56-23bb970d99d8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:46.262289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b7b7df00-d859-42a2-9b82-7f8d08885c83 req-55e9e5c8-1ec0-4ca9-ae56-23bb970d99d8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:46.262818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b7b7df00-d859-42a2-9b82-7f8d08885c83 req-55e9e5c8-1ec0-4ca9-ae56-23bb970d99d8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.279366 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b7b7df00-d859-42a2-9b82-7f8d08885c83 req-55e9e5c8-1ec0-4ca9-ae56-23bb970d99d8 service nova] Creating event network-vif-plugged:9a1ad777-3930-4162-ad15-7a3eecf20329 for instance 9de95010-d595-4176-bae5-71fefb910fe7 on n-h2-854925-5 Aug 30 04:12:46.288373 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b7b7df00-d859-42a2-9b82-7f8d08885c83 req-55e9e5c8-1ec0-4ca9-ae56-23bb970d99d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041492 Aug 30 04:12:46.289781 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 542/1117] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:46.315407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:46.328051 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6a297281-70d3-4e9d-a542-a209316df024 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1467 microversion: 2.1 time: 0.151964 Aug 30 04:12:46.331046 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 576/1118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:46 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1467 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:46.567084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:46.568681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:46.583497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:46.584358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:46.584805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.588353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:46.588353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:46.588353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.597534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:46.598457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:46.606002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:46.607569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:46.608792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.609923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:46.610613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:46.611427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:46.807113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:46.818561 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1ea22a7-8e33-426c-bbad-dd74b3f03413 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.225629 Aug 30 04:12:46.829411 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 577/1119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:46 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:46.851871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:46.860846 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed1795ac-5588-4c15-be25-cf7534f3d91e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.301857 Aug 30 04:12:46.874736 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 543/1120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:46 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:47.167762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.168436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:47.188690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.189302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.189753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.190465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.191243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.191368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.327807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:47.335749 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cadbe00c-e701-4b32-b356-2fb07a56434f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1324 microversion: 2.1 time: 0.171737 Aug 30 04:12:47.336466 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 578/1121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:47 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:47.350856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.351655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:47.358439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.358924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.359393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.360086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.360539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.361058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.391587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.392070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.392507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.392955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lazy-loading 'fault' on Instance uuid 36e66e97-cc16-4abe-a475-ac63c384e8ad {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:47.439031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:47.448576 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e0008e1-55e8-4185-af4c-150e2620953e tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1305 microversion: 2.1 time: 0.101003 Aug 30 04:12:47.449867 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 544/1122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:47 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:47.840542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.841161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:47.853588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.854085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.854528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.855257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.855711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.856136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.882461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:47.883379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:47.919411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.921518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.922924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:47.924714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:47.930803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:47.931592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.049828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:48.060518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1dcabd86-6d63-41ca-a9a3-c89496255132 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1542 microversion: 2.1 time: 0.223764 Aug 30 04:12:48.062475 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 579/1123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:47 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1542 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:48.160507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:48.168951 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-85ca27c2-82ec-469d-ad2b-f2166f79d56f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.290676 Aug 30 04:12:48.169552 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 545/1124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:47 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:48.356263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.356873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:48.364659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.365143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.365605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.366296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.366805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.367229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.471404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.472048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:48.479446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.479942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.480411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.481123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.481606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.482220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.515963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:48.524468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.524904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.525368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.525938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lazy-loading 'fault' on Instance uuid 36e66e97-cc16-4abe-a475-ac63c384e8ad {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:48.526431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d7a8a954-482c-48a6-8562-32c26713e6a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.174098 Aug 30 04:12:48.527358 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 580/1125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:48.549803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.549803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:48.555717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.556221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.556667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.557395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.557858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.558325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.569679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f14c4b1487b456586f06a011b459b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b389a23eb7413d9228460edde080a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:48.579346 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0326d3f7-78e9-4f47-890e-35794a02d5ce tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 200 len: 1305 microversion: 2.1 time: 0.112579 Aug 30 04:12:48.579933 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 546/1126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:48.729312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:48.742438 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bbe39ce7-859e-4275-b405-e7442665ad52 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.198691 Aug 30 04:12:48.757372 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 581/1127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:48.762632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b960c633-3370-4ea3-827c-faf7c3ee7de9 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-778320889", "metadata": {"": ""}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b960c633-3370-4ea3-827c-faf7c3ee7de9 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action HTTP/1.1 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 106 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-778320889", "metadata": {"": ""}}} Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9de95010-d595-4176-bae5-71fefb910fe7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-778320889', 'metadata': {'': ''}}}} Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'': ''} Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:48.767329 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b960c633-3370-4ea3-827c-faf7c3ee7de9 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:48.771608 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b960c633-3370-4ea3-827c-faf7c3ee7de9 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action" status: 400 len: 170 microversion: 2.1 time: 0.010298 Aug 30 04:12:48.772787 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 582/1128] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Aug 30 04:12:48 2022] POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action => generated 170 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:12:48.777159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:48.777691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:48.789112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.790431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.790976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:48.791878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:48.792553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:48.793273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.027030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:49.037365 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfd34e4a-1640-42d8-ad25-105a45b6a4f7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.263865 Aug 30 04:12:49.038929 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 583/1129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:48 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:49.066170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.066798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.079468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.082985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.083693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.084628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7b6228c7-81ea-4d31-81fb-b38419c84d1f"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:49.086164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.087633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.089890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.090386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.095712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.096201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.096809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.097599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.098208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.098813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.272479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:49.283261 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f6ef7cb-2cad-4193-86a8-cf32d5bec9d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.222113 Aug 30 04:12:49.284403 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 584/1130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:49 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:49.293229 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] HTTP exception thrown: Volume 7b6228c7-81ea-4d31-81fb-b38419c84d1f could not be found. Aug 30 04:12:49.302075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b340ae92-88b6-4490-9049-d25ada465918 req-4c26f6c0-41a7-4df3-a6ba-c4631181bc3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c70b4a-4c6a-4137-a2c3-a02b16b5a369", "name": "network-vif-unplugged", "status": "completed", "tag": "acbaf2e5-9af3-4cbd-b7cc-9d2045334073"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:49.312097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b340ae92-88b6-4490-9049-d25ada465918 req-4c26f6c0-41a7-4df3-a6ba-c4631181bc3f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.312579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b340ae92-88b6-4490-9049-d25ada465918 req-4c26f6c0-41a7-4df3-a6ba-c4631181bc3f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.313015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b340ae92-88b6-4490-9049-d25ada465918 req-4c26f6c0-41a7-4df3-a6ba-c4631181bc3f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.325246 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b340ae92-88b6-4490-9049-d25ada465918 req-4c26f6c0-41a7-4df3-a6ba-c4631181bc3f service nova] Creating event network-vif-unplugged:acbaf2e5-9af3-4cbd-b7cc-9d2045334073 for instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 on n-h1-854925-5 Aug 30 04:12:49.333134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-b340ae92-88b6-4490-9049-d25ada465918 req-4c26f6c0-41a7-4df3-a6ba-c4631181bc3f service nova] Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:12:49.339315 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b340ae92-88b6-4490-9049-d25ada465918 req-4c26f6c0-41a7-4df3-a6ba-c4631181bc3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052999 Aug 30 04:12:49.339914 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 585/1131] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Request method failure captured: Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments/b548fda2-d8f4-4d9f-97db-c0ac73e4fd5d HTTP/1.1 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 74 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY20XUK5fjUny_mKXM0cDjOLQBLBdi17QY4gZV9TMCmIwSGSmoyef7r5E1KoTdOcmX4rzoAAGtX4jAEcAsYAZuusmjo0ETcz_GL-AncZa5YVOHw7-7af899eHX8kQLZRGp4SK98cnepIyxp35-8XRdTYzogOAinZAWMHpWYTRADSEl8 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 77b686cae6954628a0f0eb980e50a84d Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesAdminNegativeTest-796627120 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b686cae6954628a0f0eb980e50a84d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b686cae6954628a0f0eb980e50a84d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b686cae6954628a0f0eb980e50a84d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b686cae6954628a0f0eb980e50a84d"}]}] Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesAdminNegativeTest-796627120 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 77b686cae6954628a0f0eb980e50a84d Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-796627120 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesAdminNegativeTest-796627120-project-admin Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 28987d65849f42ac85bf2c638c149ab9 Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesAdminNegativeTest-796627120-project-admin Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: {"volumeAttachment": {"volumeId": "7b6228c7-81ea-4d31-81fb-b38419c84d1f"}} Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: exception: Volume 7b6228c7-81ea-4d31-81fb-b38419c84d1f could not be found. Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '5a7e450c-101b-43a5-96ef-e8e35901e3b2', 'id': 'b548fda2-d8f4-4d9f-97db-c0ac73e4fd5d', 'body': {'volumeAttachment': {'volumeId': '7b6228c7-81ea-4d31-81fb-b38419c84d1f'}}} Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b6228c7-81ea-4d31-81fb-b38419c84d1f could not be found. (HTTP 404) (Request-ID: req-00d1ebf8-4dba-4a0c-9997-0db6a32a31a3) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:12:49.342170 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b6228c7-81ea-4d31-81fb-b38419c84d1f could not be found. Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7b6228c7-81ea-4d31-81fb-b38419c84d1f could not be found. Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b6228c7-81ea-4d31-81fb-b38419c84d1f could not be found. Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.347778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Returning 400 to user: Volume 7b6228c7-81ea-4d31-81fb-b38419c84d1f could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:49.355431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.355431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.355891 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a8af2a7-3dbc-49bc-bd34-555f4775bf4a tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments/b548fda2-d8f4-4d9f-97db-c0ac73e4fd5d" status: 400 len: 107 microversion: 2.1 time: 0.607091 Aug 30 04:12:49.355891 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 547/1132] 10.222.0.27 () {60 vars in 1433 bytes} [Tue Aug 30 04:12:48 2022] PUT /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments/b548fda2-d8f4-4d9f-97db-c0ac73e4fd5d => generated 107 bytes in 609 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:12:49.355891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.355891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.358811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.358811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.358811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.360213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.360213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.360520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.364175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.364175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.364175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.364570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.364973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.365686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.560532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:49.568371 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e8892fa-0430-4a55-b1f3-7518d014ac74 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1541 microversion: 2.1 time: 0.227074 Aug 30 04:12:49.569002 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 586/1133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:49 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1541 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:49.573232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:49.575077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-993e1d82-3988-4a78-9d35-2483722f5dc5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-511970431", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-993e1d82-3988-4a78-9d35-2483722f5dc5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action HTTP/1.1 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 618 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-511970431", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9de95010-d595-4176-bae5-71fefb910fe7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-511970431', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:12:49.580307 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:12:49.586654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.589631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-993e1d82-3988-4a78-9d35-2483722f5dc5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:49.589631 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-993e1d82-3988-4a78-9d35-2483722f5dc5 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action" status: 400 len: 938 microversion: 2.1 time: 0.011176 Aug 30 04:12:49.589631 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 587/1134] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Aug 30 04:12:49 2022] POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action => generated 938 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:12:49.593205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5e0f6d95-c116-4e5e-bf5f-8e224a546cf8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.243928 Aug 30 04:12:49.593854 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 548/1135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:49 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:49.598686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.599330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.605157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.605688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.606127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.606819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.607274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.607731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.729756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lazy-loading 'services' on Instance uuid 5a7e450c-101b-43a5-96ef-e8e35901e3b2 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:12:49.758530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea29e021-71c2-4f39-9f57-ff87277af230 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2134981674", "id": 1998395720, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:49.773145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:49.778284 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea29e021-71c2-4f39-9f57-ff87277af230 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.194765 Aug 30 04:12:49.778856 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 588/1136] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:49 2022] POST /compute/v2.1/flavors => generated 439 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:49.791816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.792428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.799969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.800773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.801544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.802453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.803102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.803707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.844653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff043e37-7398-467c-b171-9d627e6ba70a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments/b548fda2-d8f4-4d9f-97db-c0ac73e4fd5d" status: 202 len: 0 microversion: 2.1 time: 0.249531 Aug 30 04:12:49.845294 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 549/1137] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:12:49 2022] DELETE /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments/b548fda2-d8f4-4d9f-97db-c0ac73e4fd5d => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:49.850226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.850917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] [instance: 36e66e97-cc16-4abe-a475-ac63c384e8ad] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.857596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.858162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.858596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.859296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.859742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.860160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.874647 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] HTTP exception thrown: Instance 36e66e97-cc16-4abe-a475-ac63c384e8ad could not be found. Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Request method failure captured: Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad HTTP/1.1 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY3xUFYRvoJwFxlUuHpaaZe3a0S5Vq59r893UXYc4tG_Io4H3Ow0PmBWAg2t6oAdvfr6ZIDOapiFQuy_tLh3HIrfN93jdaTb7a_ApH7_wLwYHS1qun8gE6-utFNF_rfi0gzWYWep1C-ILLDk6PoKSwt9MuPruWM4tDn1-XMmOfjaC6s Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_24b389a23eb7413d9228460edde080a6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/24b389a23eb7413d9228460edde080a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/24b389a23eb7413d9228460edde080a6"}]}] Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 24b389a23eb7413d9228460edde080a6 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1879338796 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0f14c4b1487b456586f06a011b459b38 Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsTestJSON-1879338796-project Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 36e66e97-cc16-4abe-a475-ac63c384e8ad could not be found. Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '36e66e97-cc16-4abe-a475-ac63c384e8ad'} Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36e66e97-cc16-4abe-a475-ac63c384e8ad could not be found. Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36e66e97-cc16-4abe-a475-ac63c384e8ad could not be found. Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:49.876338 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36e66e97-cc16-4abe-a475-ac63c384e8ad could not be found. Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Returning 404 to user: Instance 36e66e97-cc16-4abe-a475-ac63c384e8ad could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25909d69-2edf-4c69-823e-97ceac67f34a tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad" status: 404 len: 111 microversion: 2.1 time: 0.031327 Aug 30 04:12:49.880627 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 550/1138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:49 2022] GET /compute/v2.1/servers/36e66e97-cc16-4abe-a475-ac63c384e8ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:49.882899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4852389a-14ac-4770-85fe-8d8a48cb5014 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:49.953097 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4852389a-14ac-4770-85fe-8d8a48cb5014 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1998395720/action" status: 200 len: 97 microversion: 2.1 time: 0.073471 Aug 30 04:12:49.953627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:49.953972 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 551/1139] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Aug 30 04:12:49 2022] POST /compute/v2.1/flavors/1998395720/action => generated 97 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:12:49.961829 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab423642-7a4e-4ea5-8e0a-cbd22902048a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.174401 Aug 30 04:12:49.962401 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 589/1140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:49 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:49.966884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f55eb58a-5947-419d-9715-874e24484b6d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a2ee700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.968256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:49.970400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:49.978119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.978602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.979035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:49.979732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:49.980178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:49.980602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.012454 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-379613ef-a670-4aa0-a350-c2c3bfed826e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057121 Aug 30 04:12:50.013038 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 552/1141] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:49 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:50.019520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d006ec7-f0c7-4830-8a4b-a5aae023a918 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:50.084580 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7d006ec7-f0c7-4830-8a4b-a5aae023a918 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 4c9f483a82a44a9daf71387259d4daf9 combination. Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d006ec7-f0c7-4830-8a4b-a5aae023a918 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Request method failure captured: Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/flavors/1998395720/action HTTP/1.1 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 67 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY5AqWAfAWGt-83QAeUpbXhRGWy9IDNl3UYlWtMn9Shg598-fy0wJut4Cu8mjJI_IM5OD0BjKHvvTuQ7dF7n-Q6f7vCdX1MwukM8zUEVHgY_n9DWRLY9UMVrRSbPfewY_lYH_YIZyHGeNwPHZxQL2zxOf2dXJYf-vv_QiPjogP30h_w Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 56937ac22cad481599d7c9383779b409 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56937ac22cad481599d7c9383779b409", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56937ac22cad481599d7c9383779b409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56937ac22cad481599d7c9383779b409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56937ac22cad481599d7c9383779b409"}]}] Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 56937ac22cad481599d7c9383779b409 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 361fb88c88714ac5a1fdeb2f39579256 Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: {"addTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: exception: Flavor access already exists for flavor 36 and project 4c9f483a82a44a9daf71387259d4daf9 combination. Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1998395720', 'body': {'addTenantAccess': {'tenant': '4c9f483a82a44a9daf71387259d4daf9'}}} Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result.read() Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-4c9f483a82a44a9daf71387259d4daf9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.094853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi session.flush() Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result.read() Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 04:12:50.099425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-4c9f483a82a44a9daf71387259d4daf9' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 30, 4, 12, 50, 80225), 'updated_at': None, 'flavor_id': 36, 'project_id': '4c9f483a82a44a9daf71387259d4daf9'}] Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 4c9f483a82a44a9daf71387259d4daf9 combination. Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 4c9f483a82a44a9daf71387259d4daf9 combination. Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 4c9f483a82a44a9daf71387259d4daf9 combination. Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d006ec7-f0c7-4830-8a4b-a5aae023a918 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 4c9f483a82a44a9daf71387259d4daf9 combination. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:50.103768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d006ec7-f0c7-4830-8a4b-a5aae023a918 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1998395720/action" status: 409 len: 152 microversion: 2.1 time: 0.082411 Aug 30 04:12:50.109796 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 553/1142] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Aug 30 04:12:50 2022] POST /compute/v2.1/flavors/1998395720/action => generated 152 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:12:50.109796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:50.109796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:50.110441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.110950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.111397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.112166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.112623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.113053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.418265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:50.427492 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31b601f9-3529-41da-8094-90e77d4728ee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.329386 Aug 30 04:12:50.428087 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 554/1143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:50 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:50.432787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-caaf2105-3bce-469f-a3b2-365e81cc148c tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:50.492487 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f55eb58a-5947-419d-9715-874e24484b6d tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/091c85f6-7b42-4207-baca-d51ec83f1b8b" status: 202 len: 0 microversion: 2.1 time: 0.529039 Aug 30 04:12:50.493275 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 590/1144] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:49 2022] DELETE /compute/v2.1/os-security-groups/091c85f6-7b42-4207-baca-d51ec83f1b8b => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:50.504675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f764abed-0dc7-4469-b11e-7bdceb36e940 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f764abed-0dc7-4469-b11e-7bdceb36e940 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action HTTP/1.1 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 285 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9de95010-d595-4176-bae5-71fefb910fe7', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:50.508727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:12:50.512455 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:50.514613 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-caaf2105-3bce-469f-a3b2-365e81cc148c tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1998395720/action" status: 200 len: 21 microversion: 2.1 time: 0.081014 Aug 30 04:12:50.514613 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 555/1145] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Aug 30 04:12:50 2022] POST /compute/v2.1/flavors/1998395720/action => generated 21 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:12:50.516526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4835d53d-56c1-4e06-b6d1-0ac136bca110 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] Calling method '.version_select at 0x7fe96a368040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:50.521071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f764abed-0dc7-4469-b11e-7bdceb36e940 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:50.527334 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f764abed-0dc7-4469-b11e-7bdceb36e940 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action" status: 400 len: 619 microversion: 2.1 time: 0.027060 Aug 30 04:12:50.528022 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 591/1146] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Aug 30 04:12:50 2022] POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:12:50.536835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4ed09c0-675e-42b8-ba2c-2e521164a9fe tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:50.557702 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4ed09c0-675e-42b8-ba2c-2e521164a9fe tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1998395720" status: 202 len: 0 microversion: 2.1 time: 0.028168 Aug 30 04:12:50.558414 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 592/1147] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:12:50 2022] DELETE /compute/v2.1/flavors/1998395720 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:50.563741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:50.564383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:50.570406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.570833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.571276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.571980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.572648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.573171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.766383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:50.774428 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51095753-7857-4df5-9a18-aab8736cb44f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.215153 Aug 30 04:12:50.785957 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 593/1148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:50 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:50.786072 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4835d53d-56c1-4e06-b6d1-0ac136bca110 tempest-SecurityGroupsTestJSON-1879338796 tempest-SecurityGroupsTestJSON-1879338796-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/a3755480-c984-42ab-ba40-93b9021cb0fa" status: 202 len: 0 microversion: 2.1 time: 0.265043 Aug 30 04:12:50.786072 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 556/1149] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:12:50 2022] DELETE /compute/v2.1/os-security-groups/a3755480-c984-42ab-ba40-93b9021cb0fa => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:50.786595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ded6c685-89f6-4774-8f4d-9b844f78ad16 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:50.786692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:50.786692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:50.792676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.792676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.792676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.792676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.793287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.793965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.802928 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ded6c685-89f6-4774-8f4d-9b844f78ad16 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026533 Aug 30 04:12:50.803530 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 594/1150] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:50.816663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:50.816663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:50.816663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.816663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.816663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:50.816663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:50.817155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:50.817257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.127390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:51.134938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:51.135333 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb0df9a7-cc08-45d8-bd54-703738a79886 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1473 microversion: 2.1 time: 0.356428 Aug 30 04:12:51.135911 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 557/1151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:50 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1473 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:51.141077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.141718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:51.144370 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-49c3fa3a-8d23-4ef5-b0b0-c73c96f5144f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.339811 Aug 30 04:12:51.144948 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 595/1152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:50 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:51.147916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.148387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.148821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.149540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.150165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.150622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc8246f6-a5fd-47c7-b748-b20f492942d5 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1738176698", "id": 815399173, "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.150931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.172484 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc8246f6-a5fd-47c7-b748-b20f492942d5 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.026275 Aug 30 04:12:51.173125 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 596/1153] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors => generated 435 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:51.178056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.180183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:51.186798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.187284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.187725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.188418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.188872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.189296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.220993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b15e35dd-e98a-44f5-adba-0c7020b16ec7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046613 Aug 30 04:12:51.225389 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 597/1154] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:51.225867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6a8b5e2-ccc1-4ae5-a781-ce04c830504e tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.232891 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a6a8b5e2-ccc1-4ae5-a781-ce04c830504e tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6a8b5e2-ccc1-4ae5-a781-ce04c830504e tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Request method failure captured: Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/flavors/815399173/os-flavor-access HTTP/1.1 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY5AqWAfAWGt-83QAeUpbXhRGWy9IDNl3UYlWtMn9Shg598-fy0wJut4Cu8mjJI_IM5OD0BjKHvvTuQ7dF7n-Q6f7vCdX1MwukM8zUEVHgY_n9DWRLY9UMVrRSbPfewY_lYH_YIZyHGeNwPHZxQL2zxOf2dXJYf-vv_QiPjogP30h_w Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 56937ac22cad481599d7c9383779b409 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56937ac22cad481599d7c9383779b409", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56937ac22cad481599d7c9383779b409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56937ac22cad481599d7c9383779b409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56937ac22cad481599d7c9383779b409"}]}] Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 56937ac22cad481599d7c9383779b409 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 361fb88c88714ac5a1fdeb2f39579256 Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: exception: Access list not available for public flavors. Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'flavor_id': '815399173'} Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 30 04:12:51.234466 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.238248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6a8b5e2-ccc1-4ae5-a781-ce04c830504e tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:51.238248 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a6a8b5e2-ccc1-4ae5-a781-ce04c830504e tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/815399173/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.013317 Aug 30 04:12:51.238248 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 598/1155] 10.222.0.27 () {58 vars in 1206 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1/flavors/815399173/os-flavor-access => generated 91 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:12:51.244921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da907c88-cc5a-4b1e-b5f7-891fe68188fe tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.261664 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da907c88-cc5a-4b1e-b5f7-891fe68188fe tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/815399173" status: 202 len: 0 microversion: 2.1 time: 0.020788 Aug 30 04:12:51.262236 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 599/1156] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:12:51 2022] DELETE /compute/v2.1/flavors/815399173 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:51.270266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-93d36856-2d40-4d5a-9ea0-02a9fbf79ba6 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.302848 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-93d36856-2d40-4d5a-9ea0-02a9fbf79ba6 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035890 Aug 30 04:12:51.303565 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 600/1157] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:51.321751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-34434cf3-2d63-4d82-b7dd-d173a013588f tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1206685431", "id": 1587827586, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.339831 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-34434cf3-2d63-4d82-b7dd-d173a013588f tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.021625 Aug 30 04:12:51.340416 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 601/1158] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors => generated 439 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:51.368253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:51.378287 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-befdd11a-caee-4a26-96e6-9f4b3d1646f0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.241119 Aug 30 04:12:51.378881 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 558/1159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:51.398574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1374796559"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.400924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:51.406868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.407358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.407799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.408504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.408971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.409421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.458159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33265df7-34cc-4413-8865-388818e821e3 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.461433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33265df7-34cc-4413-8865-388818e821e3 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ba26d8b894e44f53882d88a876b3bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9f483a82a44a9daf71387259d4daf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33265df7-34cc-4413-8865-388818e821e3 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Request method failure captured: Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/flavors/1587827586/action HTTP/1.1 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 67 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4_xB_lSoYoM4c_9AujcNO0p7xexbjp-frTmk9EBgE08F9S_8VFNGDmh-Z5LW7XzbJTX6R9CuQftYdqjLFy3NdjcRddvGkFoWIHn1_h4wstNOPSw3ub4_3tpydmfGTqWf2cMZfIhUjp6jskleuR4pa_Bwml7q7EVwG6PlflLgRvB3U Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4c9f483a82a44a9daf71387259d4daf9 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1359712594 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4c9f483a82a44a9daf71387259d4daf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4c9f483a82a44a9daf71387259d4daf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9f483a82a44a9daf71387259d4daf9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9f483a82a44a9daf71387259d4daf9"}]}] Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1359712594 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4c9f483a82a44a9daf71387259d4daf9 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1359712594 Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsAccessNegativeTestJSON-1359712594-project Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ba26d8b894e44f53882d88a876b3bb4c Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1359712594-project Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: {"addTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1587827586', 'body': {'addTenantAccess': {'tenant': '4c9f483a82a44a9daf71387259d4daf9'}}} Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:12:51.463019 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33265df7-34cc-4413-8865-388818e821e3 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33265df7-34cc-4413-8865-388818e821e3 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] 10.222.0.27 "POST /compute/v2.1/flavors/1587827586/action" status: 403 len: 130 microversion: 2.1 time: 0.116226 Aug 30 04:12:51.467970 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 602/1160] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors/1587827586/action => generated 130 bytes in 117 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:12:51.474275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33d4adf5-5468-4061-bc33-ce0279877dde tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.493345 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33d4adf5-5468-4061-bc33-ce0279877dde tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1587827586" status: 202 len: 0 microversion: 2.1 time: 0.023403 Aug 30 04:12:51.494628 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 603/1161] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:12:51 2022] DELETE /compute/v2.1/flavors/1587827586 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:51.504081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28c18f14-f9f0-43f1-a68c-8085d71a4df6 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.524952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28c18f14-f9f0-43f1-a68c-8085d71a4df6 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024504 Aug 30 04:12:51.525561 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 604/1162] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:51.547626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86a0b5e6-0b9f-42aa-bcf2-a8a18ff519c8 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-145241860", "id": 660272033, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.570489 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86a0b5e6-0b9f-42aa-bcf2-a8a18ff519c8 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.026498 Aug 30 04:12:51.571151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 605/1163] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors => generated 435 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:51.583894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b3ae5fe6-d675-44f9-9358-89d11c16b9a7 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.639840 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-71898772-9b50-4467-85ee-86efc7b7b48b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action" status: 202 len: 0 microversion: 2.1 time: 0.244233 Aug 30 04:12:51.645478 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 559/1164] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 30 04:12:51.653043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1337027385"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.655978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:51.658793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:51.665890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.666396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.666836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.667540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.668001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.668426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.670542 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b3ae5fe6-d675-44f9-9358-89d11c16b9a7 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/660272033/action" status: 200 len: 96 microversion: 2.1 time: 0.090395 Aug 30 04:12:51.673722 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 606/1165] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors/660272033/action => generated 96 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:12:51.682207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b248500c-a07d-4777-ba6e-14b9a74b3819 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.686513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b248500c-a07d-4777-ba6e-14b9a74b3819 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'ba26d8b894e44f53882d88a876b3bb4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c9f483a82a44a9daf71387259d4daf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b248500c-a07d-4777-ba6e-14b9a74b3819 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Request method failure captured: Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/flavors/660272033/action HTTP/1.1 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 70 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4_xB_lSoYoM4c_9AujcNO0p7xexbjp-frTmk9EBgE08F9S_8VFNGDmh-Z5LW7XzbJTX6R9CuQftYdqjLFy3NdjcRddvGkFoWIHn1_h4wstNOPSw3ub4_3tpydmfGTqWf2cMZfIhUjp6jskleuR4pa_Bwml7q7EVwG6PlflLgRvB3U Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4c9f483a82a44a9daf71387259d4daf9 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1359712594 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4c9f483a82a44a9daf71387259d4daf9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4c9f483a82a44a9daf71387259d4daf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9f483a82a44a9daf71387259d4daf9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4c9f483a82a44a9daf71387259d4daf9"}]}] Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1359712594 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4c9f483a82a44a9daf71387259d4daf9 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1359712594 Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsAccessNegativeTestJSON-1359712594-project Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ba26d8b894e44f53882d88a876b3bb4c Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1359712594-project Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: {"removeTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '660272033', 'body': {'removeTenantAccess': {'tenant': '4c9f483a82a44a9daf71387259d4daf9'}}} Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi context.can( Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 04:12:51.688617 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b248500c-a07d-4777-ba6e-14b9a74b3819 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b248500c-a07d-4777-ba6e-14b9a74b3819 tempest-FlavorsAccessNegativeTestJSON-1359712594 tempest-FlavorsAccessNegativeTestJSON-1359712594-project] 10.222.0.27 "POST /compute/v2.1/flavors/660272033/action" status: 403 len: 133 microversion: 2.1 time: 0.012385 Aug 30 04:12:51.693395 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 607/1166] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors/660272033/action => generated 133 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:51.698970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6a73a009-7d43-4241-a1ee-f1113053e663 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "4c9f483a82a44a9daf71387259d4daf9"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.709129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:51.726840 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Cannot 'createImage' instance 9de95010-d595-4176-bae5-71fefb910fe7 while it is in task_state image_snapshot_pending Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action HTTP/1.1 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 85 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1337027385"}} Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: exception: Cannot 'createImage' instance 9de95010-d595-4176-bae5-71fefb910fe7 while it is in task_state image_snapshot_pending Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9de95010-d595-4176-bae5-71fefb910fe7', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1337027385'}}} Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9de95010-d595-4176-bae5-71fefb910fe7 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:12:51.731587 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 9de95010-d595-4176-bae5-71fefb910fe7 while it is in task_state image_snapshot_pending Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 9de95010-d595-4176-bae5-71fefb910fe7 while it is in task_state image_snapshot_pending Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 409 to user: Cannot 'createImage' instance 9de95010-d595-4176-bae5-71fefb910fe7 while it is in task_state image_snapshot_pending {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f317c0dd-6056-4678-a39c-abb4203995b3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action" status: 409 len: 167 microversion: 2.1 time: 0.086566 Aug 30 04:12:51.741808 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 560/1167] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7/action => generated 167 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:12:51.746919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1d272da1-e77f-40d2-8745-48ec5cdb1117 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '.version_select at 0x7fe96a2533a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.782660 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6a73a009-7d43-4241-a1ee-f1113053e663 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/660272033/action" status: 200 len: 21 microversion: 2.1 time: 0.087430 Aug 30 04:12:51.783471 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 608/1168] 10.222.0.27 () {60 vars in 1197 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors/660272033/action => generated 21 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:12:51.793946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0e654dd-cea3-40f2-bfd3-383fdb60264f tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.822764 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0e654dd-cea3-40f2-bfd3-383fdb60264f tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/660272033" status: 202 len: 0 microversion: 2.1 time: 0.032203 Aug 30 04:12:51.823782 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 609/1169] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:12:51 2022] DELETE /compute/v2.1/flavors/660272033 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:12:51.834349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-352602bb-fe2c-4290-b0c2-f49928d464cc tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.859041 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-352602bb-fe2c-4290-b0c2-f49928d464cc tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030358 Aug 30 04:12:51.861371 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 610/1170] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:51.881501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6aed5650-7150-47f2-bbe4-0182402c2b04 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-777590149", "id": 1278511715, "os-flavor-access:is_public": "False"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.891991 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1d272da1-e77f-40d2-8745-48ec5cdb1117 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/images/568c1fe4-7125-43f7-bf89-71d87473a0d1" status: 204 len: 0 microversion: 2.1 time: 0.151945 Aug 30 04:12:51.893018 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 561/1171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:51 2022] DELETE /compute/v2.1/images/568c1fe4-7125-43f7-bf89-71d87473a0d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:12:51.903120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:51.903835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:51.911082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.911566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.912015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.912730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:51.913196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:51.913664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:51.918875 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6aed5650-7150-47f2-bbe4-0182402c2b04 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.043143 Aug 30 04:12:51.919569 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 611/1172] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors => generated 438 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:51.932021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2aeaec99-0e05-4b32-8ee7-ea598dce8c87 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "54183397a6e74fa28d28b826f648b572"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:51.994935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-2aeaec99-0e05-4b32-8ee7-ea598dce8c87 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] HTTP exception thrown: Flavor access not found for 40 / 54183397a6e74fa28d28b826f648b572 combination. Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2aeaec99-0e05-4b32-8ee7-ea598dce8c87 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Request method failure captured: Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/flavors/1278511715/action HTTP/1.1 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 70 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY5AqWAfAWGt-83QAeUpbXhRGWy9IDNl3UYlWtMn9Shg598-fy0wJut4Cu8mjJI_IM5OD0BjKHvvTuQ7dF7n-Q6f7vCdX1MwukM8zUEVHgY_n9DWRLY9UMVrRSbPfewY_lYH_YIZyHGeNwPHZxQL2zxOf2dXJYf-vv_QiPjogP30h_w Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 56937ac22cad481599d7c9383779b409 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_56937ac22cad481599d7c9383779b409", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/56937ac22cad481599d7c9383779b409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56937ac22cad481599d7c9383779b409"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/56937ac22cad481599d7c9383779b409"}]}] Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 56937ac22cad481599d7c9383779b409 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 361fb88c88714ac5a1fdeb2f39579256 Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: {"removeTenantAccess": {"tenant": "54183397a6e74fa28d28b826f648b572"}} Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor access not found for 40 / 54183397a6e74fa28d28b826f648b572 combination. Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1278511715', 'body': {'removeTenantAccess': {'tenant': '54183397a6e74fa28d28b826f648b572'}}} Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / 54183397a6e74fa28d28b826f648b572 combination. Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:12:51.996629 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / 54183397a6e74fa28d28b826f648b572 combination. Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / 54183397a6e74fa28d28b826f648b572 combination. Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2aeaec99-0e05-4b32-8ee7-ea598dce8c87 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Returning 404 to user: Flavor access not found for 40 / 54183397a6e74fa28d28b826f648b572 combination. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2aeaec99-0e05-4b32-8ee7-ea598dce8c87 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors/1278511715/action" status: 404 len: 124 microversion: 2.1 time: 0.069959 Aug 30 04:12:52.002107 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 612/1173] 10.222.0.27 () {60 vars in 1200 bytes} [Tue Aug 30 04:12:51 2022] POST /compute/v2.1/flavors/1278511715/action => generated 124 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:12:52.011842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eba5e2da-800e-4a01-a210-7ab41ce5219c tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:52.033437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eba5e2da-800e-4a01-a210-7ab41ce5219c tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1278511715" status: 202 len: 0 microversion: 2.1 time: 0.025121 Aug 30 04:12:52.034516 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 613/1174] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:12:52 2022] DELETE /compute/v2.1/flavors/1278511715 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:12:52.043141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72495577-02d1-4ba1-88e8-dec890f372f8 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:52.065383 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-72495577-02d1-4ba1-88e8-dec890f372f8 tempest-FlavorsAccessNegativeTestJSON-1484483731 tempest-FlavorsAccessNegativeTestJSON-1484483731-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025941 Aug 30 04:12:52.066336 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 614/1175] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:12:52 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:52.158970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:52.161524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:52.162198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:52.168511 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f1ddf12-6b02-4984-a7d2-62d740a6a396 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1533 microversion: 2.1 time: 0.270619 Aug 30 04:12:52.169199 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 562/1176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:51 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1533 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:52.171831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:52.172324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:52.172773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:52.175662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:52.176311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:52.176806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:52.190801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:52.191699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:52.200218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:52.200970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:52.201696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:52.202588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:52.203476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:52.204073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:52.535035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:52.539892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:52.555458 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c7be64a-af3e-448d-af19-1e12f8c6b422 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1473 microversion: 2.1 time: 0.398432 Aug 30 04:12:52.556044 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 615/1177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:52 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1473 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:52.559541 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4302a4c3-d737-4d02-a317-84b19e7aa903 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.375368 Aug 30 04:12:52.563676 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 563/1178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:52 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:52.590396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:52.593779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:52.601764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:52.602485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:52.603081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:52.603966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:52.604663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:52.605257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:52.645509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75f8eace-1887-4902-935c-46404b8f7766 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081768 Aug 30 04:12:52.646415 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 616/1179] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:52 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:53.191125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:53.192318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:53.199520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.200289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.200900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.202389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.203013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.203861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.427238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:53.445187 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-13a040aa-6963-46dd-a981-2258d9aaef3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1539 microversion: 2.1 time: 0.258649 Aug 30 04:12:53.447154 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 564/1180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:53 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1539 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:53.577644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:53.579149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:53.590597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.591467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.592100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.593111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.593716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:53.594087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.594514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:53.594851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.602302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.603058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.603911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.604947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:53.605906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:53.606551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:53.976678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:53.980407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:53.987098 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4c3863c-e8c2-4f9a-9c58-b49785a46f75 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1470 microversion: 2.1 time: 0.414630 Aug 30 04:12:53.988602 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 617/1181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:53 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1470 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:54.008219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:54.011803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:54.018787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25f91569-bc14-4864-b17d-f03ac6900bf1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.423845 Aug 30 04:12:54.024051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.024768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.025372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.026224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.026900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.033071 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 565/1182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:53 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:54.037792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.044547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:54.053979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:54.061735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:54.077711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.078215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.080584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.081381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.081853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.082282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.092252 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a2b75d2d-d4f7-48c0-8795-5394170ec4e9 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091517 Aug 30 04:12:54.093813 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 618/1183] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:53 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:54.148565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.149052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.149562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.150427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.151194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.151627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.188779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for project 7b1c9a3949b2461aaefac288f381241c. Resources: {'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:12:54.197577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for user 7ead040764484d059aa9a82f0714373f and project 7b1c9a3949b2461aaefac288f381241c. Resources: {'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:12:54.345530 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-025aaab6-94c6-4001-a8df-783e9e4952ef tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369/action" status: 202 len: 0 microversion: 2.1 time: 0.310568 Aug 30 04:12:54.347465 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 566/1184] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:12:54 2022] POST /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:12:54.355978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:54.356613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:54.363046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.363531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.364405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.366126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.366765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.367202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.475770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:54.481243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:54.492173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.492971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.493437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:54.494773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:54.495743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:54.496407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:55.050013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:55.066136 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f5ef6536-c345-4560-8d6d-214eb96996c1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1469 microversion: 2.1 time: 0.714870 Aug 30 04:12:55.077755 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 619/1185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:54 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1469 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:55.083807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:55.084784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:55.088263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=17,nova_api:INSERT=5 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:55.097646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:55.098507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:55.099234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:55.100974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:55.101684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:55.102346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:55.222845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:55.247106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de280518-d06e-47af-b521-0e9fe2363fce tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1539 microversion: 2.1 time: 0.781233 Aug 30 04:12:55.260975 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 567/1186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:54 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1539 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:55.266683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:55.269833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:55.276312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:55.277015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:55.277652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:55.278504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:55.279129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:55.280230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:55.332131 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3da2c47-a0fe-41e1-9fb2-4376e35704c2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069629 Aug 30 04:12:55.338429 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 568/1187] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:55 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:55.464081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:55.484839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d47306f1-afd4-402e-80c8-3dc062f12281 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.416830 Aug 30 04:12:55.485478 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 620/1188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:55 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:56.038675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-086f11f8-5e3a-4067-af42-8271569df77a req-b3e9cd3e-cd91-4f58-8ccc-42994608a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a98f78-a3b5-45ac-b93b-72c766284dbd", "name": "network-vif-unplugged", "status": "completed", "tag": "b4cc38e1-ad5b-4717-b289-318c740668e6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:56.058467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-086f11f8-5e3a-4067-af42-8271569df77a req-b3e9cd3e-cd91-4f58-8ccc-42994608a4cc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.059985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-086f11f8-5e3a-4067-af42-8271569df77a req-b3e9cd3e-cd91-4f58-8ccc-42994608a4cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.062264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-086f11f8-5e3a-4067-af42-8271569df77a req-b3e9cd3e-cd91-4f58-8ccc-42994608a4cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.090186 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-086f11f8-5e3a-4067-af42-8271569df77a req-b3e9cd3e-cd91-4f58-8ccc-42994608a4cc service nova] Creating event network-vif-unplugged:b4cc38e1-ad5b-4717-b289-318c740668e6 for instance b3a98f78-a3b5-45ac-b93b-72c766284dbd on n-h2-854925-5 Aug 30 04:12:56.091207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:56.092369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:56.099037 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-086f11f8-5e3a-4067-af42-8271569df77a req-b3e9cd3e-cd91-4f58-8ccc-42994608a4cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064711 Aug 30 04:12:56.101358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.101859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.102297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.103062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.103972 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 569/1189] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:56.110471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.110996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.268444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:56.269821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:56.276772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.289811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.290417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.294515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.297787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.298709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.697955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:56.705877 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33cae475-7b92-4736-93e4-b595e327d9d0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1469 microversion: 2.1 time: 0.618361 Aug 30 04:12:56.712438 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 621/1190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:56 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1469 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:56.729813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:56.732118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:56.744625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.745877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.749739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.751798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.752450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.753451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.777287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:56.795958 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d1e8e77-cb32-4cdd-bd40-1cd6d13ed0a0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1521 microversion: 2.1 time: 0.531040 Aug 30 04:12:56.800641 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 570/1191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:56 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:56.809403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:56.810435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:56.827630 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-35566de6-6fc9-484a-a669-699b554e83ae tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114018 Aug 30 04:12:56.829932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 622/1192] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:56 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:56.847469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:56.849559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:56.861451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.861787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.861971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.862308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.862437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.863100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.863551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.863973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.866985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.867691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:56.868171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:56.868608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:56.915378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:12:57.116241 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38d6a969-5f09-4614-b2ec-0440a345c07f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 204 len: 0 microversion: 2.1 time: 0.281164 Aug 30 04:12:57.116911 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 623/1193] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:12:56 2022] DELETE /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:12:57.134646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:57.136241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:57.151865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:57.152367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:57.152805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:57.155563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:57.156048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:57.156483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:57.178478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:57.195503 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-37047d63-3c3b-402c-86da-df237c1c5f4c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.393125 Aug 30 04:12:57.198139 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 571/1194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:56 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:57.384025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:57.395858 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5a268fc-0594-4963-9c95-6ea82bae7205 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1527 microversion: 2.1 time: 0.274290 Aug 30 04:12:57.409369 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 624/1195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:57 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1527 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:57.728904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:57.730518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:57.739152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:57.744218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:57.745018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:57.746832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:57.749670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:57.750512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:57.841758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:57.845176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:57.860311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:57.862400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:57.864166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:57.865222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:57.867903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:57.869417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:57.936573 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-286f4c08-0740-4e88-8e56-e26326201768 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100226 Aug 30 04:12:57.937172 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 625/1196] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:57 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:12:58.074219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:58.090544 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4523bcac-0221-4d6a-9f80-2f8d8b56d2f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1469 microversion: 2.1 time: 0.365941 Aug 30 04:12:58.091557 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 572/1197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:57 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1469 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:58.158791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b7ddc768-cd13-4784-ba2f-0614478905eb req-b0f2ed7e-dcae-4c5b-b218-96a6b1f03da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a98f78-a3b5-45ac-b93b-72c766284dbd", "tag": "b4cc38e1-ad5b-4717-b289-318c740668e6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:58.198179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b7ddc768-cd13-4784-ba2f-0614478905eb req-b0f2ed7e-dcae-4c5b-b218-96a6b1f03da0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.200545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b7ddc768-cd13-4784-ba2f-0614478905eb req-b0f2ed7e-dcae-4c5b-b218-96a6b1f03da0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.202897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b7ddc768-cd13-4784-ba2f-0614478905eb req-b0f2ed7e-dcae-4c5b-b218-96a6b1f03da0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:58.221186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:58.222221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:58.238638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.239512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.241402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:58.242593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.243512 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b7ddc768-cd13-4784-ba2f-0614478905eb req-b0f2ed7e-dcae-4c5b-b218-96a6b1f03da0 service nova] Creating event network-changed:b4cc38e1-ad5b-4717-b289-318c740668e6 for instance b3a98f78-a3b5-45ac-b93b-72c766284dbd on n-h2-854925-5 Aug 30 04:12:58.244527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.246095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:58.257185 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b7ddc768-cd13-4784-ba2f-0614478905eb req-b0f2ed7e-dcae-4c5b-b218-96a6b1f03da0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102194 Aug 30 04:12:58.259278 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 626/1198] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:58.423497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:58.424926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:58.464329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.465481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.466146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:58.467157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.468070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.468709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:58.677516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:58.687180 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4663ef0a-c8c2-48c2-8ae5-9267fdd38db5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.471452 Aug 30 04:12:58.687837 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 573/1199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:58 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:58.693255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7b21a11d-2c68-4b74-b1e0-520c9e7903b0 req-6b222bf1-e280-4bf0-aa93-bd973cdedcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c70b4a-4c6a-4137-a2c3-a02b16b5a369", "name": "network-vif-plugged", "status": "completed", "tag": "acbaf2e5-9af3-4cbd-b7cc-9d2045334073"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:12:58.703070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7b21a11d-2c68-4b74-b1e0-520c9e7903b0 req-6b222bf1-e280-4bf0-aa93-bd973cdedcdd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.703908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7b21a11d-2c68-4b74-b1e0-520c9e7903b0 req-6b222bf1-e280-4bf0-aa93-bd973cdedcdd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.704373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7b21a11d-2c68-4b74-b1e0-520c9e7903b0 req-6b222bf1-e280-4bf0-aa93-bd973cdedcdd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:58.717803 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7b21a11d-2c68-4b74-b1e0-520c9e7903b0 req-6b222bf1-e280-4bf0-aa93-bd973cdedcdd service nova] Creating event network-vif-plugged:acbaf2e5-9af3-4cbd-b7cc-9d2045334073 for instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 on n-h1-854925-5 Aug 30 04:12:58.723762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-7b21a11d-2c68-4b74-b1e0-520c9e7903b0 req-6b222bf1-e280-4bf0-aa93-bd973cdedcdd service nova] Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:12:58.730485 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7b21a11d-2c68-4b74-b1e0-520c9e7903b0 req-6b222bf1-e280-4bf0-aa93-bd973cdedcdd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040968 Aug 30 04:12:58.731077 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 574/1200] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:58.803722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:58.814097 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17811928-1f59-454e-adb7-8e94c193e63e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1527 microversion: 2.1 time: 0.398153 Aug 30 04:12:58.839104 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 627/1201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:58 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1527 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:12:58.960608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:58.963793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:58.983578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.984356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.984952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:58.986939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:58.989209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:58.989989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:59.049683 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-094ea678-0dd9-4d9c-bf23-3ee0633dd6eb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104739 Aug 30 04:12:59.050702 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 575/1202] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:12:58 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:12:59.113112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:59.114284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:59.125670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:59.126714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:59.127981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:59.129998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:59.132463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:59.133136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:59.616844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:12:59.629484 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-63eb98b1-f706-4623-bd67-af957e4784ee tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1469 microversion: 2.1 time: 0.521604 Aug 30 04:12:59.630469 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 628/1203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:59 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1469 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:12:59.710908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:59.712087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:59.726743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:59.727536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:59.728217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:59.734014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:59.735233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:59.736143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:59.744904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:12:59.839373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:12:59.841711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:12:59.855698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:59.857856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:59.863355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:12:59.865965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:12:59.866676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:12:59.867339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:00.857940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:00.862088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:00.869889 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bba10466-59b0-47fb-8470-b5ababf34ba3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 200 len: 1527 microversion: 2.1 time: 1.034224 Aug 30 04:13:00.873013 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 629/1204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:59 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 1527 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:00.878338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:00.888103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:00.903026 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0b26df8-a0c5-4aa3-acdc-f1ea2ef22c0c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 1.194073 Aug 30 04:13:00.905733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:00.923044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:00.923044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:00.923044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:00.923044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:00.923044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:00.931970 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 576/1205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:12:59 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:00.941402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:00.942433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:00.967086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:00.968507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:00.969211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:00.971778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:00.972984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:00.973658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:00.995506 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d4038d6-5d21-42f3-8442-f714fa6834cf tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121211 Aug 30 04:13:00.996449 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 630/1206] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:00 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:13:01.006801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-38f6dfab-f629-4f97-a066-3fa4105ce0f9 req-38a56325-0d57-4655-8fb6-e8cb86d62778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9de95010-d595-4176-bae5-71fefb910fe7", "name": "network-vif-deleted", "tag": "9a1ad777-3930-4162-ad15-7a3eecf20329"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:01.018927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-38f6dfab-f629-4f97-a066-3fa4105ce0f9 req-38a56325-0d57-4655-8fb6-e8cb86d62778 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:01.019711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-38f6dfab-f629-4f97-a066-3fa4105ce0f9 req-38a56325-0d57-4655-8fb6-e8cb86d62778 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:01.020363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-38f6dfab-f629-4f97-a066-3fa4105ce0f9 req-38a56325-0d57-4655-8fb6-e8cb86d62778 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:01.037271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-38f6dfab-f629-4f97-a066-3fa4105ce0f9 req-38a56325-0d57-4655-8fb6-e8cb86d62778 service nova] Creating event network-vif-deleted:9a1ad777-3930-4162-ad15-7a3eecf20329 for instance 9de95010-d595-4176-bae5-71fefb910fe7 on n-h2-854925-5 Aug 30 04:13:01.043352 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-38f6dfab-f629-4f97-a066-3fa4105ce0f9 req-38a56325-0d57-4655-8fb6-e8cb86d62778 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045419 Aug 30 04:13:01.044261 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 631/1207] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:01.086038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:01.095269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:01.096262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Searching by: {'deleted': False, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:13:01.107043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:01.108470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:01.109067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:01.111197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:01.111840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:01.112443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:01.240547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:13:01.370807 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0385d9a-35b6-4005-a31a-a400dc29f2b2 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.289164 Aug 30 04:13:01.371568 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 632/1208] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:13:01 2022] GET /compute/v2.1/servers => generated 334 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:01.377235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1928025476", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "e0b8dfa8-162d-42c1-8f88-ea11a6791fad"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:01.445563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] validate_networks() for [('e0b8dfa8-162d-42c1-8f88-ea11a6791fad', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:01.616438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:01.627698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3d087fc7-2512-43d1-bda1-420a4be07624 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1535 microversion: 2.1 time: 0.691633 Aug 30 04:13:01.629357 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 577/1209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:00 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1535 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:01.654696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:01.706284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:01.707932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Searching by: {'deleted': False, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:13:01.728622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:01.730113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:01.731020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:01.732428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:01.734745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:01.737424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:01.916961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:13:02.101082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:02.110103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:02.110298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:02.110645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:02.706525 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fcbc282-0f9d-43c6-89b7-47ccbee7ff42 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 1.075754 Aug 30 04:13:02.707249 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 578/1210] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:13:01 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:02.717595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:02.717595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:02.724950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:02.726243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:02.726243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:02.729146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:02.729729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:02.730450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:02.767722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 HTTP/1.1 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9de95010-d595-4176-bae5-71fefb910fe7'} Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:02.769685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-62f09616-8b43-4dfd-9fe8-f99591011a57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 404 len: 111 microversion: 2.1 time: 0.062585 Aug 30 04:13:02.773732 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 579/1211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:02 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:02.787852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:02.788545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:02.794552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:02.795043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:02.795983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:02.796206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:02.796657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:02.797077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.068833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:03.069892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:03.070530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:03.071239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:03.071861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:03.081564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:03.082283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:03.082883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.083824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:03.084566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:03.085210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.106873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Getting quotas for project b44a575fabe74c81a44e2ae1cd33ce66. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:03.115220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Getting quotas for user ef42627af9c446b2ac60d9fc9f01a019 and project b44a575fabe74c81a44e2ae1cd33ce66. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:03.130469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:13:03.133507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:13:03.197624 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c014038-2ff5-4ee9-9538-02a6c7829f3b tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.824539 Aug 30 04:13:03.205401 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 633/1212] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:13:03.211132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0484a636-134e-40f7-8152-0d67a6a6ac39 req-e33ecab4-c931-4154-b459-8b571c2281e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c70b4a-4c6a-4137-a2c3-a02b16b5a369", "name": "network-vif-unplugged", "status": "completed", "tag": "acbaf2e5-9af3-4cbd-b7cc-9d2045334073"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:03.221516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:03.223740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0484a636-134e-40f7-8152-0d67a6a6ac39 req-e33ecab4-c931-4154-b459-8b571c2281e1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:03.224417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0484a636-134e-40f7-8152-0d67a6a6ac39 req-e33ecab4-c931-4154-b459-8b571c2281e1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:03.225016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0484a636-134e-40f7-8152-0d67a6a6ac39 req-e33ecab4-c931-4154-b459-8b571c2281e1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.236657 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba58c176-8d49-4638-9c73-d0b62958f492 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.462705 Aug 30 04:13:03.241682 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0484a636-134e-40f7-8152-0d67a6a6ac39 req-e33ecab4-c931-4154-b459-8b571c2281e1 service nova] Creating event network-vif-unplugged:acbaf2e5-9af3-4cbd-b7cc-9d2045334073 for instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 on n-h1-854925-5 Aug 30 04:13:03.249715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-0484a636-134e-40f7-8152-0d67a6a6ac39 req-e33ecab4-c931-4154-b459-8b571c2281e1 service nova] Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:13:03.254802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 580/1213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:02 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:03.257171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0484a636-134e-40f7-8152-0d67a6a6ac39 req-e33ecab4-c931-4154-b459-8b571c2281e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049898 Aug 30 04:13:03.258020 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 634/1214] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:03.265295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf41a116-313f-4b8a-acf9-39d192876baf tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:03.266885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:03.268542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:03.274880 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf41a116-313f-4b8a-acf9-39d192876baf tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015460 Aug 30 04:13:03.276104 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 635/1215] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:13:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:03.281542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd034ff1-2367-4c4b-a1b8-4f24b7d5d577 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'create', calling method: .version_select at 0x7fe96a2ee310>, body: {"keypair": {"name": "tempest-keypair-1255372187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGhjnLGtcAUSaCaFcgzoM2v+QDjf9oml5830bc47G6/TcO1OkUPg46fDASfLeRYStkDrhl51FcgRGZ2Wl58gIOuzt2bHuxJACiFB2XIqb4ZPr2gTUSzb5qJQzCjlZLzbA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:03.282822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:03.285526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:03.286260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.287595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:03.292332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:03.293043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.301421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-dd034ff1-2367-4c4b-a1b8-4f24b7d5d577 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:03.307934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-dd034ff1-2367-4c4b-a1b8-4f24b7d5d577 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for user d9abb5b0dbb04242acaf957bd30cd5c1 and project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:03.343316 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd034ff1-2367-4c4b-a1b8-4f24b7d5d577 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065026 Aug 30 04:13:03.345602 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 636/1216] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:13:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:03.357442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cbacad8-1d54-4405-96a8-5a20ee3d1905 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:03.360482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0cbacad8-1d54-4405-96a8-5a20ee3d1905 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:03.878018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0cbacad8-1d54-4405-96a8-5a20ee3d1905 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:03.891953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0cbacad8-1d54-4405-96a8-5a20ee3d1905 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1218 microversion: 2.1 time: 0.543927 Aug 30 04:13:03.892889 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 637/1217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:03 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1218 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:03.915276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:03.916042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:03.927067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:03.928023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:03.928522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.929502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:03.930254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:03.930691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:03.935779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:03.965632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:13:04.085755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:04.101845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e36260b-f53f-48ee-b9a0-8b0a14252e1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1535 microversion: 2.1 time: 0.845289 Aug 30 04:13:04.103983 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 581/1218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:03 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1535 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:04.108584 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-24de557e-bf4a-4220-bc3e-f5b098494e44 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 204 len: 0 microversion: 2.1 time: 0.212247 Aug 30 04:13:04.109784 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 638/1219] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:13:03 2022] DELETE /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:04.118298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:04.119089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:04.128933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:04.129845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:04.130520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:04.131608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:04.132792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:04.134057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:04.269615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:04.270736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:04.300395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:04.301163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:04.301931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:04.303136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:04.304171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:04.306211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:04.480812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:04.511431 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-374ab026-382a-4ab1-9fef-2f53be9a06f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1702 microversion: 2.1 time: 0.395904 Aug 30 04:13:04.525722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 582/1220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:04 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1702 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:04.636221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:04.644796 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f60e2c7f-1bc1-4a61-a352-67a0b139cdeb tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.385055 Aug 30 04:13:04.662145 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 639/1221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:04 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:04.914998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:04.919210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:04.935785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:04.945341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:04.946070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:04.948478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:04.951189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:04.951837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:05.112052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:05.123079 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f9d9060-c555-430d-8d8b-e1b3c7eda9e5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1214 microversion: 2.1 time: 0.213421 Aug 30 04:13:05.123955 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 583/1222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:04 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:05.124237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:05.125082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:05.131739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:05.132260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:05.132696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:05.133522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:05.137897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:05.139810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:05.288126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1505175730", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:05.345204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] validate_networks() for [('3dff0292-dcc6-40ae-bb98-ee6cb060090b', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:05.507893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:05.516107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e9c43658-4707-4823-ad9a-8435a291c79a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1535 microversion: 2.1 time: 0.395868 Aug 30 04:13:05.516605 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 640/1223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:05 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1535 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:05.534601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:05.535216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:05.542086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:05.542865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:05.543504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:05.544200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:05.544656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:05.545077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:06.068966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:06.080770 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c2967ae6-b96f-4f37-8d88-b62cb2869bc4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1702 microversion: 2.1 time: 0.550851 Aug 30 04:13:06.084239 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 641/1224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:05 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1702 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:06.094350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:06.097285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:06.107302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:06.108648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:06.109420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:06.118021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:06.120715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:06.120715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:06.990161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:06.991148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:06.992076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:06.992669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:06.993856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:07.013560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.013560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.013560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:07.014581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.014581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.015268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:07.042563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:07.059670 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c52a93d7-47e8-41b8-9bcc-4a8f2e0631c0 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.973848 Aug 30 04:13:07.061383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Getting quotas for project b951a77b2b33488fb6c1c3ef578d558a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:07.062901 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 642/1225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:06 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:07.079769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:07.082215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Getting quotas for user d01f80c9403a469db623008e42096033 and project b951a77b2b33488fb6c1c3ef578d558a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:07.083150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:07.097798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.098733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.099359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:07.100231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.102691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:13:07.103954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.104397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:07.106206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:13:07.203978 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-185699dd-c723-49a5-9050-ec7a4e35333c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.034856 Aug 30 04:13:07.209210 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 584/1226] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:13:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:13:07.218168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:07.219065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:07.237634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.241143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.241932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:07.244889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.246045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.249702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:07.536990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:07.561625 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94f77523-1773-4354-917a-78aa53b34f5c tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1276 microversion: 2.1 time: 0.496257 Aug 30 04:13:07.576285 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 643/1227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:07 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1276 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:07.595375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:07.597736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:07.620133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.622064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.622881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:07.629814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:07.645020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:07.647407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:08.879698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:08.902351 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bb9140a3-751e-4ea8-9a95-da01020f53bd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1535 microversion: 2.1 time: 1.686983 Aug 30 04:13:08.906622 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 585/1228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:07 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1535 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:08.928559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:08.932051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:08.987735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:08.998121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:09.001450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:09.002531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:09.003886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:09.006196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:09.185100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:09.195327 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-179ab579-5c94-4f10-935e-b6bdcb28fb20 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1702 microversion: 2.1 time: 1.613585 Aug 30 04:13:09.196696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 644/1229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:07 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1702 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:09.202493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:09.214313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:09.237203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:09.238716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:09.240103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:09.240790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:09.255307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:09.255910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:09.257319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:09.257587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2210821b-22b5-4be5-bae4-8a9c59bbd33e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1275 microversion: 2.1 time: 0.336637 Aug 30 04:13:09.259946 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 586/1230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:08 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1275 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:09.270319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:09.270950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:09.289481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:09.291847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:09.292307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:09.293302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:09.293790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:09.296254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:09.828968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:09.845650 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d2f6c47f-eb6f-4cb2-82d5-687ee5477bd3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1318 microversion: 2.1 time: 0.584307 Aug 30 04:13:09.863207 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 587/1231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:09 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:09.879016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f2771554-d63d-42d3-9067-ffb33d29c7a3 req-f3459ab3-6ef4-455b-9c22-4a5537cee226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f792ab5-e7c6-40dc-8164-02b879d5a30d", "name": "network-vif-unplugged", "status": "completed", "tag": "774dd0b2-d77d-464b-9176-c29007e52568"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:09.901183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f2771554-d63d-42d3-9067-ffb33d29c7a3 req-f3459ab3-6ef4-455b-9c22-4a5537cee226 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:09.901887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f2771554-d63d-42d3-9067-ffb33d29c7a3 req-f3459ab3-6ef4-455b-9c22-4a5537cee226 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:09.906885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f2771554-d63d-42d3-9067-ffb33d29c7a3 req-f3459ab3-6ef4-455b-9c22-4a5537cee226 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:09.947348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f2771554-d63d-42d3-9067-ffb33d29c7a3 req-f3459ab3-6ef4-455b-9c22-4a5537cee226 service nova] Creating event network-vif-unplugged:774dd0b2-d77d-464b-9176-c29007e52568 for instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d on n-h2-854925-5 Aug 30 04:13:09.961272 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f2771554-d63d-42d3-9067-ffb33d29c7a3 req-f3459ab3-6ef4-455b-9c22-4a5537cee226 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092171 Aug 30 04:13:09.964894 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 588/1232] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:09.983980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2130571216", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:09.994202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:10.003366 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd865aeb-c706-4c32-ab18-37f19d42a1ca tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.805393 Aug 30 04:13:10.011129 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 645/1233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:09 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:10.017280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ab8198a5-d1c7-489a-ada6-b3916f979f28 req-36a5be0f-9338-4899-ba08-4d838534ed32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf6924b8-3ae7-4975-96df-cbc966865cfd", "tag": "e7c5b272-f231-4ba3-b572-523b5d2f7cac"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:10.075701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ab8198a5-d1c7-489a-ada6-b3916f979f28 req-36a5be0f-9338-4899-ba08-4d838534ed32 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:10.093056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ab8198a5-d1c7-489a-ada6-b3916f979f28 req-36a5be0f-9338-4899-ba08-4d838534ed32 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:10.093670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ab8198a5-d1c7-489a-ada6-b3916f979f28 req-36a5be0f-9338-4899-ba08-4d838534ed32 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:10.139951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] validate_networks() for [('762873a3-4a4d-475f-83c3-c7f859ce784c', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:10.143739 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ab8198a5-d1c7-489a-ada6-b3916f979f28 req-36a5be0f-9338-4899-ba08-4d838534ed32 service nova] Creating event network-changed:e7c5b272-f231-4ba3-b572-523b5d2f7cac for instance cf6924b8-3ae7-4975-96df-cbc966865cfd on n-h2-854925-5 Aug 30 04:13:10.155847 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ab8198a5-d1c7-489a-ada6-b3916f979f28 req-36a5be0f-9338-4899-ba08-4d838534ed32 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143054 Aug 30 04:13:10.156284 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 646/1234] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:10.163457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:10.164384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:10.172128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:10.172930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:10.173586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:10.174470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:10.175099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:10.175718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:10.956269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:10.979620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-87670dfe-7575-4dce-8fa5-73724167ef67 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1528 microversion: 2.1 time: 0.820613 Aug 30 04:13:10.981569 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 647/1235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:10 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1528 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:10.995251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:10.996172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:11.017598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:11.018822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:11.019499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:11.020699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:11.022411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:11.023100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:11.163199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:11.173866 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b246aef-c0e4-4b72-a608-a324665001f4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1634 microversion: 2.1 time: 0.187698 Aug 30 04:13:11.174689 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 648/1236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:10 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1634 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:11.193027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:11.198768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:11.207369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:11.208008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:11.208543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:11.209451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:11.210008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:11.211949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.006233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:12.027282 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-054d2c7a-d051-499b-96aa-d7abd8e494f5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1323 microversion: 2.1 time: 0.838013 Aug 30 04:13:12.045763 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 649/1237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:11 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1323 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:12.051405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:12.054534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:12.068270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.071412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.072088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.073855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.074553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.075968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.172556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:12.173937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:12.179143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:12.179840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:12.180637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:12.205136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.206287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.209468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.210704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.213016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.214286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.263387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:12.270838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for user d9abb5b0dbb04242acaf957bd30cd5c1 and project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:12.287091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:13:12.290287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:13:12.330040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:12.384385 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a06b8d1-e4f8-4e98-aa4e-8455ba3a121e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.417877 Aug 30 04:13:12.389471 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 589/1238] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:13:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:13:12.394626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:12.395225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:12.437084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.437619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.438109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.438845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.439291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.439707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.565084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:12.580830 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a543d01e-71d6-4dd1-a42f-c35071e8afaa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1318 microversion: 2.1 time: 0.532669 Aug 30 04:13:12.590539 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 650/1239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:12 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1318 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:12.603321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:12.614745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:12.617830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:12.628884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.629838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.630448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.631335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:12.631943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:12.635269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:12.963570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:12.976175 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9f4f5c65-0263-42c6-a94b-386fddf6835f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1528 microversion: 2.1 time: 0.585321 Aug 30 04:13:12.977843 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 590/1240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:12 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1528 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:12.985751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d3149d03-061e-4b30-8f1a-9dda525a8342 req-a45f4013-1549-4179-800c-2bad8e07ea49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f792ab5-e7c6-40dc-8164-02b879d5a30d", "name": "network-vif-deleted", "tag": "774dd0b2-d77d-464b-9176-c29007e52568"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:13.012064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d3149d03-061e-4b30-8f1a-9dda525a8342 req-a45f4013-1549-4179-800c-2bad8e07ea49 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.012563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d3149d03-061e-4b30-8f1a-9dda525a8342 req-a45f4013-1549-4179-800c-2bad8e07ea49 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.013001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d3149d03-061e-4b30-8f1a-9dda525a8342 req-a45f4013-1549-4179-800c-2bad8e07ea49 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.059748 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d3149d03-061e-4b30-8f1a-9dda525a8342 req-a45f4013-1549-4179-800c-2bad8e07ea49 service nova] Creating event network-vif-deleted:774dd0b2-d77d-464b-9176-c29007e52568 for instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d on n-h2-854925-5 Aug 30 04:13:13.081773 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d3149d03-061e-4b30-8f1a-9dda525a8342 req-a45f4013-1549-4179-800c-2bad8e07ea49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102050 Aug 30 04:13:13.083289 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 591/1241] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:13.092659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:13.094707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:13.096128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:13.118537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.119162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.119608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.120386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.120875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.121311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.131824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:13.144920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6b2f2a7-7ad1-440a-a76e-584d3f7fdc30 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.552953 Aug 30 04:13:13.145572 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 651/1242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:12 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:13.151495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:13.152315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:13.159710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.160930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.165618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.166755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.167672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.168698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.177800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.178334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.178613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.179065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lazy-loading 'fault' on Instance uuid 1f792ab5-e7c6-40dc-8164-02b879d5a30d {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:13.279407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8da6aeff6a74f909fb618eeb54253a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f140908f88a44eeb9e6d8474d8280f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:13.295703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:13.295892 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-860b82ae-2368-47e3-8f0f-77700d20fbf4 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 200 len: 1360 microversion: 2.1 time: 0.211142 Aug 30 04:13:13.310564 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 592/1243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:13 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 1360 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:13.313446 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-65854ac2-9950-4e5a-9165-e8f15b0c8eac tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1229 microversion: 2.1 time: 0.166577 Aug 30 04:13:13.314531 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 652/1244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:13 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1229 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:13.321035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-45d36e50-199e-4897-9944-e354329c4c7b req-9ff82205-88b1-4117-8748-8bd2c07ce6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e862c1e7-2cc7-4c20-9020-11fc41c1c7b7", "tag": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:13.332889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45d36e50-199e-4897-9944-e354329c4c7b req-9ff82205-88b1-4117-8748-8bd2c07ce6f8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.335342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-664bb4fc-e56f-49df-90d8-ef5ab19c558d req-d3113a99-f7f4-4041-8f6e-87ef833e3494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c70b4a-4c6a-4137-a2c3-a02b16b5a369", "name": "network-vif-plugged", "status": "completed", "tag": "acbaf2e5-9af3-4cbd-b7cc-9d2045334073"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:13.346064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45d36e50-199e-4897-9944-e354329c4c7b req-9ff82205-88b1-4117-8748-8bd2c07ce6f8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.350042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45d36e50-199e-4897-9944-e354329c4c7b req-9ff82205-88b1-4117-8748-8bd2c07ce6f8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.357867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-664bb4fc-e56f-49df-90d8-ef5ab19c558d req-d3113a99-f7f4-4041-8f6e-87ef833e3494 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.358360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-664bb4fc-e56f-49df-90d8-ef5ab19c558d req-d3113a99-f7f4-4041-8f6e-87ef833e3494 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.358800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-664bb4fc-e56f-49df-90d8-ef5ab19c558d req-d3113a99-f7f4-4041-8f6e-87ef833e3494 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.376739 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-45d36e50-199e-4897-9944-e354329c4c7b req-9ff82205-88b1-4117-8748-8bd2c07ce6f8 service nova] Creating event network-changed:b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 for instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 on n-h2-854925-5 Aug 30 04:13:13.382621 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-45d36e50-199e-4897-9944-e354329c4c7b req-9ff82205-88b1-4117-8748-8bd2c07ce6f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066293 Aug 30 04:13:13.386896 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 653/1245] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:13.397632 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-664bb4fc-e56f-49df-90d8-ef5ab19c558d req-d3113a99-f7f4-4041-8f6e-87ef833e3494 service nova] Creating event network-vif-plugged:acbaf2e5-9af3-4cbd-b7cc-9d2045334073 for instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 on n-h1-854925-5 Aug 30 04:13:13.398263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-97f0d3e7-97a2-4487-b491-10acb221c017 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:13.408584 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-97f0d3e7-97a2-4487-b491-10acb221c017 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] HTTP exception thrown: Flavor 08cb9ab5-51a9-4519-aa38-574d90fbdbc1 could not be found. Aug 30 04:13:13.413668 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-664bb4fc-e56f-49df-90d8-ef5ab19c558d req-d3113a99-f7f4-4041-8f6e-87ef833e3494 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101117 Aug 30 04:13:13.414630 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 593/1246] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-97f0d3e7-97a2-4487-b491-10acb221c017 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Request method failure captured: Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/flavors/08cb9ab5-51a9-4519-aa38-574d90fbdbc1 HTTP/1.1 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY17O5pU3flW-yFH7Phbsb7zrkWoS9RZ7ovooqa9EDYaQNseFhpvQ377bH_hvXMSztX9C8RvO_NXcWmIJ5LGVOcP51i2fSmn6Y-NvVFYynTgQJ-bdqpPEXRPuhWX37jZEGJDaKtFolQ4AKANNXSes8CjU0kTVGF1arZRj7y3eqC9Gf8 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b8b5714ad31147e09278412b8e7de2de Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-MigrationsAdminTest-494812007 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8b5714ad31147e09278412b8e7de2de", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8b5714ad31147e09278412b8e7de2de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8b5714ad31147e09278412b8e7de2de"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8b5714ad31147e09278412b8e7de2de"}]}] Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-MigrationsAdminTest-494812007 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b8b5714ad31147e09278412b8e7de2de Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-MigrationsAdminTest-494812007 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-MigrationsAdminTest-494812007-project-admin Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9ad8b7c062d4d2fa6604c354223a441 Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-MigrationsAdminTest-494812007-project-admin Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor 08cb9ab5-51a9-4519-aa38-574d90fbdbc1 could not be found. Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '08cb9ab5-51a9-4519-aa38-574d90fbdbc1'} Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 08cb9ab5-51a9-4519-aa38-574d90fbdbc1 could not be found. Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 08cb9ab5-51a9-4519-aa38-574d90fbdbc1 could not be found. Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:13.421315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 08cb9ab5-51a9-4519-aa38-574d90fbdbc1 could not be found. Aug 30 04:13:13.426670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:13.427382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:13.427382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:13.429966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-97f0d3e7-97a2-4487-b491-10acb221c017 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Returning 404 to user: Flavor 08cb9ab5-51a9-4519-aa38-574d90fbdbc1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:13.431183 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-97f0d3e7-97a2-4487-b491-10acb221c017 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/08cb9ab5-51a9-4519-aa38-574d90fbdbc1" status: 404 len: 109 microversion: 2.1 time: 0.042897 Aug 30 04:13:13.432271 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 654/1247] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:13:13 2022] DELETE /compute/v2.1/flavors/08cb9ab5-51a9-4519-aa38-574d90fbdbc1 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:13.435047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.435605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.436657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.437491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.438042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.438553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.610061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:13.610881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:13.641564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.642075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.642527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.667910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:13.668602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:13.673690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:13.757872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:13.888983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:14.205053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:14.214453 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d4513b8-e870-4f85-b832-a4c283ce3537 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1323 microversion: 2.1 time: 0.798225 Aug 30 04:13:14.220460 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 594/1248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:13 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1323 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:14.234698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1639772354", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:14.332551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:14.560600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:14.576085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ddcd411-73e9-4182-b37b-97f586a38df3 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1318 microversion: 2.1 time: 0.973980 Aug 30 04:13:14.589351 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 655/1249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:13 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1318 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:14.598068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:14.598935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:14.614208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:14.614714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:14.615162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:14.615883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:14.616339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:14.622117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.280598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:15.282542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:15.283470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:15.283934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:15.284710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:15.285291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:15.294878 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2eb59cd0-b954-47cc-a1e1-b660ee8f96da tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1718 microversion: 2.1 time: 0.716112 Aug 30 04:13:15.298057 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 656/1250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:14 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1718 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:15.309131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:15.311728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] [instance: 1f792ab5-e7c6-40dc-8164-02b879d5a30d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:15.319503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.321042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.321672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.322570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.323217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.323806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.327514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.328010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.328443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.331981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.332945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.334794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.353198 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] HTTP exception thrown: Instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d could not be found. Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Request method failure captured: Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d HTTP/1.1 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4HRUz1H0vyKDz-akeS1Zkr67cpVKA9wS3iIecFs2P_7ATQ23lue-AAa-RZjGbYaXGcOOkXIl7_jiBAPoNxhEmh68qPabM6kBs4gRYCpThahqgKyPxaS8uvq4qt1ue9wOpYrhuLvw_fw_uVfy-KvrovujkzLZVk4x2kI9kWw2onLOg Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4f140908f88a44eeb9e6d8474d8280f4 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestJSON-363095833 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4f140908f88a44eeb9e6d8474d8280f4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4f140908f88a44eeb9e6d8474d8280f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f140908f88a44eeb9e6d8474d8280f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4f140908f88a44eeb9e6d8474d8280f4"}]}] Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestJSON-363095833 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4f140908f88a44eeb9e6d8474d8280f4 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestJSON-363095833 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestJSON-363095833-project Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: a8da6aeff6a74f909fb618eeb54253a9 Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestJSON-363095833-project Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d could not be found. Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1f792ab5-e7c6-40dc-8164-02b879d5a30d'} Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d could not be found. Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d could not be found. Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:15.355503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:15.361408 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:15.361408 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:15.361408 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:15.361408 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:15.361408 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d could not be found. Aug 30 04:13:15.361408 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:15.363197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:15.363689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Returning 404 to user: Instance 1f792ab5-e7c6-40dc-8164-02b879d5a30d could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:15.365998 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3cc6fc19-e3d0-4cdf-ad80-9820b71e74f3 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d" status: 404 len: 111 microversion: 2.1 time: 0.066751 Aug 30 04:13:15.370104 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 657/1251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:15 2022] GET /compute/v2.1/servers/1f792ab5-e7c6-40dc-8164-02b879d5a30d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:15.383615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Getting quotas for user 7ead040764484d059aa9a82f0714373f and project 7b1c9a3949b2461aaefac288f381241c. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:15.385553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:15.386395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:15.395493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.396186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.396792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.398070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.398682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.399263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.414094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:13:15.416696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:13:15.509061 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b55c107-b478-4266-a179-790291e2fd38 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287012 Aug 30 04:13:15.511142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 595/1252] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:13:15.537130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:15.539686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:15.559500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.560691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.562197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.563086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.563797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.564449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.596940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:15.601670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:15.620567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10de10e5-e5c5-47c8-8bb7-42fa8dea4e67 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1283 microversion: 2.1 time: 0.248869 Aug 30 04:13:15.621563 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 658/1253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:15 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1283 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:15.632040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5f97a316-f988-4052-8ce5-18d46c7d42b5 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] Calling method '.version_select at 0x7fe96e655f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:15.681256 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5f97a316-f988-4052-8ce5-18d46c7d42b5 tempest-ServersTestJSON-363095833 tempest-ServersTestJSON-363095833-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974094931" status: 202 len: 0 microversion: 2.1 time: 0.057427 Aug 30 04:13:15.682059 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 659/1254] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1974094931 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:13:15.688005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be191f52-d870-4d93-b340-82941b671bca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:15.690355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be191f52-d870-4d93-b340-82941b671bca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:15.856786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be191f52-d870-4d93-b340-82941b671bca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:15.883249 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be191f52-d870-4d93-b340-82941b671bca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1213 microversion: 2.1 time: 0.199870 Aug 30 04:13:15.887070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 660/1255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:15 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:15.928422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:15.937292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:15.974138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.975160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.975901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:15.978088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:15.979198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:15.980001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:16.814056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:16.829472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b79edb19-c543-4458-943c-aa3a3de89d5f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1323 microversion: 2.1 time: 1.312310 Aug 30 04:13:16.830732 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 596/1256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:15 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1323 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:16.847152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:16.848145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:16.859992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:16.860495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:16.860940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:16.861716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:16.865687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:16.866401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.161113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:17.172409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad246eb2-641e-4861-8c0e-504babb03f22 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1318 microversion: 2.1 time: 1.282744 Aug 30 04:13:17.173961 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 661/1257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:15 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1318 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:17.183291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:17.184537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:17.192847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.193732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.194504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.195446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.196068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.196666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.630847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:17.656681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4897ab5c-cee8-432b-a269-f53556857387 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1708 microversion: 2.1 time: 0.822621 Aug 30 04:13:17.657321 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 597/1258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:16 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1708 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:17.674552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-57269e55-7b88-4b1e-aa2a-4ba3b0e1f7b9 req-8674b09f-9737-43bf-8f00-23c42db8da8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6924b8-3ae7-4975-96df-cbc966865cfd", "name": "network-vif-plugged", "status": "completed", "tag": "e7c5b272-f231-4ba3-b572-523b5d2f7cac"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:17.675724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:17.685077 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-348a6e5f-f329-4fd9-a2f1-267e418aa5a2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.509747 Aug 30 04:13:17.689513 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 662/1259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:17 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:17.694335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:17.694933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:17.697072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-57269e55-7b88-4b1e-aa2a-4ba3b0e1f7b9 req-8674b09f-9737-43bf-8f00-23c42db8da8e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.697679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-57269e55-7b88-4b1e-aa2a-4ba3b0e1f7b9 req-8674b09f-9737-43bf-8f00-23c42db8da8e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.698011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-57269e55-7b88-4b1e-aa2a-4ba3b0e1f7b9 req-8674b09f-9737-43bf-8f00-23c42db8da8e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.719383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.719883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.720323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.721037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.721519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.721947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.728879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-57269e55-7b88-4b1e-aa2a-4ba3b0e1f7b9 req-8674b09f-9737-43bf-8f00-23c42db8da8e service nova] Creating event network-vif-plugged:e7c5b272-f231-4ba3-b572-523b5d2f7cac for instance cf6924b8-3ae7-4975-96df-cbc966865cfd on n-h2-854925-5 Aug 30 04:13:17.738855 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-57269e55-7b88-4b1e-aa2a-4ba3b0e1f7b9 req-8674b09f-9737-43bf-8f00-23c42db8da8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080266 Aug 30 04:13:17.739728 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 598/1260] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:17.754876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-92c71415-38cf-4023-9502-70fb3a477bb6 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '.version_select at 0x7fe96a04b820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:17.759424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92c71415-38cf-4023-9502-70fb3a477bb6 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.759920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92c71415-38cf-4023-9502-70fb3a477bb6 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.760360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92c71415-38cf-4023-9502-70fb3a477bb6 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.784648 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-92c71415-38cf-4023-9502-70fb3a477bb6 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2344 microversion: 2.1 time: 0.043489 Aug 30 04:13:17.785283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 599/1261] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:13:17 2022] GET /compute/v2.1/os-migrations => generated 2344 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:17.800053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:17.800804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:17.819533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.820222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.820457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.821168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.821658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.822089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.846453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:17.854750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3816f959-e281-4fdf-a40b-4f4ab099c783 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1265 microversion: 2.1 time: 0.164094 Aug 30 04:13:17.858545 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 663/1262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:17 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:17.866303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:17.866920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:17.882589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.883080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.890072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:17.890817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:17.891426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:17.891858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.242761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:18.255083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e29b3dc-c213-41a0-a1fb-7b80a3b993cd tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1323 microversion: 2.1 time: 0.393777 Aug 30 04:13:18.256562 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 664/1263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:17 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1323 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:18.261734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:18.262886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:18.314069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.317534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.322156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.323203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.325876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.327684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.481821 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-800a9d06-4573-4615-8e24-f49458d488d7 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1859 microversion: 2.1 time: 0.685275 Aug 30 04:13:18.483970 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 600/1264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:17 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1859 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:18.503517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:18.505884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:18.515274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.517437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.518786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.519737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.521361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.522018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.657665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:18.672723 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd76c9db-0134-45d2-96b4-d5b43158f299 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1318 microversion: 2.1 time: 0.413059 Aug 30 04:13:18.676064 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 665/1265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:18 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:18.717758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:18.719007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:18.728947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.729427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.730397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.731368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.732085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.734441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.936379 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a6d0b87c-5093-4f11-aace-29d9cebf1ce8 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1859 microversion: 2.1 time: 0.436449 Aug 30 04:13:18.936969 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 601/1266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:18 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1859 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:18.949457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:18.949763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:18.982093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.985617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.986365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:18.987800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:18.988323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:18.989162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.043157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:19.070247 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c0a918a8-dd77-47b9-8c2a-b920e871038a tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.366522 Aug 30 04:13:19.075655 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 666/1267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:18 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:19.091297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:19.107276 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59285a30-777c-4fd8-8caa-4d5910ce3000 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1283 microversion: 2.1 time: 0.164937 Aug 30 04:13:19.108624 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 602/1268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:18 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1283 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:19.118336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:19.118846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:19.126416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.126906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.127543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.128251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.128874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.129489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.264322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lazy-loading 'services' on Instance uuid b3a98f78-a3b5-45ac-b93b-72c766284dbd {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:19.277253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:19.278121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:19.286970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.287712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.288320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.289269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.289977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.290571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.501688 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d8011f2e-55fd-4b6a-b772-2d6570e2f8d8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments/34adc4e0-747f-4bee-a316-1f9c751e473e" status: 202 len: 0 microversion: 2.1 time: 0.394147 Aug 30 04:13:19.504307 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 667/1269] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:13:19 2022] DELETE /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments/34adc4e0-747f-4bee-a316-1f9c751e473e => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:13:19.519369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:19.523133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:19.530242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:19.535659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.536596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.537319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.538751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.539500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.540316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.540825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23da3dcc-dde8-4cba-93f4-a73bf6a1e915 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1323 microversion: 2.1 time: 0.267246 Aug 30 04:13:19.541439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 603/1270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:19 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:19.605976 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b300decf-e03b-46c9-a72e-4a4fcc7e1194 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095948 Aug 30 04:13:19.612310 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 668/1271] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:19 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:19.696460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:19.697276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:19.709054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.711328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.712004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.714028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:19.718265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:19.718890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:19.909979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:19.918512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5bea1c5e-7d9d-411a-9d3d-1e6d5821b979 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1318 microversion: 2.1 time: 0.226148 Aug 30 04:13:19.919198 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 604/1272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:19 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:20.099087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:20.099925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:20.106518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.107033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.107462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.108830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.109318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.109940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.135538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:20.136395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:20.148418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.151201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.155326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.157469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.158292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.158936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.247887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:20.263591 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b27e1ab8-2751-42a3-aee1-6d78963960a3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1271 microversion: 2.1 time: 0.132812 Aug 30 04:13:20.280726 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 605/1273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:20 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1271 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:20.312999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:20.325082 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00d2f07a-78a7-487e-b898-deefc680fd6d tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.228183 Aug 30 04:13:20.326019 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 669/1274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:20 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:20.396963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fedfd070-83b2-4560-8157-609301b66a55 req-2b495389-fbb7-4e96-b583-58f659acc1f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e862c1e7-2cc7-4c20-9020-11fc41c1c7b7", "name": "network-vif-plugged", "status": "completed", "tag": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:20.430125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fedfd070-83b2-4560-8157-609301b66a55 req-2b495389-fbb7-4e96-b583-58f659acc1f7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.431216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fedfd070-83b2-4560-8157-609301b66a55 req-2b495389-fbb7-4e96-b583-58f659acc1f7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.432060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fedfd070-83b2-4560-8157-609301b66a55 req-2b495389-fbb7-4e96-b583-58f659acc1f7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.454572 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fedfd070-83b2-4560-8157-609301b66a55 req-2b495389-fbb7-4e96-b583-58f659acc1f7 service nova] Creating event network-vif-plugged:b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 for instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 on n-h2-854925-5 Aug 30 04:13:20.462494 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fedfd070-83b2-4560-8157-609301b66a55 req-2b495389-fbb7-4e96-b583-58f659acc1f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069468 Aug 30 04:13:20.463917 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 606/1275] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:20.563002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:20.564247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:20.579620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.580120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.580556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.581267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.581747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.585970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.619786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:20.622749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:20.641406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.642856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.644527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.646163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.647748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.648857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.726661 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-94b9965b-4e17-48ce-b065-bf3744584904 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110960 Aug 30 04:13:20.739243 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 607/1276] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:20 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:13:20.750609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9b411d2c-52b6-4cdc-a792-cf5ee3f83edf req-9541d22f-c641-4815-9d8d-451b9c143e98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4ab32b1-0c9a-4544-82b7-e5a4b37dc555", "tag": "4b2b8670-b968-4f57-98f2-d6397f574cf5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:20.773778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9b411d2c-52b6-4cdc-a792-cf5ee3f83edf req-9541d22f-c641-4815-9d8d-451b9c143e98 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.774846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9b411d2c-52b6-4cdc-a792-cf5ee3f83edf req-9541d22f-c641-4815-9d8d-451b9c143e98 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.775629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9b411d2c-52b6-4cdc-a792-cf5ee3f83edf req-9541d22f-c641-4815-9d8d-451b9c143e98 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.796730 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9b411d2c-52b6-4cdc-a792-cf5ee3f83edf req-9541d22f-c641-4815-9d8d-451b9c143e98 service nova] Creating event network-changed:4b2b8670-b968-4f57-98f2-d6397f574cf5 for instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 on n-h1-854925-5 Aug 30 04:13:20.807036 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9b411d2c-52b6-4cdc-a792-cf5ee3f83edf req-9541d22f-c641-4815-9d8d-451b9c143e98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065164 Aug 30 04:13:20.808346 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 608/1277] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:20.941082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:20.942227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:20.952345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.953251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.953932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.955214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:20.955852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:20.956461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:20.989631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:20.999561 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df7f1125-bd20-4860-872d-6f103e0afec0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1323 microversion: 2.1 time: 0.441711 Aug 30 04:13:21.000178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 670/1278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:20 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:21.105195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:21.113771 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ca2cd6f-8c8d-43ea-ae14-8355965dbd9e tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1509 microversion: 2.1 time: 0.177625 Aug 30 04:13:21.125215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 609/1279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:20 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:21.290306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:21.290903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:21.305055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:21.305603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:21.306055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:21.307306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:21.307306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:21.313625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:21.348206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:21.349503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:21.356557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:21.357304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:21.358718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:21.359633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:21.360368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:21.360946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:21.456707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:21.473765 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ea57670-00e4-47fc-937b-0825f4f2d9ab tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1271 microversion: 2.1 time: 0.187346 Aug 30 04:13:21.483948 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 671/1280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:21 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:21.641388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:21.652543 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a93e317b-ce1b-4f6c-943e-3c25e11e8605 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.308470 Aug 30 04:13:21.653750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 610/1281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:21 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:21.739009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:21.741415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:21.760680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:21.761179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:21.761733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:21.762659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:21.763116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:21.763549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:21.828785 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3cff5e83-e4c2-4b4a-b2a2-85ca1f38a12c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093332 Aug 30 04:13:21.833484 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 672/1282] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:21 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:22.020644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:22.021696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:22.030911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.031117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.031494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.032835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.032835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.033146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.213656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:22.227954 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3515ace5-b5cc-43b2-85fe-c6760144d9fa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1323 microversion: 2.1 time: 0.211119 Aug 30 04:13:22.242830 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 611/1283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:22 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:22.503633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:22.504926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:22.525840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.526590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.527209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.529113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.530388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.531035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.680731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:22.681776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:22.691939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:22.699032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.699734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.700497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.704541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.705798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.706464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b541dc97-4525-4b7c-a232-c1a40f384d36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1271 microversion: 2.1 time: 0.206058 Aug 30 04:13:22.707392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.718656 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 673/1284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:22 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:22.842561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:22.845437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:22.852807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.853583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.854210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.855090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:22.855718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:22.856435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:22.867745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:22.918640 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc84d138-1e7b-4987-bd9d-a7840610fbea tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081111 Aug 30 04:13:22.920923 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 674/1285] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:22 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:22.985262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:23.017769 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e183da97-37db-4dc2-a4ab-cbaef90d7b66 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.343074 Aug 30 04:13:23.018654 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 612/1286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:22 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:23.252180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:23.253279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:23.265371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:23.267761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:23.268434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:23.269385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:23.270776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:23.273707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:23.732098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:23.733297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:23.773419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:23.774368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:23.776928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:23.782278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:23.786877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:23.787545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.340044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:24.348500 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d872085-544b-4b9f-bf71-6f31f626703f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1518 microversion: 2.1 time: 1.101079 Aug 30 04:13:24.365417 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 675/1287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:23 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1518 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:24.370721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "62158363-3ad0-4a48-91b9-e4535b7ce087"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:24.373896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.380468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.381197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.381826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.382691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.383407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.383790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.438714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:24.448243 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de89607d-8d5a-45c2-b36d-541a9ad10fc8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1313 microversion: 2.1 time: 0.719988 Aug 30 04:13:24.453129 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 613/1288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:23 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:24.461254 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] HTTP exception thrown: Volume ca677735-bb54-433e-96d4-355285aff85e could not be found. Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Request method failure captured: Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd/os-volume_attachments/ca677735-bb54-433e-96d4-355285aff85e HTTP/1.1 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 74 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY20XUK5fjUny_mKXM0cDjOLQBLBdi17QY4gZV9TMCmIwSGSmoyef7r5E1KoTdOcmX4rzoAAGtX4jAEcAsYAZuusmjo0ETcz_GL-AncZa5YVOHw7-7af899eHX8kQLZRGp4SK98cnepIyxp35-8XRdTYzogOAinZAWMHpWYTRADSEl8 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 77b686cae6954628a0f0eb980e50a84d Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesAdminNegativeTest-796627120 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_77b686cae6954628a0f0eb980e50a84d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/77b686cae6954628a0f0eb980e50a84d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b686cae6954628a0f0eb980e50a84d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/77b686cae6954628a0f0eb980e50a84d"}]}] Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesAdminNegativeTest-796627120 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 77b686cae6954628a0f0eb980e50a84d Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-796627120 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesAdminNegativeTest-796627120-project-admin Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 28987d65849f42ac85bf2c638c149ab9 Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesAdminNegativeTest-796627120-project-admin Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: {"volumeAttachment": {"volumeId": "62158363-3ad0-4a48-91b9-e4535b7ce087"}} Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: exception: Volume ca677735-bb54-433e-96d4-355285aff85e could not be found. Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': 'cf6924b8-3ae7-4975-96df-cbc966865cfd', 'id': 'ca677735-bb54-433e-96d4-355285aff85e', 'body': {'volumeAttachment': {'volumeId': '62158363-3ad0-4a48-91b9-e4535b7ce087'}}} Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca677735-bb54-433e-96d4-355285aff85e could not be found. (HTTP 404) (Request-ID: req-3182e715-0e05-4ad0-9149-5888cb5050c8) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:13:24.465368 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca677735-bb54-433e-96d4-355285aff85e could not be found. Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca677735-bb54-433e-96d4-355285aff85e could not be found. Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca677735-bb54-433e-96d4-355285aff85e could not be found. Aug 30 04:13:24.470760 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:24.475426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] Returning 404 to user: Volume ca677735-bb54-433e-96d4-355285aff85e could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:24.476310 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-84b56b76-a062-4a80-b1d9-ffd2358205da tempest-VolumesAdminNegativeTest-796627120 tempest-VolumesAdminNegativeTest-796627120-project-admin] 10.222.0.27 "PUT /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd/os-volume_attachments/ca677735-bb54-433e-96d4-355285aff85e" status: 404 len: 109 microversion: 2.1 time: 0.109896 Aug 30 04:13:24.480391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:24.481251 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 676/1289] 10.222.0.27 () {60 vars in 1433 bytes} [Tue Aug 30 04:13:24 2022] PUT /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd/os-volume_attachments/ca677735-bb54-433e-96d4-355285aff85e => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:24.492284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:24.496199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.500632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.523298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.524499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.529133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.530801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.531567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.532992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.536169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.537605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.538647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.539360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.543899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.544891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.646121 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63a84fb4-a84b-4db0-8838-53481a228379 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191557 Aug 30 04:13:24.647250 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 614/1290] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:24 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:24.653049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:24.669345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.684646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.685431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.686641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.687581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.688237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.688860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.741241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lazy-loading 'flavor' on Instance uuid e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:24.806381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:24.954578 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b6174bd-05ff-48da-96ab-68173c0d51fc tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action" status: 200 len: 32 microversion: 2.1 time: 0.305535 Aug 30 04:13:24.955813 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 615/1291] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:13:24 2022] POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action => generated 32 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:13:24.964376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09699321-30ef-47a3-9344-8a304b8d9d79"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:24.971737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:24.984754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:24.991168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:24.995620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:24.996580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:25.010523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:25.013624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:25.337987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=11 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:25.407455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=20 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:25.828768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:25.847421 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0458fefc-8ec8-4259-a32e-6176f1f3d1b6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 1.364457 Aug 30 04:13:25.848042 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 677/1292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:24 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:25.872871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:25.874574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:25.883722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:25.886796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:25.887986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:25.887986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:25.892765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:25.896845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:25.897617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:26.329671 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34213282-16c7-4e64-bdd7-9472d5e1d10e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "POST /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.371739 Aug 30 04:13:26.334211 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 616/1293] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:13:24 2022] POST /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments => generated 194 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:26.348328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:26.350176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:26.369258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:26.370578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:26.372074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:26.382708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:26.385178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:26.385887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.578231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:27.595752 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-62ce88ff-1bb1-4e0b-a803-c20f51f35e68 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 1.728602 Aug 30 04:13:27.596375 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 678/1294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:25 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:27.624101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:27.629948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:27.639732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.640649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.641455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.642733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.643463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.644109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.684812 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-15350901-b4e3-4877-9613-84a48dcc53ad tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069573 Aug 30 04:13:27.685831 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 679/1295] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:27 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:27.690448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cf51df17-8a9c-46c1-ad70-cc80bff86d78 req-9d609a5d-c49a-4884-bb83-5a6563e833e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:27.704460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cf51df17-8a9c-46c1-ad70-cc80bff86d78 req-9d609a5d-c49a-4884-bb83-5a6563e833e5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.705177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cf51df17-8a9c-46c1-ad70-cc80bff86d78 req-9d609a5d-c49a-4884-bb83-5a6563e833e5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.705814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cf51df17-8a9c-46c1-ad70-cc80bff86d78 req-9d609a5d-c49a-4884-bb83-5a6563e833e5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.719932 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cf51df17-8a9c-46c1-ad70-cc80bff86d78 req-9d609a5d-c49a-4884-bb83-5a6563e833e5 service nova] Creating event network-changed:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h2-854925-5 Aug 30 04:13:27.727328 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cf51df17-8a9c-46c1-ad70-cc80bff86d78 req-9d609a5d-c49a-4884-bb83-5a6563e833e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040114 Aug 30 04:13:27.728577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 680/1296] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:27.745701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:27.747383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:27.758398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.759203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.759841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.760792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:27.762584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:27.763285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:27.766166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:27.779068 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-67aef412-8e3a-43b7-bf2e-c233a64a95b1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1313 microversion: 2.1 time: 1.442211 Aug 30 04:13:27.781255 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 617/1297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:26 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1313 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:28.159902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:28.175449 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-374e62e6-d38f-41e4-a79f-71048fe6cdd1 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.440216 Aug 30 04:13:28.176194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 681/1298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:27 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:28.622058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:28.624657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:28.633803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.634981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.635780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.636786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.637701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.638287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.697008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:28.699472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:28.721803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.722457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.722823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.723536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.723993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.726434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.817925 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8546bdf5-566d-4847-be32-5367900ae6f5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.125648 Aug 30 04:13:28.833447 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 682/1299] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:28 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:13:28.844429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:28.846732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:28.862285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.864981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.865942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:28.869463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:28.870119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:28.870716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:29.042441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:29.054001 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f5a90885-9ebb-4b8c-98a4-2cbabebb4e2b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.436720 Aug 30 04:13:29.068427 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 618/1300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:28 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:29.083366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d1201bc4-e642-4a14-87af-c0002b583279 req-8d341338-e3c6-43ef-b6cc-e98a7dade751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ab32b1-0c9a-4544-82b7-e5a4b37dc555", "name": "network-vif-plugged", "status": "completed", "tag": "4b2b8670-b968-4f57-98f2-d6397f574cf5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:29.102540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d1201bc4-e642-4a14-87af-c0002b583279 req-8d341338-e3c6-43ef-b6cc-e98a7dade751 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:29.107846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d1201bc4-e642-4a14-87af-c0002b583279 req-8d341338-e3c6-43ef-b6cc-e98a7dade751 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:29.108412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d1201bc4-e642-4a14-87af-c0002b583279 req-8d341338-e3c6-43ef-b6cc-e98a7dade751 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:29.131973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d1201bc4-e642-4a14-87af-c0002b583279 req-8d341338-e3c6-43ef-b6cc-e98a7dade751 service nova] Creating event network-vif-plugged:4b2b8670-b968-4f57-98f2-d6397f574cf5 for instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 on n-h1-854925-5 Aug 30 04:13:29.143211 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d1201bc4-e642-4a14-87af-c0002b583279 req-8d341338-e3c6-43ef-b6cc-e98a7dade751 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073341 Aug 30 04:13:29.148388 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 619/1301] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:29.203494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:29.204744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:29.218737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:29.227873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:29.228304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:29.229056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:29.229551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:29.230196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:29.711341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:29.724724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e83fa43e-3381-42e5-b99d-d94649884300 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1313 microversion: 2.1 time: 0.890084 Aug 30 04:13:29.725344 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 683/1302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:28 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1313 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:29.794038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:29.806547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4c21d8a-0529-4237-a30a-cbc81bf131ff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.607523 Aug 30 04:13:29.807356 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 620/1303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:29 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:30.081128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:30.081930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:30.093976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.096742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.097302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.098105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.098577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.099015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.171349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:30.171858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:30.179174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.179676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.180127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.197910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.198438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.198887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.365090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:13:30.589479 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b8658199-3edc-4135-a51f-6531fc1199e1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 204 len: 0 microversion: 2.1 time: 0.421611 Aug 30 04:13:30.593434 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 621/1304] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:13:30 2022] DELETE /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:30.600234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:30.600907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:30.620361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.620861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.622768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.624203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.627092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.629197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.875679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:30.890497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ba2d02c2-b079-44f4-b755-832c62fb0ff5 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.812524 Aug 30 04:13:30.907849 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 684/1305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:30 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:30.933408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:30.938047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:30.947721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.952064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.952632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:30.955401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:30.955979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:30.956520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.137768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:31.149685 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-17142ab1-ec1c-4ad2-8ab7-f071865ef2bb tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1515 microversion: 2.1 time: 0.553449 Aug 30 04:13:31.151203 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 622/1306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:30 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1515 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:31.158364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:31.159688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:31.188161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.190422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.191154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.193223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.194540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.195807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.528732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:31.562162 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b53a0176-c906-4c41-af26-64daa3565f59 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1313 microversion: 2.1 time: 0.649482 Aug 30 04:13:31.568874 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 685/1307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:30 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:31.684597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:31.701491 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11b190b2-82e4-4844-8268-4e8fde21857e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1325 microversion: 2.1 time: 0.544933 Aug 30 04:13:31.702190 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 623/1308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:31 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1325 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:31.917849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:31.918645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:31.934784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.935541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.936202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:31.937090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:31.937743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:31.938354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:32.258696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-837320000", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "25481288-b646-4c38-9a19-eb4c2fee8514"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:32.344818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] validate_networks() for [('25481288-b646-4c38-9a19-eb4c2fee8514', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:32.411271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:32.437857 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2a40c1ae-2bd0-4f1f-8d77-5ac12ba0769b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.528559 Aug 30 04:13:32.460743 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 686/1309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:31 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:32.474066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:32.474833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:32.495112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:32.497580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:32.498276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:32.499180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:32.500812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:32.502904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.241574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:33.276113 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ed29b90-4869-444d-9d53-14bb67acac30 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1515 microversion: 2.1 time: 0.804111 Aug 30 04:13:33.279119 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 687/1310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:32 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1515 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:33.313563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:33.318390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:33.335090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.343243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.344667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.347451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.350546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.352520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.493602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:33.494702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:33.495343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:33.495928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:33.496499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:33.544981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.548184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.548635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.549467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.549913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.550340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.639573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:33.646966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for user 45901cc649784305a10c8a9278d1bef3 and project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:33.652273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:33.668926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:13:33.672505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:13:33.837210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:33.847290 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f8ec35b3-7265-4378-b04a-88a534597182 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1313 microversion: 2.1 time: 0.565565 Aug 30 04:13:33.848949 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 688/1311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:33 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:33.854534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:33.856333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:33.863891 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ebee3614-c72b-4394-8748-ae920896a0a6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.885098 Aug 30 04:13:33.864494 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 624/1312] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:13:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:13:33.873613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d4356cb1-8ef8-4bfd-a6c6-c35383c90b0d req-c0148c10-399f-4cab-afc9-a8b17e288e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "name": "network-vif-plugged", "status": "completed", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:33.887683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.889965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.892161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.896295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.897047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.907958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d4356cb1-8ef8-4bfd-a6c6-c35383c90b0d req-c0148c10-399f-4cab-afc9-a8b17e288e40 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:33.908443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d4356cb1-8ef8-4bfd-a6c6-c35383c90b0d req-c0148c10-399f-4cab-afc9-a8b17e288e40 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:33.908940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d4356cb1-8ef8-4bfd-a6c6-c35383c90b0d req-c0148c10-399f-4cab-afc9-a8b17e288e40 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.914917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:33.938477 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d4356cb1-8ef8-4bfd-a6c6-c35383c90b0d req-c0148c10-399f-4cab-afc9-a8b17e288e40 service nova] Creating event network-vif-plugged:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h2-854925-5 Aug 30 04:13:33.954683 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d4356cb1-8ef8-4bfd-a6c6-c35383c90b0d req-c0148c10-399f-4cab-afc9-a8b17e288e40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088469 Aug 30 04:13:33.958850 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 625/1313] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:33.984295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:33.988007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:34.002442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.003181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.003781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:34.004624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.005218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.008762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:34.454030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:34.462542 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b9d72c2-1518-4aaa-950f-260368cf3f49 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1521 microversion: 2.1 time: 0.611999 Aug 30 04:13:34.484599 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 689/1314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:33 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1521 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:34.492232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1b7b80e0-0c24-480d-a13b-be4a971afb0d req-4be9753d-3037-4b68-afb1-8b87658da264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf6924b8-3ae7-4975-96df-cbc966865cfd", "name": "network-vif-deleted", "tag": "e7c5b272-f231-4ba3-b572-523b5d2f7cac"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:34.557029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1b7b80e0-0c24-480d-a13b-be4a971afb0d req-4be9753d-3037-4b68-afb1-8b87658da264 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.563092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1b7b80e0-0c24-480d-a13b-be4a971afb0d req-4be9753d-3037-4b68-afb1-8b87658da264 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.564170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1b7b80e0-0c24-480d-a13b-be4a971afb0d req-4be9753d-3037-4b68-afb1-8b87658da264 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:34.604289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:34.624897 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-09dd792c-2ed0-4a6e-9305-168b8342f514 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.664286 Aug 30 04:13:34.628772 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 626/1315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:33 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:34.629250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1b7b80e0-0c24-480d-a13b-be4a971afb0d req-4be9753d-3037-4b68-afb1-8b87658da264 service nova] Creating event network-vif-deleted:e7c5b272-f231-4ba3-b572-523b5d2f7cac for instance cf6924b8-3ae7-4975-96df-cbc966865cfd on n-h2-854925-5 Aug 30 04:13:34.647065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1b7b80e0-0c24-480d-a13b-be4a971afb0d req-4be9753d-3037-4b68-afb1-8b87658da264 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157634 Aug 30 04:13:34.648411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ca76717-1bdb-4fee-9a63-884deec0ae0e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:34.650597 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 690/1316] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:34.652088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ca76717-1bdb-4fee-9a63-884deec0ae0e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:34.697645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:34.702076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:34.746525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.751432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.751973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:34.757185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.759119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.764531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:34.869100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ca76717-1bdb-4fee-9a63-884deec0ae0e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:34.884323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ca76717-1bdb-4fee-9a63-884deec0ae0e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:34.885402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.887993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.892059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ca76717-1bdb-4fee-9a63-884deec0ae0e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:34.892630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:34.895064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lazy-loading 'fault' on Instance uuid cf6924b8-3ae7-4975-96df-cbc966865cfd {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:34.899225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ca76717-1bdb-4fee-9a63-884deec0ae0e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1261 microversion: 2.25 time: 0.264772 Aug 30 04:13:34.900763 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 627/1317] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:34 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1261 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:34.919510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:34.928710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:34.967827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.968550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.969008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:34.969765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:34.970229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:34.970661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.006788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:35.015779 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6f0890b-016f-4adc-b3f2-2a83ddf6df3a tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 200 len: 1308 microversion: 2.1 time: 0.343362 Aug 30 04:13:35.016363 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 691/1318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:34 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 1308 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:35.025091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:35.028969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:35.056309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.056309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.070425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.073563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.074103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.074570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.078536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.412780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:35.436411 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa0d74f1-8b19-4edc-9052-26320e55e584 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1521 microversion: 2.1 time: 0.528564 Aug 30 04:13:35.438664 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 628/1319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:34 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1521 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:35.459913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-3182137"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:35.463321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:35.490252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.493919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.495716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.499887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.501813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.504819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.534616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:35.551028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab47b476-3267-468f-a115-de05674c4fe2 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1313 microversion: 2.1 time: 0.530898 Aug 30 04:13:35.551663 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 692/1320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:35 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:35.649755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:35.650720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:35.682103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.686116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.686919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.689249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:35.689876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:35.690907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:35.856210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:35.973765 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3b09314a-df7b-44a7-8094-38e0d448f64f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555/action" status: 202 len: 0 microversion: 2.1 time: 0.511350 Aug 30 04:13:35.977158 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 629/1321] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:13:35 2022] POST /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:13:36.003807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.007657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:36.043084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.053214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.054870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.069592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.072274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.072853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.262415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:36.266456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:36.272317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:36.274141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:36.275585 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a8dbd4f-eba3-4907-9365-ef827c1d1553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1313 microversion: 2.25 time: 0.295757 Aug 30 04:13:36.276318 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 630/1322] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:35 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:36.278707 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6673ce6d-82a8-49b3-a3c4-ccfba485f22c tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.633103 Aug 30 04:13:36.281100 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 693/1323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:35 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:36.293099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.293421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21ff42e0-ed0a-4f7a-b432-018fb61c08a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '.version_select at 0x7fe96a00fca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.295534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: cf6924b8-3ae7-4975-96df-cbc966865cfd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:36.330722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.332845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.336147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.337010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.337620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.338151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.411971 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] HTTP exception thrown: Instance cf6924b8-3ae7-4975-96df-cbc966865cfd could not be found. Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Request method failure captured: Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd HTTP/1.1 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2px92Vmq-D8yZCT3OLPKUOp84OLuOsnCW63Xr7IGY-lBKD_ECbD4BVxd1ovzOrLTJVtm0NSvbIzKag0kMU1wIL2WTYXxUmObLR2k2uXmZnadgq1G1XHKnNUw0Ok7awVVobESueF5O7R8hoip990sy3Uvj4FSXPkRRSsrOmvNbHEV0 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b44a575fabe74c81a44e2ae1cd33ce66 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesAdminNegativeTest-1366814761 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b44a575fabe74c81a44e2ae1cd33ce66", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b44a575fabe74c81a44e2ae1cd33ce66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b44a575fabe74c81a44e2ae1cd33ce66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b44a575fabe74c81a44e2ae1cd33ce66"}]}] Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesAdminNegativeTest-1366814761 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b44a575fabe74c81a44e2ae1cd33ce66 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1366814761 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesAdminNegativeTest-1366814761-project Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ef42627af9c446b2ac60d9fc9f01a019 Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesAdminNegativeTest-1366814761-project Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance cf6924b8-3ae7-4975-96df-cbc966865cfd could not be found. Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'cf6924b8-3ae7-4975-96df-cbc966865cfd'} Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf6924b8-3ae7-4975-96df-cbc966865cfd could not be found. Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf6924b8-3ae7-4975-96df-cbc966865cfd could not be found. Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:36.425903 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf6924b8-3ae7-4975-96df-cbc966865cfd could not be found. Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.430399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Returning 404 to user: Instance cf6924b8-3ae7-4975-96df-cbc966865cfd could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:36.432389 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4aeab4c-4034-4c79-bd88-40075b9acff4 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd" status: 404 len: 111 microversion: 2.1 time: 0.147822 Aug 30 04:13:36.436615 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 694/1324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:36 2022] GET /compute/v2.1/servers/cf6924b8-3ae7-4975-96df-cbc966865cfd => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:36.575173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.577485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:36.601517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.602779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.604970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.613582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.617574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.617574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.647843 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21ff42e0-ed0a-4f7a-b432-018fb61c08a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393" status: 204 len: 0 microversion: 2.1 time: 0.370266 Aug 30 04:13:36.648421 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 631/1325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:36 2022] DELETE /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:36.656384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82cf20a6-ac17-44ab-8fc3-4a588c43e5c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '.version_select at 0x7fe96a1c1160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.691522 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-82cf20a6-ac17-44ab-8fc3-4a588c43e5c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Image not found. Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82cf20a6-ac17-44ab-8fc3-4a588c43e5c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393 HTTP/1.1 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '7398d687-6379-453a-8205-3c169d492393'} Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7398d687-6379-453a-8205-3c169d492393 Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:13:36.693894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7398d687-6379-453a-8205-3c169d492393 could not be found. Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:13:36.698819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:13:36.705096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82cf20a6-ac17-44ab-8fc3-4a588c43e5c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:36.706452 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82cf20a6-ac17-44ab-8fc3-4a588c43e5c0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393" status: 404 len: 62 microversion: 2.1 time: 0.053753 Aug 30 04:13:36.715619 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 632/1326] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:13:36 2022] GET /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:13:36.720904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:36.725972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:36.752313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.755925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.758898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:36.761050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:36.761842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:36.762286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.310146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:37.314802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:37.325199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab82c927-ebf9-4467-b5c2-7f9eaf3ef0be tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1463 microversion: 2.1 time: 0.756947 Aug 30 04:13:37.325621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26f9df18-0cae-4407-b6d9-9ff18283f1a6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1533 microversion: 2.1 time: 0.608456 Aug 30 04:13:37.327891 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 695/1327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:36 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1463 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:37.339143 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 633/1328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:36 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1533 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:37.344402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:37.344739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:37.347062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:37.361408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:37.378029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.384196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.385339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.387157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.387937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.388600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.388741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.389776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.390454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.391100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.391502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.391960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.598360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:37.614356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:37.615945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:37.617847 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a0782d40-7490-4771-8653-e53d473ab853 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1331 microversion: 2.25 time: 0.287819 Aug 30 04:13:37.618752 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 696/1329] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:37 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1331 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:37.637192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:37.640037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:37.652571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.655224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.656882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:37.657832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:37.658586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:37.659161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.375697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:38.389693 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-120e92d9-b748-4f0e-ac79-d4097d1eabe3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 1.047670 Aug 30 04:13:38.404548 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 634/1330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:37 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:38.415554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:38.416394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:38.439743 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-82694b93-040d-4ee7-b55e-9260cd35d829 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1614 microversion: 2.1 time: 0.819523 Aug 30 04:13:38.451374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.452351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.453168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.454146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.455161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.456514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.457501 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 697/1331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:37 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1614 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:38.472262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:38.478012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:38.491836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:38.493579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.496950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.497623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.499500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.501991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.502617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.557043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'd9ad8b7c062d4d2fa6604c354223a441', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8b5714ad31147e09278412b8e7de2de', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:38.557953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] flavor_id is None. Assuming migration. {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 04:13:38.558583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:13:38.776649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:38.790709 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c09e76a-3345-4494-9caa-087d2ca0332e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1533 microversion: 2.1 time: 0.384942 Aug 30 04:13:38.792989 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 635/1332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:38 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1533 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:38.803376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:38.808633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:38.846426 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5526b4a7-42ce-47d6-ade2-6f85c80269a7 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f/action" status: 202 len: 0 microversion: 2.1 time: 0.387386 Aug 30 04:13:38.858628 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 698/1333] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:13:38 2022] POST /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:13:38.865616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:38.866566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:38.875493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.883543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.884750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.885998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.886652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.887282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.915897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.917905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.919390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:38.924130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:38.926582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:38.927270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:39.588032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:39.604862 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c556d797-b93e-4d8b-8c18-ef8da20e3545 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1472 microversion: 2.1 time: 0.739050 Aug 30 04:13:39.617416 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 699/1334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:38 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1472 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:39.620437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:39.622052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:39.637564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:39.639523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:39.639523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:39.644610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:39.645622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:39.646312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:40.275759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:40.300573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:40.313510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:40.316171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7cd3ffa2-b4b3-48f7-84fa-8b6a3d37229b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 1.521103 Aug 30 04:13:40.317385 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 636/1335] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:38 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:40.322291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:40.323162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:40.333907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:40.337221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:40.338666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:40.340409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:40.348728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:40.349558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:40.607637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:40.617984 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6f7cce6-3e97-4ced-98a7-dfe21e8bd794 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 1.005938 Aug 30 04:13:40.636527 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 700/1336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:39 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:40.997691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5306d0e7-c72e-4f4f-89c4-ed8c2c4b18c1 req-0441fa34-4f72-4b5e-b351-e5f7d1b38e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cab24f-d0e3-4f5b-9c03-160d24dee5cd", "tag": "68819321-643b-4b16-8e40-c2405c0e617b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:41.025951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5306d0e7-c72e-4f4f-89c4-ed8c2c4b18c1 req-0441fa34-4f72-4b5e-b351-e5f7d1b38e21 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.027540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5306d0e7-c72e-4f4f-89c4-ed8c2c4b18c1 req-0441fa34-4f72-4b5e-b351-e5f7d1b38e21 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.027999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5306d0e7-c72e-4f4f-89c4-ed8c2c4b18c1 req-0441fa34-4f72-4b5e-b351-e5f7d1b38e21 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.079267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:41.096632 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff42473b-fb1f-4064-8c33-718ad5a70aee tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1539 microversion: 2.1 time: 0.773592 Aug 30 04:13:41.098186 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 637/1337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:40 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1539 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:41.107816 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5306d0e7-c72e-4f4f-89c4-ed8c2c4b18c1 req-0441fa34-4f72-4b5e-b351-e5f7d1b38e21 service nova] Creating event network-changed:68819321-643b-4b16-8e40-c2405c0e617b for instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd on n-h1-854925-5 Aug 30 04:13:41.111080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:41.114375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:41.135825 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5306d0e7-c72e-4f4f-89c4-ed8c2c4b18c1 req-0441fa34-4f72-4b5e-b351-e5f7d1b38e21 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.508242 Aug 30 04:13:41.145521 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 701/1338] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:41.154499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.158235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.165862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.173383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.173383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.173383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.341782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:41.342806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:41.356153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.356841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.358062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.358980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.370722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.372755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.786158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:41.796806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:41.798614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:41.799979 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b3f30613-651f-4111-bb1e-5d6859578d59 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.463650 Aug 30 04:13:41.815006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:41.816992 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 702/1339] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:41 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:41.835353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ffc0e904-45ce-40d8-b5c8-bad15d1c0bfd tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1472 microversion: 2.1 time: 0.732091 Aug 30 04:13:41.836337 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 638/1340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:41 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1472 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:41.836665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:41.837757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:41.852573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.854402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.855824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:41.860794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:41.861364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:41.863357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.119770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:42.120738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:42.136244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.137492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.138356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.140421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.142910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.143636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.400129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:42.416128 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7933b25-87e8-4d45-b95b-babf719d72e3 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.586806 Aug 30 04:13:42.419626 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 703/1341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:41 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:42.642993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:42.661003 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99f6b730-081f-4900-b6e9-2b0b5d89f283 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1539 microversion: 2.1 time: 0.544872 Aug 30 04:13:42.663463 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 639/1342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:42 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1539 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:42.829015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:42.830559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:42.846031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.846602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.847064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.853803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.854650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.855310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.860151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:42.861907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:42.870603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.871483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.872093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:42.872978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:42.873703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:42.874300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.277744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:43.285506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:43.288498 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e6f8bc3c-616d-48ff-9816-581f8fc16644 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1472 microversion: 2.1 time: 0.433621 Aug 30 04:13:43.294724 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 640/1343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:42 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:43.301135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:43.302678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:43.303816 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71739fc1-fc74-4590-a837-5767b02ce343 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.479308 Aug 30 04:13:43.304367 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 704/1344] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:42 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:43.455307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:43.456216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:43.469994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.472488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.473238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.475913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.476797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.477546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.613364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:43.695307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:43.696278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:43.707323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:43.709361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.710407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.711035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.712197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:43.712834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:43.713660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:43.716114 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e2cd84f-4059-4f1e-864c-4a69d7c4e69f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.268833 Aug 30 04:13:43.736017 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 641/1345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:43 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:44.045656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:44.055038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dc3abb56-184e-4e03-ac2b-ca724c46ae95 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1539 microversion: 2.1 time: 0.372947 Aug 30 04:13:44.065815 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 705/1346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:43 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1539 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:44.315301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:44.315916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:44.325764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:44.326419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:44.339202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.339702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.340144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.344922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.346358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.347280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.348780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.350900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.352469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.353524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.359934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.361189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.814613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:44.823790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:44.824405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:44.828744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:44.831582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6fe53ad-5fde-488e-8307-31e7a053a7dc tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.509851 Aug 30 04:13:44.834269 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a1b88d7b-fbe9-4c49-a6cb-2822c932fd36 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.523340 Aug 30 04:13:44.837001 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 706/1347] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:44 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:44.837515 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 642/1348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:44 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:44.843085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:44.843590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:44.845050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:44.845876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:44.852717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.853268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.854008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.854928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.855593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.856089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.862986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.865159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.866971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.869131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:44.870988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:44.871596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:44.898968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:44.922697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:13:44.987415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:45.110674 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0b9d689-ee5e-4091-bb13-0af60e774bda tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 204 len: 0 microversion: 2.1 time: 0.272280 Aug 30 04:13:45.111571 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 707/1349] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:13:44 2022] DELETE /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:45.117299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1df627f0-e491-4fc8-bbad-38ce5ab93944 req-ff8dd16d-dd28-491c-864a-43d892ee4874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ab32b1-0c9a-4544-82b7-e5a4b37dc555", "name": "network-vif-plugged", "status": "completed", "tag": "4b2b8670-b968-4f57-98f2-d6397f574cf5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:45.137268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1df627f0-e491-4fc8-bbad-38ce5ab93944 req-ff8dd16d-dd28-491c-864a-43d892ee4874 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.138121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1df627f0-e491-4fc8-bbad-38ce5ab93944 req-ff8dd16d-dd28-491c-864a-43d892ee4874 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.139573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1df627f0-e491-4fc8-bbad-38ce5ab93944 req-ff8dd16d-dd28-491c-864a-43d892ee4874 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.161001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1df627f0-e491-4fc8-bbad-38ce5ab93944 req-ff8dd16d-dd28-491c-864a-43d892ee4874 service nova] Creating event network-vif-plugged:4b2b8670-b968-4f57-98f2-d6397f574cf5 for instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 on n-h1-854925-5 Aug 30 04:13:45.172476 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1df627f0-e491-4fc8-bbad-38ce5ab93944 req-ff8dd16d-dd28-491c-864a-43d892ee4874 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059200 Aug 30 04:13:45.173623 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 708/1350] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:45.188467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:45.189891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:45.198922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.199523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.199973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.200937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.202111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.202867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.546424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:45.558395 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-72e459fd-7f12-42ea-8410-ac36cee85f08 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.719642 Aug 30 04:13:45.562286 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 643/1351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:44 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:45.567373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:45.568664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:45.575895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.577083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.577642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:45.578799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:45.579362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:45.580303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.015716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:46.024525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26cdb729-4f80-4c4a-ae47-c804634c9d3f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1539 microversion: 2.1 time: 0.849563 Aug 30 04:13:46.025200 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 709/1352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:45 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1539 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:46.030223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:46.031047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:46.037617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.039227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.040244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.041257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.041640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.042197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.134005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:46.146073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c67fe522-531b-45fb-a567-75d3f5ece089 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1680 microversion: 2.1 time: 0.580286 Aug 30 04:13:46.147743 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 644/1353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:45 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1680 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:46.155969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:46.158441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:46.174746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.177025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.177468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.179305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.182479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.183731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.261954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:46.274975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:46.276450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:46.278359 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47e71f93-a6bf-4226-99ec-757208fa229e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.252136 Aug 30 04:13:46.278935 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 710/1354] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:46 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:46.383999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1722830110", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "1c7da6b7-0398-45be-8c2b-7a646ff291b6"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:46.443838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:46.455555 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dca014e6-8f6c-4111-8e9e-97135756f2b7 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.306445 Aug 30 04:13:46.457138 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 645/1355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:46 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:46.499685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] validate_networks() for [('1c7da6b7-0398-45be-8c2b-7a646ff291b6', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:46.585129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:46.586090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:46.599519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.600407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.601048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.605814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:46.606616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:46.607270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:46.898929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:46.908019 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9bc60538-b14c-4410-8c8a-ee659799d226 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.328191 Aug 30 04:13:46.923117 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 646/1356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:46 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:47.045118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:47.045771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:47.054218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:13:47.054644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:13:47.055123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:13:47.055537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:13:47.055949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:13:47.065265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.065779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.066399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.067115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.067572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.068054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.075285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.076154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.077631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.078601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.079065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.079498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.112859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Getting quotas for project 67d43f74483f4c5aa5ba8fb5fd14032b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:13:47.119997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Getting quotas for user 2150ff19d8bf4037a114d9b31edfdc9a and project 67d43f74483f4c5aa5ba8fb5fd14032b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:13:47.135261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:13:47.138023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:13:47.211773 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-129eb8e1-f464-4ddd-858d-2023ee054f7a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896342 Aug 30 04:13:47.212863 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 711/1357] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:13:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:13:47.219505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:47.222858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:47.248259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.249269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.249736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.251764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.252230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.252754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.256104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.262179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:47.268630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-37f1d229-339a-4147-85a8-1bd2a8c3675b tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1534 microversion: 2.1 time: 0.227265 Aug 30 04:13:47.269655 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 647/1358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:47 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1534 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:47.274245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e899d818-af5b-4b21-9b59-2fca8dfdb699 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:47.274942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e899d818-af5b-4b21-9b59-2fca8dfdb699 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:47.382596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e899d818-af5b-4b21-9b59-2fca8dfdb699 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.390151 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e899d818-af5b-4b21-9b59-2fca8dfdb699 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1218 microversion: 2.1 time: 0.119392 Aug 30 04:13:47.390736 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 648/1359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:47 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:47.409367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:47.410963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:47.423622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.424632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.425250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.426419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.427247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.427860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.486419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.495030 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ca9656a-d4ab-4eff-a092-81fdc3531868 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1680 microversion: 2.1 time: 0.280991 Aug 30 04:13:47.495613 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 712/1360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:47 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1680 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:47.531119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:47.536913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:47.549586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.550081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.550517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.551228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.554796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.555260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.797204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.807530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.809814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.811202 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5b38395-509a-4ed6-9293-b8b507d19ef8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.418386 Aug 30 04:13:47.812095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 649/1361] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:47 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:47.842961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:47.854648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-74107253-7080-445a-92cc-88208c917476 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.357995 Aug 30 04:13:47.856558 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 713/1362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:47 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:47.928645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:47.929314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:47.936556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.937034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.937565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:47.938322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:47.939238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:47.940115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.105053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:48.114284 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b981ca1-7ff9-41ce-97b1-d1587083ff90 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.190024 Aug 30 04:13:48.115380 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 650/1363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:47 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:48.295674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:48.296594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:48.308321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.309070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.309704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.311537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.312268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.313387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.413677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:48.414810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:48.434638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.436132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.438084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.439212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.442932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.444225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.554757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:48.565311 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7173182-e289-44f6-880b-16ea94cb53a7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1534 microversion: 2.1 time: 0.274951 Aug 30 04:13:48.580101 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 714/1364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:48 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1534 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:48.585612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:48.586505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:48.593993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.595025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.595891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.597025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.597692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.598285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.613591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:48.622797 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b85ef20b-4591-4dcf-9d75-6845da3e1232 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1270 microversion: 2.1 time: 0.215266 Aug 30 04:13:48.631079 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 651/1365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:48 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:48.795668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:48.809566 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f20e50bd-eafe-4e03-88c2-1c93635daea7 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1680 microversion: 2.1 time: 0.226316 Aug 30 04:13:48.812994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 715/1366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:48 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1680 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:48.840506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:48.841132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:48.867616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.877968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.891671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:48.892740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:48.898269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.899708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.905639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.906747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.915382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.915922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.916845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:48.917125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:48.917977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:48.918432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:49.306038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:49.318285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:49.319806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:49.320994 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6eacfeb8-3566-4778-9331-9600fda677da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.487746 Aug 30 04:13:49.321601 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 652/1367] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:48 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:49.340814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:49.341708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:49.359731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:49.360613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:49.361250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:49.362254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:49.362889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:49.363480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:49.375745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:49.391986 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-54a8793a-cfe5-499f-8a4a-3a3657fe73f6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.506174 Aug 30 04:13:49.408669 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 716/1368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:48 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:49.598154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:49.600058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:49.616262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:49.617561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:49.620798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:49.622939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:49.626279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:49.627681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.025099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:50.035481 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-834eceda-4ac0-407d-ba62-2fc16cc5516f tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.706899 Aug 30 04:13:50.036571 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 653/1369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:49 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:50.041605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:50.046689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:50.059153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.059762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.060470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.062813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.063380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.063872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.206668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:50.226593 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-41a491d1-8fa7-4a8a-9f08-eb807abb81f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1276 microversion: 2.1 time: 0.183500 Aug 30 04:13:50.237383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:50.242600 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 654/1370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:50 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1276 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:50.245552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7856a95-aaf6-4e78-a23f-083cafbe6485 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1521 microversion: 2.1 time: 0.659373 Aug 30 04:13:50.246139 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 717/1371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:49 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1521 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:50.258509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3adac96e-e165-49cd-b587-74dc0ebeff12 req-7dfe0fb0-5684-40ea-8218-77ae118b56b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cab24f-d0e3-4f5b-9c03-160d24dee5cd", "name": "network-vif-plugged", "status": "completed", "tag": "68819321-643b-4b16-8e40-c2405c0e617b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:50.268373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:50.268999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:50.281724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.282225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.282664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.283380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.283839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.284271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.286200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3adac96e-e165-49cd-b587-74dc0ebeff12 req-7dfe0fb0-5684-40ea-8218-77ae118b56b7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.287889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3adac96e-e165-49cd-b587-74dc0ebeff12 req-7dfe0fb0-5684-40ea-8218-77ae118b56b7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.291591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3adac96e-e165-49cd-b587-74dc0ebeff12 req-7dfe0fb0-5684-40ea-8218-77ae118b56b7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.319799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3adac96e-e165-49cd-b587-74dc0ebeff12 req-7dfe0fb0-5684-40ea-8218-77ae118b56b7 service nova] Creating event network-vif-plugged:68819321-643b-4b16-8e40-c2405c0e617b for instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd on n-h1-854925-5 Aug 30 04:13:50.330796 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3adac96e-e165-49cd-b587-74dc0ebeff12 req-7dfe0fb0-5684-40ea-8218-77ae118b56b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085680 Aug 30 04:13:50.332663 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 655/1372] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:50.350888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:50.359730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:50.379487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.380022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.380468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.381183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.381712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.382144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.453067 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-60b48fa6-2852-4707-a2e8-951786d5e71c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118180 Aug 30 04:13:50.453743 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 656/1373] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:13:50 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:50.463121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:50.465750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:50.479709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.480237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.480656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.481388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.483298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.484199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.556506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:13:50.612937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:50.626923 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9481da60-32e2-4265-99dc-5c8c50f355ee tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1680 microversion: 2.1 time: 0.358942 Aug 30 04:13:50.627833 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 718/1374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:50 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1680 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:50.648611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:50.650428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:50.671351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.672448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.675030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.677453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.678469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.679094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.832611 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ab5b4d9-ad4b-4f17-9023-86d2e060e611 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 204 len: 0 microversion: 2.1 time: 0.373426 Aug 30 04:13:50.833224 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 657/1375] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:13:50 2022] DELETE /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:50.843295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:50.844006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:50.866225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.866729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.867168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:50.867878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:50.868602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:50.869177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.076761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:51.088771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:51.090896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:51.093402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5bdcdda9-e6a8-49ef-b06c-1f8de1cd8642 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.463168 Aug 30 04:13:51.114935 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 719/1376] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:50 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:51.125247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.125834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:51.134408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.135476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.136139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.137104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.137831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.138511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.309375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lazy-loading 'services' on Instance uuid 2fa0d49a-b773-4919-bc1f-237caf6c7381 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:51.354027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:51.366378 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd144116-e53e-45dd-b4c8-bde33a5d959d tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.528580 Aug 30 04:13:51.385135 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 658/1377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:50 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:51.390314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.397846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:51.406534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.407341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.408055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.409163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.409961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.410677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.443134 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfb566b9-85c0-4ff7-9db6-92bb817f5b96 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments/09699321-30ef-47a3-9344-8a304b8d9d79" status: 202 len: 0 microversion: 2.1 time: 0.326815 Aug 30 04:13:51.443858 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 720/1378] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:13:51 2022] DELETE /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments/09699321-30ef-47a3-9344-8a304b8d9d79 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:13:51.451300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.452223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:51.459128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.459813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.460410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.461266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.461899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.462678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.850496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:51.862097 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dc57aad-f04d-4446-b309-b2c4949662d0 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1527 microversion: 2.1 time: 0.475531 Aug 30 04:13:51.865743 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 659/1379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:51 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1527 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:51.872940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:51.873918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:51.893560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.894388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.906097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.907238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:51.907940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:51.908609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:51.947458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:51.967646 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-999edbe4-4eb9-42af-b7c6-765edae0d155 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.513981 Aug 30 04:13:51.982516 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 721/1380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:51 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:51.988416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-98d619b4-0c74-4170-95c5-278c49438874 req-a416768f-d5b8-4baf-8d0a-07ecc6b3f273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b6241b-bd6b-497a-be52-1610160d2fbf", "tag": "466d0b50-71b0-4ea1-b478-2f7f3c8cc403"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:52.000050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98d619b4-0c74-4170-95c5-278c49438874 req-a416768f-d5b8-4baf-8d0a-07ecc6b3f273 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.002702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98d619b4-0c74-4170-95c5-278c49438874 req-a416768f-d5b8-4baf-8d0a-07ecc6b3f273 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.014546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98d619b4-0c74-4170-95c5-278c49438874 req-a416768f-d5b8-4baf-8d0a-07ecc6b3f273 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.031069 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-98d619b4-0c74-4170-95c5-278c49438874 req-a416768f-d5b8-4baf-8d0a-07ecc6b3f273 service nova] Creating event network-changed:466d0b50-71b0-4ea1-b478-2f7f3c8cc403 for instance 98b6241b-bd6b-497a-be52-1610160d2fbf on n-h2-854925-5 Aug 30 04:13:52.037072 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-98d619b4-0c74-4170-95c5-278c49438874 req-a416768f-d5b8-4baf-8d0a-07ecc6b3f273 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052138 Aug 30 04:13:52.038899 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 722/1381] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:52.050797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:52.067522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:52.080541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:52.084720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.086066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.087702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.089172 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b09e8105-8f96-4760-8c83-e0f0c6989d9e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1318 microversion: 2.1 time: 0.221842 Aug 30 04:13:52.089635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.090515 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 660/1382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:51 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:52.104466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.105576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.188492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7b2b3142-ade3-46b5-b26d-514a2f7a9836 req-0d37c46e-49a0-4de4-a1a0-8ee75b0abbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7e450c-101b-43a5-96ef-e8e35901e3b2", "name": "network-vif-deleted", "tag": "457ebde2-e320-4370-9d9b-77ba6f31e833"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:52.200958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7b2b3142-ade3-46b5-b26d-514a2f7a9836 req-0d37c46e-49a0-4de4-a1a0-8ee75b0abbff service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.202255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7b2b3142-ade3-46b5-b26d-514a2f7a9836 req-0d37c46e-49a0-4de4-a1a0-8ee75b0abbff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.202940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7b2b3142-ade3-46b5-b26d-514a2f7a9836 req-0d37c46e-49a0-4de4-a1a0-8ee75b0abbff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.214930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:52.223379 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7b2b3142-ade3-46b5-b26d-514a2f7a9836 req-0d37c46e-49a0-4de4-a1a0-8ee75b0abbff service nova] Creating event network-vif-deleted:457ebde2-e320-4370-9d9b-77ba6f31e833 for instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 on n-h1-854925-5 Aug 30 04:13:52.226943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fce0267e-644d-42f3-bec7-89add3a1cc03 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1613 microversion: 2.1 time: 0.186370 Aug 30 04:13:52.227923 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 723/1383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:52 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1613 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:52.229959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7b2b3142-ade3-46b5-b26d-514a2f7a9836 req-0d37c46e-49a0-4de4-a1a0-8ee75b0abbff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137468 Aug 30 04:13:52.231089 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 661/1384] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:52.233042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:52.233708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:52.243011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.243711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.244096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.244724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.245409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.245876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.388641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:52.389897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:52.393020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:52.395595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:52.404354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.404354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.404757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.405771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.406233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.406661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.406770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:52.408140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:52.409409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8590d9ef-2480-4886-9b76-772de602fd77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.180324 Aug 30 04:13:52.410143 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 724/1385] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:52 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:52.579268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:52.588679 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc4a0596-1665-462f-a27c-e04858188968 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.204112 Aug 30 04:13:52.589506 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 662/1386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:52 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:52.885666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:52.886279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:52.895722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.896213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.896649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.897477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:52.897840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:52.898254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:52.994695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:52.995766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:53.002346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.003266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.003881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.004582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.005193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.006762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.180796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.189028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a554ceb-1b94-47e3-bd39-ddfe0b216a73 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1527 microversion: 2.1 time: 0.307178 Aug 30 04:13:53.198211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 725/1387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:52 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1527 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:53.210606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:53.211275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:53.221497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.222001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.222641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.223358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.223933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.224423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.232142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.241315 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5eca7bb4-3ce2-4c6f-bffd-9e6d71d57419 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.251729 Aug 30 04:13:53.243210 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 663/1388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:52 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:53.258115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:53.259400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:53.272740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.273941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.274462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.275304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.275831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.276598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.395801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.406752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c582296-1f77-4d4f-9dc2-2f1f47db68e2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1326 microversion: 2.1 time: 0.154538 Aug 30 04:13:53.419448 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 664/1389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:53 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1326 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:53.434017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:53.434915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:53.443981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.444669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.445206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.447532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.448178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.448753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.455613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:53.467791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.476786 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c03b88a-b933-4536-b1d7-dc22bc87c903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1318 microversion: 2.1 time: 0.283845 Aug 30 04:13:53.490599 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 726/1390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:53 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:53.613909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:53.614912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.615293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:53.624413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.625403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.626098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.626909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.627913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.628478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.629195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.630765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.632138 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed4e91c1-e842-4ff5-aa0f-f5dd76c2a963 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1361 microversion: 2.25 time: 0.204019 Aug 30 04:13:53.633191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 665/1391] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:53 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:13:53.713529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5a704667-72af-4c16-9bb9-cc99ec1f1a52 req-fd2f22fd-47fd-4bcf-a7db-bc8ebad03c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ab32b1-0c9a-4544-82b7-e5a4b37dc555", "name": "network-vif-unplugged", "status": "completed", "tag": "4b2b8670-b968-4f57-98f2-d6397f574cf5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:53.726369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5a704667-72af-4c16-9bb9-cc99ec1f1a52 req-fd2f22fd-47fd-4bcf-a7db-bc8ebad03c07 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:53.727130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5a704667-72af-4c16-9bb9-cc99ec1f1a52 req-fd2f22fd-47fd-4bcf-a7db-bc8ebad03c07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:53.727786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5a704667-72af-4c16-9bb9-cc99ec1f1a52 req-fd2f22fd-47fd-4bcf-a7db-bc8ebad03c07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:53.751398 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5a704667-72af-4c16-9bb9-cc99ec1f1a52 req-fd2f22fd-47fd-4bcf-a7db-bc8ebad03c07 service nova] Creating event network-vif-unplugged:4b2b8670-b968-4f57-98f2-d6397f574cf5 for instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 on n-h1-854925-5 Aug 30 04:13:53.756547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5a704667-72af-4c16-9bb9-cc99ec1f1a52 req-fd2f22fd-47fd-4bcf-a7db-bc8ebad03c07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121913 Aug 30 04:13:53.757310 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 666/1392] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:53.830796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:53.838835 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20d31f75-4915-4f42-ab58-8c2ec0bc051e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.230242 Aug 30 04:13:53.839416 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 727/1393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:53 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:13:54.213086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:54.213820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:54.220183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.220676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.221117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.222222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.222316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.222710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.265260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:54.265939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:54.272384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.272880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.273356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.274508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.274508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.274933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.467921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:54.479050 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11a16211-1bb7-4aac-b810-6e089b185dbe tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1527 microversion: 2.1 time: 0.270244 Aug 30 04:13:54.479653 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 667/1394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:54 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1527 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:54.491503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:54.492130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:54.507946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:54.509521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.510020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.510461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.513111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.513616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.514119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.587761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:54.595962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.597015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.597557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.597953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-045fed58-a84c-4d5d-b4c6-10814950ad7e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1524 microversion: 2.1 time: 0.337656 Aug 30 04:13:54.598074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lazy-loading 'fault' on Instance uuid 5a7e450c-101b-43a5-96ef-e8e35901e3b2 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:54.598556 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 728/1395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:54 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1524 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:54.608834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:54.621620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:54.632325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.634897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.634897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.635264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.635473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.635878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.663832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:54.674138 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-15834135-6215-4ffc-80cd-4cdb0b4c3cc2 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1331 microversion: 2.1 time: 0.193451 Aug 30 04:13:54.675046 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 668/1396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:54 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1331 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:54.679692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:54.680300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:54.686441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.686859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.687302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:54.687986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:54.688782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:54.689633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.157000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:55.167058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26102693-175f-4f67-9286-64799fe50337 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1318 microversion: 2.1 time: 0.566794 Aug 30 04:13:55.186920 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 729/1397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:54 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:55.197037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:55.197957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:55.225854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.226580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.227185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.228078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.230638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.231793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.247745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:55.256799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:55.259665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:55.261446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5a02ef32-8aa3-4db2-8cbb-de7a0016f073 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1558 microversion: 2.25 time: 0.585319 Aug 30 04:13:55.263110 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 669/1398] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:54 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1558 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:55.268119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-340d65e3-362d-4537-b948-3146f7cf0bb7 req-0cfb17c0-3fb8-41c2-9b1d-1d53b3e35e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ab32b1-0c9a-4544-82b7-e5a4b37dc555", "name": "network-vif-deleted", "tag": "4b2b8670-b968-4f57-98f2-d6397f574cf5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:55.286718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-340d65e3-362d-4537-b948-3146f7cf0bb7 req-0cfb17c0-3fb8-41c2-9b1d-1d53b3e35e59 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.293375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-340d65e3-362d-4537-b948-3146f7cf0bb7 req-0cfb17c0-3fb8-41c2-9b1d-1d53b3e35e59 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.294350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-340d65e3-362d-4537-b948-3146f7cf0bb7 req-0cfb17c0-3fb8-41c2-9b1d-1d53b3e35e59 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.326671 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-340d65e3-362d-4537-b948-3146f7cf0bb7 req-0cfb17c0-3fb8-41c2-9b1d-1d53b3e35e59 service nova] Creating event network-vif-deleted:4b2b8670-b968-4f57-98f2-d6397f574cf5 for instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 on n-h1-854925-5 Aug 30 04:13:55.338713 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-340d65e3-362d-4537-b948-3146f7cf0bb7 req-0cfb17c0-3fb8-41c2-9b1d-1d53b3e35e59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074036 Aug 30 04:13:55.339579 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 670/1399] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:55.434051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:55.447953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-049cd368-8f9f-4ef1-9dc0-e6c7a45b2a06 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.259269 Aug 30 04:13:55.448557 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 730/1400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:55 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:55.502432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:55.503331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:55.510080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:55.510817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.510952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:55.511652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.512300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.514411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.515061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.515904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.519798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.520366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.520865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.521894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.522797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.523671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.552672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.553393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.553929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.554473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lazy-loading 'fault' on Instance uuid a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:55.737170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:55.747574 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a4e3f526-0122-48dc-9fb1-ac1a3c498c69 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 200 len: 1315 microversion: 2.1 time: 0.251190 Aug 30 04:13:55.751797 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 731/1401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:55 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:55.760987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:55.762419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:55.780634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.781154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.781627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.782367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.782811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.783240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.794316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 79cab24f-d0e3-4f5b-9c03-160d24dee5cd {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:55.830473 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9bfbda56-958f-4e0e-950b-c5c2fff98327 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 2050 microversion: 2.25 time: 0.488932 Aug 30 04:13:55.831090 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 671/1402] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:55 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 2050 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:55.851780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:55.852817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:55.866950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.870036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.870774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.871699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.884478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.885254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.954306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:55.955233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:55.956290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:55.956901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lazy-loading 'fault' on Instance uuid 5a7e450c-101b-43a5-96ef-e8e35901e3b2 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:56.030544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef42627af9c446b2ac60d9fc9f01a019', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44a575fabe74c81a44e2ae1cd33ce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:56.039137 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3996a320-adf3-4f87-9c66-3b818f217fc5 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 200 len: 1331 microversion: 2.1 time: 0.192472 Aug 30 04:13:56.040229 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 672/1403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:55 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 1331 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:56.045442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:56.046759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:56.053639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.054562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.055182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.056659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.057308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.057932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.077313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:56.087459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-13e00997-1fe3-4e40-b128-7201fac5e7ff tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1504 microversion: 2.1 time: 0.334101 Aug 30 04:13:56.093810 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 732/1404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:55 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1504 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:56.108965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-665eba5d-fcde-4aec-905a-b0b1ef32bf49 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'create', calling method: .version_select at 0x7fe96a3a8d30>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1989567679", "description": "tempest-description-12173847"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:56.287515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 79cab24f-d0e3-4f5b-9c03-160d24dee5cd {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:56.307327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3577d54f-d183-4fb2-a585-d088ffa5eb1b tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 2050 microversion: 2.25 time: 0.265610 Aug 30 04:13:56.317347 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 673/1405] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:13:56 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 2050 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:13:56.317347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:56.317347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:56.329284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.331373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.333176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.333766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.334230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.334734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.443922 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-665eba5d-fcde-4aec-905a-b0b1ef32bf49 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.338776 Aug 30 04:13:56.445095 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 733/1406] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:13:56 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:13:56.459486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:56.464851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.465886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.466779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.467711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.468424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.469028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.515740 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c18d7797-d757-43f3-876a-66fec9cde8ec tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060363 Aug 30 04:13:56.524138 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 734/1407] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Aug 30 04:13:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:13:56.529858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1989567679"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:56.530789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:56.537840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.538560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.539179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.540054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.540670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.541429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.640040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:56.647968 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a128b2ac-cc31-4417-b62d-064acea939f2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1318 microversion: 2.1 time: 0.338742 Aug 30 04:13:56.664869 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 674/1408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:56 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:56.673118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:56.673756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:56.688678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.689190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.689643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.690356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.690808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.692398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.917501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Adding security group eb7b2886-cb22-474f-9167-60bc31f35789 to port b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 Aug 30 04:13:56.922432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:56.930746 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e550e72c-b768-45b1-a8f3-aead127e4be1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.264716 Aug 30 04:13:56.931894 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 675/1409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:56 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:56.937028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854925-5", "block_migration": "auto"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:56.939734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:56.952557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.953311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.953951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.955336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:56.955955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:56.956542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:56.991217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'flavor' on Instance uuid 79cab24f-d0e3-4f5b-9c03-160d24dee5cd {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:13:57.008547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Going to try to live migrate instance to n-h2-854925-5 {{(pid=122402) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:13:57.131202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:57.370412 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-389ff408-7f6b-42d4-b176-12b6be1f5e6a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action" status: 202 len: 0 microversion: 2.1 time: 0.844593 Aug 30 04:13:57.371652 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 735/1410] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:13:56 2022] POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:13:57.390901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:57.391323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b1f911d3-5d5c-4506-81b4-c0a2120be882 req-ed6c8cbf-3e03-4a3a-9244-bb3fbd6e00c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b6241b-bd6b-497a-be52-1610160d2fbf", "name": "network-vif-plugged", "status": "completed", "tag": "466d0b50-71b0-4ea1-b478-2f7f3c8cc403"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:57.409281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:13:57.413173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b1f911d3-5d5c-4506-81b4-c0a2120be882 req-ed6c8cbf-3e03-4a3a-9244-bb3fbd6e00c8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:57.414755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b1f911d3-5d5c-4506-81b4-c0a2120be882 req-ed6c8cbf-3e03-4a3a-9244-bb3fbd6e00c8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:57.415419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b1f911d3-5d5c-4506-81b4-c0a2120be882 req-ed6c8cbf-3e03-4a3a-9244-bb3fbd6e00c8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:57.491163 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b1f911d3-5d5c-4506-81b4-c0a2120be882 req-ed6c8cbf-3e03-4a3a-9244-bb3fbd6e00c8 service nova] Creating event network-vif-plugged:466d0b50-71b0-4ea1-b478-2f7f3c8cc403 for instance 98b6241b-bd6b-497a-be52-1610160d2fbf on n-h2-854925-5 Aug 30 04:13:57.502255 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b1f911d3-5d5c-4506-81b4-c0a2120be882 req-ed6c8cbf-3e03-4a3a-9244-bb3fbd6e00c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128800 Aug 30 04:13:57.503507 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 736/1411] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:57.515140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:57.517373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:57.527461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:57.528448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:57.529167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:57.531140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:57.532253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:57.533300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:57.555776 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 HTTP/1.1 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'a4ab32b1-0c9a-4544-82b7-e5a4b37dc555'} Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.559679 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:13:57.564775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.570008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:57.572215 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9aaed8d6-58ee-4b9b-aea0-e8b4fb9d36ec tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 404 len: 111 microversion: 2.1 time: 0.065995 Aug 30 04:13:57.574345 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 737/1412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:57 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:57.581925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:57.583065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] [instance: 5a7e450c-101b-43a5-96ef-e8e35901e3b2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:57.593303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:57.594580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:57.595292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:57.596469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:57.597153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:57.598070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:57.636945 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] HTTP exception thrown: Instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 could not be found. Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Request method failure captured: Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 HTTP/1.1 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY2px92Vmq-D8yZCT3OLPKUOp84OLuOsnCW63Xr7IGY-lBKD_ECbD4BVxd1ovzOrLTJVtm0NSvbIzKag0kMU1wIL2WTYXxUmObLR2k2uXmZnadgq1G1XHKnNUw0Ok7awVVobESueF5O7R8hoip990sy3Uvj4FSXPkRRSsrOmvNbHEV0 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b44a575fabe74c81a44e2ae1cd33ce66 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesAdminNegativeTest-1366814761 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b44a575fabe74c81a44e2ae1cd33ce66", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b44a575fabe74c81a44e2ae1cd33ce66"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b44a575fabe74c81a44e2ae1cd33ce66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b44a575fabe74c81a44e2ae1cd33ce66"}]}] Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesAdminNegativeTest-1366814761 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b44a575fabe74c81a44e2ae1cd33ce66 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1366814761 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesAdminNegativeTest-1366814761-project Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ef42627af9c446b2ac60d9fc9f01a019 Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesAdminNegativeTest-1366814761-project Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 could not be found. Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5a7e450c-101b-43a5-96ef-e8e35901e3b2'} Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 could not be found. Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 could not be found. Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:13:57.640627 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.644923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:13:57.644923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:13:57.644923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:13:57.644923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:13:57.644923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:13:57.644923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 could not be found. Aug 30 04:13:57.644923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:13:57.648760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Returning 404 to user: Instance 5a7e450c-101b-43a5-96ef-e8e35901e3b2 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:13:57.650164 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77c024d2-de8c-4702-8a64-4b2f84c041aa tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2" status: 404 len: 111 microversion: 2.1 time: 0.074480 Aug 30 04:13:57.651680 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 738/1413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:57 2022] GET /compute/v2.1/servers/5a7e450c-101b-43a5-96ef-e8e35901e3b2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:13:57.660340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1989567679"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:57.661391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:57.671417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:57.672354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:57.673094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:57.674276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:57.674997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:57.675678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:57.885675 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Removing security group eb7b2886-cb22-474f-9167-60bc31f35789 from port b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 Aug 30 04:13:58.459197 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23a7cd3c-2a02-423a-aa38-4f80cbc5fc45 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action" status: 202 len: 0 microversion: 2.1 time: 0.805181 Aug 30 04:13:58.466086 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 739/1414] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:13:57 2022] POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:13:58.472893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c8173983-b4bd-4a0e-b335-d319c6bd9fda req-68116900-7f55-4012-819f-541c9d13a64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e862c1e7-2cc7-4c20-9020-11fc41c1c7b7", "tag": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:58.488478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c8173983-b4bd-4a0e-b335-d319c6bd9fda req-68116900-7f55-4012-819f-541c9d13a64d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:58.489980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c8173983-b4bd-4a0e-b335-d319c6bd9fda req-68116900-7f55-4012-819f-541c9d13a64d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:58.490661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c8173983-b4bd-4a0e-b335-d319c6bd9fda req-68116900-7f55-4012-819f-541c9d13a64d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:58.522323 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c8173983-b4bd-4a0e-b335-d319c6bd9fda req-68116900-7f55-4012-819f-541c9d13a64d service nova] Creating event network-changed:b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 for instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 on n-h2-854925-5 Aug 30 04:13:58.539945 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c8173983-b4bd-4a0e-b335-d319c6bd9fda req-68116900-7f55-4012-819f-541c9d13a64d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071241 Aug 30 04:13:58.540756 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 740/1415] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:13:58.546614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6830959b-86d7-4f31-a584-df32b499e3f1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] Calling method '.version_select at 0x7fe96a4399d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:58.568253 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6830959b-86d7-4f31-a584-df32b499e3f1 tempest-VolumesAdminNegativeTest-1366814761 tempest-VolumesAdminNegativeTest-1366814761-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132059478" status: 202 len: 0 microversion: 2.1 time: 0.026232 Aug 30 04:13:58.573243 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 741/1416] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132059478 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:13:58.580917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:58.582337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:58.589543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:58.590025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:58.590464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:58.591175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:58.591629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:58.592682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:58.939589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:13:58.960797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d461e073-e3b7-45b7-8b9b-fe1b004dfe09 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1318 microversion: 2.1 time: 0.382244 Aug 30 04:13:58.974663 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 742/1417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:58 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:13:58.983833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-987867842", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:13:59.160781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] validate_networks() for [('762873a3-4a4d-475f-83c3-c7f859ce784c', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:13:59.208600 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73bb6afc-f734-47f1-b88b-302404bef31e tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd/action" status: 202 len: 0 microversion: 2.25 time: 2.275369 Aug 30 04:13:59.209548 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 676/1418] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:13:56 2022] POST /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd/action => generated 0 bytes in 2277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:13:59.215842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:13:59.216931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:13:59.235748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:59.236903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:59.237565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:13:59.240254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:13:59.240895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:13:59.244331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:00.144147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:00.153785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7712d007-068d-43bd-ba31-ea2be30e230c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.942996 Aug 30 04:14:00.162180 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 677/1419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:13:59 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:00.167522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82e07308-4f01-41f7-a2d4-4c879204c813 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'create', calling method: .version_select at 0x7fe969fbd160>, body: {"pool": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:00.618361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:00.619411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:00.619899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:00.620489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:00.621140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:00.634149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:00.635039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:00.635711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:00.636781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:00.637283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:00.637920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:00.659126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:00.665683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Getting quotas for user d9abb5b0dbb04242acaf957bd30cd5c1 and project 7a907c55f8d44858bc82f64b652a2d2c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:00.680925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:00.683654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:00.756065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e18311da-67d2-4ac6-b364-894861996931 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.793206 Aug 30 04:14:00.757051 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 743/1420] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:13:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:14:00.764507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:00.765450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:00.774895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:00.775711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:00.777051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:00.778498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:00.779150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:00.779842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:01.270205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:01.281646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:01.283598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:01.285296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80df95c5-e895-4d41-bf2b-e763f017bda5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1568 microversion: 2.25 time: 0.525206 Aug 30 04:14:01.285866 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 744/1421] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:00 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1568 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:01.307739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:01.308374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:01.315406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:01.316108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:01.316579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:01.317351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:01.317972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:01.318570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:01.600484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:01.612047 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea04474b-ac3f-4519-8953-bc53062ac19d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1508 microversion: 2.1 time: 0.308318 Aug 30 04:14:01.612559 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 745/1422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:01 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1508 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:01.627743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0014a030-c853-438e-b935-98a3b1ac048c req-1aa8b860-c3b6-4407-9d0c-9d2b76d3a5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e862c1e7-2cc7-4c20-9020-11fc41c1c7b7", "tag": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:01.634509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0014a030-c853-438e-b935-98a3b1ac048c req-1aa8b860-c3b6-4407-9d0c-9d2b76d3a5e8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:01.635271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0014a030-c853-438e-b935-98a3b1ac048c req-1aa8b860-c3b6-4407-9d0c-9d2b76d3a5e8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:01.636019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0014a030-c853-438e-b935-98a3b1ac048c req-1aa8b860-c3b6-4407-9d0c-9d2b76d3a5e8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:01.652234 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0014a030-c853-438e-b935-98a3b1ac048c req-1aa8b860-c3b6-4407-9d0c-9d2b76d3a5e8 service nova] Creating event network-changed:b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 for instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 on n-h2-854925-5 Aug 30 04:14:01.660298 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0014a030-c853-438e-b935-98a3b1ac048c req-1aa8b860-c3b6-4407-9d0c-9d2b76d3a5e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046404 Aug 30 04:14:01.661313 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 746/1423] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:01.666752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1292123962", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "c3c9ddd9-fb5e-49c2-b881-772d074b19d2"}], "block_device_mapping_v2": [{"uuid": "b22fca5e-4f35-445f-93eb-ae97032164e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:01.762555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] validate_networks() for [('c3c9ddd9-fb5e-49c2-b881-772d074b19d2', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:14:02.452327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82e07308-4f01-41f7-a2d4-4c879204c813 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.288056 Aug 30 04:14:02.453019 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 678/1424] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:14:00 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:02.458495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:02.459412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:02.466150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.466928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.468297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.469223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.469857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.470627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.478900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:02.479794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:02.480626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:02.481269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:02.481934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:02.492817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.493683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.494363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.495667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.496343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.496987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.517887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:02.526022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Getting quotas for user c05146c8ea7b425eb8eda0088841dd8a and project 7b74886057a041a0afd0d14497424b41. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:02.538093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:02.547654 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b56b90e1-d845-4270-a0cd-720b1ba4bef3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1276 microversion: 2.1 time: 0.093332 Aug 30 04:14:02.548520 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 679/1425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:02 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:02.554607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-faec8c28-e8d4-45bb-a745-85e5a80a517e req-602e71bc-2d64-43cb-9680-adcc48695aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cab24f-d0e3-4f5b-9c03-160d24dee5cd", "name": "network-vif-unplugged", "status": "completed", "tag": "68819321-643b-4b16-8e40-c2405c0e617b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:02.582983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-faec8c28-e8d4-45bb-a745-85e5a80a517e req-602e71bc-2d64-43cb-9680-adcc48695aa9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.583613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-faec8c28-e8d4-45bb-a745-85e5a80a517e req-602e71bc-2d64-43cb-9680-adcc48695aa9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.584520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-faec8c28-e8d4-45bb-a745-85e5a80a517e req-602e71bc-2d64-43cb-9680-adcc48695aa9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.599155 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-faec8c28-e8d4-45bb-a745-85e5a80a517e req-602e71bc-2d64-43cb-9680-adcc48695aa9 service nova] Creating event network-vif-unplugged:68819321-643b-4b16-8e40-c2405c0e617b for instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd on n-h1-854925-5 Aug 30 04:14:02.605109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:02.605792 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-faec8c28-e8d4-45bb-a745-85e5a80a517e req-602e71bc-2d64-43cb-9680-adcc48695aa9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055141 Aug 30 04:14:02.606895 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 680/1426] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:02.608723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b22fca5e-4f35-445f-93eb-ae97032164e4',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:02.612661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:02.613670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:02.629222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.631564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.632378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.633112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.633806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.634237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.654883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:02.788528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5d027b7-c0fe-47be-a3eb-66d1767e7926 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.125515 Aug 30 04:14:02.790096 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 747/1427] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:14:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:14:02.797045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:02.800522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:02.807853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.808569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.809190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.810124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.811128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.812433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.848328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:02.856980 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e33e739-2a2d-4135-9711-c3bce80ff205 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065518 Aug 30 04:14:02.858671 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22671a8e-0558-451a-aab2-51f1d430cac3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.249125 Aug 30 04:14:02.863192 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 748/1428] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:14:02 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:14:02.870724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:02.874858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:02.882952 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 681/1429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:02 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:02.887359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.887855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.888299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.889609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.890068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.890499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.891639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:02.892703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:02.903210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:02.908556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.909301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.909987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:02.910874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:02.911486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:02.912072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.213891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:03.229394 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e45b0f55-4c46-4cd5-a1f8-98b9caff3b2e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1508 microversion: 2.1 time: 0.358041 Aug 30 04:14:03.230524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:03.230962 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 749/1430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:02 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1508 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:03.237790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.188"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:03.240481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:03.246653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:03.250938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:03.251117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.251684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.252321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.253185 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7682b5fc-5c2e-4960-b09d-833843b9152b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1568 microversion: 2.25 time: 0.367935 Aug 30 04:14:03.253611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.254289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.254826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.257508 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 682/1431] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:02 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1568 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:03.263828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7bcd2edd-3ebf-4dca-8d5a-706b3bd60c31 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:03.264699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7bcd2edd-3ebf-4dca-8d5a-706b3bd60c31 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:03.298499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "refresh_cache-e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:14:03.299137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquired lock "refresh_cache-e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:14:03.323921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7bcd2edd-3ebf-4dca-8d5a-706b3bd60c31 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:03.331577 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7bcd2edd-3ebf-4dca-8d5a-706b3bd60c31 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1053 microversion: 2.1 time: 0.072624 Aug 30 04:14:03.345180 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 683/1432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:03 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1053 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:03.350552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:03.353048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:03.360204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.360782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.361490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.362446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.363107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.363731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.397903 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c46c14a7-2c82-4056-84c8-fd223ca14a31 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051188 Aug 30 04:14:03.399260 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 684/1433] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:14:03 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:14:03.409419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:03.412278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:03.418452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.418932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.420249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.421134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.421636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.422061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.528071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:03.529494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:03.530263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:03.530866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:03.531507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:03.614752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:03.625138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.625790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.626552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.627276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.627738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.628229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.667400 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3cd6bfa3-7ce7-4fb6-b99a-52b7f5e9c09f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "POST /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf/action" status: 202 len: 1110 microversion: 2.1 time: 0.266591 Aug 30 04:14:03.668685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 685/1434] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:14:03 2022] POST /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf/action => generated 1110 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 04:14:03.674136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:03.674948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:03.683086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.684317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.685076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.686818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.688233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.689534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.724359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:03.892841 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66b974a8-85b5-433a-85bd-b108dbeab6b9 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 204 len: 0 microversion: 2.1 time: 0.222651 Aug 30 04:14:03.894358 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 686/1435] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:03 2022] DELETE /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:03.925341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:03.926531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:03.944173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.946079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.947209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:03.948780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:03.949251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:03.950313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:04.442372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:04.452980 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d47135ef-cca7-449d-b96c-3a79af7eb30c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1282 microversion: 2.1 time: 0.555798 Aug 30 04:14:04.453644 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 687/1436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:03 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1282 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:04.475668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:04.476412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:04.483234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:04.483763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:04.484302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:04.485385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:04.485879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:04.486403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:05.223828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:05.233638 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-55a5b135-c12f-4893-b272-e7822261285a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.762046 Aug 30 04:14:05.249007 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 688/1437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:04 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:05.255491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:05.256304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:05.263286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:05.264593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:05.265237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:05.266141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:05.266757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:05.267346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:05.709994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:05.720936 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-acfc01ef-b4ac-49ee-88f0-27d9ff7d012f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.470459 Aug 30 04:14:05.730342 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 689/1438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:05 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:05.742300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:05.743278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:05.760261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:05.764321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:05.764899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:05.765752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:05.767919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:05.768562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:06.446389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:06.462694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3d6833b-73a3-4764-a1bb-c508413cc6e5 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1680 microversion: 2.1 time: 0.730442 Aug 30 04:14:06.463920 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 690/1439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:05 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1680 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:06.470534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:06.471465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:06.481551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:06.482298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:06.482945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:06.484109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:06.484733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:06.485588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:07.084278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Building network info cache for instance {{(pid=122403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:14:07.262433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:07.272217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:07.284258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:07.285548 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a28603f3-991e-4822-9364-918e0c2ae553 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1568 microversion: 2.25 time: 0.820264 Aug 30 04:14:07.296293 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 691/1440] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:06 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1568 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:07.302461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:07.303306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:07.310926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:07.311821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:07.312427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:07.313374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:07.314001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:07.314584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:07.816649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:07.834040 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d00c1fa-e886-417c-9f07-3a75107a4334 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1211 microversion: 2.1 time: 0.529912 Aug 30 04:14:07.835035 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 692/1441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:07 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1211 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:07.842832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ec01b516-7a64-47a1-a151-bfca5379286e req-0e750f24-738f-4d28-ad04-f1c8d73c388f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79cab24f-d0e3-4f5b-9c03-160d24dee5cd", "tag": "68819321-643b-4b16-8e40-c2405c0e617b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:07.873826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ec01b516-7a64-47a1-a151-bfca5379286e req-0e750f24-738f-4d28-ad04-f1c8d73c388f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:07.874617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ec01b516-7a64-47a1-a151-bfca5379286e req-0e750f24-738f-4d28-ad04-f1c8d73c388f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:07.875213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ec01b516-7a64-47a1-a151-bfca5379286e req-0e750f24-738f-4d28-ad04-f1c8d73c388f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:07.902360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ec01b516-7a64-47a1-a151-bfca5379286e req-0e750f24-738f-4d28-ad04-f1c8d73c388f service nova] Creating event network-changed:68819321-643b-4b16-8e40-c2405c0e617b for instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd on n-h1-854925-5 Aug 30 04:14:07.915886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ec01b516-7a64-47a1-a151-bfca5379286e req-0e750f24-738f-4d28-ad04-f1c8d73c388f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079388 Aug 30 04:14:07.919699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 693/1442] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:07.931193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:07.938063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:07.950935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:07.952388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:07.957697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:07.959051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:07.960355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:07.961049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:08.790717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:08.820944 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-91bd1819-8efb-4bb2-b19b-cec3da827266 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1324 microversion: 2.1 time: 0.899697 Aug 30 04:14:08.821559 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 694/1443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:07 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1324 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:08.833945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:08.833945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:08.841418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:08.842826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:08.843467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:08.844479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:08.845100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:08.845974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:09.663606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:09.674161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Updating instance_info_cache with network_info: [{"id": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1", "address": "fa:16:3e:41:42:a4", "network": {"id": "3dff0292-dcc6-40ae-bb98-ee6cb060090b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1464263635-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b951a77b2b33488fb6c1c3ef578d558a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5e2d508-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:14:09.684028 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2a1648d-f571-4922-bf17-a83bc89a35c1 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.861378 Aug 30 04:14:09.684628 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 695/1444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:08 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:09.690277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:09.691294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:09.696084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Releasing lock "refresh_cache-e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:14:09.698355 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3878f58a-ae03-4256-baaf-c0fd1854a83e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action" status: 202 len: 0 microversion: 2.1 time: 6.466064 Aug 30 04:14:09.699892 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 750/1445] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:14:03 2022] POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action => generated 0 bytes in 6468 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:14:09.710820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:09.711321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:09.711766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:09.712295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2e6ed7f9-3ba1-477a-960a-75592dc07eb5 req-6ccbbc19-8664-481b-bb14-33c02468ed1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e862c1e7-2cc7-4c20-9020-11fc41c1c7b7", "tag": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:09.712476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:09.717468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:09.720888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:09.728135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2e6ed7f9-3ba1-477a-960a-75592dc07eb5 req-6ccbbc19-8664-481b-bb14-33c02468ed1c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:09.728977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2e6ed7f9-3ba1-477a-960a-75592dc07eb5 req-6ccbbc19-8664-481b-bb14-33c02468ed1c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:09.730374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2e6ed7f9-3ba1-477a-960a-75592dc07eb5 req-6ccbbc19-8664-481b-bb14-33c02468ed1c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:09.736618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:09.754367 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2e6ed7f9-3ba1-477a-960a-75592dc07eb5 req-6ccbbc19-8664-481b-bb14-33c02468ed1c service nova] Creating event network-changed:b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 for instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 on n-h2-854925-5 Aug 30 04:14:09.765899 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2e6ed7f9-3ba1-477a-960a-75592dc07eb5 req-6ccbbc19-8664-481b-bb14-33c02468ed1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059910 Aug 30 04:14:09.767587 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 751/1446] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:09.774981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:09.776411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:09.784477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:09.785760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:09.786503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:09.787827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:09.788543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:09.789779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:09.919328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:09.933646 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8493283-ecb1-435a-a038-c7dbc4e4f07b tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1613 microversion: 2.1 time: 0.164277 Aug 30 04:14:09.934805 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 752/1447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:09 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1613 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:09.941490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:09.942746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:09.950502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:09.952013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:09.953114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:09.955255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:09.957251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:09.984819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:10.129501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:10.142199 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a23e2fca-6029-4f1f-b9ac-cb97a4ed87c3 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.453066 Aug 30 04:14:10.143412 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 696/1448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:09 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:10.163820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:10.164644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:10.172880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:10.173608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:10.174210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:10.175111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:10.175728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:10.176336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:10.237889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:10.249468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:10.256677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:10.258121 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-84140019-b90f-4eb8-ae45-b318f5b773c7 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1568 microversion: 2.25 time: 0.322357 Aug 30 04:14:10.259132 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 753/1449] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:09 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1568 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:10.264702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Action: 'action', calling method: .version_select at 0x7fe96c89dc10>, body: {"removeFloatingIp": {"address": "172.25.2.188"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:10.495922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:10.509642 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e8dc360-5371-4f7e-be07-94d4a8df8825 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1211 microversion: 2.1 time: 0.350800 Aug 30 04:14:10.512745 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 697/1450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:10 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1211 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:10.527443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:10.528411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:10.537495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:10.538231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:10.538831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:10.540557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:10.553702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:10.554440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:10.574614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:10.581959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:10.582608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:10.583147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:10.583968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:10.584531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:10.585066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:10.855788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "refresh_cache-e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:14:10.856355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquired lock "refresh_cache-e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:14:11.062726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:11.073854 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f677849-9368-4032-ba34-9ebbf00dcd33 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1324 microversion: 2.1 time: 0.559612 Aug 30 04:14:11.079705 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 698/1451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:10 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1324 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:11.084709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-366b9239-14ad-4fcd-a2ce-748725c7db18 req-327cfb31-1114-41ad-8540-2a314deb30c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d780c8-8ba4-4726-9a9e-a2b9770068ff", "tag": "2cc186af-e9fd-4ac4-be72-fcb78b0c36d7"}, {"name": "network-changed", "server_uuid": "2c43c07e-706b-4003-9da9-1bfa84b66310", "tag": "de6cd9f0-a510-457e-b105-32cd081b65fb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:11.119059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-366b9239-14ad-4fcd-a2ce-748725c7db18 req-327cfb31-1114-41ad-8540-2a314deb30c1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:11.119539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-366b9239-14ad-4fcd-a2ce-748725c7db18 req-327cfb31-1114-41ad-8540-2a314deb30c1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:11.120607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-366b9239-14ad-4fcd-a2ce-748725c7db18 req-327cfb31-1114-41ad-8540-2a314deb30c1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:11.141959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-366b9239-14ad-4fcd-a2ce-748725c7db18 req-327cfb31-1114-41ad-8540-2a314deb30c1 service nova] Creating event network-changed:2cc186af-e9fd-4ac4-be72-fcb78b0c36d7 for instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff on n-h1-854925-5 Aug 30 04:14:11.143249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-366b9239-14ad-4fcd-a2ce-748725c7db18 req-327cfb31-1114-41ad-8540-2a314deb30c1 service nova] Creating event network-changed:de6cd9f0-a510-457e-b105-32cd081b65fb for instance 2c43c07e-706b-4003-9da9-1bfa84b66310 on n-h2-854925-5 Aug 30 04:14:11.162337 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-366b9239-14ad-4fcd-a2ce-748725c7db18 req-327cfb31-1114-41ad-8540-2a314deb30c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.081086 Aug 30 04:14:11.163244 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 699/1452] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:11.168866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:11.170003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:11.192178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:11.193120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:11.193752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:11.194665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:11.195289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:11.195892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:11.568686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:11.586107 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-00ca488d-b557-4277-9009-647ad61c2a9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.421456 Aug 30 04:14:11.598855 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 700/1453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:11 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:11.604716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:11.605680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:11.613276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:11.614226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:11.615918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:11.616819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:11.617464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:11.618111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:11.759436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:11.770698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4888d0c9-fcc0-45b5-b91b-69a3afab3cd2 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1613 microversion: 2.1 time: 0.170025 Aug 30 04:14:11.771923 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 701/1454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:11 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1613 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:11.777811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:11.778648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:11.786329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:11.787320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:11.787786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:11.788856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:11.789560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:11.790206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:12.068523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:12.071931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Building network info cache for instance {{(pid=122403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:14:12.078372 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-65d4d58f-f2fb-4d63-abc4-5ae09e9bf4ca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.304815 Aug 30 04:14:12.093027 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 702/1455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:11 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:12.098893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:12.099726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:12.106194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:12.106938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:12.107588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:12.108547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:12.109168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:12.109781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:12.341148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:12.350040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:12.351497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:12.355114 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ed4acad-dcf1-49a8-9fbb-23b5a5cf43ab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1558 microversion: 2.25 time: 0.260732 Aug 30 04:14:12.379916 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 703/1456] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:12 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1558 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:12.507951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:12.538213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:12.545522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:12.546394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:12.553162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:12.553771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:12.554272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:12.555073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:12.555738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:12.556249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.332668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:13.358294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:13.371309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cffa1c6a-7812-4001-8bb8-2a4747aef82c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1199 microversion: 2.1 time: 0.989923 Aug 30 04:14:13.372820 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 704/1457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:12 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1199 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:13.390168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6acc5c5a-9041-40d2-8508-beb0a69c7ee0 req-c2b32a70-9c47-4ff0-8d39-5d524bcf6720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa0d49a-b773-4919-bc1f-237caf6c7381", "name": "network-vif-deleted", "tag": "5c09ea82-bb1e-4bab-8464-cf3672c4c351"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:13.405662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6acc5c5a-9041-40d2-8508-beb0a69c7ee0 req-c2b32a70-9c47-4ff0-8d39-5d524bcf6720 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.406790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6acc5c5a-9041-40d2-8508-beb0a69c7ee0 req-c2b32a70-9c47-4ff0-8d39-5d524bcf6720 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.407460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6acc5c5a-9041-40d2-8508-beb0a69c7ee0 req-c2b32a70-9c47-4ff0-8d39-5d524bcf6720 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.436745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6acc5c5a-9041-40d2-8508-beb0a69c7ee0 req-c2b32a70-9c47-4ff0-8d39-5d524bcf6720 service nova] Creating event network-vif-deleted:5c09ea82-bb1e-4bab-8464-cf3672c4c351 for instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 on n-h1-854925-5 Aug 30 04:14:13.442408 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6acc5c5a-9041-40d2-8508-beb0a69c7ee0 req-c2b32a70-9c47-4ff0-8d39-5d524bcf6720 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065782 Aug 30 04:14:13.443842 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 705/1458] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:13.459444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:13.461904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:13.470476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.471523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.472219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.473157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.473863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.474727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.512891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Updating instance_info_cache with network_info: [{"id": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1", "address": "fa:16:3e:41:42:a4", "network": {"id": "3dff0292-dcc6-40ae-bb98-ee6cb060090b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1464263635-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "b951a77b2b33488fb6c1c3ef578d558a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb5e2d508-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:14:13.538004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Releasing lock "refresh_cache-e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:14:13.539531 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-874a066f-16d7-4cc8-8254-f4d8f1ca3e3a tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action" status: 202 len: 0 microversion: 2.1 time: 3.279130 Aug 30 04:14:13.541992 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 754/1459] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:14:10 2022] POST /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7/action => generated 0 bytes in 3282 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:14:13.556711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d546a76-d65a-4c62-9624-14701a13e809 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '.version_select at 0x7fe96a54e040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:13.569484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d546a76-d65a-4c62-9624-14701a13e809 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.569975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d546a76-d65a-4c62-9624-14701a13e809 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.570419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d546a76-d65a-4c62-9624-14701a13e809 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.615783 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d546a76-d65a-4c62-9624-14701a13e809 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 3629 microversion: 2.25 time: 0.072261 Aug 30 04:14:13.617875 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 755/1460] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Aug 30 04:14:13 2022] GET /compute/v2.1/os-migrations => generated 3629 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:13.629490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:13.630544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:13.646064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.649661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.650257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.653699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.654191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.655200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.892150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:13.910586 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-161f258f-2734-41b6-bc60-9c397e7c4432 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1324 microversion: 2.1 time: 0.465207 Aug 30 04:14:13.911415 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 706/1461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:13 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1324 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:13.916442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:13.917426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:13.928949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.930404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.931090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.932039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.932670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.933278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.976745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:13.977537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:13.978171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:13.978787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lazy-loading 'fault' on Instance uuid 2fa0d49a-b773-4919-bc1f-237caf6c7381 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:14.011064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:14.022360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4cfb995-de1c-4ad6-b413-be113a75a418 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.402040 Aug 30 04:14:14.023964 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 756/1462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:13 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:14.028169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e24aec83db374898a8fbbe3da7407cc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e48071560647d1b0684dea4cbb0883', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:14.029808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:14.030850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:14.036527 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-61fc9c1c-2d81-4965-bcdd-ca4be3df1276 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 200 len: 1331 microversion: 2.1 time: 0.123687 Aug 30 04:14:14.037111 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 707/1463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:13 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:14.043383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74b0ff04-107c-4688-bcdd-eb091b7e0222 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '.version_select at 0x7fe96a024ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:14.054689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:14.055803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:14.058071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:14.071617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:14.073902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:14.076539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:14.492326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:14.505058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b0af4ad-3b92-4643-a660-5c27fc0ee811 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1477 microversion: 2.1 time: 0.479812 Aug 30 04:14:14.505679 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 757/1464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:14 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1477 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:14.520597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:14.521252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:14.528107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:14.528614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:14.529051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:14.530579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:14.531209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:14.531644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:15.020677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 79cab24f-d0e3-4f5b-9c03-160d24dee5cd {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:15.049422 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8d0f33dc-d508-4fc5-8dfb-5ed59d407794 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 2050 microversion: 2.25 time: 0.535281 Aug 30 04:14:15.050482 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 758/1465] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:14 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 2050 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:15.055830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:15.056644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:15.065915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:15.066680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:15.067362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:15.068347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:15.068833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:15.069511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:15.728423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:15.736286 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4d40be34-ad06-4487-99e0-7ff5e640f911 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1199 microversion: 2.1 time: 0.684372 Aug 30 04:14:15.736864 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 759/1466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:15 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1199 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:15.741554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:15.742166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:15.747944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:15.748650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:15.749096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:15.749897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:15.750360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:15.750785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.113588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:16.122495 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-67eab255-7a51-4c97-9a02-4360aac0099f tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1324 microversion: 2.1 time: 0.384571 Aug 30 04:14:16.123595 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 760/1467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:15 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1324 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:16.135151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:16.137364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:16.145767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:16.146275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:16.146722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.147438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:16.147903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:16.148503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.378133 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74b0ff04-107c-4688-bcdd-eb091b7e0222 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/29389f4d-c1b0-496e-a2ae-3e1f7f6ce51e" status: 202 len: 0 microversion: 2.1 time: 2.337975 Aug 30 04:14:16.379650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 708/1468] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:14:14 2022] DELETE /compute/v2.1/os-floating-ips/29389f4d-c1b0-496e-a2ae-3e1f7f6ce51e => generated 0 bytes in 2340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:14:16.391687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:16.394049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:16.402280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:16.403385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:16.404085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.405125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:16.405649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:16.406537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.430394 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] HTTP exception thrown: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Request method failure captured: Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 HTTP/1.1 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY26wgtsJ04Pd08MRzH0QM9Fh1kI4R1aXu2tafFbZ77zeeGwIY5bI9iph_QBzIuIBioyBDzov_eJCYCaICIqsMFgJz0S7r-vqo2hFy2xf60oBe1l1L7SlHum9BCU5-wwYPyvsGyS-QTth4kARyc6P2m_wB4SNWmEYDZbwUF7ZpYmA0g Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: b8e48071560647d1b0684dea4cbb0883 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8e48071560647d1b0684dea4cbb0883", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8e48071560647d1b0684dea4cbb0883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8e48071560647d1b0684dea4cbb0883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8e48071560647d1b0684dea4cbb0883"}]}] Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: b8e48071560647d1b0684dea4cbb0883 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachSCSIVolumeTestJSON-1927892413-project Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: e24aec83db374898a8fbbe3da7407cc1 Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1927892413-project Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2fa0d49a-b773-4919-bc1f-237caf6c7381'} Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:16.432298 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:16.439590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:16.439590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:16.439590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:16.439590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:16.439590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:16.439590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:16.439590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:16.441578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Returning 404 to user: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:16.442890 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f968ab0-f7ce-4392-982b-bd08c910e39c tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 404 len: 111 microversion: 2.1 time: 0.061955 Aug 30 04:14:16.448957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 709/1469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:16 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:16.457419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-387547487", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "25481288-b646-4c38-9a19-eb4c2fee8514"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:16.470790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:16.472374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:16.487995 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d23529e8-8fbd-4892-92ef-0598888ad99f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.362359 Aug 30 04:14:16.491579 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 761/1470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:16 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:16.503473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:16.504776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:16.522961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:16.523485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:16.525903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.528291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:16.530528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:16.531162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.537177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] validate_networks() for [('25481288-b646-4c38-9a19-eb4c2fee8514', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:14:16.851637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:16.861488 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-011f054f-2909-4ffe-8c5b-e41139f59dac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1476 microversion: 2.1 time: 0.368795 Aug 30 04:14:16.873560 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 762/1471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:16 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1476 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:16.873560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e6a36f7c-8352-4ae1-9562-a3e56c87eb62 req-081913c8-d4e8-4945-8b72-35069d7edcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e862c1e7-2cc7-4c20-9020-11fc41c1c7b7", "tag": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:16.877260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6a36f7c-8352-4ae1-9562-a3e56c87eb62 req-081913c8-d4e8-4945-8b72-35069d7edcc7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:16.877790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6a36f7c-8352-4ae1-9562-a3e56c87eb62 req-081913c8-d4e8-4945-8b72-35069d7edcc7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:16.878224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6a36f7c-8352-4ae1-9562-a3e56c87eb62 req-081913c8-d4e8-4945-8b72-35069d7edcc7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:16.891250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e6a36f7c-8352-4ae1-9562-a3e56c87eb62 req-081913c8-d4e8-4945-8b72-35069d7edcc7 service nova] Creating event network-changed:b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 for instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 on n-h2-854925-5 Aug 30 04:14:16.896213 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e6a36f7c-8352-4ae1-9562-a3e56c87eb62 req-081913c8-d4e8-4945-8b72-35069d7edcc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Aug 30 04:14:16.897953 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 763/1472] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:16.903906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8def830-36f2-4bce-b1a1-45634b6e8b0b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '.version_select at 0x7fe96a496ee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:17.670503 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d8def830-36f2-4bce-b1a1-45634b6e8b0b tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/eb7b2886-cb22-474f-9167-60bc31f35789" status: 202 len: 0 microversion: 2.1 time: 0.770642 Aug 30 04:14:17.670864 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 764/1473] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:14:16 2022] DELETE /compute/v2.1/os-security-groups/eb7b2886-cb22-474f-9167-60bc31f35789 => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:14:17.677403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-80a8261a-8e7d-4db3-a781-3df746ca42af req-ae41cf96-5efe-4a60-8c09-e9bcbcc167fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d780c8-8ba4-4726-9a9e-a2b9770068ff", "name": "network-vif-plugged", "status": "completed", "tag": "2cc186af-e9fd-4ac4-be72-fcb78b0c36d7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:17.688840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-80a8261a-8e7d-4db3-a781-3df746ca42af req-ae41cf96-5efe-4a60-8c09-e9bcbcc167fd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:17.689309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-80a8261a-8e7d-4db3-a781-3df746ca42af req-ae41cf96-5efe-4a60-8c09-e9bcbcc167fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:17.689758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-80a8261a-8e7d-4db3-a781-3df746ca42af req-ae41cf96-5efe-4a60-8c09-e9bcbcc167fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:17.700234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:17.702224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:17.702787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:17.703214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:17.703659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:17.707456 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-80a8261a-8e7d-4db3-a781-3df746ca42af req-ae41cf96-5efe-4a60-8c09-e9bcbcc167fd service nova] Creating event network-vif-plugged:2cc186af-e9fd-4ac4-be72-fcb78b0c36d7 for instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff on n-h1-854925-5 Aug 30 04:14:17.714354 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-80a8261a-8e7d-4db3-a781-3df746ca42af req-ae41cf96-5efe-4a60-8c09-e9bcbcc167fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042017 Aug 30 04:14:17.716077 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 765/1474] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:17.722649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9521c169-0aad-4a1d-b5e2-c3ec5fb96a67 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '.version_select at 0x7fe96a36a550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:17.738952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:17.741092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:17.742063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:17.744655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:17.745696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:17.746534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:17.771639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:17.771792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9521c169-0aad-4a1d-b5e2-c3ec5fb96a67 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015403446" status: 202 len: 0 microversion: 2.1 time: 0.054131 Aug 30 04:14:17.774382 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 766/1475] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:14:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015403446 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:14:17.777160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for user 45901cc649784305a10c8a9278d1bef3 and project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:17.784153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:17.785134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:17.792143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:17.792907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:17.793612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:17.795416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:17.796180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:17.796768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:17.805052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:17.809828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:17.887038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca7429b4-4e3f-451f-ac2d-b53e04473e9c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.433965 Aug 30 04:14:17.887771 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 710/1476] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:14:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:14:17.893973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:17.895069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:17.902712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:17.903571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:17.904250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:17.905372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:17.906050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:17.906712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.614733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:18.625047 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e8e81b24-54a3-4901-8166-fa691acaba6c tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1199 microversion: 2.1 time: 0.845799 Aug 30 04:14:18.625763 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 767/1477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:17 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1199 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:18.631133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:18.631830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:18.632431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:18.640920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.641731 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-312889c1-293d-4c7e-bbc2-e61a65111238 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1324 microversion: 2.1 time: 0.752595 Aug 30 04:14:18.641898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.642244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.642977 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 711/1478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:17 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1324 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:18.643326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.643799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.644241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.648455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:18.649205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:18.660155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.661104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:18.661984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.662710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.664722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.665675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.669995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.696810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:18.785789 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03df3f12-f76e-4505-99de-a868536e951e tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 204 len: 0 microversion: 2.1 time: 0.140791 Aug 30 04:14:18.787126 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 712/1479] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:18 2022] DELETE /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:18.792479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:18.793630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:18.799865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.805607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.807357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.808645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.809130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.810138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.833232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:18.847028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-199be0f8-2468-4527-ba59-007546a98e7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.219945 Aug 30 04:14:18.849824 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 768/1480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:18 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:18.854385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:18.855032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:18.864106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.864677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.865198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.866004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:18.866519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:18.867010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:18.944778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:18.955290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:18.957403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:18.958809 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6dbaa403-3fd6-448b-8dcf-144598772ef6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1265 microversion: 2.25 time: 0.108051 Aug 30 04:14:18.959866 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 769/1481] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:18 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:19.059216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:19.067906 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-485f0f96-75b7-46e5-a65a-bcc6d98ef728 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1476 microversion: 2.1 time: 0.279353 Aug 30 04:14:19.068419 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 713/1482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:18 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.076992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.077653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:19.083851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:19.084339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:19.084781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:19.085514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:19.086520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:19.086824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:19.108875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.141648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f822791-2fb7-4ffe-88ea-4276f7cee842 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.150618 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f822791-2fb7-4ffe-88ea-4276f7cee842 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.189373 Aug 30 04:14:19.153676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 770/1483] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:19.159497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "name": "network-vif-unplugged", "status": "completed", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}, {"name": "network-changed", "server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:19.171390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:19.171881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:19.172330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:19.185140 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] Creating event network-vif-unplugged:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h1-854925-5 Aug 30 04:14:19.186226 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] Creating event network-changed:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h1-854925-5 Aug 30 04:14:19.193193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] Instance 5634b704-42d5-42f6-81b6-06009a0a600f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:14:19.205896 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-037b7f4c-58f8-4183-9de4-4f5c3182ccda req-151bb42a-0b48-4059-94ab-f734a8c1bcd0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.050514 Aug 30 04:14:19.206819 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 771/1484] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:19.212160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8dd5422-668a-469c-9911-c7f63cafa6db tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.220785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:19.236632 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d8dd5422-668a-469c-9911-c7f63cafa6db tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.028389 Aug 30 04:14:19.237773 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 772/1485] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.253582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-65aa2d92-8f25-44b7-a49f-f4754d101fe0 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.257088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:19.265712 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-65aa2d92-8f25-44b7-a49f-f4754d101fe0 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017663 Aug 30 04:14:19.266229 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-abf33d7a-3e72-4564-a728-583904a2c416 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1510 microversion: 2.1 time: 0.196689 Aug 30 04:14:19.266485 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 773/1486] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:19.267105 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 714/1487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.284483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b0534886-efed-435d-8fd4-7bacfc42c7a2 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.295784 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b0534886-efed-435d-8fd4-7bacfc42c7a2 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017091 Aug 30 04:14:19.296291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 774/1488] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:19.307567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7521a8d-0974-4e04-a536-ddcfd3a6af7f tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.336348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7521a8d-0974-4e04-a536-ddcfd3a6af7f tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.032486 Aug 30 04:14:19.336939 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 715/1489] 10.222.0.27 () {58 vars in 1165 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.353683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29487d71-08b4-4ec3-8304-215de1de3fde tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.361797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29487d71-08b4-4ec3-8304-215de1de3fde tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011911 Aug 30 04:14:19.362350 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 775/1490] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:19.374311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68903f5c-7d78-4edf-bc30-f8ba6f96246b tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.399257 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68903f5c-7d78-4edf-bc30-f8ba6f96246b tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.029471 Aug 30 04:14:19.399854 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 716/1491] 10.222.0.27 () {58 vars in 1169 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.414872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0095096b-37dd-4760-aaed-b6edcdb96940 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.427895 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0095096b-37dd-4760-aaed-b6edcdb96940 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.016809 Aug 30 04:14:19.428468 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 776/1492] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:19.446653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06e94845-0abc-4a0a-b432-4ccd680afd1d tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.453202 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06e94845-0abc-4a0a-b432-4ccd680afd1d tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013575 Aug 30 04:14:19.453859 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 717/1493] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:19.465714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e45b72f5-30fe-4ab9-b400-b150fb11f020 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.505602 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e45b72f5-30fe-4ab9-b400-b150fb11f020 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.043521 Aug 30 04:14:19.506185 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 777/1494] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.521800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a9959762-2a5b-4f4e-bec8-fe41fb11e37f tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.531057 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a9959762-2a5b-4f4e-bec8-fe41fb11e37f tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013002 Aug 30 04:14:19.531640 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 718/1495] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:19.543961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d12c3ff-325f-4bb6-9c6f-6322f3bd682c tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.578529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d12c3ff-325f-4bb6-9c6f-6322f3bd682c tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.038383 Aug 30 04:14:19.579390 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 778/1496] 10.222.0.27 () {58 vars in 1144 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.593258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-09c5e406-b735-4eb6-ae1b-8d3f2fe1986c tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.601893 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-09c5e406-b735-4eb6-ae1b-8d3f2fe1986c tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012468 Aug 30 04:14:19.602495 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 719/1497] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:19.614827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f27594e4-962e-4063-9ec7-1e4f60d84f8a tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.641148 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f27594e4-962e-4063-9ec7-1e4f60d84f8a tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.030017 Aug 30 04:14:19.641955 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 779/1498] 10.222.0.27 () {58 vars in 1148 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:19.647281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.648224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:19.655021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db672331-e25d-46cf-bc5e-f3c1e701652b tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.655840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:19.656071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:19.656546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:19.657258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:19.657898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:19.658335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:19.669712 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db672331-e25d-46cf-bc5e-f3c1e701652b tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.018755 Aug 30 04:14:19.670837 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 780/1499] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:19.676293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:19.678355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:19.699742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:19.700239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:19.700703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:19.701477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:19.701938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:19.702371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:19.989220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:19.992348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:20.000068 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38f2d59e-b467-42fe-b625-7a0d069fa0d3 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1324 microversion: 2.1 time: 0.328118 Aug 30 04:14:20.012898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df4f0759-5741-4c02-82dc-c82b7575a744 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1199 microversion: 2.1 time: 0.358422 Aug 30 04:14:20.012898 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 720/1500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1199 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:20.012898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-158cb925-4fc5-4723-be95-1864e1ab7173 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.014411 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 781/1501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:19 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:20.016370 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-158cb925-4fc5-4723-be95-1864e1ab7173 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012590 Aug 30 04:14:20.017218 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 721/1502] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:20.022147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.023044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:20.027359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.027983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:20.032381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.033666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.034345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.034597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.035152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.036138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.036840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.036995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.037748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.038159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.038840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.039423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.163483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:20.174779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:20.176598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:20.178671 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f61f8282-0845-4b88-9b35-22aca6f8c438 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1313 microversion: 2.25 time: 0.160408 Aug 30 04:14:20.179445 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 722/1503] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:20.199343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e9df796b-3bd2-439b-88e0-fa252e79128e tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.239407 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e9df796b-3bd2-439b-88e0-fa252e79128e tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.048631 Aug 30 04:14:20.240031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 723/1504] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:20.246387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.247265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:20.254805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.255580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.256053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.256795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.257259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.257708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.356435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:20.368106 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4582488b-db51-419e-a337-d9a9d8af9ef6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.352364 Aug 30 04:14:20.368937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 782/1505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:20.383310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b1ac29f-69a2-4b33-9458-885dd2556843 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.406354 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b1ac29f-69a2-4b33-9458-885dd2556843 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035788 Aug 30 04:14:20.407207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 783/1506] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:20.427232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.428284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:20.435734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.436971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.437863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.439019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:20.440045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:20.440504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:20.565825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:20.575179 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-97f018dc-da07-4ee1-bad5-271f18566c35 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1476 microversion: 2.1 time: 0.333840 Aug 30 04:14:20.577550 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 724/1507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1476 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:20.582777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-40bd7bfb-8353-437a-9679-d0360bd1c553 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:20.624547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-40bd7bfb-8353-437a-9679-d0360bd1c553 tempest-FlavorsV2TestJSON-1202960453 tempest-FlavorsV2TestJSON-1202960453-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044020 Aug 30 04:14:20.627783 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 725/1508] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:20.759141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:20.772411 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fa3e91c2-e5e9-4f33-a932-0fdb7700a667 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1510 microversion: 2.1 time: 0.353149 Aug 30 04:14:20.775539 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 784/1509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:20 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1510 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:21.020812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.021550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.028257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.028813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.029460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.029948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.030793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.030929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.031284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.031865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.038173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.039194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.039805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.040860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.041571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.042280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.217709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:21.229390 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-76ddf62d-6fde-4202-9d21-4b379122bfff tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1520 microversion: 2.1 time: 0.213076 Aug 30 04:14:21.230646 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 726/1510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:21 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:21.237164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.238063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.250862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.259005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.259573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.260355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.261092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.261560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.385283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:21.398334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:21.400841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:21.406710 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-825beba7-7fca-42d2-a1a6-4aad48adc9ca tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1313 microversion: 2.25 time: 0.174506 Aug 30 04:14:21.408069 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 727/1511] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:21 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:21.418671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.421967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.430071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.430809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.431252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.431990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.432601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.433362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.484432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:21.490919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:21.505886 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-729cb167-87c9-49fb-851b-bcda4b0c1e18 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1199 microversion: 2.1 time: 0.482665 Aug 30 04:14:21.512724 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 785/1512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:21 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1199 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:21.532988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.535179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.549402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.550184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.551786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.553925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.555051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.555667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.657362 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1d8cd47b-ba52-4bb0-9462-35bf24459b6e tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 204 len: 0 microversion: 2.1 time: 0.247562 Aug 30 04:14:21.658432 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 728/1513] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:21 2022] DELETE /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:21.665742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.666996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.695594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.696087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.696528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.697237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.718323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.720447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.815319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:21.824137 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b7c5d5b-f6b4-4793-a123-c8f3b1513c9c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.310223 Aug 30 04:14:21.825431 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 786/1514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:21 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:21.844266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.845098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.868384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.869384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.870247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.876537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.877460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.878175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.939800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:21.949172 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c3a7a27b-f31d-499d-b1cc-14726a4f256e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1474 microversion: 2.1 time: 0.289158 Aug 30 04:14:21.957786 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 729/1515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:21 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1474 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:21.963267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:21.967975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:21.992172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.992568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.993007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:21.993751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:21.994205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:21.994629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.204060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01f80c9403a469db623008e42096033', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b951a77b2b33488fb6c1c3ef578d558a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:22.218119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2232ea8d-26f5-4745-92d9-d0cf1b02dbf0 tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 200 len: 1468 microversion: 2.1 time: 0.257148 Aug 30 04:14:22.219168 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 730/1516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:21 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 1468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:22.255560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2cbafe8a-2bf1-49fa-a692-0d6eff4c5cf1 req-278e8177-618d-4ffb-b124-ecaff28a970c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e862c1e7-2cc7-4c20-9020-11fc41c1c7b7", "name": "network-vif-deleted", "tag": "b5e2d508-e3c2-4a53-a9b2-7aaf50046be1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:22.267399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2cbafe8a-2bf1-49fa-a692-0d6eff4c5cf1 req-278e8177-618d-4ffb-b124-ecaff28a970c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.267942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2cbafe8a-2bf1-49fa-a692-0d6eff4c5cf1 req-278e8177-618d-4ffb-b124-ecaff28a970c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.268373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2cbafe8a-2bf1-49fa-a692-0d6eff4c5cf1 req-278e8177-618d-4ffb-b124-ecaff28a970c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.281813 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2cbafe8a-2bf1-49fa-a692-0d6eff4c5cf1 req-278e8177-618d-4ffb-b124-ecaff28a970c service nova] Creating event network-vif-deleted:b5e2d508-e3c2-4a53-a9b2-7aaf50046be1 for instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 on n-h2-854925-5 Aug 30 04:14:22.287774 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2cbafe8a-2bf1-49fa-a692-0d6eff4c5cf1 req-278e8177-618d-4ffb-b124-ecaff28a970c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036035 Aug 30 04:14:22.292098 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 731/1517] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:14:22.345160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:22.357934 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c8f76ed-e49b-4a88-b915-c3a9454acc57 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1526 microversion: 2.1 time: 0.527411 Aug 30 04:14:22.359196 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 787/1518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:21 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1526 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:22.438503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:22.449316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:22.463858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.464351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.465496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.465496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.465964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.466450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.538860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:22.539791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:22.556541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.557280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.557999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.558957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.559519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.560257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.596123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:22.614550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:22.616283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:22.617718 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b92e39a-9586-4965-94d0-104ad8534cf9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1313 microversion: 2.25 time: 0.191056 Aug 30 04:14:22.629484 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 732/1519] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:22 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:22.849253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:22.865810 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0818413e-d00f-4e16-958f-3ce763a60267 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1199 microversion: 2.1 time: 0.331523 Aug 30 04:14:22.870005 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 788/1520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:22 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1199 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:22.876014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8dff2d71-092d-4748-8d39-fdb432899b90 req-a1adb97c-1a46-4238-8a27-6e07b182ebd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c43c07e-706b-4003-9da9-1bfa84b66310", "name": "network-vif-plugged", "status": "completed", "tag": "de6cd9f0-a510-457e-b105-32cd081b65fb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:22.890110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8dff2d71-092d-4748-8d39-fdb432899b90 req-a1adb97c-1a46-4238-8a27-6e07b182ebd7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.890598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8dff2d71-092d-4748-8d39-fdb432899b90 req-a1adb97c-1a46-4238-8a27-6e07b182ebd7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.891024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8dff2d71-092d-4748-8d39-fdb432899b90 req-a1adb97c-1a46-4238-8a27-6e07b182ebd7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.906055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8dff2d71-092d-4748-8d39-fdb432899b90 req-a1adb97c-1a46-4238-8a27-6e07b182ebd7 service nova] Creating event network-vif-plugged:de6cd9f0-a510-457e-b105-32cd081b65fb for instance 2c43c07e-706b-4003-9da9-1bfa84b66310 on n-h2-854925-5 Aug 30 04:14:22.917371 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8dff2d71-092d-4748-8d39-fdb432899b90 req-a1adb97c-1a46-4238-8a27-6e07b182ebd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041444 Aug 30 04:14:22.918704 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 789/1521] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:22.925653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:22.927055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:22.934813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.935296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.935840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:22.936566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:22.937019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:22.937466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.008756 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1766d5f2-c806-43b8-b9c1-eaf3a7df2363 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] 10.222.0.27 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.230198 Aug 30 04:14:23.009289 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 733/1522] 10.222.0.27 () {58 vars in 1128 bytes} [Tue Aug 30 04:14:22 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:14:23.018217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.019229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.026212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.026704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.027346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.028281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.028741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.029204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.241739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:23.250332 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a55b915-ccce-4f43-8439-fea8ddc10e06 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.330003 Aug 30 04:14:23.250920 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 790/1523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:22 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:23.266518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ce519d3-9acb-4fa1-b31c-6c60e5940372 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Calling method '.version_select at 0x7fe96a5caca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.297034 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-2ce519d3-9acb-4fa1-b31c-6c60e5940372 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] HTTP exception thrown: Image not found. Aug 30 04:14:23.301882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:23.309943 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-72d10a73-485c-4123-8da8-188f9bc40d4e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1474 microversion: 2.1 time: 0.299675 Aug 30 04:14:23.310527 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 734/1524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1474 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:23.315457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.316584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] [instance: e862c1e7-2cc7-4c20-9020-11fc41c1c7b7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.322581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.323341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.323792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ce519d3-9acb-4fa1-b31c-6c60e5940372 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Request method failure captured: Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6e4tkAWZ5_jqgYpbLJqK60m7VGaOzfmaWSQRZ1hzGYXHAz7hF6ECyPYZ5rOYDKnNFyhRew-1niT3yUZru60xr33fhHpuds-zhwRqOT7Pex_ZOXI5X9qtHog-EQKVjWjENuYFU2hnLfTLAnjtXtjzw4fBBcLQieV26ylkQGhQjIUTo Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b941c0d9a2f44daaa012d4e7869eb492", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}] Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 29265bbea7494b82b415e635bbd67918 Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '-1'} Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.324482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:14:23.330199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.332436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.332436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.332436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.332699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ce519d3-9acb-4fa1-b31c-6c60e5940372 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:23.332699 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ce519d3-9acb-4fa1-b31c-6c60e5940372 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] 10.222.0.27 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.079352 Aug 30 04:14:23.333397 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 791/1525] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 30 04:14:23 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:14:23.343706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-088453c9-3e70-4e36-bd10-b5449b66e449 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Calling method '.version_select at 0x7fe96a578f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.349163 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] HTTP exception thrown: Instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 could not be found. Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Request method failure captured: Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 HTTP/1.1 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY5QT3qSFo8sridX1i-pePoEJXfG-j3e2yt-s4XLX-xZ1uwWqlaj54oPfoSV82ZcVc4MS994533rH1UEsREZb6aB2QC56MTr9WzYddV2GviQB7ousXJmZ78CyspE9duufv5NIGsQ_24s3U-dFgNp5xbZZMcsNn7duz1VbtzCUfs6g48 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: b951a77b2b33488fb6c1c3ef578d558a Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-2112306544 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b951a77b2b33488fb6c1c3ef578d558a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b951a77b2b33488fb6c1c3ef578d558a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b951a77b2b33488fb6c1c3ef578d558a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b951a77b2b33488fb6c1c3ef578d558a"}]}] Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-2112306544 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: b951a77b2b33488fb6c1c3ef578d558a Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-2112306544 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerRescueTestJSONUnderV235-2112306544-project Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d01f80c9403a469db623008e42096033 Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-2112306544-project Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 could not be found. Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e862c1e7-2cc7-4c20-9020-11fc41c1c7b7'} Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 could not be found. Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 could not be found. Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.351853 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 could not be found. Aug 30 04:14:23.356828 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.357911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] Returning 404 to user: Instance e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:23.358609 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4043629f-cfdc-480f-b0b3-5200f64e87aa tempest-ServerRescueTestJSONUnderV235-2112306544 tempest-ServerRescueTestJSONUnderV235-2112306544-project] 10.222.0.27 "GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7" status: 404 len: 111 microversion: 2.1 time: 0.046928 Aug 30 04:14:23.359492 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 735/1526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] GET /compute/v2.1/servers/e862c1e7-2cc7-4c20-9020-11fc41c1c7b7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:23.372462 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-088453c9-3e70-4e36-bd10-b5449b66e449 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] HTTP exception thrown: Image not found. Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-088453c9-3e70-4e36-bd10-b5449b66e449 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Request method failure captured: Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/7dd35738-cd89-4dd9-9012-3d342dcb980j HTTP/1.1 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6e4tkAWZ5_jqgYpbLJqK60m7VGaOzfmaWSQRZ1hzGYXHAz7hF6ECyPYZ5rOYDKnNFyhRew-1niT3yUZru60xr33fhHpuds-zhwRqOT7Pex_ZOXI5X9qtHog-EQKVjWjENuYFU2hnLfTLAnjtXtjzw4fBBcLQieV26ylkQGhQjIUTo Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b941c0d9a2f44daaa012d4e7869eb492", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}] Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 29265bbea7494b82b415e635bbd67918 Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7dd35738-cd89-4dd9-9012-3d342dcb980j'} Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7dd35738-cd89-4dd9-9012-3d342dcb980j to delete Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7dd35738-cd89-4dd9-9012-3d342dcb980j could not be found. Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.374572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-088453c9-3e70-4e36-bd10-b5449b66e449 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-088453c9-3e70-4e36-bd10-b5449b66e449 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] 10.222.0.27 "DELETE /compute/v2.1/images/7dd35738-cd89-4dd9-9012-3d342dcb980j" status: 404 len: 62 microversion: 2.1 time: 0.037395 Aug 30 04:14:23.379571 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 792/1527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] DELETE /compute/v2.1/images/7dd35738-cd89-4dd9-9012-3d342dcb980j => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:14:23.386247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.386867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.387119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae284436-9d61-48d8-81e8-8be90119bc17 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Calling method '.version_select at 0x7fe96a5ca550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.395583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.395991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.396627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.397352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.397811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.398238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.406594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ae284436-9d61-48d8-81e8-8be90119bc17 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] HTTP exception thrown: Image not found. Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae284436-9d61-48d8-81e8-8be90119bc17 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Request method failure captured: Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/0c2ca9a2-c1d6-49bf-86e5-2e5c8a70c1a11 HTTP/1.1 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6e4tkAWZ5_jqgYpbLJqK60m7VGaOzfmaWSQRZ1hzGYXHAz7hF6ECyPYZ5rOYDKnNFyhRew-1niT3yUZru60xr33fhHpuds-zhwRqOT7Pex_ZOXI5X9qtHog-EQKVjWjENuYFU2hnLfTLAnjtXtjzw4fBBcLQieV26ylkQGhQjIUTo Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b941c0d9a2f44daaa012d4e7869eb492", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}] Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 29265bbea7494b82b415e635bbd67918 Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '0c2ca9a2-c1d6-49bf-86e5-2e5c8a70c1a11'} Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0c2ca9a2-c1d6-49bf-86e5-2e5c8a70c1a11 to delete Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0c2ca9a2-c1d6-49bf-86e5-2e5c8a70c1a11 could not be found. Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.408931 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:14:23.413121 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.417253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae284436-9d61-48d8-81e8-8be90119bc17 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:23.418527 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae284436-9d61-48d8-81e8-8be90119bc17 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] 10.222.0.27 "DELETE /compute/v2.1/images/0c2ca9a2-c1d6-49bf-86e5-2e5c8a70c1a11" status: 404 len: 62 microversion: 2.1 time: 0.035431 Aug 30 04:14:23.419685 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 793/1528] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:23 2022] DELETE /compute/v2.1/images/0c2ca9a2-c1d6-49bf-86e5-2e5c8a70c1a11 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:14:23.430001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64e82db8-caca-4e46-8b9f-46afc9e012c2 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Calling method '.version_select at 0x7fe96a436d30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.457525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-64e82db8-caca-4e46-8b9f-46afc9e012c2 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] HTTP exception thrown: Image not found. Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64e82db8-caca-4e46-8b9f-46afc9e012c2 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Request method failure captured: Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/tempest-invalid-921292661 HTTP/1.1 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6e4tkAWZ5_jqgYpbLJqK60m7VGaOzfmaWSQRZ1hzGYXHAz7hF6ECyPYZ5rOYDKnNFyhRew-1niT3yUZru60xr33fhHpuds-zhwRqOT7Pex_ZOXI5X9qtHog-EQKVjWjENuYFU2hnLfTLAnjtXtjzw4fBBcLQieV26ylkQGhQjIUTo Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b941c0d9a2f44daaa012d4e7869eb492", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}] Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 29265bbea7494b82b415e635bbd67918 Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'tempest-invalid-921292661'} Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-921292661 to delete Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-921292661 could not be found. Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.459622 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.464576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64e82db8-caca-4e46-8b9f-46afc9e012c2 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:23.466804 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64e82db8-caca-4e46-8b9f-46afc9e012c2 tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] 10.222.0.27 "DELETE /compute/v2.1/images/tempest-invalid-921292661" status: 404 len: 62 microversion: 2.1 time: 0.042331 Aug 30 04:14:23.468042 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 794/1529] 10.222.0.27 () {58 vars in 1203 bytes} [Tue Aug 30 04:14:23 2022] DELETE /compute/v2.1/images/tempest-invalid-921292661 => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:14:23.477340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c35016cf-afa4-4427-9591-a62a0c9ec4bd tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Calling method '.version_select at 0x7fe96a5785e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.508490 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-c35016cf-afa4-4427-9591-a62a0c9ec4bd tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] HTTP exception thrown: Image not found. Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c35016cf-afa4-4427-9591-a62a0c9ec4bd tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Request method failure captured: Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/42303b83-992d-4f85-80fd-7aa5e6d6cbc5 HTTP/1.1 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6e4tkAWZ5_jqgYpbLJqK60m7VGaOzfmaWSQRZ1hzGYXHAz7hF6ECyPYZ5rOYDKnNFyhRew-1niT3yUZru60xr33fhHpuds-zhwRqOT7Pex_ZOXI5X9qtHog-EQKVjWjENuYFU2hnLfTLAnjtXtjzw4fBBcLQieV26ylkQGhQjIUTo Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b941c0d9a2f44daaa012d4e7869eb492", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b941c0d9a2f44daaa012d4e7869eb492"}]}] Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b941c0d9a2f44daaa012d4e7869eb492 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-74604343 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 29265bbea7494b82b415e635bbd67918 Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-74604343-project Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '42303b83-992d-4f85-80fd-7aa5e6d6cbc5'} Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 42303b83-992d-4f85-80fd-7aa5e6d6cbc5 to delete Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42303b83-992d-4f85-80fd-7aa5e6d6cbc5 could not be found. Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.510858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.516383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c35016cf-afa4-4427-9591-a62a0c9ec4bd tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:23.519053 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c35016cf-afa4-4427-9591-a62a0c9ec4bd tempest-ImagesDeleteNegativeTestJSON-74604343 tempest-ImagesDeleteNegativeTestJSON-74604343-project] 10.222.0.27 "DELETE /compute/v2.1/images/42303b83-992d-4f85-80fd-7aa5e6d6cbc5" status: 404 len: 62 microversion: 2.1 time: 0.045214 Aug 30 04:14:23.523821 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 795/1530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] DELETE /compute/v2.1/images/42303b83-992d-4f85-80fd-7aa5e6d6cbc5 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:14:23.573605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:23.583231 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc664af0-733a-4848-afaa-158034b878b2 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1526 microversion: 2.1 time: 0.208616 Aug 30 04:14:23.584399 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 736/1531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1526 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:14:23.646648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.648171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.660647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.661678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.662860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.664045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.664868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.665569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.740565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:23.750667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:23.752775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:23.754698 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5dcff04f-214c-42b7-a998-e4e062e17ab4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1313 microversion: 2.25 time: 0.116058 Aug 30 04:14:23.755617 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 796/1532] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:23 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1313 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:23.886139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.886753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.901539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.903172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.912267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.914336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.917726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.918554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.919243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.919988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.921512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.922529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.923236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.923921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.924601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.925300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.956923 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] HTTP exception thrown: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Request method failure captured: Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 HTTP/1.1 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY26wgtsJ04Pd08MRzH0QM9Fh1kI4R1aXu2tafFbZ77zeeGwIY5bI9iph_QBzIuIBioyBDzov_eJCYCaICIqsMFgJz0S7r-vqo2hFy2xf60oBe1l1L7SlHum9BCU5-wwYPyvsGyS-QTth4kARyc6P2m_wB4SNWmEYDZbwUF7ZpYmA0g Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b8e48071560647d1b0684dea4cbb0883 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8e48071560647d1b0684dea4cbb0883", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8e48071560647d1b0684dea4cbb0883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8e48071560647d1b0684dea4cbb0883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8e48071560647d1b0684dea4cbb0883"}]}] Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b8e48071560647d1b0684dea4cbb0883 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachSCSIVolumeTestJSON-1927892413-project Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: e24aec83db374898a8fbbe3da7407cc1 Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1927892413-project Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '2fa0d49a-b773-4919-bc1f-237caf6c7381'} Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:23.959997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:23.966462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:23.970414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Returning 404 to user: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:23.971514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-366ff94b-4a76-4127-8b69-5efab2d5093e tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 404 len: 111 microversion: 2.1 time: 0.073909 Aug 30 04:14:23.973115 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 797/1533] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:23 2022] DELETE /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:14:23.983878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:23.984597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] [instance: 2fa0d49a-b773-4919-bc1f-237caf6c7381] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:23.993236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.993841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.994347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:23.995451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:23.995980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:23.996472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.027281 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] HTTP exception thrown: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Request method failure captured: Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 HTTP/1.1 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY26wgtsJ04Pd08MRzH0QM9Fh1kI4R1aXu2tafFbZ77zeeGwIY5bI9iph_QBzIuIBioyBDzov_eJCYCaICIqsMFgJz0S7r-vqo2hFy2xf60oBe1l1L7SlHum9BCU5-wwYPyvsGyS-QTth4kARyc6P2m_wB4SNWmEYDZbwUF7ZpYmA0g Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b8e48071560647d1b0684dea4cbb0883 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b8e48071560647d1b0684dea4cbb0883", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b8e48071560647d1b0684dea4cbb0883"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8e48071560647d1b0684dea4cbb0883"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b8e48071560647d1b0684dea4cbb0883"}]}] Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b8e48071560647d1b0684dea4cbb0883 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1927892413 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachSCSIVolumeTestJSON-1927892413-project Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: e24aec83db374898a8fbbe3da7407cc1 Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1927892413-project Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '2fa0d49a-b773-4919-bc1f-237caf6c7381'} Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:24.029209 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:24.034370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:24.034370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:24.034370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:24.034370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:24.034370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:24.034370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. Aug 30 04:14:24.034370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:24.036368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] Returning 404 to user: Instance 2fa0d49a-b773-4919-bc1f-237caf6c7381 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:24.037450 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-203201ab-5e49-441b-9778-11da45fc8f84 tempest-AttachSCSIVolumeTestJSON-1927892413 tempest-AttachSCSIVolumeTestJSON-1927892413-project] 10.222.0.27 "GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381" status: 404 len: 111 microversion: 2.1 time: 0.058755 Aug 30 04:14:24.041744 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 798/1534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] GET /compute/v2.1/servers/2fa0d49a-b773-4919-bc1f-237caf6c7381 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:24.273541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:24.274432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:24.282008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.283027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.285021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.286015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.286779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.287378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.335113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:24.352541 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c3a78c34-fc02-4774-b2a6-bb110f3b544b tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1199 microversion: 2.1 time: 0.470169 Aug 30 04:14:24.358253 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 737/1535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:23 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1199 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:24.378327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:24.379479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:24.387756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.388557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.389035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.389858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.390323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.390760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.660303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:24.671172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3120c2a5-38c3-44bc-bf1a-84d99c986c22 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.401558 Aug 30 04:14:24.671767 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 799/1536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:24 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:14:24.678901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:24.679621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:24.688614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.690004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.690879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.691858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.692402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.692900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.775332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:24.785626 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08ec0c91-d0e4-463c-8cae-bb37dc00573c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1474 microversion: 2.1 time: 0.425993 Aug 30 04:14:24.800428 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 738/1537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:24 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1474 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:24.806298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:24.807142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:24.814462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.815468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.816089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:24.817191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:24.833363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:24.834162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.240640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:25.247032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:25.256763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:25.258397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:25.259642 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06907247-ea26-4c53-8312-89284bb8fad5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1313 microversion: 2.25 time: 0.457469 Aug 30 04:14:25.275335 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 739/1538] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:24 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:25.275723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:25.285163 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c64bbbf-6173-4010-ad85-5ca4ca0f63d7 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1526 microversion: 2.1 time: 0.612020 Aug 30 04:14:25.286199 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 800/1539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:24 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1526 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:25.377636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:25.378264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:25.390103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.390621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.391066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.391785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.392241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.392669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.703418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:25.705238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:25.715260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.716211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.716973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.717954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.718638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.719355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.783242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:25.792345 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d299ab2-d2b0-452b-93d4-9bfd0d33caa2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1383 microversion: 2.1 time: 0.418661 Aug 30 04:14:25.801837 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 740/1540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:25 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1383 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:25.974034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:25.976202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.976895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.977717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:25.978634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:25.979256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:25.979865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.010350 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51010a57-8c15-4d60-b615-399a84ea3d19 tempest-AZV2TestJSON-1124313111 tempest-AZV2TestJSON-1124313111-project] 10.222.0.27 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.215678 Aug 30 04:14:26.011671 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 741/1541] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Aug 30 04:14:25 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:14:26.017988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:26.019010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:26.027322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.028108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.028844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.030488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.031330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.032038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.092548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:26.119925 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fde650e0-6fb6-4da0-88cb-93391b883b2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.428906 Aug 30 04:14:26.121254 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 801/1542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:25 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:26.132039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:26.164942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:26.197710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.198217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.198653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.199732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.199858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.200236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.612190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:26.628650 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b75aea87-a16e-435a-914b-1050772110c0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1471 microversion: 2.1 time: 0.613306 Aug 30 04:14:26.630967 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 742/1543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:26 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1471 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:26.645550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:26.645550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:26.659865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.662162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.665721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.670561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.673920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.674917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.840579 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a767797-2cb5-48a0-bcbc-e46e5b4cbe78 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1534 microversion: 2.1 time: 0.716733 Aug 30 04:14:26.842322 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 802/1544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:26 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1534 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:26.852571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:26.853893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:26.863689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.864650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.865301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.866484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.867200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.867912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.901310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:26.913411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:26.917840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:26.919339 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa3510e0-68e6-47c2-8f06-d91a6dde8de4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1319 microversion: 2.25 time: 0.286022 Aug 30 04:14:26.921071 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 743/1545] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:26 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:26.922388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:26.926308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:26.927135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:26.933480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.934318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.934995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:26.935963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:26.936651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:26.937309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:27.096850 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e29e419-8293-4c51-bd77-a2486e3249f9 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "POST /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f/action" status: 202 len: 0 microversion: 2.1 time: 0.174015 Aug 30 04:14:27.101158 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 744/1546] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:14:26 2022] POST /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:14:27.108838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:27.110057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:27.112825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:27.131695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:27.133001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:27.133604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:27.134357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:27.135058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:27.137241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:27.798477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:27.915959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9abb5b0dbb04242acaf957bd30cd5c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a907c55f8d44858bc82f64b652a2d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:27.924914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0bf12ca8-540d-4f70-9a5c-b6a65a39d65c tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 200 len: 1526 microversion: 2.1 time: 1.080924 Aug 30 04:14:27.925264 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 803/1547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:26 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 1526 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:27.929767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:27.930575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:27.937021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:27.937720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:27.938557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:27.939347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:27.939963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:27.940406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:28.087947 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c02d8289-c932-4e86-89b9-c87300dd8632 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1534 microversion: 2.1 time: 0.984986 Aug 30 04:14:28.089130 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 745/1548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:27 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1534 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:28.108425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:28.109460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:28.118090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:28.120391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:28.121310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:28.123698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:28.125207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:28.125916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:28.745313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:28.756616 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bbcd0c2b-784a-4024-81a3-7960508adf1c tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 0.827434 Aug 30 04:14:28.756616 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 804/1549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:27 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:28.760368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8c5f61fd-78e2-4e5c-bca2-8e7ece686134 req-354ed2fc-d331-45fa-98ee-e7af2d4df1a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d780c8-8ba4-4726-9a9e-a2b9770068ff", "name": "network-vif-deleted", "tag": "2cc186af-e9fd-4ac4-be72-fcb78b0c36d7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:28.772471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8c5f61fd-78e2-4e5c-bca2-8e7ece686134 req-354ed2fc-d331-45fa-98ee-e7af2d4df1a3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:28.773219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8c5f61fd-78e2-4e5c-bca2-8e7ece686134 req-354ed2fc-d331-45fa-98ee-e7af2d4df1a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:28.773685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8c5f61fd-78e2-4e5c-bca2-8e7ece686134 req-354ed2fc-d331-45fa-98ee-e7af2d4df1a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:28.786880 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8c5f61fd-78e2-4e5c-bca2-8e7ece686134 req-354ed2fc-d331-45fa-98ee-e7af2d4df1a3 service nova] Creating event network-vif-deleted:2cc186af-e9fd-4ac4-be72-fcb78b0c36d7 for instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff on n-h1-854925-5 Aug 30 04:14:28.792622 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8c5f61fd-78e2-4e5c-bca2-8e7ece686134 req-354ed2fc-d331-45fa-98ee-e7af2d4df1a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037148 Aug 30 04:14:28.793229 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 805/1550] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:28.798987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:28.800171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:28.806754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:28.807415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:28.808419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:28.809318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:28.809906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:28.810226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:28.985647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:28.994808 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-207c7b62-7174-4805-a519-490be05bdd51 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.904350 Aug 30 04:14:29.010434 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 746/1551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:28 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:29.015948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.019969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.020715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.021232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.022091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.022647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.023171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.049585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:29.050424 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9d97e0a-72b9-44bf-9518-749739a509d5 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038517 Aug 30 04:14:29.058978 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 747/1552] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:14:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:29.064396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:29.065365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.066367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 64d780c8-8ba4-4726-9a9e-a2b9770068ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:29.070763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:29.073563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.074332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.074828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.075574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.075726 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bdf4cde3-d3ea-4db8-a88b-c9c2c2087bd4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1319 microversion: 2.25 time: 0.281139 Aug 30 04:14:29.078288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.078525 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 806/1553] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:28 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:29.079277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.088745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854925-5", "block_migration": false, "disk_over_commit": false}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:29.091249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:29.111440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.111943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.113486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.113644 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff could not be found. Aug 30 04:14:29.114717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff HTTP/1.1 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff could not be found. Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '64d780c8-8ba4-4726-9a9e-a2b9770068ff'} Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff could not be found. Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff could not be found. Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.115473 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff could not be found. Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Instance 64d780c8-8ba4-4726-9a9e-a2b9770068ff could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:29.120540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59653b06-948d-479c-bd95-b34f573fdcb6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff" status: 404 len: 111 microversion: 2.1 time: 0.057781 Aug 30 04:14:29.122331 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 748/1554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:29 2022] GET /compute/v2.1/servers/64d780c8-8ba4-4726-9a9e-a2b9770068ff => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:29.125975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.126784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.128872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b298310f-e91e-4743-bf53-869ce8c17373 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '.version_select at 0x7fe969fcc0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.157085 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b298310f-e91e-4743-bf53-869ce8c17373 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Image not found. Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b298310f-e91e-4743-bf53-869ce8c17373 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393 HTTP/1.1 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '7398d687-6379-453a-8205-3c169d492393'} Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7398d687-6379-453a-8205-3c169d492393 to delete Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7398d687-6379-453a-8205-3c169d492393 could not be found. Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.160051 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:14:29.165540 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.170510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b298310f-e91e-4743-bf53-869ce8c17373 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:29.171731 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b298310f-e91e-4743-bf53-869ce8c17373 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393" status: 404 len: 62 microversion: 2.1 time: 0.047900 Aug 30 04:14:29.172485 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 749/1555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:29 2022] DELETE /compute/v2.1/images/7398d687-6379-453a-8205-3c169d492393 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:14:29.180633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0e3b93e0-4bcf-4684-8269-14d467b372cc req-76d2c728-2fe2-4cd8-b0ff-2b07bf72d5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "name": "network-vif-plugged", "status": "completed", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:29.188892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lazy-loading 'flavor' on Instance uuid 2c43c07e-706b-4003-9da9-1bfa84b66310 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:29.195106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0e3b93e0-4bcf-4684-8269-14d467b372cc req-76d2c728-2fe2-4cd8-b0ff-2b07bf72d5d5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.195953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0e3b93e0-4bcf-4684-8269-14d467b372cc req-76d2c728-2fe2-4cd8-b0ff-2b07bf72d5d5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.196803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0e3b93e0-4bcf-4684-8269-14d467b372cc req-76d2c728-2fe2-4cd8-b0ff-2b07bf72d5d5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.211035 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0e3b93e0-4bcf-4684-8269-14d467b372cc req-76d2c728-2fe2-4cd8-b0ff-2b07bf72d5d5 service nova] Creating event network-vif-plugged:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h1-854925-5 Aug 30 04:14:29.218431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-0e3b93e0-4bcf-4684-8269-14d467b372cc req-76d2c728-2fe2-4cd8-b0ff-2b07bf72d5d5 service nova] Instance 5634b704-42d5-42f6-81b6-06009a0a600f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:14:29.219263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Going to try to live migrate instance to n-h1-854925-5 {{(pid=122403) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:14:29.234393 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0e3b93e0-4bcf-4684-8269-14d467b372cc req-76d2c728-2fe2-4cd8-b0ff-2b07bf72d5d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060385 Aug 30 04:14:29.235416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 750/1556] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:29.240777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.241698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:29.250783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.251520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.252312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.253615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.254715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.255439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.274739 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 HTTP/1.1 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a4ab32b1-0c9a-4544-82b7-e5a4b37dc555'} Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:29.277501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.286233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.289056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:29.290366 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed9ba1dc-b347-4ae7-b205-76f0dfabe221 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 404 len: 111 microversion: 2.1 time: 0.053744 Aug 30 04:14:29.291178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 751/1557] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:29 2022] DELETE /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:29.300168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.300893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: a4ab32b1-0c9a-4544-82b7-e5a4b37dc555] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:29.307792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.308365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.309030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.310053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.310771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.311422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.333413 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 HTTP/1.1 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a4ab32b1-0c9a-4544-82b7-e5a4b37dc555'} Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.335456 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. Aug 30 04:14:29.339922 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:14:29.343050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Instance a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:29.345225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83ebc1bd-662f-4155-8386-f59cacd0b171 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555" status: 404 len: 111 microversion: 2.1 time: 0.048415 Aug 30 04:14:29.345511 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 752/1558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:29 2022] GET /compute/v2.1/servers/a4ab32b1-0c9a-4544-82b7-e5a4b37dc555 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:14:29.363794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6696696-cf99-42aa-ac2c-9eb8576238d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '.version_select at 0x7fe96a162a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.400651 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6696696-cf99-42aa-ac2c-9eb8576238d6 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255372187" status: 202 len: 0 microversion: 2.1 time: 0.047793 Aug 30 04:14:29.402223 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 753/1559] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:14:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255372187 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:14:29.776294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:29.777959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:29.788255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.788936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.790104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:29.791212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:29.792105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:29.792899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:30.728380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:30.750113 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b42b9f3-a411-46cc-b0ad-9fe17d23e1b6 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 0.978595 Aug 30 04:14:30.751885 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 754/1560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:29 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:30.758797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:30.759478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:30.768694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:30.769632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:30.770285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:30.771842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:30.772583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:30.773088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:31.316006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:31.325061 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eafe9236-fd27-4e37-8b17-3052b0a40ae8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.571325 Aug 30 04:14:31.330410 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 755/1561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:30 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:31.345567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:31.347366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:31.361134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:31.365610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:31.366368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:31.391572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:31.392134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:31.392575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:31.781446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:31.791880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:31.809645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:31.811778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8b3d48f5-f1cd-4afe-a30e-c3bbe39d98ce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.479850 Aug 30 04:14:31.812857 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 756/1562] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:31 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:31.814093 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8f3be9f7-4781-43fc-84ed-5a4cde51d9e0 tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310/action" status: 202 len: 0 microversion: 2.1 time: 2.734143 Aug 30 04:14:31.815712 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 807/1563] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:14:29 2022] POST /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310/action => generated 0 bytes in 2736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:14:31.822515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0280d1d-0821-4e56-896b-20e8c4b8b6bb tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '.version_select at 0x7fe96a578820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:31.864548 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a0280d1d-0821-4e56-896b-20e8c4b8b6bb tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Image not found. Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0280d1d-0821-4e56-896b-20e8c4b8b6bb tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/568c1fe4-7125-43f7-bf89-71d87473a0d1 HTTP/1.1 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '568c1fe4-7125-43f7-bf89-71d87473a0d1'} Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 568c1fe4-7125-43f7-bf89-71d87473a0d1 to delete Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 568c1fe4-7125-43f7-bf89-71d87473a0d1 could not be found. Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:31.866846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:14:31.872142 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:31.875211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0280d1d-0821-4e56-896b-20e8c4b8b6bb tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:31.876100 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a0280d1d-0821-4e56-896b-20e8c4b8b6bb tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/images/568c1fe4-7125-43f7-bf89-71d87473a0d1" status: 404 len: 62 microversion: 2.1 time: 0.059277 Aug 30 04:14:31.876690 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 808/1564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:31 2022] DELETE /compute/v2.1/images/568c1fe4-7125-43f7-bf89-71d87473a0d1 => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:14:31.884834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:31.885769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:31.893821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:31.894811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:31.895434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:31.896349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:31.896988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:31.897630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:32.078123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:32.092514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86492cbb-37fd-446c-8445-03140a1c237b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 0.213787 Aug 30 04:14:32.093726 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 809/1565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:31 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:32.129164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:32.130092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:32.144685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:32.146178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:32.146817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:32.147904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:32.148623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:32.149365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:32.301248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1929163796", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "daf32fdd-555c-43ad-9f26-60c2f572e852"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:32.426710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] validate_networks() for [('daf32fdd-555c-43ad-9f26-60c2f572e852', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:14:32.666374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:32.688780 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7782d63-9a15-49ab-ba31-3d9e1929b0f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.593165 Aug 30 04:14:32.689680 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 810/1566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:32 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:32.719385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:32.725633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:32.742408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:32.744440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:32.745492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:32.746730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:32.747363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:32.748973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:32.799787 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 HTTP/1.1 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9de95010-d595-4176-bae5-71fefb910fe7'} Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:32.801640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:32.806675 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:32.809235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:32.810434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06f71878-f693-4bd6-aecd-f9e09cd42349 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 404 len: 111 microversion: 2.1 time: 0.101925 Aug 30 04:14:32.811685 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 811/1567] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:32 2022] DELETE /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:32.817106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:32.818818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:32.826870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:32.827569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:32.828467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:32.829416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:32.830276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:32.830880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:33.505132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:33.521995 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ed456102-a48f-4c95-b919-589d68ad769f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.709035 Aug 30 04:14:33.522857 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 812/1568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:32 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:33.537513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:33.538393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] [instance: 9de95010-d595-4176-bae5-71fefb910fe7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:33.548415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:33.548913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:33.549368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:33.550083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:33.550535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:33.550963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:33.575315 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] HTTP exception thrown: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Request method failure captured: Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 HTTP/1.1 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY4y4g4EOKA3luY55A3L_depdvV_UrdkUG3BY5pDQ6QY0kN4pS69rYDw_JwGp0fbgC8iTiyt4gGuxVc_saJYxv1C5nBSb7q0LFkg2lBJaZS5CVC24SgW7_jSX8P9O-Lo79OQB_PKXqxzh3SKJwFFg_knclMcTXov7t_8yfwvbyK46fA Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7a907c55f8d44858bc82f64b652a2d2c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7a907c55f8d44858bc82f64b652a2d2c"}]}] Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7a907c55f8d44858bc82f64b652a2d2c Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d9abb5b0dbb04242acaf957bd30cd5c1 Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1374045831-project Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9de95010-d595-4176-bae5-71fefb910fe7'} Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:33.578670 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. Aug 30 04:14:33.584058 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:33.586071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] Returning 404 to user: Instance 9de95010-d595-4176-bae5-71fefb910fe7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:33.587824 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47702289-9135-4c4d-ba74-36a9895dc044 tempest-ImagesOneServerNegativeTestJSON-1374045831 tempest-ImagesOneServerNegativeTestJSON-1374045831-project] 10.222.0.27 "GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7" status: 404 len: 111 microversion: 2.1 time: 0.063345 Aug 30 04:14:33.592915 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 813/1569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:33 2022] GET /compute/v2.1/servers/9de95010-d595-4176-bae5-71fefb910fe7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:33.600313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:33.601905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:33.611052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:33.611804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:33.612549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:33.614036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:33.614675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:33.616946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:34.320203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:34.320690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:34.321164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:34.321612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:34.322033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:34.339068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:34.339568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:34.340014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:34.340756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:34.341215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:34.341672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:34.400890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Getting quotas for project 9e3ec368e5824d159ce139aebfdfbd0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:34.413614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Getting quotas for user 75aaab3bc0ea4852844bcc7a25df0806 and project 9e3ec368e5824d159ce139aebfdfbd0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:34.418776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:34.433599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:34.435503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:34.441250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:34.441645 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-66d2a038-35cf-4657-ab65-4d9d94593e7c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.845969 Aug 30 04:14:34.443181 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 814/1570] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:33 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:34.444945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:34.504586 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1df7e3d3-47aa-4ba6-a09c-45bff7192a69 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.689705 Aug 30 04:14:34.506019 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 757/1571] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:14:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:14:34.511797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:34.512641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:34.521240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:34.522012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:34.522627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:34.523514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:34.524137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:34.524731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:34.918794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:34.919508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:34.930109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:34.930856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:34.931513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:34.932500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:34.933160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:34.933809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:35.283938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:35.293130 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0482ee8c-4efd-4263-b881-d007b4d90235 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.785808 Aug 30 04:14:35.294299 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 758/1572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:34 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:35.406385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1328855016", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": "none"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:35.495393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:35.497999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:35.498958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:35.499793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:35.500459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:35.515242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:35.516186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:35.516867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:35.518296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:35.519012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:35.520027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:35.547604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Getting quotas for project 1bf5a56e9774458a8bcebeba24c3078b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:35.548173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:35.554480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Getting quotas for user cc4f813ba3944a90b46583dc595d6087 and project 1bf5a56e9774458a8bcebeba24c3078b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:35.559677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c575d30-efa4-4906-a874-a75e5d660155 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 1.113645 Aug 30 04:14:35.563627 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 815/1573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:34 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:35.573532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:35.573768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:35.577794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:35.578622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:35.591250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:35.594715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:35.595934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:35.597498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:35.598790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:35.599396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:35.690408 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c1ea64fd-d187-42d5-9bd9-834205866c5f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.393194 Aug 30 04:14:35.693492 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 759/1574] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 398 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:14:35.705910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1108444999", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "daf32fdd-555c-43ad-9f26-60c2f572e852"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:35.813100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] validate_networks() for [('daf32fdd-555c-43ad-9f26-60c2f572e852', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:14:36.298842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:36.310364 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6cf3eb8c-a950-431c-a9cc-d1652c72428c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1515 microversion: 2.1 time: 0.745367 Aug 30 04:14:36.312812 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 816/1575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:35 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1515 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:36.321731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-48fcce43-1c41-4242-bd10-1ed535221442 req-5ef14475-0b04-4d6b-a60d-ee1bd977ab6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e146cd9a-2f09-46fc-a6f0-c91ae439ec69", "tag": "48649702-bdde-4500-91fc-108723f11e96"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:36.334163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-48fcce43-1c41-4242-bd10-1ed535221442 req-5ef14475-0b04-4d6b-a60d-ee1bd977ab6b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:36.335189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-48fcce43-1c41-4242-bd10-1ed535221442 req-5ef14475-0b04-4d6b-a60d-ee1bd977ab6b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:36.335864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-48fcce43-1c41-4242-bd10-1ed535221442 req-5ef14475-0b04-4d6b-a60d-ee1bd977ab6b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:36.356333 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-48fcce43-1c41-4242-bd10-1ed535221442 req-5ef14475-0b04-4d6b-a60d-ee1bd977ab6b service nova] Creating event network-changed:48649702-bdde-4500-91fc-108723f11e96 for instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 on n-h1-854925-5 Aug 30 04:14:36.363914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-48fcce43-1c41-4242-bd10-1ed535221442 req-5ef14475-0b04-4d6b-a60d-ee1bd977ab6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047533 Aug 30 04:14:36.365180 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 817/1576] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:36.371571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:36.372781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:36.382415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:36.382927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:36.383447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:36.384519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:36.385146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:36.386045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:36.898725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:36.912521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:36.922442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:36.923639 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-68b49b41-7d17-4605-9dfe-d2e7e0b49be6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.556940 Aug 30 04:14:36.924291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 818/1577] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:36 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:36.930295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:36.937611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:36.957626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:36.958540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:36.959188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:36.960104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:36.960811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:36.961501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.266870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:37.290103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:37.291916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:37.293220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f01efa99-4a48-434e-9c37-a9213b6bf294 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1274 microversion: 2.57 time: 0.367982 Aug 30 04:14:37.293865 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 819/1578] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:36 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1274 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:37.310662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:37.311705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:37.319644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.320982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.321737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.322710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.323488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.324133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.524604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:37.525699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:37.528031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:37.528890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:37.530611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:37.549259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.551302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.551751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.552517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.560732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.561835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.599714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Getting quotas for project 9e3ec368e5824d159ce139aebfdfbd0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:37.606111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Getting quotas for user 75aaab3bc0ea4852844bcc7a25df0806 and project 9e3ec368e5824d159ce139aebfdfbd0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:37.622248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:37.625549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:37.698010 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-80f1722b-fa8c-40f0-8ae1-a38bef4af31d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002780 Aug 30 04:14:37.699310 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 760/1579] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2005 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:14:37.704990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:37.705850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:37.740169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.741235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.741716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.742781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.743485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.744108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.883620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:37.894460 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f5e024b-3c35-45a1-beda-c5a67f2d364e tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.597619 Aug 30 04:14:37.932806 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 820/1580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:37 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:37.938443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:37.939626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:37.953287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.955646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.956369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:37.957095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:37.957581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:37.958003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:38.036729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.046633 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30c4036c-9583-4359-a574-57f1444a50ac tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 0.345967 Aug 30 04:14:38.047233 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 761/1581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:37 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:38.056813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1625535107", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "451", "networks": [{"uuid": "daf32fdd-555c-43ad-9f26-60c2f572e852"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:38.128064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] validate_networks() for [('daf32fdd-555c-43ad-9f26-60c2f572e852', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:14:38.260105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.264662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:38.283811 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4d4c5e3d-82d6-4d0c-8e43-c5f95e18e55a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1521 microversion: 2.1 time: 0.349488 Aug 30 04:14:38.285623 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 821/1582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:37 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1521 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:38.300557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:38.302771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:38.315188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:38.318388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:38.319177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:38.320993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:38.321723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:38.322330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:38.664934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.707032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.708757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.713914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd902159-5cdc-4059-be84-9b83b50ecd2f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.424519 Aug 30 04:14:38.717623 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 822/1583] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:38 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:38.726136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:38.730720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:38.750487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:38.751473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:38.753801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:38.757041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:38.758037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:38.758602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:38.938729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.957959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.966049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:38.972916 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-efde62ae-2187-4b2d-819b-d6230a55fd90 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1274 microversion: 2.57 time: 0.252618 Aug 30 04:14:38.977244 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 823/1584] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:38 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1274 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:38.986343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "name": "network-vif-unplugged", "status": "completed", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}, {"name": "network-changed", "server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:39.030042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:39.030819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:39.034227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:39.078711 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] Creating event network-vif-unplugged:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h2-854925-5 Aug 30 04:14:39.080519 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] Creating event network-changed:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h2-854925-5 Aug 30 04:14:39.096600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] Instance 5634b704-42d5-42f6-81b6-06009a0a600f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:14:39.130676 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b3db3e60-c50b-4472-842a-17282c06709c req-4be7eea5-7b4e-4c3d-8a38-bcd64d97d1d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.151247 Aug 30 04:14:39.132291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 824/1585] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:39.152982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:39.156099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:39.172503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:39.177644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:39.178221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:39.179089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:39.179665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:39.181408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:39.814584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:39.816186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:39.817095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:39.817709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:39.818298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:39.836581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:39.837384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:39.839261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:39.840756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:39.843033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:39.850570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:39.910535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Getting quotas for project 9e3ec368e5824d159ce139aebfdfbd0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:39.917263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Getting quotas for user 75aaab3bc0ea4852844bcc7a25df0806 and project 9e3ec368e5824d159ce139aebfdfbd0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:39.945947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:39.948452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:40.075810 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2cac36f9-84a7-4125-a260-903ef27fe767 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.024612 Aug 30 04:14:40.081037 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 762/1586] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:14:40.091339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:40.094143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:40.143297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:40.150353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:40.150948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:40.151860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:40.152493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:40.152996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:40.234438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.047356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:41.057237 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7ef2c572-540f-4173-a9bd-71ef7060657f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 1.923407 Aug 30 04:14:41.061969 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 825/1587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:39 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:41.066943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:41.082044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:41.106194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:41.111958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:41.114198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:41.114961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:41.115428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:41.115861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:41.322662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:41.338602 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb35f6ba-4454-475f-8daf-a19a1300e70a tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 1.255598 Aug 30 04:14:41.343472 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 763/1588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:40 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:41.357286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:41.358534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:41.401657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:41.405665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:41.407273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:41.409799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:41.413139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:41.413840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:41.863179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:41.883323 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d6a7e7c9-ec67-4b71-acff-6e9070d2fc20 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1521 microversion: 2.1 time: 0.820029 Aug 30 04:14:41.888993 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 826/1589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:41 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1521 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:41.902809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:41.903552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:41.908401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:41.928982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:41.929520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:41.929965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:41.930825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:41.931283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:41.931711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:42.277915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:42.293059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:42.294886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:42.298884 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e83ec1cd-b899-47af-8584-7b957e3fb4b1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1330 microversion: 2.57 time: 0.407455 Aug 30 04:14:42.301648 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 827/1590] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:41 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1330 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:42.311288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:42.321757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:42.350689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:42.351486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:42.352703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:42.353651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:42.355046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:42.356256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:43.152477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:43.159365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:43.168181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:43.176710 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23403bed-dddf-4a9a-ad4f-2597e6c7642a tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1273 microversion: 2.1 time: 0.869199 Aug 30 04:14:43.178338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:43.179950 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 828/1591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:42 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1273 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:43.180409 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce53c333-849d-4bce-a9c9-54aeb3a44d57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 1.834140 Aug 30 04:14:43.181190 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 764/1592] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:41 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:43.205481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6032ab34-98a0-43f6-a005-522af6712431 req-35a74c09-77ed-4e16-89ee-9c089fa71c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b6241b-bd6b-497a-be52-1610160d2fbf", "name": "network-vif-unplugged", "status": "completed", "tag": "466d0b50-71b0-4ea1-b478-2f7f3c8cc403"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:43.215151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:43.216221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:43.231454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6032ab34-98a0-43f6-a005-522af6712431 req-35a74c09-77ed-4e16-89ee-9c089fa71c9b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:43.231939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6032ab34-98a0-43f6-a005-522af6712431 req-35a74c09-77ed-4e16-89ee-9c089fa71c9b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:43.233707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:43.234816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:43.235381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:43.235530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6032ab34-98a0-43f6-a005-522af6712431 req-35a74c09-77ed-4e16-89ee-9c089fa71c9b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:43.238991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:43.240381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:43.245416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:43.260242 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6032ab34-98a0-43f6-a005-522af6712431 req-35a74c09-77ed-4e16-89ee-9c089fa71c9b service nova] Creating event network-vif-unplugged:466d0b50-71b0-4ea1-b478-2f7f3c8cc403 for instance 98b6241b-bd6b-497a-be52-1610160d2fbf on n-h2-854925-5 Aug 30 04:14:43.274922 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6032ab34-98a0-43f6-a005-522af6712431 req-35a74c09-77ed-4e16-89ee-9c089fa71c9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093591 Aug 30 04:14:43.276258 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 829/1593] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:43.289027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:43.290487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:43.305427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:43.306958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:43.309003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:43.311372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:43.312923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:43.314708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:43.933536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:43.941194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:43.961873 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aba58d41-594b-4046-970f-deef57ed75f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.778353 Aug 30 04:14:43.963572 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bcd603b0-4ca0-44d7-a143-bcd10fbc9bb1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 0.685954 Aug 30 04:14:43.965600 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 765/1594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:43 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:43.967644 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 830/1595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:43 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:43.976366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:43.977236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:43.978053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:43.980068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:43.980555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:43.998568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:43.999482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.001111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.001425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.013463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.014905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.015489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.016251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.017565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.018013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.020172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.020619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.216905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.230216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.231648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.239026 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21bb66f9-3773-41c8-9233-8a4552b5be98 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1336 microversion: 2.57 time: 0.270168 Aug 30 04:14:44.253373 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 831/1596] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:43 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1336 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:44.253373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:44.253373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:44.267229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.267723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.268164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.268871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.275031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.275785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.323424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.338318 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-241ecd2d-db95-43ad-bd4f-c795268b71c6 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1521 microversion: 2.1 time: 0.371499 Aug 30 04:14:44.339291 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 766/1597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:43 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:44.345219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:44.350037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:44.362314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.362807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.363249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.363959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.364415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.364840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.411276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.425999 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d626212-814c-49f5-9df4-e01b4fa3f8a2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1279 microversion: 2.1 time: 0.181128 Aug 30 04:14:44.442045 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 832/1598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:44 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:44.673692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.692768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.694379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:44.696008 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b5f983a-13ca-40fe-8379-0d129cf6da7e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.355507 Aug 30 04:14:44.698591 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 767/1599] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:44 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:44.840007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-28048250-2a6d-4f57-b8e3-5326607ba2a5 req-782b7b72-64e9-4bc5-9057-0e7bb7291fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7622a31b-95c0-4360-b9b9-7237c084514e", "tag": "f7ea778a-6721-4820-a88f-1cec1b8b6e38"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:44.850055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28048250-2a6d-4f57-b8e3-5326607ba2a5 req-782b7b72-64e9-4bc5-9057-0e7bb7291fed service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:44.850842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28048250-2a6d-4f57-b8e3-5326607ba2a5 req-782b7b72-64e9-4bc5-9057-0e7bb7291fed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:44.851452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28048250-2a6d-4f57-b8e3-5326607ba2a5 req-782b7b72-64e9-4bc5-9057-0e7bb7291fed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:44.863496 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-28048250-2a6d-4f57-b8e3-5326607ba2a5 req-782b7b72-64e9-4bc5-9057-0e7bb7291fed service nova] Creating event network-changed:f7ea778a-6721-4820-a88f-1cec1b8b6e38 for instance 7622a31b-95c0-4360-b9b9-7237c084514e on n-h1-854925-5 Aug 30 04:14:44.868575 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-28048250-2a6d-4f57-b8e3-5326607ba2a5 req-782b7b72-64e9-4bc5-9057-0e7bb7291fed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Aug 30 04:14:44.869727 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 833/1600] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:44.984933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:44.985852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:44.999997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.001965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:45.002675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:45.004019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.004508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.005841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.006321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.006746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.024880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.025442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.026029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.030882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.032377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.033258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.372276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:45.396515 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f16f6386-2895-46c0-89cd-54963bcc9046 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1470 microversion: 2.1 time: 0.413821 Aug 30 04:14:45.399424 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 768/1601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:44 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1470 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:45.407745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:45.408686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:45.417965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.424091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.426761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.427552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.428209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.428481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.445386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:45.460613 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-48778818-f15d-45d3-86ac-c4344f1088bd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.469848 Aug 30 04:14:45.466220 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 834/1602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:44 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:45.471306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d1ab54ac-2f6a-459d-9064-7352c754d6ac req-7566ae0f-7594-4a27-9319-bfab41f2c622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e146cd9a-2f09-46fc-a6f0-c91ae439ec69", "name": "network-vif-plugged", "status": "completed", "tag": "48649702-bdde-4500-91fc-108723f11e96"}, {"server_uuid": "98b6241b-bd6b-497a-be52-1610160d2fbf", "name": "network-vif-plugged", "status": "completed", "tag": "466d0b50-71b0-4ea1-b478-2f7f3c8cc403"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:45.504829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d1ab54ac-2f6a-459d-9064-7352c754d6ac req-7566ae0f-7594-4a27-9319-bfab41f2c622 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.509052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d1ab54ac-2f6a-459d-9064-7352c754d6ac req-7566ae0f-7594-4a27-9319-bfab41f2c622 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.509870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d1ab54ac-2f6a-459d-9064-7352c754d6ac req-7566ae0f-7594-4a27-9319-bfab41f2c622 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.556046 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d1ab54ac-2f6a-459d-9064-7352c754d6ac req-7566ae0f-7594-4a27-9319-bfab41f2c622 service nova] Creating event network-vif-plugged:48649702-bdde-4500-91fc-108723f11e96 for instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 on n-h1-854925-5 Aug 30 04:14:45.559350 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d1ab54ac-2f6a-459d-9064-7352c754d6ac req-7566ae0f-7594-4a27-9319-bfab41f2c622 service nova] Creating event network-vif-plugged:466d0b50-71b0-4ea1-b478-2f7f3c8cc403 for instance 98b6241b-bd6b-497a-be52-1610160d2fbf on n-h2-854925-5 Aug 30 04:14:45.577398 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d1ab54ac-2f6a-459d-9064-7352c754d6ac req-7566ae0f-7594-4a27-9319-bfab41f2c622 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108960 Aug 30 04:14:45.586560 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 835/1603] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:45.615187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:45.618352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:45.650439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.651004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.651457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.653598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.656323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.656777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.776377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:45.789512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:45.792304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:45.797979 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd216cf1-ed0b-4cac-a861-01310510b516 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1336 microversion: 2.57 time: 0.396242 Aug 30 04:14:45.798580 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 769/1604] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:45 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1336 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:45.820660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:45.821291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:45.853304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.854120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.854824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:45.855788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:45.856493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:45.857138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:46.016883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:46.035174 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8cdaccba-380d-4188-a517-0fc2dcf6bba6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1279 microversion: 2.1 time: 0.218851 Aug 30 04:14:46.049242 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 770/1605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:45 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:46.055157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:46.056193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:46.066452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:46.067475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:46.068160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:46.069213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:46.069933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:46.070589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:46.604324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:46.614341 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9dc61273-e741-4a7a-bf7a-d1fa73141108 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1521 microversion: 2.1 time: 1.024589 Aug 30 04:14:46.615567 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 836/1606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:45 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1521 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:46.620615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:46.621683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:46.629631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:46.631346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:46.631996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:46.632722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:46.633179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:46.634039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:46.817833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:46.857246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:46.861909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:46.868450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa025143-c977-4c34-9f66-9fd55e4ca185 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.817525 Aug 30 04:14:46.891069 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 771/1607] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:46 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:46.911594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:46.915116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:46.934349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:46.937824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:46.938314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:46.939059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:46.939554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:46.939986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.078669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:47.094605 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3f06a779-8bfa-447f-adf6-ce4964f58ee8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1463 microversion: 2.1 time: 0.477787 Aug 30 04:14:47.095203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 837/1608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:46 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1463 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:47.103342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:47.103538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:47.119016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.121426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.121874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.122592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.123079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.123511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.244117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:47.264892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:47.266733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:47.268513 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-39dc9864-67aa-4d1c-8f02-14393a1c6601 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1336 microversion: 2.57 time: 0.171964 Aug 30 04:14:47.269762 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 838/1609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:47 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1336 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:47.276532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-485bf0de-4ea9-48ee-bec4-ac58b2b0e677 req-f8e5a76b-dbfc-469c-a08b-f7d2b50814ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a718e944-7477-4567-9c55-ecb365f95772", "tag": "d2681412-9815-44a0-9351-385d152e763a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:47.278867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:47.291080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-485bf0de-4ea9-48ee-bec4-ac58b2b0e677 req-f8e5a76b-dbfc-469c-a08b-f7d2b50814ee service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.294191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-485bf0de-4ea9-48ee-bec4-ac58b2b0e677 req-f8e5a76b-dbfc-469c-a08b-f7d2b50814ee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.295145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-485bf0de-4ea9-48ee-bec4-ac58b2b0e677 req-f8e5a76b-dbfc-469c-a08b-f7d2b50814ee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.295489 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c26f26b-2595-4385-9a02-6b4d0af38ca1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.402690 Aug 30 04:14:47.304042 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 772/1610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:46 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:47.310850 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-485bf0de-4ea9-48ee-bec4-ac58b2b0e677 req-f8e5a76b-dbfc-469c-a08b-f7d2b50814ee service nova] Creating event network-changed:d2681412-9815-44a0-9351-385d152e763a for instance a718e944-7477-4567-9c55-ecb365f95772 on n-h2-854925-5 Aug 30 04:14:47.317112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:47.317779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:47.319087 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-485bf0de-4ea9-48ee-bec4-ac58b2b0e677 req-f8e5a76b-dbfc-469c-a08b-f7d2b50814ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046521 Aug 30 04:14:47.319847 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 839/1611] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:47.334388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.334888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.335334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.336046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.336187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:47.336911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:47.345894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.346396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.355803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.356336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.357167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.358841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.359318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.363791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.803329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:47.833775 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a02ec7ac-7b09-4681-8376-803876b6c005 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1279 microversion: 2.1 time: 0.536640 Aug 30 04:14:47.835503 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 773/1612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:47 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1279 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:47.842590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:47.844235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:47.860708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.862517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.863265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:47.864786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:47.865821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:47.867491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.036265 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c64e0755-204f-4aed-984f-6f0391a08b58 tempest-MigrationsAdminTest-494812007 tempest-MigrationsAdminTest-494812007-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1614 microversion: 2.1 time: 0.713621 Aug 30 04:14:48.057667 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 840/1613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:47 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1614 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:48.057667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:48.057667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:48.070525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.071099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.075392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.077598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.078144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.079735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.130240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:48.142017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.158011 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a7a1f09-35c8-4378-b81b-37ca0b18c6a3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1521 microversion: 2.1 time: 0.318576 Aug 30 04:14:48.160269 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 774/1614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:47 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:48.193513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:48.196121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:48.219304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.219831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.223700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.226400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.226906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.227351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.298308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:48.360241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.373165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.375345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.377362 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2b467ac-4c52-4fba-b51f-e86f7acfcdc9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.333218 Aug 30 04:14:48.394672 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 841/1615] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:48 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:48.403591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:48.405831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:48.413274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.414023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.414441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.416058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.416666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.417211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.421841 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-125f5b23-96b9-4e51-a0fe-4fc2b97ade9b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 204 len: 0 microversion: 2.1 time: 0.256895 Aug 30 04:14:48.422871 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 775/1616] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:48 2022] DELETE /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:48.432082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:48.433025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:48.442260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.443069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.444034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.445168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.445818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.446629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.618914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.630076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.632083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.633548 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-607877d5-4169-4ca1-a54d-ed25adfaeb38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1357 microversion: 2.57 time: 0.237507 Aug 30 04:14:48.634279 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 842/1617] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:48 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:48.641028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:48.641845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:48.650689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.651418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.652015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.654891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.655521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.656128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.801106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.815277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c2e32535-7805-48e4-8c2f-0959f2153d11 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.388816 Aug 30 04:14:48.818944 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 776/1618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:48 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:48.831165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:48.834752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:48.852585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.853110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.857932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.861805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.862296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.862742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.892568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:48.902060 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75e125cc-239b-46de-9cd8-8150e272bfd4 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1469 microversion: 2.1 time: 0.266115 Aug 30 04:14:48.907058 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 843/1619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:48 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:48.912019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:48.918263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:48.930430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.931721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.932495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:48.933474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:48.934155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:48.934954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.028827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:49.035137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:49.037537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:49.040092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:49.040733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:49.075489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.136229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:49.148311 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ed4fe0e-ae14-40c2-a730-7b797ab2e7f2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.239720 Aug 30 04:14:49.150509 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 844/1620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:48 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:49.158878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-87757a0a-6aa5-430b-b0ac-3a5dc9732e79 req-13f6a566-5eac-4766-9ef2-101402498598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "name": "network-vif-plugged", "status": "completed", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:49.198782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-87757a0a-6aa5-430b-b0ac-3a5dc9732e79 req-13f6a566-5eac-4766-9ef2-101402498598 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.199689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-87757a0a-6aa5-430b-b0ac-3a5dc9732e79 req-13f6a566-5eac-4766-9ef2-101402498598 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.200394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-87757a0a-6aa5-430b-b0ac-3a5dc9732e79 req-13f6a566-5eac-4766-9ef2-101402498598 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.220731 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-87757a0a-6aa5-430b-b0ac-3a5dc9732e79 req-13f6a566-5eac-4766-9ef2-101402498598 service nova] Creating event network-vif-plugged:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h2-854925-5 Aug 30 04:14:49.230603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-87757a0a-6aa5-430b-b0ac-3a5dc9732e79 req-13f6a566-5eac-4766-9ef2-101402498598 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078111 Aug 30 04:14:49.231883 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 845/1621] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:49.242981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:49.243182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:49.244254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:49.251518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.252084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.252600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.253464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.253992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.254425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.254670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.255965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.256634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.257736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.258705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.259343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.302404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b4a99c99-0dca-4ffe-86fa-6c6b1ea5f098 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "POST /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8/action" status: 202 len: 1138 microversion: 2.57 time: 0.481704 Aug 30 04:14:49.309846 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 777/1622] 10.222.0.27 () {62 vars in 1320 bytes} [Tue Aug 30 04:14:48 2022] POST /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8/action => generated 1138 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 04:14:49.325825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:49.330955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:49.338686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.339153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.339592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.340561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.341027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.341516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.540007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:49.563353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:49.571803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:49.573858 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a840d5db-489d-4f49-b875-a807c3359647 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.254087 Aug 30 04:14:49.582788 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 778/1623] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:49 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:14:49.601208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:49.602992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:49.611248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.612460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.613069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.613990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.614637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.615061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.651956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:49.661200 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c3eeecd-ed7a-44dd-928a-732e1147e4b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1506 microversion: 2.1 time: 0.427525 Aug 30 04:14:49.665454 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 846/1624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:49 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:49.687743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:49.689222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:49.698537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.699868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.701143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.702435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:49.703190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:49.703839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:49.869132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=14 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:49.940857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=24 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:50.007606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.030248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.036894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.039582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f5496f7-9e78-4f7a-91a5-5cb52399da89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1361 microversion: 2.25 time: 0.455303 Aug 30 04:14:50.049918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 779/1625] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:49 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:50.053605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.061096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-87d3eba8-ee96-4a91-8ef2-f40c3fa69335 req-991d085a-17ec-47e8-8e2c-3693cb4bc043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "423d2eaa-d24e-4ae2-8efa-7e93158ba897", "tag": "f61e16e2-ebbe-4354-89f6-82c163108ecf"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:50.083352 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-518a8d8a-2ed5-4d0c-acab-6a4c2c5b70e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 200 len: 1506 microversion: 2.1 time: 0.382861 Aug 30 04:14:50.083798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-87d3eba8-ee96-4a91-8ef2-f40c3fa69335 req-991d085a-17ec-47e8-8e2c-3693cb4bc043 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.084293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-87d3eba8-ee96-4a91-8ef2-f40c3fa69335 req-991d085a-17ec-47e8-8e2c-3693cb4bc043 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.084922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-87d3eba8-ee96-4a91-8ef2-f40c3fa69335 req-991d085a-17ec-47e8-8e2c-3693cb4bc043 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.085545 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 847/1626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:49 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:50.110450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:50.111089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:50.120933 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-87d3eba8-ee96-4a91-8ef2-f40c3fa69335 req-991d085a-17ec-47e8-8e2c-3693cb4bc043 service nova] Creating event network-changed:f61e16e2-ebbe-4354-89f6-82c163108ecf for instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 on n-h1-854925-5 Aug 30 04:14:50.125996 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-87d3eba8-ee96-4a91-8ef2-f40c3fa69335 req-991d085a-17ec-47e8-8e2c-3693cb4bc043 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071221 Aug 30 04:14:50.126962 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 780/1627] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:50.130945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.132232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.134576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.136025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:50.136377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.136855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:50.138227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.140172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.149104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.151763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.153026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.153928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.155100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.155553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.462794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.469841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.472649 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0fb3d127-c04e-4826-a9d8-71cbb1f15c90 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.384498 Aug 30 04:14:50.474372 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 848/1628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:50 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:50.494083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:50.494918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:50.498705 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64c5a843-5b56-4946-a440-5d025cd1f6f1 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1469 microversion: 2.1 time: 0.368456 Aug 30 04:14:50.499257 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 781/1629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:50 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:50.502043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.502539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.503002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.503742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.504369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.504885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.528527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:50.529159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:50.540747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:50.544581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.545107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.545976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.546880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.547510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.548102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.690358 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-509e460d-6ebd-4467-89cc-7b3497373a2f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 204 len: 0 microversion: 2.1 time: 0.212991 Aug 30 04:14:50.691537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 849/1630] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:50 2022] DELETE /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:50.703979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:50.706420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:50.716364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.717690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.718327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.719203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:50.719920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:50.720592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:50.873131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.884329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.886439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:50.887870 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ec20354-d9ff-4ece-b4c0-482d8d3d1382 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.194565 Aug 30 04:14:50.888696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 850/1631] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:50 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:50.894832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1983816644", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "1c7da6b7-0398-45be-8c2b-7a646ff291b6"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:50.980451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] validate_networks() for [('1c7da6b7-0398-45be-8c2b-7a646ff291b6', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:14:51.007462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:51.017703 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a794a86-d4ea-46f6-bd36-bfca7ca8a886 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.497580 Aug 30 04:14:51.032147 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 782/1632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:50 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:51.064222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:51.064993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:51.072945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:51.073537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:51.074199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:51.075159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:51.075570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:51.077050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:51.505923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:51.515563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:51.517178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:51.518356 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25a0506f-1e1c-437e-9241-242e8ae63fba tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1557 microversion: 2.25 time: 0.458572 Aug 30 04:14:51.518920 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 783/1633] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:51 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1557 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:51.523858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:51.524467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:51.530827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:51.531746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:51.532327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:51.533202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:51.533749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:51.534366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:51.806720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:51.834279 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-401b004f-aaff-4f4f-bd9d-ff3becb49796 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.313094 Aug 30 04:14:51.835562 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 784/1634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:51 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:51.850687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:51.851795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:51.865061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:51.867341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:51.867821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:51.868734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:51.869204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:51.869834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.052399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:52.065307 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2173eb47-639b-4f3c-9467-c3c0df26fcc0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 200 len: 1427 microversion: 2.1 time: 0.227314 Aug 30 04:14:52.066237 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 785/1635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:51 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 1427 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:52.070760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:52.071429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:52.089735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.090439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.091087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.092534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.092988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.093472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.252615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:14:52.254792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:14:52.256082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:14:52.256756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:14:52.258297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:14:52.281904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.282522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.283203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.286049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.288168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.290134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.349524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Getting quotas for project 67d43f74483f4c5aa5ba8fb5fd14032b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:14:52.363761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Getting quotas for user 2150ff19d8bf4037a114d9b31edfdc9a and project 67d43f74483f4c5aa5ba8fb5fd14032b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:14:52.417132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:14:52.424825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:14:52.497778 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75bd63bf-c9f8-42a8-9c6d-05c961f49ee2 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.607464 Aug 30 04:14:52.498787 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 851/1636] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:14:52.504485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0c8219cc-c6de-4e35-951a-048e9f729901 req-22d61cfd-dcdd-4483-8142-84176bf75c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5634b704-42d5-42f6-81b6-06009a0a600f", "name": "network-vif-deleted", "tag": "12fae82d-9596-4bd5-9a5a-439d59f727da"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:52.521412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c8219cc-c6de-4e35-951a-048e9f729901 req-22d61cfd-dcdd-4483-8142-84176bf75c0a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.522582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c8219cc-c6de-4e35-951a-048e9f729901 req-22d61cfd-dcdd-4483-8142-84176bf75c0a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.523673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c8219cc-c6de-4e35-951a-048e9f729901 req-22d61cfd-dcdd-4483-8142-84176bf75c0a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.538337 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0c8219cc-c6de-4e35-951a-048e9f729901 req-22d61cfd-dcdd-4483-8142-84176bf75c0a service nova] Creating event network-vif-deleted:12fae82d-9596-4bd5-9a5a-439d59f727da for instance 5634b704-42d5-42f6-81b6-06009a0a600f on n-h2-854925-5 Aug 30 04:14:52.546500 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0c8219cc-c6de-4e35-951a-048e9f729901 req-22d61cfd-dcdd-4483-8142-84176bf75c0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044757 Aug 30 04:14:52.548274 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 852/1637] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:52.554783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:52.558328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:52.574454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.575500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.576805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.578362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.579241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.579900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.706019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid e146cd9a-2f09-46fc-a6f0-c91ae439ec69 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:52.730463 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-abdd3424-ee25-40fd-b267-c1e060828318 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 2049 microversion: 2.25 time: 0.661854 Aug 30 04:14:52.732587 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 786/1638] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:52 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 2049 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:52.740251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:52.742771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:52.753222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.754341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.756545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:52.756971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.758354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.758816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.759263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.778167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:52.783243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:52.784714 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb9da36a-d7ca-45f6-97ff-da58683e1297 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.235002 Aug 30 04:14:52.788263 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 853/1639] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:52 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:52.801286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26169f6c-9f72-4798-a0cf-45f78a678a74 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:52.801286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26169f6c-9f72-4798-a0cf-45f78a678a74 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:52.946407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26169f6c-9f72-4798-a0cf-45f78a678a74 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:52.954534 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26169f6c-9f72-4798-a0cf-45f78a678a74 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1218 microversion: 2.1 time: 0.165012 Aug 30 04:14:52.957751 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 854/1640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:52 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:52.970022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:52.971031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:52.982872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.988482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.990735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:52.991820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:52.992401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:52.995780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.194063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:53.205142 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c92ccbe-34e3-44d3-ade8-60d5413c71b2 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.470299 Aug 30 04:14:53.220440 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 787/1641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:52 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:53.233113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:53.234117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:53.243537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.244102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.244535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.245262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.245787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.246284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.323320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid e146cd9a-2f09-46fc-a6f0-c91ae439ec69 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:53.344009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-12ea7a10-ca87-4f51-8a42-a15d2aaaf7f2 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 2049 microversion: 2.25 time: 0.384924 Aug 30 04:14:53.358904 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 855/1642] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:52 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 2049 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:53.364179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:53.370143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5634b704-42d5-42f6-81b6-06009a0a600f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:53.382798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.383716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.390052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.391042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.391687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.392304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.420962 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] HTTP exception thrown: Instance 5634b704-42d5-42f6-81b6-06009a0a600f could not be found. Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Request method failure captured: Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f HTTP/1.1 Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY169RBrOd0AZItsb9sJx7FTOqSgjCA4XPPma9RgPJLwvpeVBooASVYX5DLWgXiqOu1od8VQuzg-VnBMkVJcILxVQLEEPu8TBDdyFTIya7uFYGR62yfGM5QNLCDPwdy4suBH2b62KLUD8bj8HaNjk8aVXCUm7lWZPCa1-quVegE4s7A Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b1c9a3949b2461aaefac288f381241c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}] Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-MigrationsAdminTest-1831244722 Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 7ead040764484d059aa9a82f0714373f Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 5634b704-42d5-42f6-81b6-06009a0a600f could not be found. Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5634b704-42d5-42f6-81b6-06009a0a600f'} Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5634b704-42d5-42f6-81b6-06009a0a600f could not be found. Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5634b704-42d5-42f6-81b6-06009a0a600f could not be found. Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:14:53.429661 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:53.435462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:14:53.435462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:14:53.435462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:14:53.435462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:14:53.435462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:14:53.435462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5634b704-42d5-42f6-81b6-06009a0a600f could not be found. Aug 30 04:14:53.435462 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:14:53.436943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Returning 404 to user: Instance 5634b704-42d5-42f6-81b6-06009a0a600f could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:14:53.438053 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-90720f19-17aa-4f1c-a089-2e71b43c411b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f" status: 404 len: 111 microversion: 2.1 time: 0.077820 Aug 30 04:14:53.438820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 856/1643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:53 2022] GET /compute/v2.1/servers/5634b704-42d5-42f6-81b6-06009a0a600f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:14:53.447487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:53.464700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.465533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.466148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.468169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.468644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.469081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.505778 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9c580561-1050-44c8-8070-09be5fa22290 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.065338 Aug 30 04:14:53.506611 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 857/1644] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Aug 30 04:14:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:14:53.511881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:53.512602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:53.520747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.521525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.522191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.523165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.523788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.524575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.558665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:14:53.621705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:53.637251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e224e36b-20f5-411a-bfc1-0e5fc82be726 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.411716 Aug 30 04:14:53.640166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:53.655309 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 788/1645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:53 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:53.668179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:53.668734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:53.678805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.684414 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-624bbd9a-d76f-429b-8ee6-bf77abec62dc tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 204 len: 0 microversion: 2.1 time: 0.173943 Aug 30 04:14:53.687147 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 858/1646] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:14:53 2022] DELETE /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:53.687959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.688426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.689421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.690132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.690766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.697890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:53.698860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:53.708411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.709049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.709736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.710886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.711440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.712253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.863112 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-222f3596-6d87-4693-97c1-258057da8482 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69/action" status: 202 len: 0 microversion: 2.25 time: 0.205210 Aug 30 04:14:53.863776 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 789/1647] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:14:53 2022] POST /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:14:53.877634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:53.879713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:53.892478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.894005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.894996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:53.895988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:53.896665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:53.897258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.033116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:54.047710 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31b4d99d-31da-4b66-bd9c-8e5c3fe01c57 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1534 microversion: 2.1 time: 0.352268 Aug 30 04:14:54.052265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:54.065070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 859/1648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:53 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1534 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:14:54.075388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:54.077856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:54.078752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:54.079205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e6d6ad2e-de0d-4ac6-9e0f-d5c42dcc9e38 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.212004 Aug 30 04:14:54.081071 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 790/1649] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:53 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:54.090514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:54.091710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:54.095476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:54.100229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.100789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.101541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.102384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.103378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.103515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.114709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.115560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.116201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.116975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.117665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.119113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.239527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:54.268596 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ad50c6b-df85-44fe-ba30-11b67e765e46 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1270 microversion: 2.1 time: 0.186005 Aug 30 04:14:54.270368 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 791/1650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:54 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:54.279702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:54.280760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:54.288227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.289401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.289900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.290986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.291520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.292018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.296561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:54.329956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid e146cd9a-2f09-46fc-a6f0-c91ae439ec69 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:54.368681 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e456cb5-c58f-4260-b5a6-46cddd92a257 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 2054 microversion: 2.25 time: 0.301920 Aug 30 04:14:54.369981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 860/1651] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:54 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 2054 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:54.507915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:54.539722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3dcf033d-46f1-47da-b82a-e76b5b2c8516 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.267107 Aug 30 04:14:54.551394 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 792/1652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:54 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:54.635879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a1bbbc61-ce59-4460-b9ae-d3e02ce661f2 req-4c3c5d74-33af-4278-b178-6d47a857e75d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b6241b-bd6b-497a-be52-1610160d2fbf", "name": "network-vif-deleted", "tag": "466d0b50-71b0-4ea1-b478-2f7f3c8cc403"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:54.649157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1bbbc61-ce59-4460-b9ae-d3e02ce661f2 req-4c3c5d74-33af-4278-b178-6d47a857e75d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.649572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1bbbc61-ce59-4460-b9ae-d3e02ce661f2 req-4c3c5d74-33af-4278-b178-6d47a857e75d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.662874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:54.663743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:54.667821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1bbbc61-ce59-4460-b9ae-d3e02ce661f2 req-4c3c5d74-33af-4278-b178-6d47a857e75d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.671440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.680196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.681538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.687223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:54.688998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:54.691167 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a1bbbc61-ce59-4460-b9ae-d3e02ce661f2 req-4c3c5d74-33af-4278-b178-6d47a857e75d service nova] Creating event network-vif-deleted:466d0b50-71b0-4ea1-b478-2f7f3c8cc403 for instance 98b6241b-bd6b-497a-be52-1610160d2fbf on n-h2-854925-5 Aug 30 04:14:54.692243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:54.696684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a1bbbc61-ce59-4460-b9ae-d3e02ce661f2 req-4c3c5d74-33af-4278-b178-6d47a857e75d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064409 Aug 30 04:14:54.697647 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 861/1653] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:55.000250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:55.009107 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cea72fac-0a98-49f4-b056-d87c4fea4c3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.350406 Aug 30 04:14:55.019744 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 793/1654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:54 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:14:55.072152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:55.082822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:55.086709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:14:55.106692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:55.108099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:55.114097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:55.114606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:55.115269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:55.116023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:55.116538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:55.116918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:55.141182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:55.142858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:55.143646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:55.158421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:55.158811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:55.159628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:55.405085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:55.450623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:55.455759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:55.465463 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9af646ad-c27a-430a-812e-b670af8c3599 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.361681 Aug 30 04:14:55.485593 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 794/1655] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:55 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:55.501838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:55.502866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:55.513462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:55.515652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:55.516589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:55.518330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:55.519101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:55.520352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:55.982509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:55.997296 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bae1c188-b22f-433c-af6a-e33993e97477 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1276 microversion: 2.1 time: 0.507010 Aug 30 04:14:55.999423 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 795/1656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:55 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1276 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:56.010234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:56.011399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:56.020675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.022189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.022859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.023956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.024792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.025614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.051297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:56.063138 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd192085-9764-4ebe-9136-fab4baefd6b8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1534 microversion: 2.1 time: 0.996276 Aug 30 04:14:56.064917 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 862/1657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:55 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1534 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:56.071496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:56.072428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:56.080711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.082084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.083273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.084874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.085618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.087602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.626020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:56.634804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid e146cd9a-2f09-46fc-a6f0-c91ae439ec69 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:56.638195 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8849e840-5237-43ab-b74e-7032eed3d9d9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.569076 Aug 30 04:14:56.639811 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 863/1658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:56 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:56.649718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:56.649718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:56.674195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.674698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.675145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.679482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.679986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.680418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.688310 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9a66cce9-2db8-42a4-bb24-28d49bcbfc20 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 2034 microversion: 2.25 time: 0.687537 Aug 30 04:14:56.702179 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 796/1659] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:55 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 2034 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:56.709469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:56.716471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:56.735058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.735483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.735932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.736659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:56.737122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:56.737593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:56.928112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:56.937284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:56.952444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:56.953775 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-09c11fab-9036-41e6-a28c-6bd3c72d4527 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.249963 Aug 30 04:14:56.973589 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 797/1660] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:56 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:56.980493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854925-5", "block_migration": "auto"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:56.995404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:57.005566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.006070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.006514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.014701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.015617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.016529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.072669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'flavor' on Instance uuid e146cd9a-2f09-46fc-a6f0-c91ae439ec69 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:14:57.114479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Going to try to live migrate instance to n-h2-854925-5 {{(pid=122402) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:14:57.140592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:57.160980 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e12e2d7-d4ae-45a3-b361-dc3dfc54ca03 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.519627 Aug 30 04:14:57.162834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 864/1661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:56 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:57.179687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:57.180325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:57.190890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.191496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.195732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.200187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.200941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.205056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.522449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:57.535943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-160e1a3d-dee7-4210-935d-4ddcbc3b7039 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1318 microversion: 2.1 time: 0.368155 Aug 30 04:14:57.549986 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 865/1662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:57 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:57.555269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:57.560952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:57.571090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.571786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.572391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.573496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:57.574113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:57.574900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:57.993670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:58.012546 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91c23318-bdb9-4880-bb5c-976a2e879554 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1534 microversion: 2.1 time: 0.461127 Aug 30 04:14:58.013298 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 866/1663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:57 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1534 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:58.019004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:58.019919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:58.040020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.040572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.041212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.042200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.043107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.043552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.502005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:58.511651 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8cef539b-0bef-43b9-8be3-225f5085ccfd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.496671 Aug 30 04:14:58.525081 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 867/1664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:58 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:58.525081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:58.525081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:58.542311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.542819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.543265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.543995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.544448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.544966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.711547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:58.747747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:58.752876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:58.756981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37d27b61-c77a-4e95-8e75-766d28870656 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.240221 Aug 30 04:14:58.775305 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 868/1665] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:14:58 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:14:58.785801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8a4c33a4-d950-4511-8852-d56ea2f53952 req-554f29a6-c957-4ce2-8078-938a7dfebe17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a718e944-7477-4567-9c55-ecb365f95772", "name": "network-vif-plugged", "status": "completed", "tag": "d2681412-9815-44a0-9351-385d152e763a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:58.800030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8a4c33a4-d950-4511-8852-d56ea2f53952 req-554f29a6-c957-4ce2-8078-938a7dfebe17 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.800567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8a4c33a4-d950-4511-8852-d56ea2f53952 req-554f29a6-c957-4ce2-8078-938a7dfebe17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.801234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8a4c33a4-d950-4511-8852-d56ea2f53952 req-554f29a6-c957-4ce2-8078-938a7dfebe17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.839591 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8a4c33a4-d950-4511-8852-d56ea2f53952 req-554f29a6-c957-4ce2-8078-938a7dfebe17 service nova] Creating event network-vif-plugged:d2681412-9815-44a0-9351-385d152e763a for instance a718e944-7477-4567-9c55-ecb365f95772 on n-h2-854925-5 Aug 30 04:14:58.848193 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8a4c33a4-d950-4511-8852-d56ea2f53952 req-554f29a6-c957-4ce2-8078-938a7dfebe17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068488 Aug 30 04:14:58.850029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 869/1666] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:58.860335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:58.861421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:58.869571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.870412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.871072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:58.871970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:58.872389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:58.873026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:59.402041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:59.412588 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c1bda33e-7e3c-4c37-8ecd-3cbecce662ff tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.561090 Aug 30 04:14:59.421118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 870/1667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:58 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:59.433971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7901d8e3-57b9-4078-94d7-8e6049bb5d0e req-b552cea2-ae6b-468c-9907-85d317ad10ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a38e91-4b23-4d55-8d7f-b6dcde51f28a", "tag": "079c07d9-1e08-40f3-986c-6985d31f55f6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:14:59.472486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7901d8e3-57b9-4078-94d7-8e6049bb5d0e req-b552cea2-ae6b-468c-9907-85d317ad10ff service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:59.473728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7901d8e3-57b9-4078-94d7-8e6049bb5d0e req-b552cea2-ae6b-468c-9907-85d317ad10ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:59.474481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7901d8e3-57b9-4078-94d7-8e6049bb5d0e req-b552cea2-ae6b-468c-9907-85d317ad10ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:59.500504 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7901d8e3-57b9-4078-94d7-8e6049bb5d0e req-b552cea2-ae6b-468c-9907-85d317ad10ff service nova] Creating event network-changed:079c07d9-1e08-40f3-986c-6985d31f55f6 for instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a on n-h2-854925-5 Aug 30 04:14:59.519329 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7901d8e3-57b9-4078-94d7-8e6049bb5d0e req-b552cea2-ae6b-468c-9907-85d317ad10ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096417 Aug 30 04:14:59.520464 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 871/1668] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:14:59.550063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:59.552741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:59.577534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:59.579182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:59.581167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:59.583550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:59.585085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:59.587570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:59.902265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:14:59.916645 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd065f6e-bfc9-4e92-8590-9d4cfa4fc0aa tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1318 microversion: 2.1 time: 0.394837 Aug 30 04:14:59.917848 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 872/1669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:59 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:14:59.934614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:14:59.936470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:14:59.950364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:59.951825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:59.952945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:14:59.955112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:14:59.958084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:14:59.958891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:00.351812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:00.362893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4a927b2e-11b5-4bf8-a718-8e22681809f0 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1534 microversion: 2.1 time: 0.443265 Aug 30 04:15:00.378603 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 873/1670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:14:59 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1534 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:00.385596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:00.386502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:00.393433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:00.394196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:00.394740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:00.395687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:00.396408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:00.397071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:00.663296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:00.684281 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c02a32b9-f640-418b-bdb4-9bcfd265759d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.304141 Aug 30 04:15:00.685376 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 874/1671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:00 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:00.704955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:00.706653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:00.723297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:00.723662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:00.724201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:00.724876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:00.725246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:00.727444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:00.898383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:00.909174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:00.911318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:00.912750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f3be30a-e4d6-4cfa-8507-58e35d0fc6a1 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.213745 Aug 30 04:15:00.930357 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 875/1672] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:00 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:00.939500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:00.940388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:00.947248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:00.947977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:00.948575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:00.949521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:00.950138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:00.950729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.192908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:01.203669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aa4e6f5d-7e7f-4c2a-9e9e-941cb67a9310 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.271892 Aug 30 04:15:01.215607 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 876/1673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:00 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:01.215607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-801074e6-ca17-46ac-804a-1e5dcedf02f6 req-5cb5e342-9fef-4c99-8f54-daf6e620cb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7622a31b-95c0-4360-b9b9-7237c084514e", "name": "network-vif-plugged", "status": "completed", "tag": "f7ea778a-6721-4820-a88f-1cec1b8b6e38"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:01.224961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-801074e6-ca17-46ac-804a-1e5dcedf02f6 req-5cb5e342-9fef-4c99-8f54-daf6e620cb56 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.226204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-801074e6-ca17-46ac-804a-1e5dcedf02f6 req-5cb5e342-9fef-4c99-8f54-daf6e620cb56 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.227209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-801074e6-ca17-46ac-804a-1e5dcedf02f6 req-5cb5e342-9fef-4c99-8f54-daf6e620cb56 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.230880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:01.250504 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-801074e6-ca17-46ac-804a-1e5dcedf02f6 req-5cb5e342-9fef-4c99-8f54-daf6e620cb56 service nova] Creating event network-vif-plugged:f7ea778a-6721-4820-a88f-1cec1b8b6e38 for instance 7622a31b-95c0-4360-b9b9-7237c084514e on n-h1-854925-5 Aug 30 04:15:01.261819 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-801074e6-ca17-46ac-804a-1e5dcedf02f6 req-5cb5e342-9fef-4c99-8f54-daf6e620cb56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055117 Aug 30 04:15:01.262628 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 877/1674] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:01.271270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:01.272395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:01.283880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.284929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.285694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.287348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.288054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.288901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.550868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:01.564010 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18055789-93c2-4fec-9a0c-3997f53d58e9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1318 microversion: 2.1 time: 0.299900 Aug 30 04:15:01.584536 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 878/1675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:01 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:01.599537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:01.608206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:01.622835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.623127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.624120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.625570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.626098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.626523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.739613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:01.754223 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bac78cad-434b-470a-96c4-f978742d00e8 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1492 microversion: 2.1 time: 0.166697 Aug 30 04:15:01.754223 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 879/1676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:01 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1492 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:01.760078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-672a98ed-9525-4024-b93d-dd8983559625 req-004571ce-5fb7-4bc4-9f26-d445592dcef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c43c07e-706b-4003-9da9-1bfa84b66310", "name": "network-vif-unplugged", "status": "completed", "tag": "de6cd9f0-a510-457e-b105-32cd081b65fb"}, {"name": "network-changed", "server_uuid": "2c43c07e-706b-4003-9da9-1bfa84b66310", "tag": "de6cd9f0-a510-457e-b105-32cd081b65fb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:01.772162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-672a98ed-9525-4024-b93d-dd8983559625 req-004571ce-5fb7-4bc4-9f26-d445592dcef9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.772850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-672a98ed-9525-4024-b93d-dd8983559625 req-004571ce-5fb7-4bc4-9f26-d445592dcef9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.773273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-672a98ed-9525-4024-b93d-dd8983559625 req-004571ce-5fb7-4bc4-9f26-d445592dcef9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.787146 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-672a98ed-9525-4024-b93d-dd8983559625 req-004571ce-5fb7-4bc4-9f26-d445592dcef9 service nova] Creating event network-vif-unplugged:de6cd9f0-a510-457e-b105-32cd081b65fb for instance 2c43c07e-706b-4003-9da9-1bfa84b66310 on n-h2-854925-5 Aug 30 04:15:01.788073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-672a98ed-9525-4024-b93d-dd8983559625 req-004571ce-5fb7-4bc4-9f26-d445592dcef9 service nova] Creating event network-changed:de6cd9f0-a510-457e-b105-32cd081b65fb for instance 2c43c07e-706b-4003-9da9-1bfa84b66310 on n-h2-854925-5 Aug 30 04:15:01.793720 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-672a98ed-9525-4024-b93d-dd8983559625 req-004571ce-5fb7-4bc4-9f26-d445592dcef9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.037804 Aug 30 04:15:01.799514 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 880/1677] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:01.806607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:01.807329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:01.817443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.818109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.818647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.819384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.819840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.820266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.849647 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aaebf271-0530-4924-88c3-6a9e627caca5 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69/action" status: 202 len: 0 microversion: 2.25 time: 4.872723 Aug 30 04:15:01.853114 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 798/1678] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:14:56 2022] POST /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69/action => generated 0 bytes in 4877 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:01.863935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:01.865985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:01.885012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.885801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.887998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:01.890170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:01.891614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:01.894373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.242491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:02.260506 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a97aa6a-8a61-4976-87be-732cd9e6f4b6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.459570 Aug 30 04:15:02.274855 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 881/1679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:01 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:02.274855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:02.274855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:02.300126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:02.301663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:02.310088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.311056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:02.311660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:02.312203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.521870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:02.546641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:02.552834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:02.570949 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-24a83d0b-d559-4b54-8f6d-64300f41bd60 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1567 microversion: 2.25 time: 0.712739 Aug 30 04:15:02.573393 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 799/1680] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:01 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1567 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:02.583799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-349cfebe-f24f-4a74-a04f-760ed949fd65 req-eec05539-579a-4b34-b01f-e109ef0fc714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c70b4a-4c6a-4137-a2c3-a02b16b5a369", "name": "network-vif-deleted", "tag": "acbaf2e5-9af3-4cbd-b7cc-9d2045334073"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:02.602677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:02.615912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-349cfebe-f24f-4a74-a04f-760ed949fd65 req-eec05539-579a-4b34-b01f-e109ef0fc714 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:02.617529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-349cfebe-f24f-4a74-a04f-760ed949fd65 req-eec05539-579a-4b34-b01f-e109ef0fc714 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:02.623827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:02.625571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-349cfebe-f24f-4a74-a04f-760ed949fd65 req-eec05539-579a-4b34-b01f-e109ef0fc714 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.631496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:02.632903 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-935ab37e-c442-4241-befe-59e90da547ff tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.367067 Aug 30 04:15:02.633537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 882/1681] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:02 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:02.646804 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-349cfebe-f24f-4a74-a04f-760ed949fd65 req-eec05539-579a-4b34-b01f-e109ef0fc714 service nova] Creating event network-vif-deleted:acbaf2e5-9af3-4cbd-b7cc-9d2045334073 for instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 on n-h1-854925-5 Aug 30 04:15:02.662132 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-349cfebe-f24f-4a74-a04f-760ed949fd65 req-eec05539-579a-4b34-b01f-e109ef0fc714 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085208 Aug 30 04:15:02.663641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:02.664809 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 800/1682] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:02.665377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:02.673618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:02.674325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:02.675131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.676031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:02.679965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:02.680711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.681062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:02.682103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:02.694378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:02.695226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:02.695913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.698731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:02.699894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:02.700573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:02.952072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:03.386839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:03.401471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-38078185-fa0e-46ce-9eb0-7c2f1c70e1a4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1318 microversion: 2.1 time: 0.731028 Aug 30 04:15:03.402142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 801/1683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:02 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1318 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:03.418535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:03.419918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:03.432346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:03.433176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:03.433796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:03.434707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:03.438222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:03.438772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:03.484916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:03.527822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:03.529943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:03.530540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:03.531014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lazy-loading 'fault' on Instance uuid d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:03.602855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:03.612171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f0efaa0-35cd-48df-bca0-cb16a5a4b7d4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.957639 Aug 30 04:15:03.631290 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 883/1684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:02 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:03.633627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:03.634250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:03.637172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:03.648740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:03.649293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:03.649832 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c4b47128-ab6d-4562-866f-b369fbc30dca tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1369 microversion: 2.1 time: 0.245138 Aug 30 04:15:03.649966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:03.651063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:03.651526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:03.651815 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 802/1685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:03 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:03.652506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:03.663342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:03.665934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:03.680104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:03.680760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:03.681305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:03.687523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:03.689469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:03.690518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.048042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.062987 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f00cf2e9-f1dd-4a72-8d99-3b3a8bba0b1e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.442273 Aug 30 04:15:04.075820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 884/1686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:03 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:04.076215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.080250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:04.080878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:04.091277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.093190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.094763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.096020 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4569ab6e-42b7-45d8-a843-62b819670a65 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1567 microversion: 2.25 time: 0.441099 Aug 30 04:15:04.096983 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 803/1687] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:03 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1567 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:04.102325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.104697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.105644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.106111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.108694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.206105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.214740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.217635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.218865 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8914a166-fad9-49dd-8ab3-c7bfdc9e9109 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.154333 Aug 30 04:15:04.219436 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 885/1688] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:04 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:04.426989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:04.427539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:04.434676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.435512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.436136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.437560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.438242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.438706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.591578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:04.611787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a21c8da-51b1-4967-890f-8a924d6ad6b9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1318 microversion: 2.1 time: 0.188781 Aug 30 04:15:04.612820 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 804/1689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:04 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:04.640187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:04.641066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:04.648202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.649129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.649813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.650837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.651845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.652462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.674494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:04.675750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:04.682625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.683360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.683982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.684922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.685937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.686618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.759486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:04.760652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:04.761117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:04.764501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lazy-loading 'fault' on Instance uuid d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:05.386705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.395823 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2f72f5a-5c34-49ca-99eb-ec526d2d92c5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 200 len: 1369 microversion: 2.1 time: 0.725473 Aug 30 04:15:05.397969 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 805/1690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:04 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 1369 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:05.412302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:05.418154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:05.454902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:05.455635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:05.457473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:05.459843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:05.460594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:05.461052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:05.504683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.518322 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e69ea369-2054-4b3e-8d68-58393c0a1688 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.882998 Aug 30 04:15:05.522109 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 886/1691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:04 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:05.527135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:05.536612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:05.538228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:05.556364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:05.558841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:05.559640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:05.562908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:05.563398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:05.565251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:05.826057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.838158 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e643025-f47d-43fc-8bc9-ce4903833f9d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.438816 Aug 30 04:15:05.840685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 806/1692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:05 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:05.862560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:05.863212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:05.874014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.879106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:05.879615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:05.880057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:05.880843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:05.881531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:05.882128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:05.885198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.891318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.893019 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc11b3b1-a09b-4661-9785-199f15ad5a47 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1567 microversion: 2.25 time: 0.369112 Aug 30 04:15:05.893655 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 887/1693] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:05 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1567 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:05.929118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c9ce38cb-5c11-475b-b025-d8afb3734e99 req-21a19023-a38d-42d2-a550-be008d13a50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a38e91-4b23-4d55-8d7f-b6dcde51f28a", "name": "network-vif-plugged", "status": "completed", "tag": "079c07d9-1e08-40f3-986c-6985d31f55f6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:05.958412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9ce38cb-5c11-475b-b025-d8afb3734e99 req-21a19023-a38d-42d2-a550-be008d13a50f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:05.958702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9ce38cb-5c11-475b-b025-d8afb3734e99 req-21a19023-a38d-42d2-a550-be008d13a50f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:05.959147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9ce38cb-5c11-475b-b025-d8afb3734e99 req-21a19023-a38d-42d2-a550-be008d13a50f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:05.974185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.981264 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c9ce38cb-5c11-475b-b025-d8afb3734e99 req-21a19023-a38d-42d2-a550-be008d13a50f service nova] Creating event network-vif-plugged:079c07d9-1e08-40f3-986c-6985d31f55f6 for instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a on n-h2-854925-5 Aug 30 04:15:05.987662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.988042 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c9ce38cb-5c11-475b-b025-d8afb3734e99 req-21a19023-a38d-42d2-a550-be008d13a50f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070746 Aug 30 04:15:05.989546 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 888/1694] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:05.995298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:05.996494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:05.996622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-92fb29aa-e1b9-4066-899b-11c5690a4801 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.154644 Aug 30 04:15:05.997266 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 807/1695] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:05 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:05.997676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:06.005605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:06.006556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:06.007295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:06.008351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:06.009302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:06.010118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:06.173969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:06.183591 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-afabca75-fec2-4c37-82b3-fd8f69c888b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1318 microversion: 2.1 time: 0.192611 Aug 30 04:15:06.184472 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 889/1696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:05 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:06.418778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:06.419755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: d0c70b4a-4c6a-4137-a2c3-a02b16b5a369] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:06.424051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:06.428608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:06.429241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:06.429926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:06.430823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:06.431291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:06.431722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:06.448801 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] HTTP exception thrown: Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 could not be found. Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Request method failure captured: Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 HTTP/1.1 Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY169RBrOd0AZItsb9sJx7FTOqSgjCA4XPPma9RgPJLwvpeVBooASVYX5DLWgXiqOu1od8VQuzg-VnBMkVJcILxVQLEEPu8TBDdyFTIya7uFYGR62yfGM5QNLCDPwdy4suBH2b62KLUD8bj8HaNjk8aVXCUm7lWZPCa1-quVegE4s7A Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b1c9a3949b2461aaefac288f381241c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}] Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7ead040764484d059aa9a82f0714373f Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 could not be found. Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'd0c70b4a-4c6a-4137-a2c3-a02b16b5a369'} Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 could not be found. Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 could not be found. Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:06.450442 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 could not be found. Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Returning 404 to user: Instance d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:06.455488 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c962cd20-0e48-467e-a1ca-ce9f763b4334 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369" status: 404 len: 111 microversion: 2.1 time: 0.037096 Aug 30 04:15:06.460925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83736472-18e2-4e6b-ad3b-99fcd8e0e43f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '.version_select at 0x7fe96e64ddc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:06.465559 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 808/1697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:06 2022] GET /compute/v2.1/servers/d0c70b4a-4c6a-4137-a2c3-a02b16b5a369 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:06.481166 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83736472-18e2-4e6b-ad3b-99fcd8e0e43f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-120982653" status: 202 len: 0 microversion: 2.1 time: 0.024110 Aug 30 04:15:06.482002 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 890/1698] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:15:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-120982653 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:06.554271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:06.559399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:06.600905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:06.616689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:06.618493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:06.621296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:06.630953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:06.632936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:06.931233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:06.941745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0d37403-d54f-4629-a08b-d5bb03e3f3f3 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.397890 Aug 30 04:15:06.943019 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 809/1699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:06 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:07.024034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d435040a-c8ad-48f4-9dd0-964b3281ee25 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Action: 'create', calling method: .version_select at 0x7fe96a313b80>, body: {"pool": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:07.055927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-229a47d1-c227-4893-91e9-c46216439a1f tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Action: 'create', calling method: .version_select at 0x7fe96a213550>, body: {"keypair": {"name": "tempest-keypair-1675104812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGl/cXaA+j/9mj4o6XSwWV6Y9rny09azZtu87rh8HR+ym4edoYgDLW6lR0AmyMpfjYSss4Xw+tinQR0FU18yO2mtHVJx4mAQe4SRGusFfkDUtvTH9RceoivVPXClwAACrA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:07.114091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-229a47d1-c227-4893-91e9-c46216439a1f tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Getting quotas for project 1be9bdc40f3b453196453d87e60a3f15. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:07.143603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-229a47d1-c227-4893-91e9-c46216439a1f tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Getting quotas for user f6b8ed305851465eb1f760599aca06c7 and project 1be9bdc40f3b453196453d87e60a3f15. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:07.191649 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-229a47d1-c227-4893-91e9-c46216439a1f tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.246869 Aug 30 04:15:07.199449 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 810/1700] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:15:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:07.210378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:07.211005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:07.218036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:07.218273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:07.218647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:07.219346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:07.219793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:07.222511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:07.525378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:07.534727 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b6510d33-98f0-4877-94ff-5c27973e2ad3 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.332043 Aug 30 04:15:07.535341 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 811/1701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:07 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:07.574720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:07.575343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:07.604383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:07.606424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:07.608977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:07.612027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:07.614135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:07.614651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:07.956787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:07.967816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:07.979807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:07.982162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-48adbf1a-4a7b-4805-b04d-0ecc8309da50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1567 microversion: 2.25 time: 0.425488 Aug 30 04:15:07.984773 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 812/1702] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:07 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1567 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:08.001249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:08.002238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:08.023224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:08.024563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:08.026923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:08.031278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:08.032476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:08.033537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:08.199666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:08.229039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:08.231527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:08.233271 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-55e87d87-27e5-494f-8c66-1c6cc5658831 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.246544 Aug 30 04:15:08.236997 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 813/1703] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:07 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:08.249372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:08.250983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:08.272548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:08.273363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:08.274034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:08.278688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:08.284767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:08.286055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:08.659491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:08.673438 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89e27b68-4619-4493-a27e-df0f63309cde tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1509 microversion: 2.1 time: 0.433219 Aug 30 04:15:08.676241 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 814/1704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:08 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1509 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:08.691046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1d9ad941-f4b0-4ca3-b413-0625ebeabd3e req-0d6a78ef-c84a-41b8-ac8d-86b82070ed7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e146cd9a-2f09-46fc-a6f0-c91ae439ec69", "name": "network-vif-unplugged", "status": "completed", "tag": "48649702-bdde-4500-91fc-108723f11e96"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:08.713933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1d9ad941-f4b0-4ca3-b413-0625ebeabd3e req-0d6a78ef-c84a-41b8-ac8d-86b82070ed7c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:08.714717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1d9ad941-f4b0-4ca3-b413-0625ebeabd3e req-0d6a78ef-c84a-41b8-ac8d-86b82070ed7c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:08.715390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1d9ad941-f4b0-4ca3-b413-0625ebeabd3e req-0d6a78ef-c84a-41b8-ac8d-86b82070ed7c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:08.746550 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1d9ad941-f4b0-4ca3-b413-0625ebeabd3e req-0d6a78ef-c84a-41b8-ac8d-86b82070ed7c service nova] Creating event network-vif-unplugged:48649702-bdde-4500-91fc-108723f11e96 for instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 on n-h1-854925-5 Aug 30 04:15:08.759005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1d9ad941-f4b0-4ca3-b413-0625ebeabd3e req-0d6a78ef-c84a-41b8-ac8d-86b82070ed7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072628 Aug 30 04:15:08.759713 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 815/1705] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:08.776318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:08.777977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:08.787211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:08.787955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:08.789051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:08.791262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:08.792058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:08.792653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.093295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:09.104289 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1dfab233-56ac-4b5f-a037-fce478ac9701 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.342999 Aug 30 04:15:09.106392 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 816/1706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:08 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:09.112295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4f6960c9-3075-4ac2-b2f2-f1b7de334524 req-4c0eaa41-bb23-421f-8f8c-98476ac143cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423d2eaa-d24e-4ae2-8efa-7e93158ba897", "name": "network-vif-plugged", "status": "completed", "tag": "f61e16e2-ebbe-4354-89f6-82c163108ecf"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:09.132104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4f6960c9-3075-4ac2-b2f2-f1b7de334524 req-4c0eaa41-bb23-421f-8f8c-98476ac143cc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.132839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4f6960c9-3075-4ac2-b2f2-f1b7de334524 req-4c0eaa41-bb23-421f-8f8c-98476ac143cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.133716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4f6960c9-3075-4ac2-b2f2-f1b7de334524 req-4c0eaa41-bb23-421f-8f8c-98476ac143cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.151840 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4f6960c9-3075-4ac2-b2f2-f1b7de334524 req-4c0eaa41-bb23-421f-8f8c-98476ac143cc service nova] Creating event network-vif-plugged:f61e16e2-ebbe-4354-89f6-82c163108ecf for instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 on n-h1-854925-5 Aug 30 04:15:09.162781 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4f6960c9-3075-4ac2-b2f2-f1b7de334524 req-4c0eaa41-bb23-421f-8f8c-98476ac143cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054863 Aug 30 04:15:09.166543 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 817/1707] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:09.177997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:09.179608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:09.194255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.195123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.195780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.196806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.197594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.198740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.245211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:09.409353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7967dd1e-c1e3-4400-b0fb-7dd6969b7247 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 204 len: 0 microversion: 2.1 time: 0.240333 Aug 30 04:15:09.413155 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 818/1708] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:09 2022] DELETE /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:09.426587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:09.442491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:09.459879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.460374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.460865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.461597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.462806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.462806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.591195 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d435040a-c8ad-48f4-9dd0-964b3281ee25 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.817381 Aug 30 04:15:09.594340 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 891/1709] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:15:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:15:09.604080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:09.605877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:09.631137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.632710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.633488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.635459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.636470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.637226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.716555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:09.730656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce32e6a8-1c53-4663-9816-fc78117d3c58 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1321 microversion: 2.1 time: 0.315973 Aug 30 04:15:09.731882 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 819/1710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:09 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:09.740301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:09.741188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:09.756780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.758070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.758736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.760557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.761213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.761946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.826979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:09.837988 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f202102-365a-49d1-bc62-75691bc8f280 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1509 microversion: 2.1 time: 0.241320 Aug 30 04:15:09.838770 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 892/1711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:09 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1509 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:09.849153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:09.850101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:09.863850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.869367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.870306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.871308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:09.872404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:09.873209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:09.980624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:09.993520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:09.998144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:09.999642 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6a2a05c9-ccae-4713-a286-4607f58a9bd5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1567 microversion: 2.25 time: 0.266179 Aug 30 04:15:10.000490 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 820/1712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:09 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:10.005429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:10.008957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:10.015786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.016291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.016732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:10.017483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.017945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.018373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:10.037296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:10.046636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:10.048091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:10.049275 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29b3186a-8b62-4186-b2d6-8f9398c741e0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.207086 Aug 30 04:15:10.065739 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 893/1713] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:09 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:10.070845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c139c23f-2320-4a9a-94cc-4fc373846160 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Action: 'create', calling method: .version_select at 0x7fe96e64d8b0>, body: {"pool": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:10.266784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:10.274800 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01b0be2f-b75b-4dd1-8bba-a3c2d416947b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 200 len: 1469 microversion: 2.1 time: 0.273088 Aug 30 04:15:10.288574 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 821/1714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:10 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 1469 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:10.293532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:10.296147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:10.302809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.303310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.303757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:10.304479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.305002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.305466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:10.398971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dee73546-ca40-4a5a-b514-5d469d5b59d0 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "PUT /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1081 microversion: 2.1 time: 0.109108 Aug 30 04:15:10.413287 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 822/1715] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:15:10 2022] PUT /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1081 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:10.419495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:10.420171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:10.428442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.428887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.429419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:10.430243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.431149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.431712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:10.722157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:10.725439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:10.732232 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce153bd8-2f1f-42f2-876b-965cb896cae5 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.317728 Aug 30 04:15:10.735775 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 823/1716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:10 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:10.742319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:10.743150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:10.752513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.753274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.753999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:10.754880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:10.755500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:10.756094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:11.008234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:11.017852 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-41345fb4-712f-4697-8f11-9c7fdc0b0904 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1507 microversion: 2.1 time: 0.279241 Aug 30 04:15:11.017852 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 824/1717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:10 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1507 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:11.023077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1281033211", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f1911157-33fe-42dd-b23d-748a8a3f9d3a"}], "security_groups": [{"name": "tempest-securitygroup--171896554"}], "key_name": "tempest-keypair-1675104812", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:11.234400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] validate_networks() for [('f1911157-33fe-42dd-b23d-748a8a3f9d3a', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:11.989652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Getting quotas for project 1be9bdc40f3b453196453d87e60a3f15. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:12.004409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Getting quotas for user f6b8ed305851465eb1f760599aca06c7 and project 1be9bdc40f3b453196453d87e60a3f15. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:12.028067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:12.028486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:12.028956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:12.029617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:12.030360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:12.046928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.047425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.047864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.048600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.049055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.049511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.050404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c139c23f-2320-4a9a-94cc-4fc373846160 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.981858 Aug 30 04:15:12.051031 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 894/1718] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:15:10 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:12.056482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:12.057099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:12.069400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Getting quotas for project 1be9bdc40f3b453196453d87e60a3f15. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:12.075396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Getting quotas for user f6b8ed305851465eb1f760599aca06c7 and project 1be9bdc40f3b453196453d87e60a3f15. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:12.077035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.081021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.081599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.083638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.084163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.084570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.097039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:15:12.099797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:15:12.162679 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be1ac4c6-be3d-4fb6-8dfb-7cb309980fb4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.143677 Aug 30 04:15:12.163710 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 825/1719] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:15:12.168456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e35c950f-39d2-4c71-8ac0-48f4e14d51c5 req-950dc4ed-2d80-4b41-90e9-3b49a1375d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e146cd9a-2f09-46fc-a6f0-c91ae439ec69", "tag": "48649702-bdde-4500-91fc-108723f11e96"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:12.182970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e35c950f-39d2-4c71-8ac0-48f4e14d51c5 req-950dc4ed-2d80-4b41-90e9-3b49a1375d14 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.184781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e35c950f-39d2-4c71-8ac0-48f4e14d51c5 req-950dc4ed-2d80-4b41-90e9-3b49a1375d14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.185230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e35c950f-39d2-4c71-8ac0-48f4e14d51c5 req-950dc4ed-2d80-4b41-90e9-3b49a1375d14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.206379 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e35c950f-39d2-4c71-8ac0-48f4e14d51c5 req-950dc4ed-2d80-4b41-90e9-3b49a1375d14 service nova] Creating event network-changed:48649702-bdde-4500-91fc-108723f11e96 for instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 on n-h1-854925-5 Aug 30 04:15:12.212057 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e35c950f-39d2-4c71-8ac0-48f4e14d51c5 req-950dc4ed-2d80-4b41-90e9-3b49a1375d14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046947 Aug 30 04:15:12.212684 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 826/1720] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:12.218479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:12.219184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:12.234639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.235955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.237936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.239446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.241118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.243600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.258904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.275972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2147ac0d-6e56-428b-b0b5-1eebe5bda95c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1512 microversion: 2.1 time: 0.223770 Aug 30 04:15:12.277207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 895/1721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:12 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:12.292890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:12.293983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:12.306604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.307635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.308448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.309530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.311015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.311856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.746599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.756727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.764182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.776869 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-71db661d-2db8-4d36-9541-67a79ce98665 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1567 microversion: 2.25 time: 0.562495 Aug 30 04:15:12.778216 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 827/1722] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:12 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1567 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:12.783705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:12.784971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:12.793528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.794671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.796061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.797182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.797909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.798594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.825559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.835692 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-34c0882e-38cd-49ce-8168-3f33285cabc8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1507 microversion: 2.1 time: 0.556331 Aug 30 04:15:12.854430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 896/1723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:12 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1507 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:12.866525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:12.867145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: a99d5732-f708-40b1-877b-6ca9f90a19cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:12.883819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.886400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.887119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.887964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.888810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.889647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.891345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.916803 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] HTTP exception thrown: Instance a99d5732-f708-40b1-877b-6ca9f90a19cc could not be found. Aug 30 04:15:12.917551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Request method failure captured: Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc HTTP/1.1 Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY169RBrOd0AZItsb9sJx7FTOqSgjCA4XPPma9RgPJLwvpeVBooASVYX5DLWgXiqOu1od8VQuzg-VnBMkVJcILxVQLEEPu8TBDdyFTIya7uFYGR62yfGM5QNLCDPwdy4suBH2b62KLUD8bj8HaNjk8aVXCUm7lWZPCa1-quVegE4s7A Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b1c9a3949b2461aaefac288f381241c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}] Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 7ead040764484d059aa9a82f0714373f Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance a99d5732-f708-40b1-877b-6ca9f90a19cc could not be found. Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'a99d5732-f708-40b1-877b-6ca9f90a19cc'} Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99d5732-f708-40b1-877b-6ca9f90a19cc could not be found. Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99d5732-f708-40b1-877b-6ca9f90a19cc could not be found. Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:12.918527 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99d5732-f708-40b1-877b-6ca9f90a19cc could not be found. Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Returning 404 to user: Instance a99d5732-f708-40b1-877b-6ca9f90a19cc could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:12.923793 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4da64bc2-f9ec-421c-8f99-9aac0c22ca6b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc" status: 404 len: 111 microversion: 2.1 time: 0.064238 Aug 30 04:15:12.931779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:12.933398 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 897/1724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:12 2022] GET /compute/v2.1/servers/a99d5732-f708-40b1-877b-6ca9f90a19cc => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:12.933825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19a6430d-70fc-4a68-a032-b9bd263372eb tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.153459 Aug 30 04:15:12.937755 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 828/1725] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:12 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:12.942459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:12.944256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:12.950499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.951333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.952136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.952649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:12.953754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:12.954398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:12.962196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19fb122d-9c7a-4ddc-b3f3-51ea95a9aad7 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Action: 'create', calling method: .version_select at 0x7fe96a5aadc0>, body: {"pool": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:13.370133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:13.381011 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e009a96-d4f2-483c-b6b2-a8e9ec93f349 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1393 microversion: 2.1 time: 0.446383 Aug 30 04:15:13.386677 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 898/1726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:12 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1393 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:13.407101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:13.408015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:13.415685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:13.418755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:13.419458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:13.422085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:13.423232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:13.424007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:13.448131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:13.532874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:13.540605 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-50977b3e-c07c-49ca-9ba0-d458dbb8feda tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1330 microversion: 2.1 time: 0.152680 Aug 30 04:15:13.553764 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 899/1727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:13 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1330 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:13.553764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:13.553764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:13.553764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:13.553764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:13.555776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:13.555776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:13.555776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:13.555776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.113814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:14.131501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2537ed29-17b4-42dc-bd80-7e922e9e33d7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1511 microversion: 2.1 time: 0.585303 Aug 30 04:15:14.132197 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 900/1728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:13 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1511 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:14.142913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:14.149843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:14.169638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.170449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.171162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.171982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.172719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.173152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.275429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:14.276284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:14.276979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:14.277668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:14.278303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:14.397629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:14.413710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.417126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.419417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.421098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.422804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.424319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.497651 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c252bb0f-3fcd-4630-a61d-9dc106612f2c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "POST /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a/action" status: 202 len: 1113 microversion: 2.1 time: 0.364262 Aug 30 04:15:14.502968 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 901/1729] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:15:14 2022] POST /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a/action => generated 1113 bytes in 370 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 04:15:14.511582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:14.512539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:14.526085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.527075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.527593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.528443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.529319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.529880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.564578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:14.679911 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-347dc739-e5a9-4158-930f-4855033fea5f tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 204 len: 0 microversion: 2.1 time: 0.174984 Aug 30 04:15:14.684086 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 902/1730] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:14 2022] DELETE /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:14.688494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:14.689292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:14.695890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.696347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.696785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.697549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.698001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.698663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.929228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:14.958838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:14.965869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:14.971178 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-428f403b-5cae-4c46-a491-7c737cbca3c4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1567 microversion: 2.25 time: 0.286131 Aug 30 04:15:14.972095 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 903/1731] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:14 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:14.977944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:14.978565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:14.985036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.985843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.986449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:14.987167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:14.987627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:14.988231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.098074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.106961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.119277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.120570 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6bee70bc-ae90-4c84-b05d-5493327096a5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.146522 Aug 30 04:15:15.121602 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 904/1732] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:14 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:15.137947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:15.139234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:15.146451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.147270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.148260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.149201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.149936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.150478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.428455 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19fb122d-9c7a-4ddc-b3f3-51ea95a9aad7 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.489350 Aug 30 04:15:15.430751 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 829/1733] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:15:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:15.437007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a19495d6-f7ac-4d25-939c-d57050478173 req-f7627b2c-88d6-4455-80e1-49fa6d19a11d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99d5732-f708-40b1-877b-6ca9f90a19cc", "name": "network-vif-deleted", "tag": "0c1b811a-98a7-46e9-a3a3-fe244fb67722"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:15.445654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.456603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a19495d6-f7ac-4d25-939c-d57050478173 req-f7627b2c-88d6-4455-80e1-49fa6d19a11d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.457097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a19495d6-f7ac-4d25-939c-d57050478173 req-f7627b2c-88d6-4455-80e1-49fa6d19a11d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.457830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a19495d6-f7ac-4d25-939c-d57050478173 req-f7627b2c-88d6-4455-80e1-49fa6d19a11d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.458489 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb734d7b-53e0-4278-9044-a69a777cd512 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 200 len: 1511 microversion: 2.1 time: 0.335427 Aug 30 04:15:15.459090 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 905/1734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:15 2022] GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 1511 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:15.466343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:15.467566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:15.475152 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a19495d6-f7ac-4d25-939c-d57050478173 req-f7627b2c-88d6-4455-80e1-49fa6d19a11d service nova] Creating event network-vif-deleted:0c1b811a-98a7-46e9-a3a3-fe244fb67722 for instance a99d5732-f708-40b1-877b-6ca9f90a19cc on n-h2-854925-5 Aug 30 04:15:15.475494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.475990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.476428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.478530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.479001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.479436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.480569 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a19495d6-f7ac-4d25-939c-d57050478173 req-f7627b2c-88d6-4455-80e1-49fa6d19a11d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048433 Aug 30 04:15:15.481657 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 830/1735] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:15.487405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:15.488273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:15.495016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.495588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.496168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.496939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.497511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.500294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.696894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.706861 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31a5eb59-1fe4-4129-89a4-36d9545c5c1a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1383 microversion: 2.1 time: 0.246360 Aug 30 04:15:15.707785 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 906/1736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:15 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1383 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:15.711589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.714706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:15.715320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:15.721856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.722296 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dd85a480-1a02-477b-9e37-df3da73f6229 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.238723 Aug 30 04:15:15.722424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.722839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.723490 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 831/1737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:15 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:15.723611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.723983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.724402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.729653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:15.730749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:15.738502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.739273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.739932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.740856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:15.741538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:15.742193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:15.801616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:15.814497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c68498a0-3d80-45fc-9c00-74b7b749a7d4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1336 microversion: 2.1 time: 0.103451 Aug 30 04:15:15.821476 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 907/1738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:15 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1336 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:15.828160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94ab5898-2152-4ecb-8f7d-b38ab385fc9e tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Action: 'create', calling method: .version_select at 0x7fe96e653430>, body: {"pool": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:16.071779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:16.086552 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-674236ba-b198-4aef-8710-2f70db839f2e tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1467 microversion: 2.1 time: 0.361120 Aug 30 04:15:16.088506 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 832/1739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:15 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1467 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:16.100457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:16.105937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:16.110163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:16.124231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.127337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.127337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:16.127337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.127337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.127337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:16.249537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:16.353732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:16.360963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.361765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.362220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:16.539706 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-02d09f5e-f31b-4f24-8dfb-84acbabff158 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.449868 Aug 30 04:15:16.547253 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 833/1740] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 04:15:16 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:16.552398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6885a4df-0c27-4309-a66f-5b085e6eb8ac tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '.version_select at 0x7fe96a162280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:16.555962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6885a4df-0c27-4309-a66f-5b085e6eb8ac tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.557032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6885a4df-0c27-4309-a66f-5b085e6eb8ac tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.557681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6885a4df-0c27-4309-a66f-5b085e6eb8ac tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:16.571625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6885a4df-0c27-4309-a66f-5b085e6eb8ac tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2712 microversion: 2.1 time: 0.023211 Aug 30 04:15:16.572479 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 834/1741] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:15:16 2022] GET /compute/v2.1/os-migrations => generated 2712 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:16.589224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:16.590052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:16.596501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.597214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.597880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:16.598775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.599412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.600036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:16.863891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:16.877711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:16.881711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:16.883583 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03a9f2cd-a59d-4636-9fb4-4f8af3d62234 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1542 microversion: 2.25 time: 0.298987 Aug 30 04:15:16.903199 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 835/1742] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:16 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1542 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:16.914728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:16.915763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:16.927673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.928583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.930152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:16.931499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:16.932481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:16.933041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:17.046488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:17.055396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:17.057207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:17.058842 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-69939a60-750a-40fd-979e-0b734fe5aba8 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.154078 Aug 30 04:15:17.059993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 836/1743] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:16 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:17.065187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:17.070989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:17.071765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1929163796', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:17.077609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:17.078366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:17.078842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:17.079542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:17.080162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:17.080770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:17.305060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:17.387898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:17.391807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:17.397002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:17.397772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:17.398580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:17.713873 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94ab5898-2152-4ecb-8f7d-b38ab385fc9e tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.891089 Aug 30 04:15:17.714568 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 908/1744] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:15:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:17.719806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:17.720135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:17.723003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:17.728607 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-46a77d23-9178-4955-a693-0a58c286d817 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1929163796" status: 200 len: 1514 microversion: 2.1 time: 0.666760 Aug 30 04:15:17.729430 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 837/1745] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:15:17 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1929163796 => generated 1514 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:17.734829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:17.735539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:17.741592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:17.742152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:17.742644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:17.743396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:17.745170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:17.745170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:17.745662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:17.746244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:17.746683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:17.747427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:17.747886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:17.748315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.018604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.026938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dfe0b41e-11f7-4ffe-b8df-597f018a374b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.296422 Aug 30 04:15:18.027699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 838/1746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:17 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:18.044990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.046032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:18.054803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.055692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.056291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.057175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.057812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.058401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.085040 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ee8dd49-36e5-4bb0-8975-246d9644bcef tempest-LiveMigrationTest-89324138 tempest-LiveMigrationTest-89324138-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1534 microversion: 2.1 time: 0.369083 Aug 30 04:15:18.087705 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 909/1747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:17 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1534 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:18.101308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e60bc74-586c-4d32-a992-bd99467b3afb tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '.version_select at 0x7fe96a6e9940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.101308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e60bc74-586c-4d32-a992-bd99467b3afb tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.101308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e60bc74-586c-4d32-a992-bd99467b3afb tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.101308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e60bc74-586c-4d32-a992-bd99467b3afb tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.117760 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e60bc74-586c-4d32-a992-bd99467b3afb tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.028506 Aug 30 04:15:18.119237 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 910/1748] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:18.124990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.125639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:18.133025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.133558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.134196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.135109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.135741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.136497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.219799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ead040764484d059aa9a82f0714373f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b1c9a3949b2461aaefac288f381241c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.228451 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c2c4b66-d6b8-4d58-8fbf-28ed22311e4b tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 200 len: 1425 microversion: 2.1 time: 0.107812 Aug 30 04:15:18.229029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 911/1749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 1425 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:18.233532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4252513a-8dea-4964-8570-d5d1f7ce0c73 req-0766666f-c5d8-423b-b968-1ed1913aa45c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a8d905-5efe-4c5f-a9b1-5139d12a11d4", "tag": "45cc2dd0-0d8f-4d67-8d20-69dbb253ee54"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:18.245296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4252513a-8dea-4964-8570-d5d1f7ce0c73 req-0766666f-c5d8-423b-b968-1ed1913aa45c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.245796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4252513a-8dea-4964-8570-d5d1f7ce0c73 req-0766666f-c5d8-423b-b968-1ed1913aa45c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.246226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4252513a-8dea-4964-8570-d5d1f7ce0c73 req-0766666f-c5d8-423b-b968-1ed1913aa45c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.251020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.258969 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc21b5e5-bb07-412a-b24d-c5d1e8e7277a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1403 microversion: 2.1 time: 0.223264 Aug 30 04:15:18.259145 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4252513a-8dea-4964-8570-d5d1f7ce0c73 req-0766666f-c5d8-423b-b968-1ed1913aa45c service nova] Creating event network-changed:45cc2dd0-0d8f-4d67-8d20-69dbb253ee54 for instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 on n-h2-854925-5 Aug 30 04:15:18.269303 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 839/1750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1403 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:18.274753 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4252513a-8dea-4964-8570-d5d1f7ce0c73 req-0766666f-c5d8-423b-b968-1ed1913aa45c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044494 Aug 30 04:15:18.275347 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 912/1751] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:18.280575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77ff5212-54e2-4bb8-856d-b9ff2f7049f6 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Calling method '.version_select at 0x7fe96b13d1f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.281044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.285922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.286918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:18.292346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.292839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.293366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.294074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.294536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.294963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.400336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:18.472808 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77ff5212-54e2-4bb8-856d-b9ff2f7049f6 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/fa1b6158-8fcc-429d-86c5-4ac9b89f82cc" status: 200 len: 142 microversion: 2.1 time: 0.200768 Aug 30 04:15:18.474425 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 840/1752] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/os-floating-ips/fa1b6158-8fcc-429d-86c5-4ac9b89f82cc => generated 142 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:18.480182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.481019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:18.492859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.493281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.493958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.494890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.496348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.496831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.497264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.501909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.502402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.502845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.606833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.620531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.622033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.624035 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-683142d5-c20e-4cd7-93e7-16ce27b224c3 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.148323 Aug 30 04:15:18.641147 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 841/1753] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:18.645947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7ec6e334-21aa-46a2-8131-6f6d45691769 req-c9097232-40ca-4acd-bfdd-1add08aa96d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f5b231b-2496-4cc0-a8c9-908714605d2b", "name": "network-vif-deleted", "tag": "ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:18.656671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7ec6e334-21aa-46a2-8131-6f6d45691769 req-c9097232-40ca-4acd-bfdd-1add08aa96d7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.657076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7ec6e334-21aa-46a2-8131-6f6d45691769 req-c9097232-40ca-4acd-bfdd-1add08aa96d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.657740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7ec6e334-21aa-46a2-8131-6f6d45691769 req-c9097232-40ca-4acd-bfdd-1add08aa96d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.671074 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7ec6e334-21aa-46a2-8131-6f6d45691769 req-c9097232-40ca-4acd-bfdd-1add08aa96d7 service nova] Creating event network-vif-deleted:ae53aec1-5c8a-4ed4-af0a-8ddcd65ae748 for instance 5f5b231b-2496-4cc0-a8c9-908714605d2b on n-h1-854925-5 Aug 30 04:15:18.676583 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7ec6e334-21aa-46a2-8131-6f6d45691769 req-c9097232-40ca-4acd-bfdd-1add08aa96d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034148 Aug 30 04:15:18.677478 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 842/1754] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:18.684431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.686261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:18.692986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.693511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.693958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.694667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.695123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.695548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.697115 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37c8c3e5-1691-4ea9-be15-55ac68b898cf tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.420568 Aug 30 04:15:18.698064 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 913/1755] 10.222.0.27 () {58 vars in 1173 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:18.703909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.705446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:18.713482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.714228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.715282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.716169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:18.716831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:18.717456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:18.722821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.730772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:18.758394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:18.823128 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df3b3614-c91d-4435-a77b-17cb2e1e7cc2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 204 len: 0 microversion: 2.1 time: 0.144064 Aug 30 04:15:18.823946 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 843/1756] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:18 2022] DELETE /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:18.830519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee72a67a-d1a4-4a7c-9437-3e561a73caee tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Calling method '.version_select at 0x7fe96a905820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.917267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid e146cd9a-2f09-46fc-a6f0-c91ae439ec69 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:18.948272 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc20a9f7-6e82-47b7-86b5-9e98b9ac70f3 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 2034 microversion: 2.25 time: 0.248797 Aug 30 04:15:18.948863 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 914/1757] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 2034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:18.987311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:18.994110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:18.994578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.compute.servers [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Removing options 'limit' from query {{(pid=122403) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 04:15:18.995340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:19.003174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.003667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.004111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.004841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.005294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.005748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.118291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:19.124604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.125085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.125543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.659706 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-44f5645b-2186-4d22-9caf-252c9433e056 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.686627 Aug 30 04:15:19.660305 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 915/1758] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 04:15:18 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:19.683995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:19.685066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:19.693078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.693601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.694047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.694752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.695205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.695634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.884157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:19.893292 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-222acca4-b3e0-4499-8222-cdd1ce6da58f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1389 microversion: 2.1 time: 0.215583 Aug 30 04:15:19.893945 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 916/1759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:19 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1389 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:19.898763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c83fe213-167c-41ff-9c0a-a83534aa3462 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Action: 'create', calling method: .version_select at 0x7fe96e64d1f0>, body: {"keypair": {"name": "tempest-keypair-409078519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdhLL8JpBovjbyfvW70/3ccoj5Hx058gW/PKSU0JjCbSShaoRuU0EzgCrqzFZn3LQEsIdzXxn3auoLhsQXes3Ap5TCqS2h1197PJ96ZS5MgHwXld830jN1vUN/eARQgzQ=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:19.917315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c83fe213-167c-41ff-9c0a-a83534aa3462 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:19.923886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c83fe213-167c-41ff-9c0a-a83534aa3462 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for user 45901cc649784305a10c8a9278d1bef3 and project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:19.951251 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c83fe213-167c-41ff-9c0a-a83534aa3462 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.055964 Aug 30 04:15:19.951973 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 917/1760] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:15:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:15:19.959066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:19.959188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:19.968742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.969237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.969693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:19.970953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:19.971434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:19.971859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.099336 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee72a67a-d1a4-4a7c-9437-3e561a73caee tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/fa1b6158-8fcc-429d-86c5-4ac9b89f82cc" status: 202 len: 0 microversion: 2.1 time: 1.273752 Aug 30 04:15:20.099922 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 844/1761] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:15:18 2022] DELETE /compute/v2.1/os-floating-ips/fa1b6158-8fcc-429d-86c5-4ac9b89f82cc => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:20.105620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.106378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] [instance: 5f5b231b-2496-4cc0-a8c9-908714605d2b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:20.120393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.120991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.121471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.122433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.126135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.129682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.148792 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] HTTP exception thrown: Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b could not be found. Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Request method failure captured: Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b HTTP/1.1 Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY169RBrOd0AZItsb9sJx7FTOqSgjCA4XPPma9RgPJLwvpeVBooASVYX5DLWgXiqOu1od8VQuzg-VnBMkVJcILxVQLEEPu8TBDdyFTIya7uFYGR62yfGM5QNLCDPwdy4suBH2b62KLUD8bj8HaNjk8aVXCUm7lWZPCa1-quVegE4s7A Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b1c9a3949b2461aaefac288f381241c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b1c9a3949b2461aaefac288f381241c"}]}] Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7b1c9a3949b2461aaefac288f381241c Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-MigrationsAdminTest-1831244722 Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7ead040764484d059aa9a82f0714373f Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-MigrationsAdminTest-1831244722-project Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b could not be found. Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '5f5b231b-2496-4cc0-a8c9-908714605d2b'} Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b could not be found. Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b could not be found. Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:20.150999 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:20.157410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:20.157410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:20.157410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:20.157410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:20.157410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:20.157410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b could not be found. Aug 30 04:15:20.157410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:20.159588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] Returning 404 to user: Instance 5f5b231b-2496-4cc0-a8c9-908714605d2b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:20.160785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c4ee24a-8124-4508-b06d-fd403fcd43e5 tempest-MigrationsAdminTest-1831244722 tempest-MigrationsAdminTest-1831244722-project] 10.222.0.27 "GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b" status: 404 len: 111 microversion: 2.1 time: 0.059729 Aug 30 04:15:20.165145 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 845/1762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers/5f5b231b-2496-4cc0-a8c9-908714605d2b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:20.168801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.174100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.175320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:20.177933 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f8a74293-0c56-4a95-aaad-380e8beeae65 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.223473 Aug 30 04:15:20.179549 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 918/1763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:19 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:20.183283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.183951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.184550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.185027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.185761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:20.199161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.200427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.201701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.202086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.202673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.203096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.203788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.204311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.205664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.339762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.354437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.356800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.358453 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1bdd9b2-e122-4fa9-8002-4c962746715a tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.177921 Aug 30 04:15:20.365500 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 919/1764] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:20.372136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.378113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.378841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:20.384962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.386251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.386701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.389157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.389968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.390405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.440546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.452450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-92e2317c-a5b6-44d1-b532-9dc51e40bceb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1403 microversion: 2.1 time: 0.285606 Aug 30 04:15:20.453832 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 846/1765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1403 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:20.459696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73c26439-fe6a-444d-b3fa-26800f1e7474 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Calling method '.version_select at 0x7fe96a2ee9d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.508001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:20.605437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18b713de-3422-43f5-9d70-7ca797b6aae9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.245319 Aug 30 04:15:20.606907 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 920/1766] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:20.620884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.627901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.628894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.compute.servers [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Removing options 'limit' from query {{(pid=122403) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 04:15:20.629765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:20.635842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.637106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.637755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.639298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.641081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.641776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.677602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:20.708799 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b91a780-9a8e-4afd-8bf8-dee364a4375b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.092423 Aug 30 04:15:20.709423 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 921/1767] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:20.723021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.728897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.729612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:20.739940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.740424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.740854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.741898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.742654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.743078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.774632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:20.790722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73c26439-fe6a-444d-b3fa-26800f1e7474 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.335633 Aug 30 04:15:20.791596 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 847/1768] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:15:20.803520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0eb5d1ab-347c-4481-aee0-bed53ad51f96 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Calling method '.version_select at 0x7fe96a93e550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.806039 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-45ece787-e860-494b-a086-2a42fb10b47c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.087733 Aug 30 04:15:20.806937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 922/1769] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers => generated 1012 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:20.819139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:20.823930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:20.824585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:20.836545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.837271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.837735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.838450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:20.838896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:20.839319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:20.933511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:21.014248 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-65a1319c-3c8c-4458-8574-6fb4529e9aa7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.198224 Aug 30 04:15:21.015519 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 923/1770] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:21.022016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:21.023153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:21.031776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.032743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.033367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.034324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.035224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.036088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.356758 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0eb5d1ab-347c-4481-aee0-bed53ad51f96 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.556901 Aug 30 04:15:21.370992 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 848/1771] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:15:20 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:21.379485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:21.385471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:21.386190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.servers [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Removing options 'limit' from query {{(pid=122402) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 04:15:21.388045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:21.394890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.395621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.396259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.397168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.397977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.398577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.421995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:21.430097 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1458f6b7-d361-42e1-b9ab-e1729602b403 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1389 microversion: 2.1 time: 0.413005 Aug 30 04:15:21.446037 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 924/1772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:21 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1389 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:21.454011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:21.454638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:21.469641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.470138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.474822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.475653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.476129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.476567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.519170 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b9c339d-c8cc-4328-9408-c5b1ae54bf85 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.146955 Aug 30 04:15:21.520316 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 849/1773] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 30 04:15:21 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:21.525703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83638a22-e4ac-4683-90f9-715f9060732e tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Calling method '.version_select at 0x7fe96a253ca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:21.840262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:21.848459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb7c6ece-b638-4efb-aa42-932d628f2b72 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.401314 Aug 30 04:15:21.849049 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 925/1774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:21 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:21.853969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:21.854590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:21.861108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.861821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.862264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.862961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.863417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.863848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.963366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:21.972277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:21.973932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:21.975372 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-815ad1e2-0cbd-4131-acc5-603466dc95a0 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1366 microversion: 2.57 time: 0.125107 Aug 30 04:15:21.989541 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 926/1775] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:21 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:21.989541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:21.989541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:21.995690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.996181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.996618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:21.997509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:21.998029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:21.998977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:22.300246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:22.316315 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7437aa69-aa05-4f71-b8fb-f9a091acb5f4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1403 microversion: 2.1 time: 0.338593 Aug 30 04:15:22.317254 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 927/1776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:21 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1403 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:22.322927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:22.330633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:22.331471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1929163796', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:22.339859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:22.340355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:22.340792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:22.342415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:22.343277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:22.343853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:22.479587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:22.548047 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f339cf38-8aa4-49f1-8efe-070c231df16c tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1929163796" status: 200 len: 346 microversion: 2.1 time: 0.229493 Aug 30 04:15:22.548965 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 928/1777] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:15:22 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1929163796 => generated 346 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:22.561796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1021178583", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "25481288-b646-4c38-9a19-eb4c2fee8514"}], "security_groups": [{"name": "tempest-securitygroup--1693084008"}], "key_name": "tempest-keypair-409078519", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:22.735449 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83638a22-e4ac-4683-90f9-715f9060732e tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/d688c636-5ec3-4e52-9d5c-17c0fbb161ae" status: 202 len: 0 microversion: 2.1 time: 1.213957 Aug 30 04:15:22.736031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 850/1778] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:15:21 2022] DELETE /compute/v2.1/os-floating-ips/d688c636-5ec3-4e52-9d5c-17c0fbb161ae => generated 0 bytes in 1215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:22.740859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e3f92620-fe88-4c31-b3d3-2c3c2603acd5 req-73431ea9-7291-47dd-b548-e69e245302a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c43c07e-706b-4003-9da9-1bfa84b66310", "name": "network-vif-deleted", "tag": "de6cd9f0-a510-457e-b105-32cd081b65fb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:22.751050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] validate_networks() for [('25481288-b646-4c38-9a19-eb4c2fee8514', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:22.751994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e3f92620-fe88-4c31-b3d3-2c3c2603acd5 req-73431ea9-7291-47dd-b548-e69e245302a3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:22.752481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e3f92620-fe88-4c31-b3d3-2c3c2603acd5 req-73431ea9-7291-47dd-b548-e69e245302a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:22.752920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e3f92620-fe88-4c31-b3d3-2c3c2603acd5 req-73431ea9-7291-47dd-b548-e69e245302a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:22.777571 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e3f92620-fe88-4c31-b3d3-2c3c2603acd5 req-73431ea9-7291-47dd-b548-e69e245302a3 service nova] Creating event network-vif-deleted:de6cd9f0-a510-457e-b105-32cd081b65fb for instance 2c43c07e-706b-4003-9da9-1bfa84b66310 on n-h1-854925-5 Aug 30 04:15:22.785294 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e3f92620-fe88-4c31-b3d3-2c3c2603acd5 req-73431ea9-7291-47dd-b548-e69e245302a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047483 Aug 30 04:15:22.786274 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 851/1779] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:22.791479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:22.792184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:22.799318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:22.800019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:22.800729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:22.801731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:22.802359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:22.802954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:22.889456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:22.901637 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e6ce207c-ea8a-44b1-81c6-81b0518bc65a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1184 microversion: 2.1 time: 0.114125 Aug 30 04:15:22.903476 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 852/1780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:22 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1184 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:22.929685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22e482f0-04df-45c4-8f1a-def06ef055df tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:22.944698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e482f0-04df-45c4-8f1a-def06ef055df tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:22.945894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e482f0-04df-45c4-8f1a-def06ef055df tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:22.947728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e482f0-04df-45c4-8f1a-def06ef055df tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:23.058570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22e482f0-04df-45c4-8f1a-def06ef055df tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Going to try to stop instance {{(pid=122402) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:15:23.144662 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22e482f0-04df-45c4-8f1a-def06ef055df tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "POST /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e/action" status: 202 len: 0 microversion: 2.1 time: 0.225808 Aug 30 04:15:23.149351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 853/1781] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:15:22 2022] POST /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:23.160805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c772091f-7ef9-4585-92c7-24cd66c694fc tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Calling method '.version_select at 0x7fe96a8c9040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:23.695287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:23.696777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:23.697454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:23.698055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:23.699329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:23.716932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:23.717688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:23.718565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:23.719494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:23.720115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:23.720986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:23.751119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:23.760735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for user 45901cc649784305a10c8a9278d1bef3 and project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:23.781502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:15:23.786280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:15:23.866263 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d41f4e3e-026f-47d2-9c3d-c1983fb69009 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.316071 Aug 30 04:15:23.870029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 929/1782] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:15:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:15:23.876862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:23.883130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:23.896120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:23.896619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:23.898954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:23.902473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:23.903749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:23.904731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:23.945988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:24.221576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.235570 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4bd52dad-872d-427d-8b35-429d77c2504a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.364184 Aug 30 04:15:24.237374 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 930/1783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:23 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:24.243776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:24.244406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:24.253810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.254419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.255350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.256102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.256574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.256985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.353805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.362671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.364345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.365402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f01141a-419d-4dc8-b4eb-866c57e0f16f tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1372 microversion: 2.57 time: 0.127065 Aug 30 04:15:24.365960 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 931/1784] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:24 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1372 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:24.391386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:24.396235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:24.403235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.403774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.404680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.405668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.406127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.406953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.609954 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c772091f-7ef9-4585-92c7-24cd66c694fc tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/da17e9a3-d076-4597-9e31-6360c69f1ada" status: 202 len: 0 microversion: 2.1 time: 1.459114 Aug 30 04:15:24.610650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 854/1785] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:15:23 2022] DELETE /compute/v2.1/os-floating-ips/da17e9a3-d076-4597-9e31-6360c69f1ada => generated 0 bytes in 1461 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:24.616401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-777bb216-c680-48b0-b88a-fff6787105f3 req-aff89010-b7fa-44da-bb64-ac3a942be4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a8d905-5efe-4c5f-a9b1-5139d12a11d4", "name": "network-vif-plugged", "status": "completed", "tag": "45cc2dd0-0d8f-4d67-8d20-69dbb253ee54"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:24.628010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-777bb216-c680-48b0-b88a-fff6787105f3 req-aff89010-b7fa-44da-bb64-ac3a942be4a5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.628559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-777bb216-c680-48b0-b88a-fff6787105f3 req-aff89010-b7fa-44da-bb64-ac3a942be4a5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.629101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.629264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-777bb216-c680-48b0-b88a-fff6787105f3 req-aff89010-b7fa-44da-bb64-ac3a942be4a5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.637454 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-647b07da-c08a-433f-8096-035c8ec85ee5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.256594 Aug 30 04:15:24.638464 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 932/1786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:24 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:24.640506 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-777bb216-c680-48b0-b88a-fff6787105f3 req-aff89010-b7fa-44da-bb64-ac3a942be4a5 service nova] Creating event network-vif-plugged:45cc2dd0-0d8f-4d67-8d20-69dbb253ee54 for instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 on n-h2-854925-5 Aug 30 04:15:24.644129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:24.644929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:24.651533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.651994 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-777bb216-c680-48b0-b88a-fff6787105f3 req-aff89010-b7fa-44da-bb64-ac3a942be4a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039861 Aug 30 04:15:24.652529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.652663 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 855/1787] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:24.653416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.654525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.655305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.655916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.658891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:24.659585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:24.666627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.667264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.667707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.668412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.668985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.669440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.759784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.768012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.776172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.778191 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b69dfba4-5fd1-495b-84c2-93fa39fe551f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1289 microversion: 2.25 time: 0.124429 Aug 30 04:15:24.778777 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 856/1788] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:24 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:24.783562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:24.784365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:24.790666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.791141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.791758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.792635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:24.793079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:24.793703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:24.830538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.838759 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f85ecbe0-6d52-4c26-b341-9ab45fbe9c45 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1403 microversion: 2.1 time: 0.198435 Aug 30 04:15:24.839342 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 933/1789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:24 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1403 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:24.867489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:24.876825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d827ca13-76ea-48a5-9952-c404896f8101 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1184 microversion: 2.1 time: 0.096762 Aug 30 04:15:24.877965 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 857/1790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:24 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1184 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:24.884769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3764af3c-43c7-4928-9ae8-498c7e8b8066 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] Calling method '.version_select at 0x7fe96a6f3280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:24.970270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-286973881", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:25.024305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:25.410207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:25.410720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:25.411342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:25.411758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:25.412179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:25.422844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.423334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.423775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.424882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.425017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.425395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.446076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Getting quotas for project 2b147756fd804257ab691af94f13d385. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:25.452488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Getting quotas for user 676aac43a8ef4e24b87f7067efd1fca7 and project 2b147756fd804257ab691af94f13d385. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:25.465460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:15:25.467669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:15:25.512950 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b6c8d9b4-88b0-4c83-bf2f-98f1299578a8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672374 Aug 30 04:15:25.519270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 934/1791] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:15:25.519270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:25.519911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:25.526147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.526636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.527067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.528257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.528257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.528619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.767199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:25.777823 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c08db431-b229-472e-b8a1-661119d7042e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.261160 Aug 30 04:15:25.795697 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 935/1792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:25 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:25.801351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:25.802212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:25.808699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.809619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.811061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.812152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:25.814197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:25.814830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:25.908053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:25.918429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:25.920691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:25.922208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eab8e498-4b2f-4501-bc93-870c14bd2251 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1372 microversion: 2.57 time: 0.124934 Aug 30 04:15:25.922768 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 936/1793] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:25 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:25.927321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-914e476e-165e-4801-93a7-948c8c58bca1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:25.928102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-914e476e-165e-4801-93a7-948c8c58bca1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:25.930023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:26.015630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-914e476e-165e-4801-93a7-948c8c58bca1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.027724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-914e476e-165e-4801-93a7-948c8c58bca1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1221 microversion: 2.1 time: 0.103729 Aug 30 04:15:26.028836 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 937/1794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:25 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1221 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:26.034494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.035335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.052332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.052832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.053272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.054010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.065840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.066197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.218881 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3764af3c-43c7-4928-9ae8-498c7e8b8066 tempest-FloatingIPDetailsTestJSON-1881189686 tempest-FloatingIPDetailsTestJSON-1881189686-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/75c8e3b8-c715-4204-89de-16a59f1e1661" status: 202 len: 0 microversion: 2.1 time: 1.339658 Aug 30 04:15:26.220957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 858/1795] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:15:24 2022] DELETE /compute/v2.1/os-floating-ips/75c8e3b8-c715-4204-89de-16a59f1e1661 => generated 0 bytes in 1342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:26.226639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.227438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.235314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.236056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.236693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.237610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.238230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.239065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.349828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.361021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.364000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.365488 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a5b113c-a99b-418f-b8df-9ee248ad2dc3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1337 microversion: 2.25 time: 0.143239 Aug 30 04:15:26.366228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 859/1796] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1337 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:26.370997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.371924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.379868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.380619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.381763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.382659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.383286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.384079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.397799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.408626 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59a8454e-e5ba-423b-9570-3d710861c8e9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.377889 Aug 30 04:15:26.410174 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 938/1797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:26.415941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.417265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.430045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.430682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.431218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.432022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.432621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.433090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.505699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.519712 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-feec67c2-c62e-4d7d-8fbd-836b8812f59d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1184 microversion: 2.1 time: 0.108247 Aug 30 04:15:26.520504 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 939/1798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1184 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:26.577666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:26.586460 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5f1664a7-1346-4583-b03f-9d8b407e0f48 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1590 microversion: 2.1 time: 0.219008 Aug 30 04:15:26.587389 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 860/1799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1590 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:26.607071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.607601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.622492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.623522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.623964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.624664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.625298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.625959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.717968 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-364f6d83-ca84-4032-9ee5-49b4b27242cb tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115338 Aug 30 04:15:26.725470 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 940/1800] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:26.800676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.802276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.811101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.812420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.813044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.813965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.814596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.815193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.949921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:26.950533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:26.962165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.962931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.963552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:26.964708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:26.965339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:26.965925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.052194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.061290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.063155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.064345 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ff141b6-2d18-493b-b53a-1d6a4144f7ed tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1372 microversion: 2.57 time: 0.118353 Aug 30 04:15:27.064963 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 941/1801] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1372 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:27.079433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:27.080372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:27.087445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.088192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.088626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.089963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.089963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.090195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.107028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.118906 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4bc4af46-21cf-4ca7-93ba-3f58ba455bba tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.322023 Aug 30 04:15:27.119977 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 861/1802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:26 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:27.189107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.196941 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-baf3ce5a-0b48-4e98-9022-f05966f3feee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1225 microversion: 2.1 time: 0.122338 Aug 30 04:15:27.198287 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 942/1803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:27 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:27.397199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:27.400262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:27.405101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=18 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:27.415538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.416174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.417218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.417997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.418504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.418941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.449705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:27.455246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:27.478080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.480819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.481427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.482372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.482845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.483279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.563289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.580245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.581896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.584123 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-742a36bb-b430-4c0d-b55f-c0c9cf90adb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1337 microversion: 2.25 time: 0.199757 Aug 30 04:15:27.585173 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 862/1804] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:27 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1337 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:27.590697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:27.595664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:27.605974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.606753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.607430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.608803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.609545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.610141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.675869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:27.676348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:27.678364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:27.679012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lazy-loading 'fault' on Instance uuid 2c43c07e-706b-4003-9da9-1bfa84b66310 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:27.765870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.778426 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-86cdd528-8a5e-48f5-b6f2-9a05615b1e4f tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1189 microversion: 2.1 time: 0.191990 Aug 30 04:15:27.781696 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 863/1805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:27 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1189 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:27.886506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:27.903832 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-73756983-1c0c-4082-80fc-8fba290f24b5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.469136 Aug 30 04:15:27.906187 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 943/1806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:27 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:28.088667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:28.089291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:28.096495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.096977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.097441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.098148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.102923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.103603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.141726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:28.142553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:28.153457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.153965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.156744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.160965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.161921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.162649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.262092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:28.275314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:28.280138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:28.282767 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e39fea80-688b-4785-ac49-136b8822ed67 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1357 microversion: 2.57 time: 0.198681 Aug 30 04:15:28.288095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 864/1807] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:28 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:28.301370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:28.302989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:28.314124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.314889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.315508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.316533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.317147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.318818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.827878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:28.846736 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49000664-f54f-4121-bbeb-5f2a65c6057c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1273 microversion: 2.1 time: 0.557319 Aug 30 04:15:28.857356 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 865/1808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:28 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1273 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:28.862615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:28.863225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:28.871897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.872557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.873126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.875873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:28.876452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:28.876994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:28.935839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:28.962606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:28.976828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:28.978006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17277c87-0aaa-4442-9fcd-c2b452b12559 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.841301 Aug 30 04:15:29.011627 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 944/1809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:28 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:29.028342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.028969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.050491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.062921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.063688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.064677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.065346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.065956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.186128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.206517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.208655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.210244 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f5f238f-72f0-49ef-a443-8f1f8e5ff1e6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1345 microversion: 2.25 time: 0.195312 Aug 30 04:15:29.210587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-61f65611-8de8-4636-9c6a-8987a2168ee7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 204 len: 0 microversion: 2.57 time: 0.361311 Aug 30 04:15:29.211783 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 866/1810] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:15:28 2022] DELETE /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:15:29.221094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.222235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.227049 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 945/1811] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1345 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:29.234685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.241393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.242301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.242995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.243996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.244951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.245653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.248574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.264779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.265273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.265743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.266459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.266918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.267348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.291362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.292210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.292940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.294573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lazy-loading 'fault' on Instance uuid 2c43c07e-706b-4003-9da9-1bfa84b66310 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:29.426174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.441216 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74ac437f-a1b5-4d5c-b1f9-09090f86efac tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 200 len: 1189 microversion: 2.1 time: 0.225670 Aug 30 04:15:29.442857 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 867/1812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 1189 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:29.460709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.462618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.486978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.487742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.488514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.489789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.490598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.491134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.764492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.781915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-385408bd-5559-4693-81ab-b4bda46b8ec9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.553610 Aug 30 04:15:29.783204 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 946/1813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:29.808163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7546878e-e22a-49a7-9f52-d3f6c22756cf req-909095f0-4c8f-4a94-99df-85c7e7a7693f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a8d905-5efe-4c5f-a9b1-5139d12a11d4", "tag": "45cc2dd0-0d8f-4d67-8d20-69dbb253ee54"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:29.843002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7546878e-e22a-49a7-9f52-d3f6c22756cf req-909095f0-4c8f-4a94-99df-85c7e7a7693f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.843515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7546878e-e22a-49a7-9f52-d3f6c22756cf req-909095f0-4c8f-4a94-99df-85c7e7a7693f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.846147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7546878e-e22a-49a7-9f52-d3f6c22756cf req-909095f0-4c8f-4a94-99df-85c7e7a7693f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.875135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:29.884040 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-05fa9ece-cc04-4ffc-91a0-b29e31ebc463 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1590 microversion: 2.1 time: 0.438498 Aug 30 04:15:29.884848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 868/1814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1590 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:29.894025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.895022 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7546878e-e22a-49a7-9f52-d3f6c22756cf req-909095f0-4c8f-4a94-99df-85c7e7a7693f service nova] Creating event network-changed:45cc2dd0-0d8f-4d67-8d20-69dbb253ee54 for instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 on n-h2-854925-5 Aug 30 04:15:29.897235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.914271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7546878e-e22a-49a7-9f52-d3f6c22756cf req-909095f0-4c8f-4a94-99df-85c7e7a7693f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118583 Aug 30 04:15:29.916564 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 947/1815] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:29.920779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:29.921507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:29.936576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.942044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.943435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.945542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.945694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.946201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.946657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.948579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.949872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:29.954983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:29.955876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:29.957484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.147986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.150229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.160517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.167693 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-099032ed-eca8-40b4-bdd3-ffb52561ee40 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1279 microversion: 2.1 time: 0.250549 Aug 30 04:15:30.167913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.169247 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ec6b2fa-bf92-4adc-9653-f78bef5f3ac5 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1363 microversion: 2.57 time: 0.283632 Aug 30 04:15:30.171486 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 948/1816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:30.173568 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 869/1817] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:29 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:30.186154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.187402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:30.204725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.205236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.205710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.210241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.211938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.212387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.235062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.235686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:30.244788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.247968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.249991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.252670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.256221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.256867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.412824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.427543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.433202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:30.435020 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6acb40ba-383f-485d-9bd5-47b545242bf4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1343 microversion: 2.25 time: 0.204556 Aug 30 04:15:30.440351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 870/1818] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:30 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:15:30.470888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.472057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 2c43c07e-706b-4003-9da9-1bfa84b66310] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:30.486244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.487319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.489022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.490772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.491162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.491616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.523768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] HTTP exception thrown: Instance 2c43c07e-706b-4003-9da9-1bfa84b66310 could not be found. Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Request method failure captured: Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 HTTP/1.1 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1aAVzSRw7SL-RRBewooCgju_R712_c9rvlIBgPJRl_zOZ6yeOGHI9DBDpJaa7hySZbfdL4m4LSlTlRfR8L0iwyi9CJMHc4EZzC4QarL3wBRVvX2vSselXMGJxXsTD4oaoqencQbyYhq_hIZPT9h9qcNGoCboSD-4q4ydZjC8i8cMk Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b74886057a041a0afd0d14497424b41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b74886057a041a0afd0d14497424b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}] Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: c05146c8ea7b425eb8eda0088841dd8a Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2c43c07e-706b-4003-9da9-1bfa84b66310 could not be found. Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2c43c07e-706b-4003-9da9-1bfa84b66310'} Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c43c07e-706b-4003-9da9-1bfa84b66310 could not be found. Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c43c07e-706b-4003-9da9-1bfa84b66310 could not be found. Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:30.525526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c43c07e-706b-4003-9da9-1bfa84b66310 could not be found. Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Returning 404 to user: Instance 2c43c07e-706b-4003-9da9-1bfa84b66310 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:30.532972 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f8ea9be-ff4d-4c9e-bdd9-11636d46f875 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310" status: 404 len: 111 microversion: 2.1 time: 0.063821 Aug 30 04:15:30.557855 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 871/1819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:30 2022] GET /compute/v2.1/servers/2c43c07e-706b-4003-9da9-1bfa84b66310 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:30.807246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:30.807868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:30.824632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.825144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.825618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:30.826885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:30.827339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:30.827766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.083452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:31.087337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:31.098357 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40a92241-2618-4653-a27a-dad13284a388 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.923998 Aug 30 04:15:31.099525 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 949/1820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:30 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:31.197912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:31.199323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:31.208987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.210706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.211378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.212392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.213085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.214189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.358339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:31.367460 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b5be2b4-1a68-4f97-9b1b-ba6889646acf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1279 microversion: 2.1 time: 0.175953 Aug 30 04:15:31.383904 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 950/1821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:31 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:31.383904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:31.383904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:31.406370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.407050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.407651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.409562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.412408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.412965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.426290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:31.434768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f778c704-f4a8-428e-95b1-d91ddbbb89d1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.631226 Aug 30 04:15:31.440457 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 872/1822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:30 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:31.467509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:31.468143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:31.470974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:31.487639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.488179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.488610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.489356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:31.489831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:31.490248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:31.635957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:31.649587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:31.651848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:31.654138 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0fd7d465-61a3-47ec-a76f-7e471deb65d7 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1363 microversion: 2.57 time: 0.278929 Aug 30 04:15:31.667251 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 951/1823] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:31 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:31.982496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:32.018900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:32.018900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:32.027268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b72cd1a9-9001-42dc-99ed-c5b298aef10c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.563754 Aug 30 04:15:32.032442 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 873/1824] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:31 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:15:32.124927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:32.125591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:32.139219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.141933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.144795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.147551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.152181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.153659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.393119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:32.393776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:32.410348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.410877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.411326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.412050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.417537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.418137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.821821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:32.831287 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-717b7cf8-e329-49bd-b2e1-25fc327e70f4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1279 microversion: 2.1 time: 0.443486 Aug 30 04:15:32.837944 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 874/1825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:32 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1279 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:32.852224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:32.853173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:32.862643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.863379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.864022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:32.864903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:32.865648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:32.866516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:33.006691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:33.019377 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20568903-2d1d-4f79-9fd3-d27092aa2082 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.898979 Aug 30 04:15:33.023339 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 952/1826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:32 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:33.031869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:33.036400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:33.051758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:33.052519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:33.053157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:33.054149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:33.054798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:33.056448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:33.132352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:33.133288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:33.134097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:33.134836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lazy-loading 'fault' on Instance uuid a8b6f549-e6dc-4cc9-8cbd-3677132576b8 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:33.205682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:33.218013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:33.219159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc4f813ba3944a90b46583dc595d6087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bf5a56e9774458a8bcebeba24c3078b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:33.220622 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da54057b-8d18-46dc-98f2-51e107a5f8c2 tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 200 len: 1368 microversion: 2.57 time: 0.195801 Aug 30 04:15:33.225688 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 953/1827] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:33 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:33.230968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:33.231875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:33.253903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:33.254607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:33.255228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:33.256161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:33.256808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:33.261792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.103263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:34.133743 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af8acdab-9dfa-40d5-af5f-85f1d83c9f5e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 1.294391 Aug 30 04:15:34.135901 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 875/1828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:32 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:34.141236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:34.142090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:34.164080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:34.164080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:34.164686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.165048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:34.165800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:34.166499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.231357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:34.242186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:34.244318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:34.245805 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e32ecd7e-175b-46e4-89b9-3d044a9ef988 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 1.019034 Aug 30 04:15:34.258676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 954/1829] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:33 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:34.274491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:34.275137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:34.289003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:34.295805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:34.296411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.297426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:34.298068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:34.298659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.633427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:34.641822 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff8bae40-bc1c-4772-bf60-3dab266c01ce tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1321 microversion: 2.1 time: 0.504660 Aug 30 04:15:34.642411 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 876/1830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:34 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:34.653362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:34.653994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] [instance: a8b6f549-e6dc-4cc9-8cbd-3677132576b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:34.675275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:34.676076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:34.676811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.678039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:34.678721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:34.680119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.707037 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] HTTP exception thrown: Instance a8b6f549-e6dc-4cc9-8cbd-3677132576b8 could not be found. Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Request method failure captured: Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 HTTP/1.1 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY6qxF1fjlJVcZjjqTIkXHkJkySn4EnwJUhagtnqcBgOaIm1oyZh-IGfyaxqHfTUyysFLulu_C_G8r0D75WZm65-DNucCt0nNa-EpKWUA-Rs2wgd1mJ63As1FRPrdtEMD0QuOgeD9ehz6yE_O2NfwHN0MUSCdxsB55flaxRVjFX-G4I Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.57 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 1bf5a56e9774458a8bcebeba24c3078b Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerShowV257Test-1237415620 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1bf5a56e9774458a8bcebeba24c3078b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1bf5a56e9774458a8bcebeba24c3078b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf5a56e9774458a8bcebeba24c3078b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1bf5a56e9774458a8bcebeba24c3078b"}]}] Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerShowV257Test-1237415620 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 1bf5a56e9774458a8bcebeba24c3078b Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerShowV257Test-1237415620 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerShowV257Test-1237415620-project Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cc4f813ba3944a90b46583dc595d6087 Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerShowV257Test-1237415620-project Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a8b6f549-e6dc-4cc9-8cbd-3677132576b8 could not be found. Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a8b6f549-e6dc-4cc9-8cbd-3677132576b8'} Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b6f549-e6dc-4cc9-8cbd-3677132576b8 could not be found. Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b6f549-e6dc-4cc9-8cbd-3677132576b8 could not be found. Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:34.728993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b6f549-e6dc-4cc9-8cbd-3677132576b8 could not be found. Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] Returning 404 to user: Instance a8b6f549-e6dc-4cc9-8cbd-3677132576b8 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f7ded2a-e068-41e0-89db-6e479fe274aa tempest-ServerShowV257Test-1237415620 tempest-ServerShowV257Test-1237415620-project] 10.222.0.27 "GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8" status: 404 len: 111 microversion: 2.57 time: 0.083788 Aug 30 04:15:34.735568 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 877/1831] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:34 2022] GET /compute/v2.1/servers/a8b6f549-e6dc-4cc9-8cbd-3677132576b8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:15:34.741940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-786b8db8-2ac5-41b3-9cbd-02fdcfbe3f97 req-f469f74c-8db1-4d4a-8c91-9abb135734a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf3f2b89-a214-46dd-b9f1-d1a4423d26fa", "tag": "7af95c7c-57fc-421a-8436-93221568d5f9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:34.762287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-786b8db8-2ac5-41b3-9cbd-02fdcfbe3f97 req-f469f74c-8db1-4d4a-8c91-9abb135734a9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:34.762776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-786b8db8-2ac5-41b3-9cbd-02fdcfbe3f97 req-f469f74c-8db1-4d4a-8c91-9abb135734a9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:34.763211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-786b8db8-2ac5-41b3-9cbd-02fdcfbe3f97 req-f469f74c-8db1-4d4a-8c91-9abb135734a9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:34.780675 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-786b8db8-2ac5-41b3-9cbd-02fdcfbe3f97 req-f469f74c-8db1-4d4a-8c91-9abb135734a9 service nova] Creating event network-changed:7af95c7c-57fc-421a-8436-93221568d5f9 for instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa on n-h1-854925-5 Aug 30 04:15:34.793287 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-786b8db8-2ac5-41b3-9cbd-02fdcfbe3f97 req-f469f74c-8db1-4d4a-8c91-9abb135734a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056150 Aug 30 04:15:34.794497 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 878/1832] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:35.136894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:35.155839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-553323b2-d036-4b08-a0e8-28c73d9656ea tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.892065 Aug 30 04:15:35.157795 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 955/1833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:34 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:35.159173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:35.160415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:35.176540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:35.177042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:35.177576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:35.178304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:35.178767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:35.179204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:35.278253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:35.280151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:35.312211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:35.312712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:35.313158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:35.313943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:35.314398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:35.314825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:35.434334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=18 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:35.501386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:35.511626 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd97b91d-852e-4e7c-aa79-16f769dac456 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.357238 Aug 30 04:15:35.514026 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 879/1834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:35 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:35.518893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7ae57145-5d9a-4b44-9434-85e476d34775 req-d7318cb3-40a9-4598-97e2-15095f6d3580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0a8293-be54-4224-956f-44539222c466", "tag": "fd1079f2-ffbb-4335-a81f-da6d0d027dba"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:35.530000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7ae57145-5d9a-4b44-9434-85e476d34775 req-d7318cb3-40a9-4598-97e2-15095f6d3580 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:35.530762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7ae57145-5d9a-4b44-9434-85e476d34775 req-d7318cb3-40a9-4598-97e2-15095f6d3580 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:35.531846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7ae57145-5d9a-4b44-9434-85e476d34775 req-d7318cb3-40a9-4598-97e2-15095f6d3580 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:35.548445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7ae57145-5d9a-4b44-9434-85e476d34775 req-d7318cb3-40a9-4598-97e2-15095f6d3580 service nova] Creating event network-changed:fd1079f2-ffbb-4335-a81f-da6d0d027dba for instance 8d0a8293-be54-4224-956f-44539222c466 on n-h1-854925-5 Aug 30 04:15:35.555959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7ae57145-5d9a-4b44-9434-85e476d34775 req-d7318cb3-40a9-4598-97e2-15095f6d3580 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040412 Aug 30 04:15:35.557639 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 880/1835] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:35.596402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:35.606469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:35.609091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:35.610504 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-813eccce-a591-477f-91d5-334d24039d73 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.337470 Aug 30 04:15:35.611686 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 956/1836] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:35 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:15:35.672489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:35.674816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:35.683281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:35.684235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:35.686100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:35.687038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:35.687720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:35.688310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:35.896926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:35.911913 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01dc43c5-4706-414b-aa69-5724c48b4f56 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1321 microversion: 2.1 time: 0.246047 Aug 30 04:15:35.918057 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 881/1837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:35 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:36.178306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:36.178918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:36.184617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=22 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:36.186880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.187689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.188479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.189493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.190109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.190922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.343981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:36.344999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:36.352652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.353387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.354026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.361455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.362159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.362784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.380239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:36.393186 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6674324b-71f0-4958-aea8-006620455bac tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.218467 Aug 30 04:15:36.394818 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 957/1838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:36 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:36.413809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:36.466095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:36.530992 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-10e36d1f-fd6c-49fa-832c-46dc83f3b9b4 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 204 len: 0 microversion: 2.1 time: 0.189886 Aug 30 04:15:36.530992 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 882/1839] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:36 2022] DELETE /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:36.540840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:36.541714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:36.541872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:36.542584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:36.546777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:36.550649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.551769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.553009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.554647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.555385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.555978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.557719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.565426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.565989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.566850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.568426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.569426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.853057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:36.863551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9582a310-6019-41d3-b9e1-5dfeacb05da1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1668 microversion: 2.1 time: 0.325803 Aug 30 04:15:36.870441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:36.892101 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 883/1840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:36 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1668 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:36.895506 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-70d623bb-a9a2-46ad-9112-7f74fc6b63ee tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.362687 Aug 30 04:15:36.915092 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 958/1841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:36 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:36.917681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:36.918585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:36.926034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.926622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.927047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.927631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.928079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.928594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.938057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:36.938658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:36.947425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.948239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.949412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:36.950293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:36.950914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:36.951543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:37.203491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:37.216305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:37.218764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:37.220741 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee27dc37-2817-4a36-87d6-5324d845930f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.327553 Aug 30 04:15:37.228236 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 884/1842] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:36 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:37.232071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:37.250159 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36b0d901-0f68-411b-a101-8defbc221aad tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1321 microversion: 2.1 time: 0.316399 Aug 30 04:15:37.251176 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 959/1843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:36 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:37.421792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:37.422631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:37.432346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:37.433403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:37.434936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:37.435937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:37.436908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:37.437864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:37.640593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:37.650098 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f04af932-ad2c-4e61-a32d-b625fc139cf5 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.237988 Aug 30 04:15:37.654034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 885/1844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:37 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:37.899619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:37.901789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:37.917131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:37.917510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:37.918566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:37.920057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:37.920787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:37.922460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:37.923538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:37.924739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:37.924861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:37.924956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:37.924956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:37.925475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:37.925941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:37.926367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:38.306865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:38.316653 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-003a838c-5178-4986-a56a-008cae9c0907 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1668 microversion: 2.1 time: 0.422017 Aug 30 04:15:38.317362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 960/1845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:37 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1668 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:38.337099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:38.337602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:38.352877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:38.353392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:38.357107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:38.361225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:38.362028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:38.362494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:38.415423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:38.438622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8059e0f9-ec99-444c-bbc6-20d152f875cd tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1521 microversion: 2.1 time: 0.525478 Aug 30 04:15:38.450238 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 886/1846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:37 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1521 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:38.450238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:38.450238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:38.471587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:38.472771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:38.474304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:38.476128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:38.477308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:38.480455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:38.778625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:38.790951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:38.792401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:38.797993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f4d9ee5-e0a7-4957-b16f-cf9056c2ddb6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.465109 Aug 30 04:15:38.801824 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 961/1847] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:38 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:38.808610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:38.818081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:38.822800 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae98f602-3401-4ae7-a733-fb155371cdc5 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1321 microversion: 2.1 time: 0.379339 Aug 30 04:15:38.823217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:38.824970 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 887/1848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:38 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:38.833864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:38.834657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:38.835322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:38.836280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:38.836958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:38.840048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:39.025239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:39.036281 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a9e3dac-adc7-4451-96a9-82169a57186a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.223295 Aug 30 04:15:39.041658 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 962/1849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:38 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:39.338047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:39.339440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:39.352117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:39.352713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:39.353430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:39.355446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:39.360671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:39.361466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:39.462560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:39.463610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:39.471427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:39.472210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:39.472900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:39.476095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:39.476988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:39.477817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:40.347018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:40.359130 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98cbb8a9-5377-4f2f-8cec-8be659a470b9 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1498 microversion: 2.1 time: 0.900884 Aug 30 04:15:40.362831 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 963/1850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:39 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1498 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:40.367822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:40.372292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:40.381656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32c98363-45cc-4e7d-be93-4e6c65567781 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1668 microversion: 2.1 time: 1.047614 Aug 30 04:15:40.382257 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 888/1851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:39 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1668 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:40.386822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:40.392898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:40.399557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:40.410077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:40.410567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:40.411014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:40.415122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:40.419245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:40.420876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:40.422244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:40.422743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:40.423181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:40.430063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:40.434095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:40.434754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.153373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:41.167360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:41.168943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:41.170193 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ebe2a175-6eb5-4064-99dd-6a5737913198 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.806304 Aug 30 04:15:41.170763 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 964/1852] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:40 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:41.205901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:41.206526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:41.223725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.224131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.224613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.225504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.226295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.227144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.397933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:41.413833 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-207fa8ab-3eec-4561-9196-a49cef757cb9 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1321 microversion: 2.1 time: 1.029940 Aug 30 04:15:41.416144 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 889/1853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:40 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1321 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:41.426496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-975597ce-2686-4649-9534-0cbe8bb5e56d req-3606598c-522a-46e3-a9b6-f7d471cf3895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3f2b89-a214-46dd-b9f1-d1a4423d26fa", "name": "network-vif-plugged", "status": "completed", "tag": "7af95c7c-57fc-421a-8436-93221568d5f9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:41.439257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-975597ce-2686-4649-9534-0cbe8bb5e56d req-3606598c-522a-46e3-a9b6-f7d471cf3895 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.440028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-975597ce-2686-4649-9534-0cbe8bb5e56d req-3606598c-522a-46e3-a9b6-f7d471cf3895 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.440644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-975597ce-2686-4649-9534-0cbe8bb5e56d req-3606598c-522a-46e3-a9b6-f7d471cf3895 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.453815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-975597ce-2686-4649-9534-0cbe8bb5e56d req-3606598c-522a-46e3-a9b6-f7d471cf3895 service nova] Creating event network-vif-plugged:7af95c7c-57fc-421a-8436-93221568d5f9 for instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa on n-h1-854925-5 Aug 30 04:15:41.460210 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-975597ce-2686-4649-9534-0cbe8bb5e56d req-3606598c-522a-46e3-a9b6-f7d471cf3895 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042561 Aug 30 04:15:41.461599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 890/1854] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:41.468871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:41.474548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:41.475579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:41.481678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.482995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.483446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.484237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.484628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.485363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.586482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:41.634846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:41.651817 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9c1af63-0696-401e-b3ed-6493f4d74e97 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.456564 Aug 30 04:15:41.655292 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 965/1855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:41 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:41.669907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:41.671305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:41.684503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.690482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.691214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.692469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.693105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.693785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.700429 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f2c5b9c-d542-4370-81b9-524362300c6e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.236758 Aug 30 04:15:41.701059 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 891/1856] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Aug 30 04:15:41 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:41.721528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5cc3fd34-aa8d-47f9-af9b-c03185b84e17 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:41.735360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc3fd34-aa8d-47f9-af9b-c03185b84e17 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.735864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc3fd34-aa8d-47f9-af9b-c03185b84e17 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.736307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc3fd34-aa8d-47f9-af9b-c03185b84e17 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.749165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:41.793006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5cc3fd34-aa8d-47f9-af9b-c03185b84e17 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Going to try to start instance {{(pid=122402) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:15:41.848466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:41.861561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5cc3fd34-aa8d-47f9-af9b-c03185b84e17 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "POST /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e/action" status: 202 len: 0 microversion: 2.1 time: 0.150416 Aug 30 04:15:41.862626 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 892/1857] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:15:41 2022] POST /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:41.866860 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb7f7725-3fc1-44cc-95ba-bd9dc653d1f1 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1600 microversion: 2.1 time: 0.209419 Aug 30 04:15:41.869569 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 966/1858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:41 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:41.883892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:41.885157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:41.895931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.896727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.897362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:41.899842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:41.901901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:41.902548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.198692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:42.199344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:42.221944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:42.222755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:42.223406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.224374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:42.225004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:42.225927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.469823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:42.481106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cfa621f2-d309-48c7-8563-9fe32daa729e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1507 microversion: 2.1 time: 0.614219 Aug 30 04:15:42.484737 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 893/1859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:41 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1507 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:42.496219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:42.497497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:42.516598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:42.517039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:42.518676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.519489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:42.521126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:42.523244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.624424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:42.642057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:42.643751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:42.647001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da82db8b-40ee-4300-a6c2-586e175ba387 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.451167 Aug 30 04:15:42.649285 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 967/1860] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:42 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:15:42.661832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8b456e33-83b8-491e-b6bf-a4d2fcc1d97a req-61aca70e-f064-4460-b3e3-390ec4f5c071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a98f78-a3b5-45ac-b93b-72c766284dbd", "name": "network-vif-deleted", "tag": "b4cc38e1-ad5b-4717-b289-318c740668e6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:42.682490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8b456e33-83b8-491e-b6bf-a4d2fcc1d97a req-61aca70e-f064-4460-b3e3-390ec4f5c071 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:42.682984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8b456e33-83b8-491e-b6bf-a4d2fcc1d97a req-61aca70e-f064-4460-b3e3-390ec4f5c071 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:42.683426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8b456e33-83b8-491e-b6bf-a4d2fcc1d97a req-61aca70e-f064-4460-b3e3-390ec4f5c071 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:42.704909 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8b456e33-83b8-491e-b6bf-a4d2fcc1d97a req-61aca70e-f064-4460-b3e3-390ec4f5c071 service nova] Creating event network-vif-deleted:b4cc38e1-ad5b-4717-b289-318c740668e6 for instance b3a98f78-a3b5-45ac-b93b-72c766284dbd on n-h1-854925-5 Aug 30 04:15:42.727831 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8b456e33-83b8-491e-b6bf-a4d2fcc1d97a req-61aca70e-f064-4460-b3e3-390ec4f5c071 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077050 Aug 30 04:15:42.728754 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 968/1861] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:43.070680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1735001791", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "a539f6e9-f96f-4f87-863e-d82c8f70b97b"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:43.143605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:43.152219 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c59636f7-7495-4a52-b19f-783bda912837 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1321 microversion: 2.1 time: 0.666323 Aug 30 04:15:43.170746 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 894/1862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:42 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1321 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:43.175750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:43.181120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] validate_networks() for [('a539f6e9-f96f-4f87-863e-d82c8f70b97b', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:43.186149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:43.202091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.202825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.204803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.206870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.207386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.207817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.553401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:43.567366 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f19359dd-d8be-402b-a9c3-0153cd16ca57 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.395243 Aug 30 04:15:43.584321 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 895/1863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:43 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:43.590302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:43.591201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:43.600131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.600895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.601587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.603439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.604786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.605487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.698277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.703146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.703856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.704483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lazy-loading 'fault' on Instance uuid b3a98f78-a3b5-45ac-b93b-72c766284dbd {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:43.835594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:43.846302 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae904cda-30e6-4c25-8ff7-ac4981ce2057 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 200 len: 1324 microversion: 2.1 time: 0.260575 Aug 30 04:15:43.847436 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 896/1864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:43 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:43.853359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:43.855212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:43.863789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.865106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.865871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:43.866849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:43.867849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:43.868519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.439363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:44.444418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:44.452400 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5ac25a8-32c5-4831-b16f-654ec1842220 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1507 microversion: 2.1 time: 0.603467 Aug 30 04:15:44.452987 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 897/1865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:43 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1507 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:44.459868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:44.460642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:44.471907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.472904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.473902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.475201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.475640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.476070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.644115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:44.644591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:44.645053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:44.645820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:44.646552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:44.658094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.658952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.661044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.663702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.664289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.664885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.669430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:44.678145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:44.680641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:44.681874 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b5450d5-2c36-49ab-a287-1af05705926b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.227766 Aug 30 04:15:44.682452 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 898/1866] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:44 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:44.692681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:44.693671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:44.709648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.710141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.710578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.711283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.711734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.712507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.712685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Getting quotas for project abbe53e538364506890448ef98f3dc3d. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:44.753867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Getting quotas for user 7c32c1afca4b42cfac0b51bbb86e04dd and project abbe53e538364506890448ef98f3dc3d. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:44.801278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:15:44.806385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:15:44.916846 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b864ebc9-4a2f-493b-8f83-2cd2e96c4a92 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186386 Aug 30 04:15:44.925065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 969/1867] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:15:44.943944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:44.947721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:44.982847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.984145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.985973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:44.986951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:44.987674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:44.988276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.465812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:45.481471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-469eb2b3-a7f6-41cb-8993-ac7a1f62056c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.550680 Aug 30 04:15:45.482754 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 970/1868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:44 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:45.492838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:45.493865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: b3a98f78-a3b5-45ac-b93b-72c766284dbd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:45.511631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.512132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.514680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.515613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.518519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.519218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.544172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:45.552897 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de9a49e4-3020-45a0-acea-d0baa65268b1 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1321 microversion: 2.1 time: 0.869096 Aug 30 04:15:45.554212 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 899/1869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:44 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1321 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:45.577217 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] HTTP exception thrown: Instance b3a98f78-a3b5-45ac-b93b-72c766284dbd could not be found. Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Request method failure captured: Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd HTTP/1.1 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY1aAVzSRw7SL-RRBewooCgju_R712_c9rvlIBgPJRl_zOZ6yeOGHI9DBDpJaa7hySZbfdL4m4LSlTlRfR8L0iwyi9CJMHc4EZzC4QarL3wBRVvX2vSselXMGJxXsTD4oaoqencQbyYhq_hIZPT9h9qcNGoCboSD-4q4ydZjC8i8cMk Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b74886057a041a0afd0d14497424b41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b74886057a041a0afd0d14497424b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}] Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c05146c8ea7b425eb8eda0088841dd8a Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance b3a98f78-a3b5-45ac-b93b-72c766284dbd could not be found. Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b3a98f78-a3b5-45ac-b93b-72c766284dbd'} Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a98f78-a3b5-45ac-b93b-72c766284dbd could not be found. Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a98f78-a3b5-45ac-b93b-72c766284dbd could not be found. Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:45.578946 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a98f78-a3b5-45ac-b93b-72c766284dbd could not be found. Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:15:45.586305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Returning 404 to user: Instance b3a98f78-a3b5-45ac-b93b-72c766284dbd could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:45.591105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9ec0b09-a369-4536-9822-b074e6a41696 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:45.591789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c9ec0b09-a369-4536-9822-b074e6a41696 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:45.594172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cf0d232e-1430-41d4-9bbe-83627602c532 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd" status: 404 len: 111 microversion: 2.1 time: 0.096394 Aug 30 04:15:45.597310 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 971/1870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:45 2022] GET /compute/v2.1/servers/b3a98f78-a3b5-45ac-b93b-72c766284dbd => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:45.608794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:45.609496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:45.625319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.625832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.626370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.626952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.630508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.630967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.667249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c9ec0b09-a369-4536-9822-b074e6a41696 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:45.679154 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c9ec0b09-a369-4536-9822-b074e6a41696 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1216 microversion: 2.1 time: 0.122863 Aug 30 04:15:45.680221 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 900/1871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:45 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1216 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:45.686815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45a8a0b6-2ad2-4367-a086-954a0a5d1e3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '.version_select at 0x7fe96994b1f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:45.716023 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45a8a0b6-2ad2-4367-a086-954a0a5d1e3a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-934377995" status: 202 len: 0 microversion: 2.1 time: 0.034504 Aug 30 04:15:45.717197 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 901/1872] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:15:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-934377995 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:15:45.741139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:45.741780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:45.758657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.765422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.765880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:45.766899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:45.767528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:45.769050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.053402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.067270 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5ea8700-fa2a-4be7-9071-b1578d8ec4aa tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1507 microversion: 2.1 time: 0.467139 Aug 30 04:15:46.068556 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 972/1873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:45 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1507 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:46.077272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.086116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.087522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.088642 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea0f0812-1205-4cc4-9862-1280bdef4489 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.370275 Aug 30 04:15:46.089613 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 902/1874] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:45 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:46.503847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:46.504572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:46.512054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.512776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.513464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.515501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.516150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.516902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.576982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:46.577859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:46.601390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.602591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.603651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.604954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.606471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.607592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.804823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.816754 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1bcd0232-ed31-4ff3-96ca-ad98b74e7805 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1518 microversion: 2.1 time: 0.317167 Aug 30 04:15:46.818683 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 973/1875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:46 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1518 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:46.823521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:46.824148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:46.832186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.832693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.833432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.834203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.834668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.835110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.923212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.932256 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64ae7e98-4b06-4f39-9719-ec1198f05d1f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1220 microversion: 2.1 time: 0.112502 Aug 30 04:15:46.946649 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 974/1876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:46 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:46.952710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:46.954263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:46.962695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:46.971010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.971787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.974111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.975487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:46.976183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:46.976826 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-675a6ccd-8f31-46b5-86ab-387a83af0592 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1471 microversion: 2.1 time: 0.404448 Aug 30 04:15:46.977474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:46.979176 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 903/1877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:46 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1471 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:47.046802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:47.215815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:47.231434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7783f16e-6213-4f78-b872-da90c40da4f8 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 204 len: 0 microversion: 2.1 time: 0.280516 Aug 30 04:15:47.232071 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 975/1878] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:46 2022] DELETE /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:15:47.246534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:47.247289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:47.259455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b639424-ef51-4ce3-b61d-25c6be39463b tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:47.260229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9b639424-ef51-4ce3-b61d-25c6be39463b tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] [instance: 4fc0c5e9-7ff4-430e-a007-ed25628629fe] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:47.265357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.265857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.266394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.267633 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-9b639424-ef51-4ce3-b61d-25c6be39463b tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] HTTP exception thrown: Instance 4fc0c5e9-7ff4-430e-a007-ed25628629fe could not be found. Aug 30 04:15:47.270305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b639424-ef51-4ce3-b61d-25c6be39463b tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Request method failure captured: Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/4fc0c5e9-7ff4-430e-a007-ed25628629fe/action HTTP/1.1 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 15 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7c6HQBCQWE8EpAhyTkHXmUwHP8brDi3GFTMou49LxUim_Mqegpm40h1ILB_Hy1wqFWlk9UOiGQynlzot5oubvAUsbhMeQUOsodXgBiUqIMs4wQwxLLteS2qX6pAHAcSGy-nb4Wx55DZAS_k4TNbyenkbx8QpyexGk2x5WNTpvKLes Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_118e02e6c0c248fb8817cdac0cdb70d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}] Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 379e39467c7f4896bd65237831aa8f3b Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: {"migrate": {}} Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 4fc0c5e9-7ff4-430e-a007-ed25628629fe could not be found. Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '4fc0c5e9-7ff4-430e-a007-ed25628629fe', 'body': {'migrate': {}}} Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fc0c5e9-7ff4-430e-a007-ed25628629fe could not be found. Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fc0c5e9-7ff4-430e-a007-ed25628629fe could not be found. Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:47.273925 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:47.279673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:47.279673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:47.279673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:47.279673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:47.279673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fc0c5e9-7ff4-430e-a007-ed25628629fe could not be found. Aug 30 04:15:47.279673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:47.280879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.280879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.282397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b639424-ef51-4ce3-b61d-25c6be39463b tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Returning 404 to user: Instance 4fc0c5e9-7ff4-430e-a007-ed25628629fe could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:47.283534 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b639424-ef51-4ce3-b61d-25c6be39463b tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/4fc0c5e9-7ff4-430e-a007-ed25628629fe/action" status: 404 len: 111 microversion: 2.1 time: 0.285430 Aug 30 04:15:47.284767 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 904/1879] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:15:46 2022] POST /compute/v2.1/servers/4fc0c5e9-7ff4-430e-a007-ed25628629fe/action => generated 111 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:47.313590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:47.319873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:47.334979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.335475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.336877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.338533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.340745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.341206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.554070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:47.568100 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d063190a-29a8-43e2-a9d4-6da36680dc6d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1511 microversion: 2.1 time: 0.331460 Aug 30 04:15:47.568998 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 976/1880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:47 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1511 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:47.576444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-16302a2f-8c63-4a68-8a82-330bd09267df req-a872966f-3b9c-413c-beb7-327d8fc2af6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0a8293-be54-4224-956f-44539222c466", "name": "network-vif-plugged", "status": "completed", "tag": "fd1079f2-ffbb-4335-a81f-da6d0d027dba"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:47.585189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:47.596787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-16302a2f-8c63-4a68-8a82-330bd09267df req-a872966f-3b9c-413c-beb7-327d8fc2af6e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.597381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:47.597808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-16302a2f-8c63-4a68-8a82-330bd09267df req-a872966f-3b9c-413c-beb7-327d8fc2af6e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.598351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-16302a2f-8c63-4a68-8a82-330bd09267df req-a872966f-3b9c-413c-beb7-327d8fc2af6e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.599863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:47.601163 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b9c63fff-18d2-4dcc-a79c-daf514e59713 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.315168 Aug 30 04:15:47.609954 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 905/1881] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:47 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:47.617140 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-16302a2f-8c63-4a68-8a82-330bd09267df req-a872966f-3b9c-413c-beb7-327d8fc2af6e service nova] Creating event network-vif-plugged:fd1079f2-ffbb-4335-a81f-da6d0d027dba for instance 8d0a8293-be54-4224-956f-44539222c466 on n-h1-854925-5 Aug 30 04:15:47.626920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:47.627560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:47.633805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.634346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.634792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.635943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-16302a2f-8c63-4a68-8a82-330bd09267df req-a872966f-3b9c-413c-beb7-327d8fc2af6e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063449 Aug 30 04:15:47.636861 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 977/1882] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:47.637076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.637605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.638114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.644916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-95725536", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:47.714977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:47.924287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:47.933612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3e4e3b00-eb7d-4102-b897-185b1c72e1cf tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1484 microversion: 2.1 time: 0.321031 Aug 30 04:15:47.948677 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 906/1883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:47 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1484 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:47.956448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:47.962126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:47.962850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.servers [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Removing options 'limit' from query {{(pid=122402) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 04:15:47.963668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:47.965273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.966229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.967422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.968691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.969582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.970553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.972727 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1511c21-877e-4364-a73c-1f8c8e4f742d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.022558 Aug 30 04:15:47.973595 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 907/1884] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 30 04:15:47 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:15:47.978324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:47.980336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:47.986149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.986603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.987039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:47.987746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:47.988168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:47.988586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.056268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:15:48.056985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:15:48.057759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:15:48.058470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:15:48.059611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:15:48.080308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.080308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.082292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.083624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.084756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.085832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.114524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Getting quotas for project 2b147756fd804257ab691af94f13d385. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:15:48.123317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Getting quotas for user 676aac43a8ef4e24b87f7067efd1fca7 and project 2b147756fd804257ab691af94f13d385. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:15:48.158473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:15:48.161097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:15:48.245816 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9d6d880-6f04-4d44-b657-bf02b9fbab45 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602577 Aug 30 04:15:48.247969 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 978/1885] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:15:48.253862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:48.254811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:48.266057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.266879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.267560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.268511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.269197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.269864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:48.270166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.290894 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d30a817f-6668-4084-a912-5b338c18a5cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1524 microversion: 2.1 time: 0.309975 Aug 30 04:15:48.292663 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 908/1886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:47 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1524 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:48.313890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:48.318333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:48.336647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.337202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.337673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.340501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.341791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.342492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.472353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:48.487642 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-679a57fa-b376-4c59-ae90-eb672af5608d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1268 microversion: 2.1 time: 0.238207 Aug 30 04:15:48.488565 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 979/1887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:48 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1268 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:48.494637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6191fe0e-1255-4899-b65e-3b5be995a806 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:48.495267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6191fe0e-1255-4899-b65e-3b5be995a806 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:48.661066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6191fe0e-1255-4899-b65e-3b5be995a806 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:48.668867 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6191fe0e-1255-4899-b65e-3b5be995a806 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1220 microversion: 2.1 time: 0.179113 Aug 30 04:15:48.680195 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 980/1888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:48 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1220 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:48.686801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:48.687421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:48.695281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.695917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.696444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.697234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.697800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.698592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.701678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:48.714295 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1698837-abf7-4034-bbe7-2a086c88474f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1511 microversion: 2.1 time: 0.420344 Aug 30 04:15:48.718576 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 909/1889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:48 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:48.753062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:48.755258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:48.777820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.782591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.783108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:48.783867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:48.791721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:48.792217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.180962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.189683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.191990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.193489 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-950400d5-851c-4b25-aeb2-0c981caeb4a2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1411 microversion: 2.25 time: 0.512160 Aug 30 04:15:49.194681 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 981/1890] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:48 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1411 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:15:49.200932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:49.201903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:49.211056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.211975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.212674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.213412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.214308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.215142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.215804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.224575 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d63b80eb-5e1a-46fe-a09a-8b0cf55b154b tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 200 len: 1511 microversion: 2.1 time: 0.489780 Aug 30 04:15:49.230437 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 910/1891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:48 2022] GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:49.254651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:49.255304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:49.265521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.266271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.266900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.267776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.272578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.273257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.363644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.375340 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-154d332e-041c-483f-ac20-388da02cdc00 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1442 microversion: 2.1 time: 0.179262 Aug 30 04:15:49.376595 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 982/1892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:49 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1442 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:49.389879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:49.391943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:49.411178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.415777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.416472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.417540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.417896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.418326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.601724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.612480 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cdd9e06d-521f-44e6-80aa-27cc798bc4c6 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1512 microversion: 2.1 time: 0.364407 Aug 30 04:15:49.628691 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 911/1893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:49 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1512 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:49.646982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-264c01ce-1f8a-4af4-a24e-2f226c7809b1 req-4e044c1e-5fd3-4143-802c-7f1826ab58ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e31325-5353-4171-b6c2-384cd56f13ca", "name": "network-vif-deleted", "tag": "ccee229a-2293-49ad-9b55-ab06dfa3a92c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:49.667612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.672150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-264c01ce-1f8a-4af4-a24e-2f226c7809b1 req-4e044c1e-5fd3-4143-802c-7f1826ab58ae service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.672646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-264c01ce-1f8a-4af4-a24e-2f226c7809b1 req-4e044c1e-5fd3-4143-802c-7f1826ab58ae service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.673080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-264c01ce-1f8a-4af4-a24e-2f226c7809b1 req-4e044c1e-5fd3-4143-802c-7f1826ab58ae service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.681629 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eba9a0df-a543-47a8-af62-75d8acd2d637 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1524 microversion: 2.1 time: 0.301320 Aug 30 04:15:49.682240 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 983/1894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:49 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1524 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:49.699340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:49.699972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:49.701780 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-264c01ce-1f8a-4af4-a24e-2f226c7809b1 req-4e044c1e-5fd3-4143-802c-7f1826ab58ae service nova] Creating event network-vif-deleted:ccee229a-2293-49ad-9b55-ab06dfa3a92c for instance 19e31325-5353-4171-b6c2-384cd56f13ca on n-h1-854925-5 Aug 30 04:15:49.708631 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-264c01ce-1f8a-4af4-a24e-2f226c7809b1 req-4e044c1e-5fd3-4143-802c-7f1826ab58ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077471 Aug 30 04:15:49.709633 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 912/1895] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:49.714954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.715473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.715930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.717229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.717773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.718145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.719867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:49.737486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.744639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:49.897251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:49.921552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-798d3bcc-21a9-44df-9a5f-4edbf241d055 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1274 microversion: 2.1 time: 0.235922 Aug 30 04:15:49.922290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.922778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.923177 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 984/1896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:49 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:49.923300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.923944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.924395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.924819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.949264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:49.954571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:49.968479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.971767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.973472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:49.974898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:49.976684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:49.979713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.016760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:50.058210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:50.087119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:50.107941 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-63da056e-8d00-46ac-b85c-3b48222cf061 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1272 microversion: 2.1 time: 0.183067 Aug 30 04:15:50.112512 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 985/1897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:49 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1272 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:50.145292 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73f2e901-f380-4e75-8091-490c3d71726f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 346 microversion: 2.1 time: 0.430938 Aug 30 04:15:50.146007 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 913/1898] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Aug 30 04:15:49 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 346 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:50.160953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:50.164994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:50.173227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.174289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.174640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.175407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.175949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.176447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.220936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:50.221683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:50.231337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.235058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.235791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.236794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.238019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.238519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.512581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:50.522388 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-04fcb076-8cba-4c01-b759-a3a63c5aeee1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1511 microversion: 2.1 time: 0.367941 Aug 30 04:15:50.523539 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 986/1899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:50 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:50.563174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:50.563827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:50.574206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.575937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.579279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.582477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.589084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.593260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.642847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.643583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.644354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.645298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lazy-loading 'fault' on Instance uuid 19e31325-5353-4171-b6c2-384cd56f13ca {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:50.661359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:50.690300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:50.694553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:50.697236 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd30dd6a-c8b9-413e-95e7-1e21cec0bd6c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1607 microversion: 2.25 time: 0.482797 Aug 30 04:15:50.701994 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 914/1900] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:15:50 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1607 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:15:50.719431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:50.721431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:50.736065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.736672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.737788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.741567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.742432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.743435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.752938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:50.768219 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5fb04439-f57f-4850-a4dd-b3a6b3f5d291 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 200 len: 1300 microversion: 2.1 time: 0.243311 Aug 30 04:15:50.770567 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 987/1901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:50 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 1300 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:50.779834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:50.780677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:50.789592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.790519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.791148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:50.792528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:50.802920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:50.804077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.084664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:51.093859 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd575d8f-9f25-4f28-9459-4c98b28eb141 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1524 microversion: 2.1 time: 0.321970 Aug 30 04:15:51.096556 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 988/1902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:50 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:51.115353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:51.115466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:51.123154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.124182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.124874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.125839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.126543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.127295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.174551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:51.182975 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac3646b5-8c40-41d5-818e-baa15a6bfcca tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 200 len: 1511 microversion: 2.1 time: 0.479888 Aug 30 04:15:51.184033 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 915/1903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:50 2022] GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 1511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:51.188993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:51.189810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:51.196291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.197178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.197790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.198771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.199386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.200256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.402567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e7099bb-03c3-4804-8c81-d462a87133a9 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.304344 Aug 30 04:15:51.403270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 989/1904] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 04:15:51 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-interface => generated 284 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:15:51.410298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:51.410967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:51.427809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.428816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.431889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.436170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.438003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.440158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.592472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:51.602617 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ed3f5567-6dc2-483f-8fac-b3e0d15fb4fe tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1278 microversion: 2.1 time: 0.198023 Aug 30 04:15:51.603408 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 990/1905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:51 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:51.622563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:51.624881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:51.635020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.636981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.637678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.639273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.640135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.640770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.679565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:51.700125 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-357a69d2-fef8-4b87-9146-f10f00c5e02e tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1316 microversion: 2.1 time: 0.513363 Aug 30 04:15:51.702552 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 916/1906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:51 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:51.727521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0380af1b-c6c7-4856-a72a-e595f6943ee9 req-501df5cf-c236-4493-a3b7-97227403e84c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a38e91-4b23-4d55-8d7f-b6dcde51f28a", "name": "network-vif-unplugged", "status": "completed", "tag": "079c07d9-1e08-40f3-986c-6985d31f55f6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:51.747312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0380af1b-c6c7-4856-a72a-e595f6943ee9 req-501df5cf-c236-4493-a3b7-97227403e84c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.748576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0380af1b-c6c7-4856-a72a-e595f6943ee9 req-501df5cf-c236-4493-a3b7-97227403e84c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.749781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0380af1b-c6c7-4856-a72a-e595f6943ee9 req-501df5cf-c236-4493-a3b7-97227403e84c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.771910 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0380af1b-c6c7-4856-a72a-e595f6943ee9 req-501df5cf-c236-4493-a3b7-97227403e84c service nova] Creating event network-vif-unplugged:079c07d9-1e08-40f3-986c-6985d31f55f6 for instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a on n-h2-854925-5 Aug 30 04:15:51.785770 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0380af1b-c6c7-4856-a72a-e595f6943ee9 req-501df5cf-c236-4493-a3b7-97227403e84c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078923 Aug 30 04:15:51.788544 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 917/1907] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:51.813643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:51.815044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 19e31325-5353-4171-b6c2-384cd56f13ca] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:51.826553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.827694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.828366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.829755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.830407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.831101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.860333 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] HTTP exception thrown: Instance 19e31325-5353-4171-b6c2-384cd56f13ca could not be found. Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Request method failure captured: Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca HTTP/1.1 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1aAVzSRw7SL-RRBewooCgju_R712_c9rvlIBgPJRl_zOZ6yeOGHI9DBDpJaa7hySZbfdL4m4LSlTlRfR8L0iwyi9CJMHc4EZzC4QarL3wBRVvX2vSselXMGJxXsTD4oaoqencQbyYhq_hIZPT9h9qcNGoCboSD-4q4ydZjC8i8cMk Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b74886057a041a0afd0d14497424b41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b74886057a041a0afd0d14497424b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}] Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: c05146c8ea7b425eb8eda0088841dd8a Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 19e31325-5353-4171-b6c2-384cd56f13ca could not be found. Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '19e31325-5353-4171-b6c2-384cd56f13ca'} Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e31325-5353-4171-b6c2-384cd56f13ca could not be found. Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e31325-5353-4171-b6c2-384cd56f13ca could not be found. Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:51.862858 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:51.869899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:51.869899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:51.869899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:51.869899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:51.869899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:51.869899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e31325-5353-4171-b6c2-384cd56f13ca could not be found. Aug 30 04:15:51.869899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:51.874239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Returning 404 to user: Instance 19e31325-5353-4171-b6c2-384cd56f13ca could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:51.875594 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e692249d-0e46-4372-9278-dcf83fcde049 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca" status: 404 len: 111 microversion: 2.1 time: 0.070495 Aug 30 04:15:51.876821 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 918/1908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:51 2022] GET /compute/v2.1/servers/19e31325-5353-4171-b6c2-384cd56f13ca => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:15:51.887552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:51.888428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:51.898437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.899711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.900323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.901292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:51.902810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:51.905629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:51.947228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:52.003855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:52.032443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:52.050568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e78bd0bd-3a29-4037-a1b6-e0933da08b68 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1512 microversion: 2.1 time: 0.440490 Aug 30 04:15:52.064017 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 991/1909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:51 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1512 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:52.087694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:52.103927 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c632e7dd-327f-4479-80cc-aa409437f8dd tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 204 len: 0 microversion: 2.1 time: 0.222739 Aug 30 04:15:52.104912 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 919/1910] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:51 2022] DELETE /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:15:52.107258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:52.112036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:52.121672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:52.123584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:52.124393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:52.125105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:52.127458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:52.130689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:52.131412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:52.132024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:52.140046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:52.140827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:52.142150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:52.161824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:52.164130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:52.171581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:52.227425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:52.369734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:52.382419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:52.383260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:52.383972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.072677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e63f9338-23ad-4f00-b798-8cbe387cc570 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.991225 Aug 30 04:15:53.074090 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 992/1911] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:15:52 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:53.081263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:53.082162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:53.093981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:53.099888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.104620 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eca23240-f895-43e5-be01-1ee99466067d tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1501 microversion: 2.1 time: 0.994876 Aug 30 04:15:53.105364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.105804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.106327 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 920/1912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:52 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1501 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:53.109203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.109735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.110202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.116565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b8bad099-a9cc-45b7-8e70-6d0062a4ea85 req-8b6a7885-739d-43c9-8007-42db60c91a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16cad0c3-0b03-4d85-b8db-e2984f4516e2", "tag": "093576bd-fb47-4205-95cd-8baa48dfcedc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:53.132738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b8bad099-a9cc-45b7-8e70-6d0062a4ea85 req-8b6a7885-739d-43c9-8007-42db60c91a75 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.133128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b8bad099-a9cc-45b7-8e70-6d0062a4ea85 req-8b6a7885-739d-43c9-8007-42db60c91a75 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.133752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b8bad099-a9cc-45b7-8e70-6d0062a4ea85 req-8b6a7885-739d-43c9-8007-42db60c91a75 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.152495 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b8bad099-a9cc-45b7-8e70-6d0062a4ea85 req-8b6a7885-739d-43c9-8007-42db60c91a75 service nova] Creating event network-changed:093576bd-fb47-4205-95cd-8baa48dfcedc for instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 on n-h2-854925-5 Aug 30 04:15:53.158450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b8bad099-a9cc-45b7-8e70-6d0062a4ea85 req-8b6a7885-739d-43c9-8007-42db60c91a75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049360 Aug 30 04:15:53.159513 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 921/1913] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:53.165645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:53.166329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:53.174714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.175400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.175846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.176546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.177176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.177909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.636966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:53.657760 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78c330c1-efe6-4a8a-8141-1479eeb09539 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1524 microversion: 2.1 time: 0.582337 Aug 30 04:15:53.662795 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 993/1914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:53 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1524 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:53.673717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:53.686894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:53.688326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:53.688683 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0f6223d-5d07-412f-af44-7712efb44e91 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.526903 Aug 30 04:15:53.689513 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 922/1915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:53 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:53.696357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:53.702748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:53.706084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:53.713375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.714114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.714920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.716001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.718058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.718735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.866010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.866689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.867259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.868195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.868828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.869491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.903564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:53.943879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3338a540-9852-48c1-95f6-74e104b04f7d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.252944 Aug 30 04:15:53.944560 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 923/1916] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Aug 30 04:15:53 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:53.950022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f1cc6464-7b99-4bee-8049-f766cfeb4535 req-d4f3a303-7f79-4324-b595-03b1322a0045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a38e91-4b23-4d55-8d7f-b6dcde51f28a", "name": "network-vif-plugged", "status": "completed", "tag": "079c07d9-1e08-40f3-986c-6985d31f55f6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:53.964435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f1cc6464-7b99-4bee-8049-f766cfeb4535 req-d4f3a303-7f79-4324-b595-03b1322a0045 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:53.965848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f1cc6464-7b99-4bee-8049-f766cfeb4535 req-d4f3a303-7f79-4324-b595-03b1322a0045 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:53.966685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f1cc6464-7b99-4bee-8049-f766cfeb4535 req-d4f3a303-7f79-4324-b595-03b1322a0045 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:53.981098 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f1cc6464-7b99-4bee-8049-f766cfeb4535 req-d4f3a303-7f79-4324-b595-03b1322a0045 service nova] Creating event network-vif-plugged:079c07d9-1e08-40f3-986c-6985d31f55f6 for instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a on n-h2-854925-5 Aug 30 04:15:53.986807 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f1cc6464-7b99-4bee-8049-f766cfeb4535 req-d4f3a303-7f79-4324-b595-03b1322a0045 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040682 Aug 30 04:15:53.987421 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 924/1917] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:53.992959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:53.998961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:54.000513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:54.006136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.006611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.007040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.007753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.008204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.008615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.105290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:54.113236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:54.126700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae7177cd-0ad2-425f-bf87-bbe0bafca698 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1316 microversion: 2.1 time: 0.445978 Aug 30 04:15:54.127283 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 994/1918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:53 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:54.136085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:54.136724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:54.147586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.148408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.149581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.150817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.151449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.151891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.318015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:54.329514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7bf9c8d-17ce-481c-9579-899e57fcb3a2 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1459 microversion: 2.1 time: 0.197442 Aug 30 04:15:54.331065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 995/1919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:54 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1459 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:54.336576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-af698a43-e9d5-4d0a-af42-c12d4694c1a5 req-df8a0d98-e5c5-4fb6-a119-ab571b3f103b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0a8293-be54-4224-956f-44539222c466", "tag": "fd1079f2-ffbb-4335-a81f-da6d0d027dba"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:54.351443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af698a43-e9d5-4d0a-af42-c12d4694c1a5 req-df8a0d98-e5c5-4fb6-a119-ab571b3f103b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.352336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af698a43-e9d5-4d0a-af42-c12d4694c1a5 req-df8a0d98-e5c5-4fb6-a119-ab571b3f103b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.353167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af698a43-e9d5-4d0a-af42-c12d4694c1a5 req-df8a0d98-e5c5-4fb6-a119-ab571b3f103b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.370793 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-af698a43-e9d5-4d0a-af42-c12d4694c1a5 req-df8a0d98-e5c5-4fb6-a119-ab571b3f103b service nova] Creating event network-changed:fd1079f2-ffbb-4335-a81f-da6d0d027dba for instance 8d0a8293-be54-4224-956f-44539222c466 on n-h1-854925-5 Aug 30 04:15:54.379683 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-af698a43-e9d5-4d0a-af42-c12d4694c1a5 req-df8a0d98-e5c5-4fb6-a119-ab571b3f103b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046914 Aug 30 04:15:54.381442 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 996/1920] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:54.434062 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da794da9-544a-42d8-9d40-3499bff7fb8d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.445404 Aug 30 04:15:54.442818 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 925/1921] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Aug 30 04:15:53 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:54.448520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:54.459768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:54.462092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:54.474070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.476388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.477881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.480199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.486121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.487014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.655945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:54.687779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:54.688800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:54.699071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.702698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.703326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.706190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.706648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.707082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.820316 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbbcfd27-37ae-4bff-8855-cd7fc6b2ec36 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.376339 Aug 30 04:15:54.832493 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 997/1922] 10.222.0.27 () {58 vars in 1196 bytes} [Tue Aug 30 04:15:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:54.839639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:54.840867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:54.852906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.855645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.858068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:54.859780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:54.860487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:54.863075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.304935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.306186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.317962 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bcce4ef9-895e-4791-8b63-52a1a146d467 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1524 microversion: 2.1 time: 0.634943 Aug 30 04:15:55.319822 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 926/1923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:54 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1524 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:55.321130 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-043cf5dc-0526-477f-a05f-c74cca27f470 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.485060 Aug 30 04:15:55.322151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 998/1924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:54 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:55.327742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:55.328390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:55.337905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.338457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.338750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:55.338907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.339668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.340475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.340910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.349042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.349758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'name': '1929163796', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:55.360219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.360941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.361593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.362502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.363222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.363822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.524490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:55.630542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf9e418e-1ecd-4be4-972c-53681b405bf5 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?name=1929163796" status: 200 len: 346 microversion: 2.1 time: 0.308884 Aug 30 04:15:55.639963 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 927/1925] 10.222.0.27 () {58 vars in 1156 bytes} [Tue Aug 30 04:15:55 2022] GET /compute/v2.1/servers?name=1929163796 => generated 346 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:55.644984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4e3e9abe-60ea-46a3-bb0c-5d70e23df863 req-f1c31f8f-23b1-4ede-875f-5523ac2b6a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41", "tag": "7bec02e8-c85e-4aeb-8e1b-51c955c6cbdc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:55.664599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4e3e9abe-60ea-46a3-bb0c-5d70e23df863 req-f1c31f8f-23b1-4ede-875f-5523ac2b6a8f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.665448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4e3e9abe-60ea-46a3-bb0c-5d70e23df863 req-f1c31f8f-23b1-4ede-875f-5523ac2b6a8f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.666093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4e3e9abe-60ea-46a3-bb0c-5d70e23df863 req-f1c31f8f-23b1-4ede-875f-5523ac2b6a8f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.673170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:55.686464 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4e3e9abe-60ea-46a3-bb0c-5d70e23df863 req-f1c31f8f-23b1-4ede-875f-5523ac2b6a8f service nova] Creating event network-changed:7bec02e8-c85e-4aeb-8e1b-51c955c6cbdc for instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 on n-h2-854925-5 Aug 30 04:15:55.693606 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4e3e9abe-60ea-46a3-bb0c-5d70e23df863 req-f1c31f8f-23b1-4ede-875f-5523ac2b6a8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052187 Aug 30 04:15:55.694594 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 928/1926] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:55.703102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:55.704213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:55.714878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.717000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.717813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.718738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.720135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.720765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.743550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.755405 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef9d10db-be49-4956-b282-870b2cb0748a tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1316 microversion: 2.1 time: 0.432065 Aug 30 04:15:55.756493 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 999/1927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:55 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:55.763002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:55.768160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.768859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:55.785975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:55.793526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.794005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.795230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.795583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lazy-loading 'fault' on Instance uuid 1feaf5e3-ffa0-4d63-97fa-34a827c83030 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:15:55.818396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.818894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.819353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.821129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:55.821608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:55.824813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:55.903128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c05146c8ea7b425eb8eda0088841dd8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b74886057a041a0afd0d14497424b41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:55.912100 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c65b1ca9-d0ff-409e-9ce4-af8a827b442a tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 200 len: 1301 microversion: 2.1 time: 0.216126 Aug 30 04:15:55.912704 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 929/1928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:55 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 1301 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:55.950995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:56.033582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d71367f4-4db5-4201-9025-c027d161c49e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.274944 Aug 30 04:15:56.034834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1000/1929] 10.222.0.27 () {58 vars in 1154 bytes} [Tue Aug 30 04:15:55 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:56.047192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.052699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:56.053383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-192916379', 'deleted': False, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:15:56.059803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.060392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.060806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.061634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.062089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.062563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.159897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:15:56.232735 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-688b3d7e-6ca2-4ab1-bce5-9dafc9715839 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-192916379" status: 200 len: 346 microversion: 2.1 time: 0.190149 Aug 30 04:15:56.233578 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 930/1930] 10.222.0.27 () {58 vars in 1228 bytes} [Tue Aug 30 04:15:56 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-192916379 => generated 346 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:56.245539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.245952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:56.252505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.252994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.253466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.254221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.254672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.255102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.281088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:56.292404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:56.341049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.342349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:56.349249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.349746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.350543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.351254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.351712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.352142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.375314 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ca5be2f-8446-48b2-a83c-4dae45cba38d tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "DELETE /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 204 len: 0 microversion: 2.1 time: 0.133288 Aug 30 04:15:56.376257 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1001/1931] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:56 2022] DELETE /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:15:56.382070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.382778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:56.389827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.390314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.390751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.391453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.391903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.392323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.568395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:56.576989 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f86da4f7-f857-4d99-b622-032639da3e8e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1524 microversion: 2.1 time: 0.239779 Aug 30 04:15:56.578052 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 931/1932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:56 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1524 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:56.584365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:56.592485 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75b75181-8acc-4fcb-8c2f-a0213c1b6278 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.215247 Aug 30 04:15:56.593151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1002/1933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:56 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:56.593678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.594330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:56.598588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-66cacec0-5d75-4822-8b82-7976beb56dbb req-fb80aaa0-769e-478b-aaa6-b4029ad52900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1feaf5e3-ffa0-4d63-97fa-34a827c83030", "name": "network-vif-deleted", "tag": "800ce387-891d-40d8-84a2-2fa64cc25a42"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:56.600466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.600958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.601456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.602164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.602618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.603377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.611060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-66cacec0-5d75-4822-8b82-7976beb56dbb req-fb80aaa0-769e-478b-aaa6-b4029ad52900 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.611764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-66cacec0-5d75-4822-8b82-7976beb56dbb req-fb80aaa0-769e-478b-aaa6-b4029ad52900 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.612196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-66cacec0-5d75-4822-8b82-7976beb56dbb req-fb80aaa0-769e-478b-aaa6-b4029ad52900 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.623862 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-66cacec0-5d75-4822-8b82-7976beb56dbb req-fb80aaa0-769e-478b-aaa6-b4029ad52900 service nova] Creating event network-vif-deleted:800ce387-891d-40d8-84a2-2fa64cc25a42 for instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 on n-h1-854925-5 Aug 30 04:15:56.628801 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-66cacec0-5d75-4822-8b82-7976beb56dbb req-fb80aaa0-769e-478b-aaa6-b4029ad52900 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033808 Aug 30 04:15:56.629629 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1003/1934] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:15:56.740724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:56.748827 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49f5b6ea-6eac-46b1-9b8c-7b6a33d1dc73 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1518 microversion: 2.1 time: 0.169351 Aug 30 04:15:56.749457 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 932/1935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:56 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1518 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:56.776515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.777251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:56.783760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.784235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.784665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.785373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.785825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.786246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.932807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:56.933674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] [instance: 1feaf5e3-ffa0-4d63-97fa-34a827c83030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:56.941045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.941567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.942001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.942733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:56.943210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:56.943635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:56.946283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:56.955343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fff711cf-09cc-49ad-a145-94218fb14129 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1316 microversion: 2.1 time: 0.182988 Aug 30 04:15:56.956119 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1004/1936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:56 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:56.959360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] HTTP exception thrown: Instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 could not be found. Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Request method failure captured: Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 HTTP/1.1 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY1aAVzSRw7SL-RRBewooCgju_R712_c9rvlIBgPJRl_zOZ6yeOGHI9DBDpJaa7hySZbfdL4m4LSlTlRfR8L0iwyi9CJMHc4EZzC4QarL3wBRVvX2vSselXMGJxXsTD4oaoqencQbyYhq_hIZPT9h9qcNGoCboSD-4q4ydZjC8i8cMk Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7b74886057a041a0afd0d14497424b41", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7b74886057a041a0afd0d14497424b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7b74886057a041a0afd0d14497424b41"}]}] Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7b74886057a041a0afd0d14497424b41 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveMigrationTest-2076061805 Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: c05146c8ea7b425eb8eda0088841dd8a Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveMigrationTest-2076061805-project Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 could not be found. Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1feaf5e3-ffa0-4d63-97fa-34a827c83030'} Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 could not be found. Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 could not be found. Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:15:56.961034 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 could not be found. Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] Returning 404 to user: Instance 1feaf5e3-ffa0-4d63-97fa-34a827c83030 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e11d0f4e-b504-491a-8226-6624b009be35 tempest-LiveMigrationTest-2076061805 tempest-LiveMigrationTest-2076061805-project] 10.222.0.27 "GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030" status: 404 len: 111 microversion: 2.1 time: 0.033814 Aug 30 04:15:56.967431 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 933/1937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:56 2022] GET /compute/v2.1/servers/1feaf5e3-ffa0-4d63-97fa-34a827c83030 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:15:57.601459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:57.602165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:57.612269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.613277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.616114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.618271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.619891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.620587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.625580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:57.626819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:57.636735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.637748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.639167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.640189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.640961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.641609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.862110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:57.872617 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-601821e7-0c52-47e4-b78f-a44c52ad543f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1509 microversion: 2.1 time: 0.276211 Aug 30 04:15:57.874087 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1005/1938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:57 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:57.882201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:57.886713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:57.896303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:57.904581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.905213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.905695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.906614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.907080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.907580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.908927 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-27d2f84f-42e5-4419-89e6-898bf1503bb2 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.295767 Aug 30 04:15:57.915643 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 934/1939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:57 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:57.926193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:57.930916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:57.945586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.946242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.946786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:57.949755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:57.950295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:57.952416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.218419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:58.226288 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d874e33b-d0d3-4d6a-a4c3-0660aec0cf00 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1518 microversion: 2.1 time: 0.350957 Aug 30 04:15:58.226865 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1006/1940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:57 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1518 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:58.231552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:58.232162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:58.241869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.242443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.242946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.243717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.244234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.244724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.249453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:58.258600 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7bf56ca7-9548-413c-9c28-1068197a0a3f tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 200 len: 1509 microversion: 2.1 time: 0.341590 Aug 30 04:15:58.267276 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 935/1941] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:57 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 1509 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:58.279900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:58.280697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:58.287675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.288250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.288930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.289893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.290553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.291199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.296514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:15:58.320985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:15:58.412194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:58.415538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-985a351b-d178-4e01-b841-5f55c11d9548 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 204 len: 0 microversion: 2.1 time: 0.139457 Aug 30 04:15:58.416104 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 936/1942] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:15:58 2022] DELETE /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:15:58.435276 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-849d0a95-43f4-442c-9bb5-ae017d56a4ec tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1316 microversion: 2.1 time: 0.207045 Aug 30 04:15:58.437063 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1007/1943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:58 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:15:58.554221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-953608550", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "1c7da6b7-0398-45be-8c2b-7a646ff291b6"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:15:58.616638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] validate_networks() for [('1c7da6b7-0398-45be-8c2b-7a646ff291b6', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:15:58.938628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:58.941037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:58.955930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.957132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.957868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:58.959235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:58.962605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:58.963401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:59.719750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:15:59.728904 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da379105-d7d6-4ddd-8a66-aeabdf3fb7f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.800627 Aug 30 04:15:59.729538 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1008/1944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:58 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:15:59.739799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:15:59.740421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:15:59.765030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:59.765855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:59.766474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:15:59.767396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:15:59.768055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:15:59.768656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.126677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:16:00.127160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:16:00.127569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:16:00.127989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:16:00.128405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:16:00.145731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.146241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.146687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.147489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.147952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.148386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.199808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Getting quotas for project 67d43f74483f4c5aa5ba8fb5fd14032b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:00.206772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Getting quotas for user 2150ff19d8bf4037a114d9b31edfdc9a and project 67d43f74483f4c5aa5ba8fb5fd14032b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:00.234543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:16:00.237591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:16:00.286891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:00.307931 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-787528a3-bb4f-4364-bc27-6dd2470772c4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1518 microversion: 2.1 time: 0.577072 Aug 30 04:16:00.309218 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1009/1945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:15:59 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1518 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:00.327580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:00.328210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:00.340592 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3bff70b7-a02d-424e-a2c3-7652276ef560 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.791214 Aug 30 04:16:00.343733 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 937/1946] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:15:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:16:00.354043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4a793fb7-8fa0-46c9-bd06-57b24ccb1622 req-22c6bf19-789a-48df-9c8c-13852a87b3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cad0c3-0b03-4d85-b8db-e2984f4516e2", "name": "network-vif-plugged", "status": "completed", "tag": "093576bd-fb47-4205-95cd-8baa48dfcedc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:00.355272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.355784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.362713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.363563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.367703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.368243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.378311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4a793fb7-8fa0-46c9-bd06-57b24ccb1622 req-22c6bf19-789a-48df-9c8c-13852a87b3c2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.381865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4a793fb7-8fa0-46c9-bd06-57b24ccb1622 req-22c6bf19-789a-48df-9c8c-13852a87b3c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.382683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4a793fb7-8fa0-46c9-bd06-57b24ccb1622 req-22c6bf19-789a-48df-9c8c-13852a87b3c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.396546 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4a793fb7-8fa0-46c9-bd06-57b24ccb1622 req-22c6bf19-789a-48df-9c8c-13852a87b3c2 service nova] Creating event network-vif-plugged:093576bd-fb47-4205-95cd-8baa48dfcedc for instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 on n-h2-854925-5 Aug 30 04:16:00.402513 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4a793fb7-8fa0-46c9-bd06-57b24ccb1622 req-22c6bf19-789a-48df-9c8c-13852a87b3c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055397 Aug 30 04:16:00.404014 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 938/1947] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:00.410245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-72072ead-08ec-430e-851d-4458247cb7cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:00.411187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-72072ead-08ec-430e-851d-4458247cb7cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:00.772425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-72072ead-08ec-430e-851d-4458247cb7cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:00.780020 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-72072ead-08ec-430e-851d-4458247cb7cd tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1217 microversion: 2.1 time: 0.374554 Aug 30 04:16:00.796340 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 939/1948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:00 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1217 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:00.804781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:00.806062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:00.815520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.816418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.817115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:00.818090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:00.818724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:00.819333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.636362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:01.638523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:01.646314 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f141eda-b1d3-48e6-9a14-4a94265ce983 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1316 microversion: 2.1 time: 1.335164 Aug 30 04:16:01.647446 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1010/1949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:00 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1316 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:01.649509 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c35bd1df-2386-47e5-a0a4-ca0a4d08a192 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.851439 Aug 30 04:16:01.655341 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 940/1950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:00 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:01.661254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:01.664376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:01.667623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e9e79e40-5369-4f56-85a3-792980d10d51 req-9a13b1cd-da59-4ec6-a9d3-354e63629f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a38e91-4b23-4d55-8d7f-b6dcde51f28a", "name": "network-vif-deleted", "tag": "079c07d9-1e08-40f3-986c-6985d31f55f6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:01.683766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e9e79e40-5369-4f56-85a3-792980d10d51 req-9a13b1cd-da59-4ec6-a9d3-354e63629f1d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.683914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.684247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e9e79e40-5369-4f56-85a3-792980d10d51 req-9a13b1cd-da59-4ec6-a9d3-354e63629f1d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.684883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.685120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e9e79e40-5369-4f56-85a3-792980d10d51 req-9a13b1cd-da59-4ec6-a9d3-354e63629f1d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.686833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.687902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.688597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.689257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.720532 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e9e79e40-5369-4f56-85a3-792980d10d51 req-9a13b1cd-da59-4ec6-a9d3-354e63629f1d service nova] Creating event network-vif-deleted:079c07d9-1e08-40f3-986c-6985d31f55f6 for instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a on n-h2-854925-5 Aug 30 04:16:01.732982 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e9e79e40-5369-4f56-85a3-792980d10d51 req-9a13b1cd-da59-4ec6-a9d3-354e63629f1d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080469 Aug 30 04:16:01.741038 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1011/1951] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:01.749505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0ae47455-de12-46cc-bbb6-96feb2800f1f req-1eb73bb9-621b-49cf-abc7-2869b7ff8d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "423d2eaa-d24e-4ae2-8efa-7e93158ba897", "name": "network-vif-deleted", "tag": "f61e16e2-ebbe-4354-89f6-82c163108ecf"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:01.785892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:01.802389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0ae47455-de12-46cc-bbb6-96feb2800f1f req-1eb73bb9-621b-49cf-abc7-2869b7ff8d5a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.802973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0ae47455-de12-46cc-bbb6-96feb2800f1f req-1eb73bb9-621b-49cf-abc7-2869b7ff8d5a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.804854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0ae47455-de12-46cc-bbb6-96feb2800f1f req-1eb73bb9-621b-49cf-abc7-2869b7ff8d5a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.826642 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0ae47455-de12-46cc-bbb6-96feb2800f1f req-1eb73bb9-621b-49cf-abc7-2869b7ff8d5a service nova] Creating event network-vif-deleted:f61e16e2-ebbe-4354-89f6-82c163108ecf for instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 on n-h1-854925-5 Aug 30 04:16:01.835315 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0ae47455-de12-46cc-bbb6-96feb2800f1f req-1eb73bb9-621b-49cf-abc7-2869b7ff8d5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092537 Aug 30 04:16:01.836828 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1012/1952] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:01.850823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:01.851746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:01.863632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.865840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.866433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.867255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:01.867821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:01.868452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:01.964403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:01.975797 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-54ba763d-7587-4970-8975-52066b21ed72 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1306 microversion: 2.1 time: 0.319046 Aug 30 04:16:01.983389 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 941/1953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:01 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:02.079474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:02.089071 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1e6694af-698e-4e5e-8a9b-8c7421537fc3 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1269 microversion: 2.1 time: 0.250743 Aug 30 04:16:02.090541 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1013/1954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:01 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1269 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:02.437645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d8ab178e-4b03-42b8-879b-7fce760c0837 req-f43f60a3-77cd-454f-a010-2ddac56a1511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41", "name": "network-vif-plugged", "status": "completed", "tag": "7bec02e8-c85e-4aeb-8e1b-51c955c6cbdc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:02.463887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d8ab178e-4b03-42b8-879b-7fce760c0837 req-f43f60a3-77cd-454f-a010-2ddac56a1511 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:02.465585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d8ab178e-4b03-42b8-879b-7fce760c0837 req-f43f60a3-77cd-454f-a010-2ddac56a1511 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:02.467489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d8ab178e-4b03-42b8-879b-7fce760c0837 req-f43f60a3-77cd-454f-a010-2ddac56a1511 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:02.493015 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d8ab178e-4b03-42b8-879b-7fce760c0837 req-f43f60a3-77cd-454f-a010-2ddac56a1511 service nova] Creating event network-vif-plugged:7bec02e8-c85e-4aeb-8e1b-51c955c6cbdc for instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 on n-h2-854925-5 Aug 30 04:16:02.502306 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d8ab178e-4b03-42b8-879b-7fce760c0837 req-f43f60a3-77cd-454f-a010-2ddac56a1511 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068044 Aug 30 04:16:02.503936 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 942/1955] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:02.673455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:02.674180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:02.677245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:02.678131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:02.683075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=16 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:02.703601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:02.707619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:02.708383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:02.710344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:02.712591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:02.713558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:02.714117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:02.715650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:02.716126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:02.717825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:02.719048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:02.720885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:02.953256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:02.961912 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b5b3476d-bdef-4164-aca7-2b5e60c012af tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.292983 Aug 30 04:16:02.969130 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 943/1956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:02 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:03.011501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:03.012173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:03.035132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:03.039468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.040242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.041135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.045344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.046212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.046832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.061417 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad880d4d-429c-45fc-93bb-1f416b2ff371 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1503 microversion: 2.1 time: 0.397195 Aug 30 04:16:03.065768 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1014/1957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:02 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1503 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:03.089499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.090251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.090764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.091470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lazy-loading 'fault' on Instance uuid 423d2eaa-d24e-4ae2-8efa-7e93158ba897 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:03.095148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:03.095859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:03.118366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.122218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.124346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.125466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.126105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.126995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.184124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:03.236153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:03.248563 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19d2e23f-bad9-43c1-9d94-e8fdb8bc6605 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 200 len: 1311 microversion: 2.1 time: 0.246496 Aug 30 04:16:03.261569 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 944/1958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:02 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:03.261569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:03.262673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:03.274521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.278324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.278841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.280164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.280633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.284978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.370200 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8f2e4317-938c-4cdc-bca1-faff8eb65896 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 204 len: 0 microversion: 2.1 time: 0.290112 Aug 30 04:16:03.373480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1015/1959] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:03 2022] DELETE /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:03.384240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:03.384952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:03.392212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.392707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.393268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.394319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:03.394842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:03.395342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:03.424497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:03.434011 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7fae271a-1cb6-4112-89ff-571c3b78b02d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1287 microversion: 2.1 time: 0.181597 Aug 30 04:16:03.434836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 945/1960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:03 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:03.677985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:03.685085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:03.689563 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f79d5d5-ae7f-4719-903f-41b164d23d99 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1509 microversion: 2.1 time: 0.309808 Aug 30 04:16:03.690483 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1016/1961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:03 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1509 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:03.990666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:03.992271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:04.000852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.001376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.002028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.002915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.003551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.004162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.229680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:04.240527 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9f8d0227-1f26-46b8-a181-a658bbe1675f tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1320 microversion: 2.1 time: 0.256229 Aug 30 04:16:04.241664 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 946/1962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:03 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:04.269668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:04.270258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 423d2eaa-d24e-4ae2-8efa-7e93158ba897] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:04.278057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.278750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.279734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.280444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.280900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.281352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.297724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] HTTP exception thrown: Instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 could not be found. Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Request method failure captured: Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 HTTP/1.1 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6m66GDMM0QZLHOP2Y6Twl_XtfrdMAJWVuwUtGcQKDjeH5bIDJbx8UG85SjSzEfrykyNdgjeVgXinUi79UVEvNP3BbnZEHie-3w604GtekNxCxCWiNa9bz3tlVWyf74a3mYLpmvgemSODjxgA-Y1NUTTrqEs1zhE0XAKY9gtoWEMQY Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9e3ec368e5824d159ce139aebfdfbd0a Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e3ec368e5824d159ce139aebfdfbd0a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e3ec368e5824d159ce139aebfdfbd0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3ec368e5824d159ce139aebfdfbd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3ec368e5824d159ce139aebfdfbd0a"}]}] Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9e3ec368e5824d159ce139aebfdfbd0a Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ListServerFiltersTestJSON-1153787108-project Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 75aaab3bc0ea4852844bcc7a25df0806 Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ListServerFiltersTestJSON-1153787108-project Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 could not be found. Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '423d2eaa-d24e-4ae2-8efa-7e93158ba897'} Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 could not be found. Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 could not be found. Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:04.299526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:04.304839 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:04.304839 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:04.304839 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:04.304839 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:04.304839 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:04.304839 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 could not be found. Aug 30 04:16:04.304839 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:04.306184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Returning 404 to user: Instance 423d2eaa-d24e-4ae2-8efa-7e93158ba897 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:04.307232 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc4525a9-2831-4c2f-97a5-4a863cb5e6b4 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897" status: 404 len: 111 microversion: 2.1 time: 0.041671 Aug 30 04:16:04.307818 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1017/1963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:04 2022] GET /compute/v2.1/servers/423d2eaa-d24e-4ae2-8efa-7e93158ba897 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:04.316583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:04.317369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:04.324313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.325085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.325771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.327862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.328542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.329179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.374762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:04.469550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:04.472378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:04.488546 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a04f8f0-803e-4272-9eef-f20ef42761c8 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 204 len: 0 microversion: 2.1 time: 0.175702 Aug 30 04:16:04.490111 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 947/1964] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:04 2022] DELETE /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:04.493958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.495435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.496125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.497088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.497821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.500025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.504533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:04.505260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:04.513393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.514109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.515053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.516281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:04.517056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:04.517533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:04.975757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:04.986758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e2160153-340d-4371-a4b7-0291e781fc7b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.529947 Aug 30 04:16:04.987359 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1018/1965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:04 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:04.992297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:04.993143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:05.000414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.001722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.002337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:05.003236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.003956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.005203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:05.032819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:05.046270 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c8a5234e-4c0e-4613-b4df-469b1d00c822 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 200 len: 1517 microversion: 2.1 time: 0.546785 Aug 30 04:16:05.047030 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 948/1966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:04 2022] GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 1517 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:05.268625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:05.269513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:05.274531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:05.287304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.287948 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1bf05e2b-90b4-4037-bc9b-b735cbf7f0aa tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1509 microversion: 2.1 time: 0.299318 Aug 30 04:16:05.288857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.290008 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1019/1967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:04 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:05.290383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:05.291592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.294361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.296690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:05.844209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:05.863371 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23d18b10-6367-49fd-9780-102b08b0984a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1470 microversion: 2.1 time: 0.604621 Aug 30 04:16:05.867995 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 949/1968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:05 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1470 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:05.895807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:05.896569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:05.900444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:05.926572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.928060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.928623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:05.931486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:05.934760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:05.936512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.009382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:06.010164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:06.016637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lazy-loading 'flavor' on Instance uuid ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:06.028884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.030449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.031345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.032353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.033410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.034717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.202755 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98f66dea-605f-4562-993a-dd21046d83fb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41/action" status: 202 len: 0 microversion: 2.1 time: 0.311757 Aug 30 04:16:06.203942 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1020/1969] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:16:05 2022] POST /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:06.223958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2b0c8d45-2d7f-45ee-9786-46bdfa44f4a9 req-5e9c65e8-58e4-4dbc-9c4c-2b51598faca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcc6b981-302e-4d2f-9168-0ee2ac235302", "tag": "d5075ba3-63f0-4caa-bba9-228c568e6c60"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:06.246492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2b0c8d45-2d7f-45ee-9786-46bdfa44f4a9 req-5e9c65e8-58e4-4dbc-9c4c-2b51598faca1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.246880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2b0c8d45-2d7f-45ee-9786-46bdfa44f4a9 req-5e9c65e8-58e4-4dbc-9c4c-2b51598faca1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.247372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2b0c8d45-2d7f-45ee-9786-46bdfa44f4a9 req-5e9c65e8-58e4-4dbc-9c4c-2b51598faca1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.259844 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2b0c8d45-2d7f-45ee-9786-46bdfa44f4a9 req-5e9c65e8-58e4-4dbc-9c4c-2b51598faca1 service nova] Creating event network-changed:d5075ba3-63f0-4caa-bba9-228c568e6c60 for instance dcc6b981-302e-4d2f-9168-0ee2ac235302 on n-h1-854925-5 Aug 30 04:16:06.265656 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2b0c8d45-2d7f-45ee-9786-46bdfa44f4a9 req-5e9c65e8-58e4-4dbc-9c4c-2b51598faca1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060312 Aug 30 04:16:06.267323 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1021/1970] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:06.272613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:06.273587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:06.303317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.303995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.304732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.306287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.307456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.308052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.433395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:06.442997 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc63f143-931e-43c2-b3da-31e4cd189a4d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.438212 Aug 30 04:16:06.444282 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 950/1971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:06 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:06.449862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:06.450490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:06.457201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.458045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.459068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.459847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.460664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.461396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.666393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:06.677759 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b03b3a6-4914-42ca-8b89-dcfcc65c0b42 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 200 len: 1517 microversion: 2.1 time: 0.408890 Aug 30 04:16:06.690861 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1022/1972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:06 2022] GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 1517 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:06.716120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:06.717155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:06.744872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.745796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.746509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:06.747750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:06.758040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:06.759945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.224235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:07.233435 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77b01640-9ea4-4663-8879-850affb55a8f tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1509 microversion: 2.1 time: 0.540571 Aug 30 04:16:07.236787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5a1d672e-7d27-4de9-87c9-c6c02afff1a6 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1629 microversion: 2.1 time: 0.790938 Aug 30 04:16:07.239834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1023/1973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:06 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1509 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:07.241202 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 951/1974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:06 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1629 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:07.464456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:07.465210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:07.476455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:07.476963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:07.477431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.478180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:07.478642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:07.479090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.681668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-697d1743-260f-4421-8724-c32ef499f6ab req-8f71890c-e5e6-4206-ae9e-f25e585035ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a718e944-7477-4567-9c55-ecb365f95772", "name": "network-vif-deleted", "tag": "d2681412-9815-44a0-9351-385d152e763a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:07.709647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-697d1743-260f-4421-8724-c32ef499f6ab req-8f71890c-e5e6-4206-ae9e-f25e585035ef service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:07.711976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-697d1743-260f-4421-8724-c32ef499f6ab req-8f71890c-e5e6-4206-ae9e-f25e585035ef service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:07.712608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-697d1743-260f-4421-8724-c32ef499f6ab req-8f71890c-e5e6-4206-ae9e-f25e585035ef service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.729754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:07.732236 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-697d1743-260f-4421-8724-c32ef499f6ab req-8f71890c-e5e6-4206-ae9e-f25e585035ef service nova] Creating event network-vif-deleted:d2681412-9815-44a0-9351-385d152e763a for instance a718e944-7477-4567-9c55-ecb365f95772 on n-h2-854925-5 Aug 30 04:16:07.741010 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-697d1743-260f-4421-8724-c32ef499f6ab req-8f71890c-e5e6-4206-ae9e-f25e585035ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063720 Aug 30 04:16:07.748203 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 952/1975] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:07.761038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:07.762381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:07.776812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:07.777860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:07.778550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.795497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:07.797576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:07.801512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:07.897220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:07.938205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-58f585cc-9ac5-425f-8713-e1d95cdd9f2a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.477506 Aug 30 04:16:07.943349 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1024/1976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:07 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:08.030641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:08.076694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c82f37c-ce3d-44c5-bd94-f0bd76a5b9ea tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 200 len: 1306 microversion: 2.1 time: 0.325257 Aug 30 04:16:08.077820 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 953/1977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:07 2022] GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 1306 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:08.147557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:08.153933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:08.169359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Searching by: {'deleted': False, 'project_id': '1be9bdc40f3b453196453d87e60a3f15'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:16:08.176714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.177190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.185810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.188125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.191258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.191945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.260236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:08.261593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:08.274422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:16:08.276541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.277041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.277509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.278223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.278676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.279129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.334794 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2fd0534-50ea-411f-8587-2f710f526aa4 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.191646 Aug 30 04:16:08.335898 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1025/1978] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:16:08 2022] GET /compute/v2.1/servers => generated 340 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:08.340465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:08.341251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:08.347486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.348190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.348797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.349782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.350398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.350992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.386084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.386577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.387011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.387483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lazy-loading 'fault' on Instance uuid 16cad0c3-0b03-4d85-b8db-e2984f4516e2 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:08.509633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c32c1afca4b42cfac0b51bbb86e04dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abbe53e538364506890448ef98f3dc3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:08.519566 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d196516-c898-45d5-bed7-4feb2e8b84db tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 200 len: 1306 microversion: 2.1 time: 0.262797 Aug 30 04:16:08.535689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 954/1979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:08 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 1306 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:08.543393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:08.557988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:08.559338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Searching by: {'deleted': False, 'project_id': '1be9bdc40f3b453196453d87e60a3f15'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:16:08.572400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.579059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.579059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.579059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.579059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.579059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.667719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:16:08.698993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b111ce25-eea8-4e99-80da-5fb65c0e83c3 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1612 microversion: 2.1 time: 0.361761 Aug 30 04:16:08.700358 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1026/1980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:08 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1612 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:08.722611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:08.723819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:08.735272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.736975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.738110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.739078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.739874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.740547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.775262 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] HTTP exception thrown: Cannot 'migrate' instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 while it is in vm_state suspended Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Request method failure captured: Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41/action HTTP/1.1 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 15 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY7c6HQBCQWE8EpAhyTkHXmUwHP8brDi3GFTMou49LxUim_Mqegpm40h1ILB_Hy1wqFWlk9UOiGQynlzot5oubvAUsbhMeQUOsodXgBiUqIMs4wQwxLLteS2qX6pAHAcSGy-nb4Wx55DZAS_k4TNbyenkbx8QpyexGk2x5WNTpvKLes Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_118e02e6c0c248fb8817cdac0cdb70d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}] Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 379e39467c7f4896bd65237831aa8f3b Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: {"migrate": {}} Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'migrate' instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 while it is in vm_state suspended Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41', 'body': {'migrate': {}}} Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 in vm_state suspended. Cannot resize while the instance is in this state. Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:08.778195 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 while it is in vm_state suspended Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 while it is in vm_state suspended Aug 30 04:16:08.784759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.789272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Returning 409 to user: Cannot 'migrate' instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 while it is in vm_state suspended {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:08.790637 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8de8c136-5da6-4822-a528-9e8189c9cec2 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41/action" status: 409 len: 148 microversion: 2.1 time: 0.072246 Aug 30 04:16:08.792774 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1027/1981] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:16:08 2022] POST /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41/action => generated 148 bytes in 75 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:16:08.808625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:08.809641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e973033e-83f3-4b37-807e-252a4a744b4c tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e973033e-83f3-4b37-807e-252a4a744b4c tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Request method failure captured: Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa/action HTTP/1.1 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 39 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY7c6HQBCQWE8EpAhyTkHXmUwHP8brDi3GFTMou49LxUim_Mqegpm40h1ILB_Hy1wqFWlk9UOiGQynlzot5oubvAUsbhMeQUOsodXgBiUqIMs4wQwxLLteS2qX6pAHAcSGy-nb4Wx55DZAS_k4TNbyenkbx8QpyexGk2x5WNTpvKLes Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_118e02e6c0c248fb8817cdac0cdb70d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}] Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 379e39467c7f4896bd65237831aa8f3b Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: {"os-resetState": {"state": "invalid"}} Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'cf3f2b89-a214-46dd-b9f1-d1a4423d26fa', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:16:08.814095 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e973033e-83f3-4b37-807e-252a4a744b4c tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e973033e-83f3-4b37-807e-252a4a744b4c tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa/action" status: 400 len: 144 microversion: 2.1 time: 0.010967 Aug 30 04:16:08.819387 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1028/1982] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:16:08 2022] POST /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa/action => generated 144 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:16:08.823258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.824184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.824798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.828438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a98ceea-8122-4505-9fe2-9ea830a9f165 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a98ceea-8122-4505-9fe2-9ea830a9f165 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Request method failure captured: Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa/action HTTP/1.1 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 31 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY7c6HQBCQWE8EpAhyTkHXmUwHP8brDi3GFTMou49LxUim_Mqegpm40h1ILB_Hy1wqFWlk9UOiGQynlzot5oubvAUsbhMeQUOsodXgBiUqIMs4wQwxLLteS2qX6pAHAcSGy-nb4Wx55DZAS_k4TNbyenkbx8QpyexGk2x5WNTpvKLes Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_118e02e6c0c248fb8817cdac0cdb70d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}] Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 379e39467c7f4896bd65237831aa8f3b Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: {"os-resetState": {"state": 1}} Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'cf3f2b89-a214-46dd-b9f1-d1a4423d26fa', 'body': {'os-resetState': {'state': 1}}} Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 1 Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 04:16:08.835128 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a98ceea-8122-4505-9fe2-9ea830a9f165 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a98ceea-8122-4505-9fe2-9ea830a9f165 tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa/action" status: 400 len: 120 microversion: 2.1 time: 0.013096 Aug 30 04:16:08.840599 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1029/1983] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:16:08 2022] POST /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:16:08.851672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e14b0b1a-9f31-4612-becc-c142f4a994eb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:08.854517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e14b0b1a-9f31-4612-becc-c142f4a994eb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Failed to fetch instance by id 999 {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 04:16:08.855058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e14b0b1a-9f31-4612-becc-c142f4a994eb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e14b0b1a-9f31-4612-becc-c142f4a994eb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Request method failure captured: Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 37 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY7c6HQBCQWE8EpAhyTkHXmUwHP8brDi3GFTMou49LxUim_Mqegpm40h1ILB_Hy1wqFWlk9UOiGQynlzot5oubvAUsbhMeQUOsodXgBiUqIMs4wQwxLLteS2qX6pAHAcSGy-nb4Wx55DZAS_k4TNbyenkbx8QpyexGk2x5WNTpvKLes Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_118e02e6c0c248fb8817cdac0cdb70d5", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/118e02e6c0c248fb8817cdac0cdb70d5"}]}] Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 118e02e6c0c248fb8817cdac0cdb70d5 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1120312330 Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 379e39467c7f4896bd65237831aa8f3b Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1120312330-project-admin Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: {"os-resetState": {"state": "error"}} Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 999 could not be found. Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:08.862611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:08.868510 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:08.868510 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 04:16:08.868510 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:08.868510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e14b0b1a-9f31-4612-becc-c142f4a994eb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:08.868510 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e14b0b1a-9f31-4612-becc-c142f4a994eb tempest-ServersAdminNegativeTestJSON-1120312330 tempest-ServersAdminNegativeTestJSON-1120312330-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.018394 Aug 30 04:16:08.868510 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1030/1984] 10.222.0.27 () {60 vars in 1179 bytes} [Tue Aug 30 04:16:08 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:16:08.883938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:08.884471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:08.892275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.893347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.893473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.895104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:08.896205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:08.897361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:08.978463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:09.072046 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-969483f0-5589-4f0a-ae64-e12838793174 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.534953 Aug 30 04:16:09.072660 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 955/1985] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:16:08 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:09.091208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.092468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.102211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.106140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.106880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.107948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.110040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.111860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.136167 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d63e4c4-bd30-43d2-a2cb-8ce762515d08 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 204 len: 0 microversion: 2.1 time: 0.262237 Aug 30 04:16:09.142399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1031/1986] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:08 2022] DELETE /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:09.148067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77c8cdef-f59a-4c73-8b6d-8ff14036e7d6 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.161447 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77c8cdef-f59a-4c73-8b6d-8ff14036e7d6 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017679 Aug 30 04:16:09.162338 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1032/1987] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:16:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:09.168174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.168902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: a718e944-7477-4567-9c55-ecb365f95772] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.175903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.178172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.178845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.179654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.180445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.180847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.196535 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] HTTP exception thrown: Instance a718e944-7477-4567-9c55-ecb365f95772 could not be found. Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Request method failure captured: Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 HTTP/1.1 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6m66GDMM0QZLHOP2Y6Twl_XtfrdMAJWVuwUtGcQKDjeH5bIDJbx8UG85SjSzEfrykyNdgjeVgXinUi79UVEvNP3BbnZEHie-3w604GtekNxCxCWiNa9bz3tlVWyf74a3mYLpmvgemSODjxgA-Y1NUTTrqEs1zhE0XAKY9gtoWEMQY Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9e3ec368e5824d159ce139aebfdfbd0a Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e3ec368e5824d159ce139aebfdfbd0a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e3ec368e5824d159ce139aebfdfbd0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3ec368e5824d159ce139aebfdfbd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3ec368e5824d159ce139aebfdfbd0a"}]}] Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9e3ec368e5824d159ce139aebfdfbd0a Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ListServerFiltersTestJSON-1153787108-project Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 75aaab3bc0ea4852844bcc7a25df0806 Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ListServerFiltersTestJSON-1153787108-project Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance a718e944-7477-4567-9c55-ecb365f95772 could not be found. Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'a718e944-7477-4567-9c55-ecb365f95772'} Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a718e944-7477-4567-9c55-ecb365f95772 could not be found. Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a718e944-7477-4567-9c55-ecb365f95772 could not be found. Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.198377 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.204343 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.204343 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.204343 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.204343 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.204343 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.204343 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a718e944-7477-4567-9c55-ecb365f95772 could not be found. Aug 30 04:16:09.204343 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.205869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Returning 404 to user: Instance a718e944-7477-4567-9c55-ecb365f95772 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.206736 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-35af34f9-eec3-46b5-ad91-052913b54137 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772" status: 404 len: 111 microversion: 2.1 time: 0.043162 Aug 30 04:16:09.208200 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1033/1988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:09 2022] GET /compute/v2.1/servers/a718e944-7477-4567-9c55-ecb365f95772 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:09.213437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.214292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.221210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.221746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.222205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.222832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.223234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.223668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.328202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:09.338422 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7710e804-6e60-43e0-899e-24c7b63938e8 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.264637 Aug 30 04:16:09.339616 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 956/1989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:09 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:09.346116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.346768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.354128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.355194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.355841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.356625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.357180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.357768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.386878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:09.421198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:09.429198 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d2ee82a-862d-475b-90f1-50d3b64d44d4 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1467 microversion: 2.1 time: 0.219502 Aug 30 04:16:09.431969 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1034/1990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:09 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1467 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:09.488446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23fef8fc-16bf-43b4-a8c4-a0b784b3bd81 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 204 len: 0 microversion: 2.1 time: 0.144425 Aug 30 04:16:09.490371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 957/1991] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:09 2022] DELETE /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:09.499296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.500224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.508702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.509076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.509613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.510361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.510823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.511272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.542129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.542848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.563317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.564096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.564941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.566552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.567195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.567686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.589193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] HTTP exception thrown: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Request method failure captured: Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 HTTP/1.1 Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7uRlGo6rAP4R-XhSBfjJREaR-z2h-bVbCiS4auE_AkuDOLrovJwpPLRg-wq0HQEuX099yo6mxbQ-sYKXhp-MFleuW9EVEWaXpEQW01471zjPH8gAMSeRVnDAjEQ0Q3OwAGBM9FoS5DAB9of6xbC7AY6dvswhncEBegSh01FGqzoBU Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abbe53e538364506890448ef98f3dc3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}] Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7c32c1afca4b42cfac0b51bbb86e04dd Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '16cad0c3-0b03-4d85-b8db-e2984f4516e2'} Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.591561 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.597075 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.597075 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.597075 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.597075 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.597075 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.597075 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.597075 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.602084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Returning 404 to user: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.608513 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7720ee15-7655-4cd3-864c-330508e301fd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 404 len: 111 microversion: 2.1 time: 0.065678 Aug 30 04:16:09.609959 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 958/1992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:09 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:09.619752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1750158637", "metadata": {"image_type": "test"}}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:09.623789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.630779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:09.634315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.635539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.636422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.637516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.638165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.638825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.656733 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] HTTP exception thrown: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Request method failure captured: Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2/action HTTP/1.1 Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 112 Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7uRlGo6rAP4R-XhSBfjJREaR-z2h-bVbCiS4auE_AkuDOLrovJwpPLRg-wq0HQEuX099yo6mxbQ-sYKXhp-MFleuW9EVEWaXpEQW01471zjPH8gAMSeRVnDAjEQ0Q3OwAGBM9FoS5DAB9of6xbC7AY6dvswhncEBegSh01FGqzoBU Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abbe53e538364506890448ef98f3dc3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}] Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7c32c1afca4b42cfac0b51bbb86e04dd Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1750158637", "metadata": {"image_type": "test"}}} Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '16cad0c3-0b03-4d85-b8db-e2984f4516e2', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1750158637', 'metadata': {'image_type': 'test'}}}} Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 04:16:09.659013 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Returning 404 to user: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6cc90f0d-1117-4eb0-93aa-4406ace4d1d1 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "POST /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2/action" status: 404 len: 111 microversion: 2.1 time: 0.046660 Aug 30 04:16:09.664084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 959/1993] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Aug 30 04:16:09 2022] POST /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:09.672923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e5b2bb44-c3bf-4f47-be5d-fe93ddce0556 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2040136607", "metadata": {"image_type": "test"}}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:09.675512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e5b2bb44-c3bf-4f47-be5d-fe93ddce0556 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Failed to fetch instance by id tempest-invalid-1801574536 {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 04:16:09.676251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e5b2bb44-c3bf-4f47-be5d-fe93ddce0556 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] HTTP exception thrown: Instance tempest-invalid-1801574536 could not be found. Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e5b2bb44-c3bf-4f47-be5d-fe93ddce0556 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Request method failure captured: Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/tempest-invalid-1801574536/action HTTP/1.1 Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 112 Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7uRlGo6rAP4R-XhSBfjJREaR-z2h-bVbCiS4auE_AkuDOLrovJwpPLRg-wq0HQEuX099yo6mxbQ-sYKXhp-MFleuW9EVEWaXpEQW01471zjPH8gAMSeRVnDAjEQ0Q3OwAGBM9FoS5DAB9of6xbC7AY6dvswhncEBegSh01FGqzoBU Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abbe53e538364506890448ef98f3dc3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}] Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7c32c1afca4b42cfac0b51bbb86e04dd Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2040136607", "metadata": {"image_type": "test"}}} Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance tempest-invalid-1801574536 could not be found. Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'tempest-invalid-1801574536', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2040136607', 'metadata': {'image_type': 'test'}}}} Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1801574536 could not be found. Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.678027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1801574536 could not be found. Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1801574536 could not be found. Aug 30 04:16:09.682483 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.685286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e5b2bb44-c3bf-4f47-be5d-fe93ddce0556 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Returning 404 to user: Instance tempest-invalid-1801574536 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.686584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e5b2bb44-c3bf-4f47-be5d-fe93ddce0556 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "POST /compute/v2.1/servers/tempest-invalid-1801574536/action" status: 404 len: 101 microversion: 2.1 time: 0.018860 Aug 30 04:16:09.687544 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 960/1994] 10.222.0.27 () {60 vars in 1249 bytes} [Tue Aug 30 04:16:09 2022] POST /compute/v2.1/servers/tempest-invalid-1801574536/action => generated 101 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:16:09.707307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0db23109-892e-49b7-b454-6a20b78348f8 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1972972924"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:09.710561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0db23109-892e-49b7-b454-6a20b78348f8 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 04:16:09.711259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-0db23109-892e-49b7-b454-6a20b78348f8 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0db23109-892e-49b7-b454-6a20b78348f8 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Request method failure captured: Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 57 Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7uRlGo6rAP4R-XhSBfjJREaR-z2h-bVbCiS4auE_AkuDOLrovJwpPLRg-wq0HQEuX099yo6mxbQ-sYKXhp-MFleuW9EVEWaXpEQW01471zjPH8gAMSeRVnDAjEQ0Q3OwAGBM9FoS5DAB9of6xbC7AY6dvswhncEBegSh01FGqzoBU Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abbe53e538364506890448ef98f3dc3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}] Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7c32c1afca4b42cfac0b51bbb86e04dd Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: {"createImage": {"name": "tempest-test-snap-1972972924"}} Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1972972924'}}} Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.714978 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.720944 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.722709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0db23109-892e-49b7-b454-6a20b78348f8 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.723915 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0db23109-892e-49b7-b454-6a20b78348f8 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.029107 Aug 30 04:16:09.724695 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 961/1995] 10.222.0.27 () {60 vars in 1275 bytes} [Tue Aug 30 04:16:09 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:09.736253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9221c87f-5e8f-4303-84ac-a4833ef82ccd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2139694332"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:09.741263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9221c87f-5e8f-4303-84ac-a4833ef82ccd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 04:16:09.741894 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-9221c87f-5e8f-4303-84ac-a4833ef82ccd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9221c87f-5e8f-4303-84ac-a4833ef82ccd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Request method failure captured: Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 57 Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7uRlGo6rAP4R-XhSBfjJREaR-z2h-bVbCiS4auE_AkuDOLrovJwpPLRg-wq0HQEuX099yo6mxbQ-sYKXhp-MFleuW9EVEWaXpEQW01471zjPH8gAMSeRVnDAjEQ0Q3OwAGBM9FoS5DAB9of6xbC7AY6dvswhncEBegSh01FGqzoBU Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abbe53e538364506890448ef98f3dc3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}] Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7c32c1afca4b42cfac0b51bbb86e04dd Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: {"createImage": {"name": "tempest-test-snap-2139694332"}} Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2139694332'}}} Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.743855 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.749427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9221c87f-5e8f-4303-84ac-a4833ef82ccd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.750760 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9221c87f-5e8f-4303-84ac-a4833ef82ccd tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.017701 Aug 30 04:16:09.751556 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 962/1996] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Aug 30 04:16:09 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:09.761173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.762218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.773534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.775073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.776056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.776980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.777653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.778191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.779343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:09.789464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d17b02f9-7a13-4e19-b2ca-0a6d9b1607e1 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1517 microversion: 2.1 time: 0.294948 Aug 30 04:16:09.790526 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1035/1997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:09 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1517 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:09.799397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c9f38a41-77d0-478f-b23c-7f4b5bdd5050 req-99174a6e-45a1-498b-95c1-a26af26f109f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16cad0c3-0b03-4d85-b8db-e2984f4516e2", "name": "network-vif-deleted", "tag": "093576bd-fb47-4205-95cd-8baa48dfcedc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:09.803823 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] HTTP exception thrown: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Request method failure captured: Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 HTTP/1.1 Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7uRlGo6rAP4R-XhSBfjJREaR-z2h-bVbCiS4auE_AkuDOLrovJwpPLRg-wq0HQEuX099yo6mxbQ-sYKXhp-MFleuW9EVEWaXpEQW01471zjPH8gAMSeRVnDAjEQ0Q3OwAGBM9FoS5DAB9of6xbC7AY6dvswhncEBegSh01FGqzoBU Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abbe53e538364506890448ef98f3dc3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}] Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7c32c1afca4b42cfac0b51bbb86e04dd Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '16cad0c3-0b03-4d85-b8db-e2984f4516e2'} Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.805754 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.810196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.812334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9f38a41-77d0-478f-b23c-7f4b5bdd5050 req-99174a6e-45a1-498b-95c1-a26af26f109f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.812992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9f38a41-77d0-478f-b23c-7f4b5bdd5050 req-99174a6e-45a1-498b-95c1-a26af26f109f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.813552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9f38a41-77d0-478f-b23c-7f4b5bdd5050 req-99174a6e-45a1-498b-95c1-a26af26f109f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.814710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Returning 404 to user: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.815664 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e994c386-86fa-4db6-973b-525d086c617d tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 404 len: 111 microversion: 2.1 time: 0.059306 Aug 30 04:16:09.817606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:09.818093 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 963/1998] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:09 2022] DELETE /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:16:09.830693 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c9f38a41-77d0-478f-b23c-7f4b5bdd5050 req-99174a6e-45a1-498b-95c1-a26af26f109f service nova] Creating event network-vif-deleted:093576bd-fb47-4205-95cd-8baa48dfcedc for instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 on n-h2-854925-5 Aug 30 04:16:09.832282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:09.833216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] [instance: 16cad0c3-0b03-4d85-b8db-e2984f4516e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:09.836827 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c9f38a41-77d0-478f-b23c-7f4b5bdd5050 req-99174a6e-45a1-498b-95c1-a26af26f109f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041853 Aug 30 04:16:09.837448 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1036/1999] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:09.841858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.843099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.843571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.844278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:09.845148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:09.845782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:09.863656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] HTTP exception thrown: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Request method failure captured: Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 HTTP/1.1 Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY7uRlGo6rAP4R-XhSBfjJREaR-z2h-bVbCiS4auE_AkuDOLrovJwpPLRg-wq0HQEuX099yo6mxbQ-sYKXhp-MFleuW9EVEWaXpEQW01471zjPH8gAMSeRVnDAjEQ0Q3OwAGBM9FoS5DAB9of6xbC7AY6dvswhncEBegSh01FGqzoBU Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_abbe53e538364506890448ef98f3dc3d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/abbe53e538364506890448ef98f3dc3d"}]}] Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: abbe53e538364506890448ef98f3dc3d Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1949834157 Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 7c32c1afca4b42cfac0b51bbb86e04dd Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesNegativeTestJSON-1949834157-project Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '16cad0c3-0b03-4d85-b8db-e2984f4516e2'} Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:09.865614 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] Returning 404 to user: Instance 16cad0c3-0b03-4d85-b8db-e2984f4516e2 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b16042ff-8ead-4b95-afbb-79033ad5cf30 tempest-ImagesNegativeTestJSON-1949834157 tempest-ImagesNegativeTestJSON-1949834157-project] 10.222.0.27 "GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2" status: 404 len: 111 microversion: 2.1 time: 0.044513 Aug 30 04:16:09.871957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 964/2000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:09 2022] GET /compute/v2.1/servers/16cad0c3-0b03-4d85-b8db-e2984f4516e2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:10.084229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:10.084761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:10.092422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.093189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.093662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.094419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.094948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.095381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.121694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:10.225171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46c25ab0-3230-4590-9c4d-d4edd03a2f34 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 204 len: 0 microversion: 2.1 time: 0.145037 Aug 30 04:16:10.226558 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1037/2001] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:10 2022] DELETE /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:10.235084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:10.236038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:10.243851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.244442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.245050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.245907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.246570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.249185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.368201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:10.369482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:10.377787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.378290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.379136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.379962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.380432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.381006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.427859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:10.438637 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d54a9f30-747d-445a-92ff-b9f60084c54d tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1715 microversion: 2.1 time: 0.208001 Aug 30 04:16:10.439812 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 965/2002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:10 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1715 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:10.453908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:10.454564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:10.462885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.463801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.464820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.465894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.466555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.467902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.667729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:10.678694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f493a6aa-2bfb-409a-9535-a5c27890fd00 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1467 microversion: 2.1 time: 0.229651 Aug 30 04:16:10.689030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:10.693526 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 966/2003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:10 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1467 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:10.701541 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f8a12c4c-14da-4e6d-9761-f0d5f03a38d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.344725 Aug 30 04:16:10.703635 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1038/2004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:10 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:10.812069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:10.812693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:10.819497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.823450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.824300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:10.826167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:10.827757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:10.828853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.088066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:11.107272 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-565c2df0-b496-480c-ad58-9ad649d8256f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1517 microversion: 2.1 time: 0.298034 Aug 30 04:16:11.108802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 967/2005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:10 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1517 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:11.463858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:11.464480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:11.480002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.484781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.485484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.486401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.487022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.487690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.704898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:11.709169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:11.730560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.733556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.734464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.737782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.738683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.739197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.810297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:11.824888 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19d99ef0-a41a-4351-bbea-b914ed8642b7 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1715 microversion: 2.1 time: 0.367709 Aug 30 04:16:11.838769 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1039/2006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:11 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1715 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:11.838769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:11.838769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:11.876470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.879813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.881131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:11.885735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:11.890161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:11.894891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:12.210490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:12.223741 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dfa5747e-97de-4bbd-90f4-b1ec10dd5456 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1467 microversion: 2.1 time: 0.522795 Aug 30 04:16:12.226882 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 968/2007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:11 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1467 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:12.254758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:12.255577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:12.262717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:12.263400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:12.264556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:12.265675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:12.266298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:12.267028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:12.270467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:12.278926 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0261cb17-f25a-4f2b-9faa-b73d05cf830e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.451634 Aug 30 04:16:12.286627 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1040/2008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:11 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:12.643738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:12.655549 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0688500b-1737-4f1d-9d3c-d7d885afadb7 tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1517 microversion: 2.1 time: 0.423141 Aug 30 04:16:12.670856 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 969/2009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:12 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1517 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:12.847038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:12.848420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:12.856327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1503345940", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:12.861790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:12.862516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:12.863754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:12.865108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:12.865755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:12.866343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:12.955252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:16:13.156664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:13.180869 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49b0ed55-f112-40cf-a2d6-0f47774caaa2 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1715 microversion: 2.1 time: 0.337544 Aug 30 04:16:13.186656 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 970/2010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:12 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1715 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:13.256298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:13.257502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:13.267500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.268306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.269025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.270670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.271519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.271652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:16:13.272017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:16:13.272601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.273088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:16:13.274305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:16:13.274735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:16:13.287725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.288424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.289124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.290112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.290802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.291496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.319044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Getting quotas for project 88ebede3b3a747d8bbad3dd1af8da400. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:13.327066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Getting quotas for user 05535ec48e11452eb2e49f89e0f2ba26 and project 88ebede3b3a747d8bbad3dd1af8da400. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:13.362786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:16:13.366071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:16:13.468719 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7d0dd35-291d-4a44-bc85-c90d822682be tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.868398 Aug 30 04:16:13.476886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1041/2011] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:16:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:16:13.486085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:13.498609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:13.513318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.513883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.514319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.515033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.515589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.516024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.531663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:13.540859 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ca4f1d0-d85e-4ae9-b533-b5e83e2c89f8 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1467 microversion: 2.1 time: 0.290404 Aug 30 04:16:13.558163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 971/2012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:13 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1467 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:13.582132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d72e6037-e80d-420b-97dc-41d16076177a tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:13.584435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d72e6037-e80d-420b-97dc-41d16076177a tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:13.720835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d72e6037-e80d-420b-97dc-41d16076177a tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:13.728205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d72e6037-e80d-420b-97dc-41d16076177a tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1219 microversion: 2.1 time: 0.168402 Aug 30 04:16:13.728783 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 972/2013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:13 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:13.738156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-84b6ae5e-d596-4053-ba55-1d3d9839da52 req-733897bc-db42-49b6-baad-06430051ccfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc6b981-302e-4d2f-9168-0ee2ac235302", "name": "network-vif-plugged", "status": "completed", "tag": "d5075ba3-63f0-4caa-bba9-228c568e6c60"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:13.760619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-84b6ae5e-d596-4053-ba55-1d3d9839da52 req-733897bc-db42-49b6-baad-06430051ccfa service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.761111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-84b6ae5e-d596-4053-ba55-1d3d9839da52 req-733897bc-db42-49b6-baad-06430051ccfa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.761583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-84b6ae5e-d596-4053-ba55-1d3d9839da52 req-733897bc-db42-49b6-baad-06430051ccfa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.789205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-84b6ae5e-d596-4053-ba55-1d3d9839da52 req-733897bc-db42-49b6-baad-06430051ccfa service nova] Creating event network-vif-plugged:d5075ba3-63f0-4caa-bba9-228c568e6c60 for instance dcc6b981-302e-4d2f-9168-0ee2ac235302 on n-h1-854925-5 Aug 30 04:16:13.795506 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-84b6ae5e-d596-4053-ba55-1d3d9839da52 req-733897bc-db42-49b6-baad-06430051ccfa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060032 Aug 30 04:16:13.796390 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 973/2014] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:13.810226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:13.811023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:13.818980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.819475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.819901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.820609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:13.821149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:13.821813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:13.827131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:13.845693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:13.857635 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a0bdb5e0-a403-4bf2-bb1e-68c96eb2bd17 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.379104 Aug 30 04:16:13.859570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1042/2015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:13 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:14.101001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:14.110671 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-37e017a4-f3f4-4c99-9687-fff5633badab tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1517 microversion: 2.1 time: 0.312898 Aug 30 04:16:14.112043 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 974/2016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:13 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:14.207306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:14.207920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:14.216093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.217141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.217873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.218785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.219411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.220003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.399808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:14.421993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71fd1e23-5b18-4fec-8e6f-e622cfcf9f74 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1715 microversion: 2.1 time: 0.219342 Aug 30 04:16:14.422595 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1043/2017] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:14 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1715 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:14.570841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:14.572889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:14.589179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.590031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1c336feb-6277-455d-97ed-67513ac66945 req-1d7da89f-b162-4635-bdcc-6ae3771a91c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41", "name": "network-vif-deleted", "tag": "7bec02e8-c85e-4aeb-8e1b-51c955c6cbdc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:14.592680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.593551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.595820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.599077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.599842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.636174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c336feb-6277-455d-97ed-67513ac66945 req-1d7da89f-b162-4635-bdcc-6ae3771a91c0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.637476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c336feb-6277-455d-97ed-67513ac66945 req-1d7da89f-b162-4635-bdcc-6ae3771a91c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.641364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c336feb-6277-455d-97ed-67513ac66945 req-1d7da89f-b162-4635-bdcc-6ae3771a91c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.668183 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1c336feb-6277-455d-97ed-67513ac66945 req-1d7da89f-b162-4635-bdcc-6ae3771a91c0 service nova] Creating event network-vif-deleted:7bec02e8-c85e-4aeb-8e1b-51c955c6cbdc for instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 on n-h2-854925-5 Aug 30 04:16:14.701221 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1c336feb-6277-455d-97ed-67513ac66945 req-1d7da89f-b162-4635-bdcc-6ae3771a91c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119958 Aug 30 04:16:14.706064 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1044/2018] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:14.752149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:14.754808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:14.784270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.785340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.786148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.787161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.787976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.794146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.814963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:14.825506 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dea4ce0c-f428-4122-970d-d2a7ece0c9a0 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 200 len: 1425 microversion: 2.1 time: 0.259966 Aug 30 04:16:14.828884 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 975/2019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:14 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 1425 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:14.887004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:14.887634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:14.913139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.913669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.914115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.915304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:14.915304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:14.915710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:14.928354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:14.940770 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ac0d298f-5e94-490f-829d-d04cc462d71f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1271 microversion: 2.1 time: 0.194427 Aug 30 04:16:14.953689 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1045/2020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:14 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1271 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:15.132435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:15.134078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:15.146974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.147875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.150275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.151743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.152449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.153961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.192464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:15.207101 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-473b577e-bdd9-4f00-ace7-66ec4b0c87ae tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1317 microversion: 2.1 time: 0.326791 Aug 30 04:16:15.208753 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 976/2021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:14 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:15.289096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:15.300226 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4d57a939-af19-4017-ac67-f6fea2e3f85e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1475 microversion: 2.1 time: 0.171272 Aug 30 04:16:15.300829 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1046/2022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:15 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1475 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:15.454227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:15.455067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:15.465827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.466337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.468404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.470479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.471284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.471991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.609439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6b8ed305851465eb1f760599aca06c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be9bdc40f3b453196453d87e60a3f15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:15.624669 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dd4c5c9-33fa-4ca0-ae76-0e2a71842515 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 200 len: 1648 microversion: 2.1 time: 0.182249 Aug 30 04:16:15.626748 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 977/2023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:15 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 1648 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:15.849798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:15.850747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:15.859283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.860559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.861504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.862916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.864408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.865591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.905025 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] HTTP exception thrown: Instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 could not be found. Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Request method failure captured: Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 HTTP/1.1 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY7b-QbHiOWuB45JrfOf0I9g4ehOw6-fOjEprhZlEF1DG2oaG9rLSIGRkNZPFeeThbmiE0MnebLWVYo2K2FpZEOJNAHYJCOc9EkB0u-2ckVO6_9I4R2Yir8L1sgx9uWlnjahmlhL606ar7qnoaI1xQGB9M5GcMjUHH9hNrqSYKmXAwo Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 2b147756fd804257ab691af94f13d385 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1893816924 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b147756fd804257ab691af94f13d385", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b147756fd804257ab691af94f13d385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b147756fd804257ab691af94f13d385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b147756fd804257ab691af94f13d385"}]}] Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1893816924 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 2b147756fd804257ab691af94f13d385 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1893816924 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAdminNegativeTestJSON-1893816924-project Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 676aac43a8ef4e24b87f7067efd1fca7 Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1893816924-project Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 could not be found. Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41'} Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 could not be found. Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 could not be found. Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:15.915318 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 could not be found. Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:15.920938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Returning 404 to user: Instance ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:15.922872 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cdb1ad0b-c83d-4d22-962e-47c3faff7bee tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41" status: 404 len: 111 microversion: 2.1 time: 0.075231 Aug 30 04:16:15.922872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1047/2024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:15 2022] GET /compute/v2.1/servers/ab7cc35d-6fcd-4ecc-87fc-4add2a8eef41 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:16:15.930671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:15.931390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:15.946062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.947275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.948301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.949938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.950595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.952402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.965611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:15.966980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:15.983383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.984238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.985091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:15.986219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:15.986938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:15.993576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.054508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:16.146747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:16.165214 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51397c52-16c4-4851-8a1d-7c3daa067a4d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1277 microversion: 2.1 time: 0.203581 Aug 30 04:16:16.168038 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1048/2025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:15 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:16.236917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:16.238085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:16.249835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:16.267181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.268192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.269769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.273066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.276131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.278960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.401121 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5832674f-4439-4c58-9ce8-60aed117ecdf tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 204 len: 0 microversion: 2.1 time: 0.474174 Aug 30 04:16:16.403103 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 978/2026] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:15 2022] DELETE /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:16.416899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:16.418473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:16.443738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.445770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.446539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.447558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.448266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.449090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.490641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.491765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.492445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.493173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lazy-loading 'fault' on Instance uuid 7622a31b-95c0-4360-b9b9-7237c084514e {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:16.740795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:16.750307 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b25454a0-fa40-43ff-878f-da86223c944e tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1311 microversion: 2.1 time: 0.345848 Aug 30 04:16:16.754084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 979/2027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:16 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1311 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:16.770571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:16.771539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:16.784357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.787873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.788484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:16.789489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:16.790344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:16.791044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.032745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:17.043112 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-358ffac2-c69e-4ea6-a2a6-009962f223d4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1507 microversion: 2.1 time: 0.814834 Aug 30 04:16:17.057761 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1049/2028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:16 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1507 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:17.065417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:17.066308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] [instance: e3a8d905-5efe-4c5f-a9b1-5139d12a11d4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:17.073226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.073963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.074597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.075298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.075974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.076563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.092422 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] HTTP exception thrown: Instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 could not be found. Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Request method failure captured: Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 HTTP/1.1 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY7KPMDW1barBZeLXTRSNgKhaCX3oUYMf_pCAsZY2mU8c2Ch_1dSwK7o2zPCasAivxs1sj-ddxhqu8VBUAoH8XZLIfDLxo_x77cyGn_i6Uw8hDIBFI_hPbIDWT3gIA5dXGTVKlZQLU4cuj85IsbAeKEtlEpRxe3WRSqkSNvItc3k_60 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 1be9bdc40f3b453196453d87e60a3f15 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestManualDisk-96739109 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1be9bdc40f3b453196453d87e60a3f15", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1be9bdc40f3b453196453d87e60a3f15"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1be9bdc40f3b453196453d87e60a3f15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1be9bdc40f3b453196453d87e60a3f15"}]}] Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestManualDisk-96739109 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 1be9bdc40f3b453196453d87e60a3f15 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestManualDisk-96739109 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestManualDisk-96739109-project Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: f6b8ed305851465eb1f760599aca06c7 Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestManualDisk-96739109-project Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 could not be found. Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'e3a8d905-5efe-4c5f-a9b1-5139d12a11d4'} Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 could not be found. Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 could not be found. Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:17.094030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:17.099638 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:17.099638 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:17.099638 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:17.099638 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:17.099638 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:17.099638 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 could not be found. Aug 30 04:16:17.099638 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:17.101297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Returning 404 to user: Instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:17.102201 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c787111-1eed-4d01-ac44-772659221c43 tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4" status: 404 len: 111 microversion: 2.1 time: 0.043126 Aug 30 04:16:17.103136 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1050/2029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:17 2022] GET /compute/v2.1/servers/e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:17.108060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f71a4767-e6fb-42b1-a1eb-35704db72f45 req-e069fca1-7cd7-4531-bcd7-e73ab54de6c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7622a31b-95c0-4360-b9b9-7237c084514e", "name": "network-vif-deleted", "tag": "f7ea778a-6721-4820-a88f-1cec1b8b6e38"}, {"server_uuid": "e3a8d905-5efe-4c5f-a9b1-5139d12a11d4", "name": "network-vif-deleted", "tag": "45cc2dd0-0d8f-4d67-8d20-69dbb253ee54"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:17.121362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f71a4767-e6fb-42b1-a1eb-35704db72f45 req-e069fca1-7cd7-4531-bcd7-e73ab54de6c0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.121877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f71a4767-e6fb-42b1-a1eb-35704db72f45 req-e069fca1-7cd7-4531-bcd7-e73ab54de6c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.122583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f71a4767-e6fb-42b1-a1eb-35704db72f45 req-e069fca1-7cd7-4531-bcd7-e73ab54de6c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.141008 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f71a4767-e6fb-42b1-a1eb-35704db72f45 req-e069fca1-7cd7-4531-bcd7-e73ab54de6c0 service nova] Creating event network-vif-deleted:f7ea778a-6721-4820-a88f-1cec1b8b6e38 for instance 7622a31b-95c0-4360-b9b9-7237c084514e on n-h1-854925-5 Aug 30 04:16:17.141908 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f71a4767-e6fb-42b1-a1eb-35704db72f45 req-e069fca1-7cd7-4531-bcd7-e73ab54de6c0 service nova] Creating event network-vif-deleted:45cc2dd0-0d8f-4d67-8d20-69dbb253ee54 for instance e3a8d905-5efe-4c5f-a9b1-5139d12a11d4 on n-h2-854925-5 Aug 30 04:16:17.152301 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f71a4767-e6fb-42b1-a1eb-35704db72f45 req-e069fca1-7cd7-4531-bcd7-e73ab54de6c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047932 Aug 30 04:16:17.153178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1051/2030] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:17.159655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:17.161223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:17.170529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.171548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.171900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.172985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.173805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.174398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.413041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:17.426828 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-165f26ea-6dc6-4043-ab1a-a5308d5e7485 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1477 microversion: 2.1 time: 0.671096 Aug 30 04:16:17.427913 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 980/2031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:16 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1477 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:17.433227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-418e33ba-7621-4033-a943-0f87d733eb4a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] Calling method '.version_select at 0x7fe96a597670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:17.463297 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-418e33ba-7621-4033-a943-0f87d733eb4a tempest-ServersTestManualDisk-96739109 tempest-ServersTestManualDisk-96739109-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675104812" status: 202 len: 0 microversion: 2.1 time: 0.033781 Aug 30 04:16:17.465280 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 981/2032] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:16:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675104812 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:17.472207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:17.475030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:17.484916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.486231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.487463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.488529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.489248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.489932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.567628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:17.584467 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c02625f-1a05-4731-9ac1-4874a7ce78b7 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1507 microversion: 2.1 time: 0.429622 Aug 30 04:16:17.586203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1052/2033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:17 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1507 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:17.626279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:17.637053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:17.646422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.647605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.648227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.649469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.650805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.651835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.753402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5f9dbb1-26fa-473e-bc32-8e7ab5ef9c7e tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "PUT /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1079 microversion: 2.1 time: 0.150953 Aug 30 04:16:17.768240 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1053/2034] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:16:17 2022] PUT /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1079 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:17.781077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:17.781761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:17.790417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.792000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.793278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.794231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:17.794957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:17.795569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:17.825485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.204416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:18.218216 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c575982-8d2e-407f-ae41-253cb34eafdd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.751468 Aug 30 04:16:18.219598 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 982/2035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:17 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:18.235871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:18.237097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:18.250958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.251535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.252078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.253086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.253699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.254776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.294051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.295364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.295981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.296431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lazy-loading 'fault' on Instance uuid 7622a31b-95c0-4360-b9b9-7237c084514e {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:18.305770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:18.315903 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-69e6ed7d-0617-4cb0-bfb3-8f16dbcc9f78 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1505 microversion: 2.1 time: 0.546317 Aug 30 04:16:18.321055 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1054/2036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:17 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:18.338194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:18.339517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:18.347262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.347746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.348185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.349250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.349730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.350160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.368620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75aaab3bc0ea4852844bcc7a25df0806', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3ec368e5824d159ce139aebfdfbd0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:18.390677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c1c29b3-00f3-47d8-9b5b-f0b04503f0be tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 200 len: 1311 microversion: 2.1 time: 0.170004 Aug 30 04:16:18.391281 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 983/2037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:18 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 1311 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:18.452757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:18.453451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:18.469603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.470131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.470572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.471353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.471806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.472229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.586395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=16 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:18.763609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:18.776529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d7e59fb-7659-4d28-a4b7-93f396f0c367 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1505 microversion: 2.1 time: 0.439846 Aug 30 04:16:18.777462 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1055/2038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:18 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:18.797875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:18.799920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:18.813786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.814282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.814723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.817599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.818196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.818978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.912090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:18.915047 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2878948c-439c-46e0-aaf0-75dbd0c4b310 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "PUT /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1081 microversion: 2.1 time: 0.121452 Aug 30 04:16:18.915687 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1056/2039] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:16:18 2022] PUT /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1081 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:18.936467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c42c8a1-3e19-4cf6-a942-31b94d113e94 tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1477 microversion: 2.1 time: 0.488175 Aug 30 04:16:18.939814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:18.940836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:18.948303 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 984/2040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:18 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1477 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:18.950185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.952123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.952518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:18.953268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:18.953922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:18.954402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.179810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f00b7172-27cc-4521-89e8-f7450323c877 req-38bdba2a-273c-4522-8e78-bba2faf72203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1266aec0-b13b-4966-8aad-d413ab5a0680", "tag": "b1ef5778-36da-4620-8cc1-fc63985beadf"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:19.202265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f00b7172-27cc-4521-89e8-f7450323c877 req-38bdba2a-273c-4522-8e78-bba2faf72203 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.202871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f00b7172-27cc-4521-89e8-f7450323c877 req-38bdba2a-273c-4522-8e78-bba2faf72203 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.203397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f00b7172-27cc-4521-89e8-f7450323c877 req-38bdba2a-273c-4522-8e78-bba2faf72203 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.234921 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f00b7172-27cc-4521-89e8-f7450323c877 req-38bdba2a-273c-4522-8e78-bba2faf72203 service nova] Creating event network-changed:b1ef5778-36da-4620-8cc1-fc63985beadf for instance 1266aec0-b13b-4966-8aad-d413ab5a0680 on n-h2-854925-5 Aug 30 04:16:19.240570 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f00b7172-27cc-4521-89e8-f7450323c877 req-38bdba2a-273c-4522-8e78-bba2faf72203 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064573 Aug 30 04:16:19.241624 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 985/2041] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:16:19.246886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:19.253059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:19.267792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:19.268927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.269712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.270370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.272552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.274835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.276720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.281589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8f6335fd-9bf7-49dc-81b7-83c3c2d444da tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1507 microversion: 2.1 time: 0.346381 Aug 30 04:16:19.283057 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1057/2042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:18 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1507 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:19.308762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:19.309306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:19.321337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.323004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.323739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.325506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.326005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.326717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.700189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:19.708322 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc9a4ab1-e288-47c8-a693-bc09263977f4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1507 microversion: 2.1 time: 0.404197 Aug 30 04:16:19.712994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1058/2043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:19 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:19.720743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:19.727856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] [instance: 7622a31b-95c0-4360-b9b9-7237c084514e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:19.742650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.743481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.744116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.745015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.746801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.749033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.768056 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] HTTP exception thrown: Instance 7622a31b-95c0-4360-b9b9-7237c084514e could not be found. Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Request method failure captured: Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e HTTP/1.1 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY6m66GDMM0QZLHOP2Y6Twl_XtfrdMAJWVuwUtGcQKDjeH5bIDJbx8UG85SjSzEfrykyNdgjeVgXinUi79UVEvNP3BbnZEHie-3w604GtekNxCxCWiNa9bz3tlVWyf74a3mYLpmvgemSODjxgA-Y1NUTTrqEs1zhE0XAKY9gtoWEMQY Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9e3ec368e5824d159ce139aebfdfbd0a Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9e3ec368e5824d159ce139aebfdfbd0a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9e3ec368e5824d159ce139aebfdfbd0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3ec368e5824d159ce139aebfdfbd0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9e3ec368e5824d159ce139aebfdfbd0a"}]}] Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9e3ec368e5824d159ce139aebfdfbd0a Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1153787108 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ListServerFiltersTestJSON-1153787108-project Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 75aaab3bc0ea4852844bcc7a25df0806 Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ListServerFiltersTestJSON-1153787108-project Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7622a31b-95c0-4360-b9b9-7237c084514e could not be found. Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7622a31b-95c0-4360-b9b9-7237c084514e'} Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7622a31b-95c0-4360-b9b9-7237c084514e could not be found. Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7622a31b-95c0-4360-b9b9-7237c084514e could not be found. Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:19.770733 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:19.775380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:19.775380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:19.775380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:19.775380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:19.775380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:19.775380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7622a31b-95c0-4360-b9b9-7237c084514e could not be found. Aug 30 04:16:19.775380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:19.778165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] Returning 404 to user: Instance 7622a31b-95c0-4360-b9b9-7237c084514e could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:19.779513 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7366a9bf-c041-41e5-ac1a-c058b7a8d43f tempest-ListServerFiltersTestJSON-1153787108 tempest-ListServerFiltersTestJSON-1153787108-project] 10.222.0.27 "GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e" status: 404 len: 111 microversion: 2.1 time: 0.065425 Aug 30 04:16:19.780798 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1059/2044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:19 2022] GET /compute/v2.1/servers/7622a31b-95c0-4360-b9b9-7237c084514e => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:19.788808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:19.789618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:19.797550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.798347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.799021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.799934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.800719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.801435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.840085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:19.861138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:19.876126 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-46371e3d-4ec5-4b6b-8c13-b90ae4bbf59d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.633040 Aug 30 04:16:19.876927 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 986/2045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:19 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:19.959807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:19.960691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:19.971883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.972607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.973245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:19.976507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:19.977352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:19.978308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.023497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a563da78-211e-4e45-bdce-09b47be22540 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 204 len: 0 microversion: 2.1 time: 0.240778 Aug 30 04:16:20.024096 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1060/2046] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:19 2022] DELETE /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:20.047419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:20.049713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:20.064825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.065388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.066018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.067540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.068009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.068444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.102222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:16:20.193368 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.compute.api [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Instance is already in deleting state, ignoring this request Aug 30 04:16:20.194337 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7d6c414-11c0-4608-9d45-ad3edeb10241 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 204 len: 0 microversion: 2.1 time: 0.157725 Aug 30 04:16:20.197810 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1061/2047] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:20 2022] DELETE /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:16:20.204637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:20.204808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:20.211428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.211920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.215955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.215955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.215955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.215955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.407991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:20.424505 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ac04fbd-4429-4d8e-b3d7-2dcbb7d465dc tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1477 microversion: 2.1 time: 0.468745 Aug 30 04:16:20.425282 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 987/2048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:19 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1477 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:20.521081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:20.542392 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc5ae76e-bbf0-4140-9738-dd7f22aeec9b tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1513 microversion: 2.1 time: 0.342873 Aug 30 04:16:20.543130 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1062/2049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:20 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1513 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:20.919425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:20.920919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:20.937659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.946270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.946568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:20.947331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:20.947812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:20.948224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:21.109926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dde846e2-bd69-45b4-8cf4-68925cc24a0f tempest-ListImageFiltersNegativeTestJSON-1591849248 tempest-ListImageFiltersNegativeTestJSON-1591849248-project] Calling method '.version_select at 0x7fe96a3d48b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:21.148510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-dde846e2-bd69-45b4-8cf4-68925cc24a0f tempest-ListImageFiltersNegativeTestJSON-1591849248 tempest-ListImageFiltersNegativeTestJSON-1591849248-project] HTTP exception thrown: Image not found. Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dde846e2-bd69-45b4-8cf4-68925cc24a0f tempest-ListImageFiltersNegativeTestJSON-1591849248 tempest-ListImageFiltersNegativeTestJSON-1591849248-project] Request method failure captured: Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/images/450bc41a-954d-428c-bf9d-0d3b840a28d7 HTTP/1.1 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY8U6CuYEHO1fQNAnfaBBZNkkGBduLRlhx1sKSP8ZWMmFXuh9jIXVzFNaS6rb63z16op8gVq0ntFjRkyKN26zTCRZkmgEyiGxEeZDHIkWxikVxdIvk7cFaXNYoW8aeIh1ZfT7NHcinowPm78VR7tcTsiF434FrWJpOmSQ7tE72svjPY Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 81c8847aeeaa4d70942978d1336d5a05 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1591849248 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_81c8847aeeaa4d70942978d1336d5a05", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/81c8847aeeaa4d70942978d1336d5a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81c8847aeeaa4d70942978d1336d5a05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/81c8847aeeaa4d70942978d1336d5a05"}]}] Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1591849248 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 81c8847aeeaa4d70942978d1336d5a05 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1591849248 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListImageFiltersNegativeTestJSON-1591849248-project Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: dabe89e2ed6c43ad86654eb948585149 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1591849248-project Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '450bc41a-954d-428c-bf9d-0d3b840a28d7'} Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 450bc41a-954d-428c-bf9d-0d3b840a28d7 Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:16:21.151668 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 450bc41a-954d-428c-bf9d-0d3b840a28d7 could not be found. Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dde846e2-bd69-45b4-8cf4-68925cc24a0f tempest-ListImageFiltersNegativeTestJSON-1591849248 tempest-ListImageFiltersNegativeTestJSON-1591849248-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dde846e2-bd69-45b4-8cf4-68925cc24a0f tempest-ListImageFiltersNegativeTestJSON-1591849248 tempest-ListImageFiltersNegativeTestJSON-1591849248-project] 10.222.0.27 "GET /compute/v2.1/images/450bc41a-954d-428c-bf9d-0d3b840a28d7" status: 404 len: 62 microversion: 2.1 time: 0.584860 Aug 30 04:16:21.162105 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 988/2050] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:16:20 2022] GET /compute/v2.1/images/450bc41a-954d-428c-bf9d-0d3b840a28d7 => generated 62 bytes in 586 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:16:21.319007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-18d0c30b-6983-480e-9b11-c2406bb4dfa2 req-1ec8a26b-290d-4bd1-a3d7-e4b23801ab01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf3f2b89-a214-46dd-b9f1-d1a4423d26fa", "name": "network-vif-deleted", "tag": "7af95c7c-57fc-421a-8436-93221568d5f9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:21.362350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:21.374398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-18d0c30b-6983-480e-9b11-c2406bb4dfa2 req-1ec8a26b-290d-4bd1-a3d7-e4b23801ab01 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:21.375213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-18d0c30b-6983-480e-9b11-c2406bb4dfa2 req-1ec8a26b-290d-4bd1-a3d7-e4b23801ab01 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:21.375883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-18d0c30b-6983-480e-9b11-c2406bb4dfa2 req-1ec8a26b-290d-4bd1-a3d7-e4b23801ab01 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:21.376572 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4e7d214-c3c1-4a68-a075-3f98bf1cc7dc tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.478108 Aug 30 04:16:21.378912 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1063/2051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:20 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:21.406457 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-18d0c30b-6983-480e-9b11-c2406bb4dfa2 req-1ec8a26b-290d-4bd1-a3d7-e4b23801ab01 service nova] Creating event network-vif-deleted:7af95c7c-57fc-421a-8436-93221568d5f9 for instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa on n-h1-854925-5 Aug 30 04:16:21.414374 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-18d0c30b-6983-480e-9b11-c2406bb4dfa2 req-1ec8a26b-290d-4bd1-a3d7-e4b23801ab01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101558 Aug 30 04:16:21.415547 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 989/2052] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:21.446434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:21.447050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:21.460262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:21.460590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:21.461040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:21.464862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:21.465443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:21.465885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:21.568695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:21.569897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:21.589848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:21.591397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:21.593897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:21.596909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:21.597854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:21.599512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:21.786013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:21.796207 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-70413192-f63f-435b-8486-ee9af8b40c0c tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1435 microversion: 2.1 time: 0.353861 Aug 30 04:16:21.802984 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1064/2053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:21 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1435 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:22.092797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:22.101315 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6933c71-afc7-46a1-92af-30dd398a791a tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1513 microversion: 2.1 time: 0.540880 Aug 30 04:16:22.108639 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 990/2054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:21 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1513 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:22.408748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:22.409364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:22.428537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:22.429806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:22.430784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:22.433806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:22.434475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:22.435132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:22.825284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:22.825930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:22.827146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:22.839890 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d80f82d4-9d44-4edc-abc9-2ef55a796a03 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.435470 Aug 30 04:16:22.841536 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1065/2055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:22 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:22.843123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:22.843728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:22.844213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:22.846318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:22.846814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:22.847549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:23.031624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:23.039964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:23.040801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:23.043541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lazy-loading 'fault' on Instance uuid cf3f2b89-a214-46dd-b9f1-d1a4423d26fa {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:23.051196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:23.133311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:23.134376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:23.145004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:23.147609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:23.148320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:23.150446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:23.151833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:23.154063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:23.303840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:23.356211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:23.573691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676aac43a8ef4e24b87f7067efd1fca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b147756fd804257ab691af94f13d385', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:23.592263 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e598e1c7-ff84-4754-bfa9-771f513b6b1a tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 200 len: 1311 microversion: 2.1 time: 0.771379 Aug 30 04:16:23.596043 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 991/2056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:22 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 1311 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:23.773318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:23.788508 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79c08096-99b8-43f1-b9cc-95602fa3917d tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1513 microversion: 2.1 time: 0.660410 Aug 30 04:16:23.791793 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1066/2057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:23 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1513 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:23.864525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:23.865527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:23.867631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:23.881298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:23.882084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:23.882630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:23.886228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:23.887050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:23.888257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.084909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4c033bc9-77a2-48c2-bdb1-4b8a2f1c5e35 req-95125c10-67e7-4bbf-804e-292147d445c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcc6b981-302e-4d2f-9168-0ee2ac235302", "name": "network-vif-deleted", "tag": "d5075ba3-63f0-4caa-bba9-228c568e6c60"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:24.144227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c033bc9-77a2-48c2-bdb1-4b8a2f1c5e35 req-95125c10-67e7-4bbf-804e-292147d445c2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.146494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c033bc9-77a2-48c2-bdb1-4b8a2f1c5e35 req-95125c10-67e7-4bbf-804e-292147d445c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:24.148587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c033bc9-77a2-48c2-bdb1-4b8a2f1c5e35 req-95125c10-67e7-4bbf-804e-292147d445c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.200363 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4c033bc9-77a2-48c2-bdb1-4b8a2f1c5e35 req-95125c10-67e7-4bbf-804e-292147d445c2 service nova] Creating event network-vif-deleted:d5075ba3-63f0-4caa-bba9-228c568e6c60 for instance dcc6b981-302e-4d2f-9168-0ee2ac235302 on n-h1-854925-5 Aug 30 04:16:24.221023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4c033bc9-77a2-48c2-bdb1-4b8a2f1c5e35 req-95125c10-67e7-4bbf-804e-292147d445c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155427 Aug 30 04:16:24.223282 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1067/2058] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:24.630179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:24.632338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] [instance: cf3f2b89-a214-46dd-b9f1-d1a4423d26fa] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:24.646832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.649257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:24.650801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.654894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.656519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:24.657476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.680944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] HTTP exception thrown: Instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa could not be found. Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Request method failure captured: Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa HTTP/1.1 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY7b-QbHiOWuB45JrfOf0I9g4ehOw6-fOjEprhZlEF1DG2oaG9rLSIGRkNZPFeeThbmiE0MnebLWVYo2K2FpZEOJNAHYJCOc9EkB0u-2ckVO6_9I4R2Yir8L1sgx9uWlnjahmlhL606ar7qnoaI1xQGB9M5GcMjUHH9hNrqSYKmXAwo Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 2b147756fd804257ab691af94f13d385 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1893816924 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2b147756fd804257ab691af94f13d385", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2b147756fd804257ab691af94f13d385"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b147756fd804257ab691af94f13d385"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2b147756fd804257ab691af94f13d385"}]}] Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1893816924 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 2b147756fd804257ab691af94f13d385 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1893816924 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAdminNegativeTestJSON-1893816924-project Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 676aac43a8ef4e24b87f7067efd1fca7 Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1893816924-project Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa could not be found. Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'cf3f2b89-a214-46dd-b9f1-d1a4423d26fa'} Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa could not be found. Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa could not be found. Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:24.688586 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa could not be found. Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] Returning 404 to user: Instance cf3f2b89-a214-46dd-b9f1-d1a4423d26fa could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:24.695256 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb76e4c9-4043-4141-b137-e7b94c8a2fac tempest-ServersAdminNegativeTestJSON-1893816924 tempest-ServersAdminNegativeTestJSON-1893816924-project] 10.222.0.27 "GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa" status: 404 len: 111 microversion: 2.1 time: 0.066036 Aug 30 04:16:24.696435 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1068/2059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:24 2022] GET /compute/v2.1/servers/cf3f2b89-a214-46dd-b9f1-d1a4423d26fa => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:24.703420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:24.714792 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de7b896c-3e36-4bfa-aa65-7568d1ef3684 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.854439 Aug 30 04:16:24.730735 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 992/2060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:23 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:24.819950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:24.821125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:24.853440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.853958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:24.856753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.870707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.871561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:24.872894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:24.949640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:24.996272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:24.998760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:25.004134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:25.005472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lazy-loading 'fault' on Instance uuid dcc6b981-302e-4d2f-9168-0ee2ac235302 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:25.125126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2150ff19d8bf4037a114d9b31edfdc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67d43f74483f4c5aa5ba8fb5fd14032b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:25.138028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c95a173-7a12-4bdd-b606-6f93d597b9d9 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 200 len: 1307 microversion: 2.1 time: 0.323293 Aug 30 04:16:25.159424 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1069/2061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:24 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 1307 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:25.738721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:25.740104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:25.759485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:25.760644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:25.761635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:25.765261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:25.768423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:25.769050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.061531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:26.087127 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a9d43f5b-e0ea-4a2b-8bd3-c06552227889 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.352511 Aug 30 04:16:26.093941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 993/2062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:25 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:26.164372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:26.165413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: dcc6b981-302e-4d2f-9168-0ee2ac235302] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:26.174291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.174965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.176032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.177164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.184225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.185027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.227440 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] HTTP exception thrown: Instance dcc6b981-302e-4d2f-9168-0ee2ac235302 could not be found. Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Request method failure captured: Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 HTTP/1.1 Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY56VKOdrqKnk6zw3vFCJUFWwS0qlviFnjcOB-qMHIAF7bFJgYGCEkp79wKKzIjUs5sjCk1mzhayMmSy3Cbi74CCOzSnEu2tiT43M4IjnSH6MFeg1RB0Rn5Kmc1Vbv45IMqakLPAN2s_y1mqVT4OtjIRzsiAWN-CBDTMMXlhv9qAYYM Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_67d43f74483f4c5aa5ba8fb5fd14032b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}] Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2150ff19d8bf4037a114d9b31edfdc9a Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance dcc6b981-302e-4d2f-9168-0ee2ac235302 could not be found. Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'dcc6b981-302e-4d2f-9168-0ee2ac235302'} Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc6b981-302e-4d2f-9168-0ee2ac235302 could not be found. Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc6b981-302e-4d2f-9168-0ee2ac235302 could not be found. Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.230276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc6b981-302e-4d2f-9168-0ee2ac235302 could not be found. Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Returning 404 to user: Instance dcc6b981-302e-4d2f-9168-0ee2ac235302 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:26.235829 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de07c699-13cc-4e13-b127-80a3e68af903 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302" status: 404 len: 111 microversion: 2.1 time: 0.073205 Aug 30 04:16:26.238088 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 994/2063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:26 2022] GET /compute/v2.1/servers/dcc6b981-302e-4d2f-9168-0ee2ac235302 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:26.242852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:26.244002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:26.257946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.258663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.259962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.264373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.265530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.266176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.289443 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] HTTP exception thrown: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Request method failure captured: Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a HTTP/1.1 Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY56VKOdrqKnk6zw3vFCJUFWwS0qlviFnjcOB-qMHIAF7bFJgYGCEkp79wKKzIjUs5sjCk1mzhayMmSy3Cbi74CCOzSnEu2tiT43M4IjnSH6MFeg1RB0Rn5Kmc1Vbv45IMqakLPAN2s_y1mqVT4OtjIRzsiAWN-CBDTMMXlhv9qAYYM Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_67d43f74483f4c5aa5ba8fb5fd14032b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}] Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2150ff19d8bf4037a114d9b31edfdc9a Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b2a38e91-4b23-4d55-8d7f-b6dcde51f28a'} Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:26.291656 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.297790 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.301691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Returning 404 to user: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:26.303917 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca6035d6-a5a8-4fb7-a18e-440e160f499c tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 404 len: 111 microversion: 2.1 time: 0.064659 Aug 30 04:16:26.309240 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 995/2064] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:26 2022] DELETE /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:26.316869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:26.317850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: b2a38e91-4b23-4d55-8d7f-b6dcde51f28a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:26.327281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.328344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.329205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.331012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.331735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.332393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.361547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] HTTP exception thrown: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Request method failure captured: Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a HTTP/1.1 Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY56VKOdrqKnk6zw3vFCJUFWwS0qlviFnjcOB-qMHIAF7bFJgYGCEkp79wKKzIjUs5sjCk1mzhayMmSy3Cbi74CCOzSnEu2tiT43M4IjnSH6MFeg1RB0Rn5Kmc1Vbv45IMqakLPAN2s_y1mqVT4OtjIRzsiAWN-CBDTMMXlhv9qAYYM Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_67d43f74483f4c5aa5ba8fb5fd14032b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}] Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2150ff19d8bf4037a114d9b31edfdc9a Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b2a38e91-4b23-4d55-8d7f-b6dcde51f28a'} Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.365219 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.370756 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.370756 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.370756 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.370756 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:26.370756 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:26.370756 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. Aug 30 04:16:26.370756 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.372426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Returning 404 to user: Instance b2a38e91-4b23-4d55-8d7f-b6dcde51f28a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:26.373636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c78cd373-bc49-4341-8394-faa86255db87 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a" status: 404 len: 111 microversion: 2.1 time: 0.061792 Aug 30 04:16:26.379263 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 996/2065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:26 2022] GET /compute/v2.1/servers/b2a38e91-4b23-4d55-8d7f-b6dcde51f28a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:26.385825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:26.392354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:26.403561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.404982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.405662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.407791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.408265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.408760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.451556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] HTTP exception thrown: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Request method failure captured: Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf HTTP/1.1 Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY56VKOdrqKnk6zw3vFCJUFWwS0qlviFnjcOB-qMHIAF7bFJgYGCEkp79wKKzIjUs5sjCk1mzhayMmSy3Cbi74CCOzSnEu2tiT43M4IjnSH6MFeg1RB0Rn5Kmc1Vbv45IMqakLPAN2s_y1mqVT4OtjIRzsiAWN-CBDTMMXlhv9qAYYM Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_67d43f74483f4c5aa5ba8fb5fd14032b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}] Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2150ff19d8bf4037a114d9b31edfdc9a Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '98b6241b-bd6b-497a-be52-1610160d2fbf'} Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:26.457478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Returning 404 to user: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:26.466240 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21d07152-b3d8-4526-b491-7207dbc29323 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 404 len: 111 microversion: 2.1 time: 0.079453 Aug 30 04:16:26.470662 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 997/2066] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:16:26 2022] DELETE /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:26.484010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:26.484573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] [instance: 98b6241b-bd6b-497a-be52-1610160d2fbf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:26.494400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.494899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.495344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.496059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:26.496519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:26.496953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:26.524617 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] HTTP exception thrown: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Request method failure captured: Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf HTTP/1.1 Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY56VKOdrqKnk6zw3vFCJUFWwS0qlviFnjcOB-qMHIAF7bFJgYGCEkp79wKKzIjUs5sjCk1mzhayMmSy3Cbi74CCOzSnEu2tiT43M4IjnSH6MFeg1RB0Rn5Kmc1Vbv45IMqakLPAN2s_y1mqVT4OtjIRzsiAWN-CBDTMMXlhv9qAYYM Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_67d43f74483f4c5aa5ba8fb5fd14032b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/67d43f74483f4c5aa5ba8fb5fd14032b"}]}] Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 67d43f74483f4c5aa5ba8fb5fd14032b Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-994387160 Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2150ff19d8bf4037a114d9b31edfdc9a Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiskConfigTestJSON-994387160-project Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '98b6241b-bd6b-497a-be52-1610160d2fbf'} Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:26.526111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] Returning 404 to user: Instance 98b6241b-bd6b-497a-be52-1610160d2fbf could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e8056d9d-8cb3-4754-b370-058656b10da4 tempest-ServerDiskConfigTestJSON-994387160 tempest-ServerDiskConfigTestJSON-994387160-project] 10.222.0.27 "GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf" status: 404 len: 111 microversion: 2.1 time: 0.057193 Aug 30 04:16:26.531602 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 998/2067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:26 2022] GET /compute/v2.1/servers/98b6241b-bd6b-497a-be52-1610160d2fbf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:16:26.840836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e9e4687-5ec0-4958-8d59-00f2afa8dfca tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Action: 'create', calling method: .version_select at 0x7fe96a8fe700>, body: {"keypair": {"name": "tempest-keypair-36034097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7m+SfqJ9qs0o+UDbiUUg4h4OMXs1sBOjL+KZccop1O3gNa8dvS/HNIu8iRdaq3DsHEH7cF+kDBNKIYlHv9LVL3/cOpfps4CXYGNjzF8wwXlpswqic5mm27UiuRtWSmtg=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:26.922818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8e9e4687-5ec0-4958-8d59-00f2afa8dfca tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:26.937566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8e9e4687-5ec0-4958-8d59-00f2afa8dfca tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for user 7cec55c8e08843c2b6411c05e95a500b and project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:26.980109 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8e9e4687-5ec0-4958-8d59-00f2afa8dfca tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.831413 Aug 30 04:16:26.981507 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1070/2068] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:16:26 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:26.992492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a233c90-4b39-47e2-8cac-99709934763c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96ad40550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.011317 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a233c90-4b39-47e2-8cac-99709934763c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-36034097" status: 200 len: 496 microversion: 2.1 time: 0.022633 Aug 30 04:16:27.017555 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 999/2069] 10.222.0.27 () {58 vars in 1212 bytes} [Tue Aug 30 04:16:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-36034097 => generated 496 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.028239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9fcce822-92a8-4012-9760-29577832c3e6 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96a8fe280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.050036 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9fcce822-92a8-4012-9760-29577832c3e6 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36034097" status: 202 len: 0 microversion: 2.1 time: 0.025625 Aug 30 04:16:27.064099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20995eda-0722-4150-9af0-dcca11fc951c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Action: 'create', calling method: .version_select at 0x7fe96a597ee0>, body: {"keypair": {"name": "tempest-keypair-514668816", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV/rrjAT3/43kPTCk7jfQLhhFbGWCyr4Rx2b6+FpnU9bSrZVly8S/ihcKNFIHbu/MKP13zL8Iam7NvjrfdZR9VHurg+13jMjio+4CAyhE/jALqDmwmLGL9tGxGTdlseIg=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:27.070510 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1071/2070] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Aug 30 04:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36034097 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:27.084827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-20995eda-0722-4150-9af0-dcca11fc951c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:27.091240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-20995eda-0722-4150-9af0-dcca11fc951c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for user 7cec55c8e08843c2b6411c05e95a500b and project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:27.112923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:27.119555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.120565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:27.131825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:27.132785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:27.133623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:27.134697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:27.135499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:27.136270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:27.138170 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20995eda-0722-4150-9af0-dcca11fc951c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079071 Aug 30 04:16:27.146015 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1000/2071] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:16:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.152349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0a7567b8-37cb-4ff1-b904-222cdb7ec353 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96a441820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.182016 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0a7567b8-37cb-4ff1-b904-222cdb7ec353 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514668816" status: 202 len: 0 microversion: 2.1 time: 0.034564 Aug 30 04:16:27.189849 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1001/2072] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514668816 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:27.199179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-384238f4-a6a7-4377-9e42-feeaa07c998d tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Action: 'create', calling method: .version_select at 0x7fe96a38eaf0>, body: {"keypair": {"name": "tempest-keypair-1142246920", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:27.229301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-384238f4-a6a7-4377-9e42-feeaa07c998d tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:27.237250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-384238f4-a6a7-4377-9e42-feeaa07c998d tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for user 7cec55c8e08843c2b6411c05e95a500b and project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:27.280185 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-384238f4-a6a7-4377-9e42-feeaa07c998d tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.088613 Aug 30 04:16:27.282310 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1002/2073] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:16:27 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.300039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce3fa7de-c4f6-4ba8-a7b4-452f55da8fe9 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96a347af0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.359002 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce3fa7de-c4f6-4ba8-a7b4-452f55da8fe9 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142246920" status: 202 len: 0 microversion: 2.1 time: 0.068897 Aug 30 04:16:27.363334 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1003/2074] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1142246920 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:27.380201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2d6944a-550f-401a-9c46-6aa7d13273fa tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Action: 'create', calling method: .version_select at 0x7fe96a2ee430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-361547448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv2B3IUDp4x7gPlQMw9PoRhLaKbgjCEtSGvOdi8mnep+u/srX/LjzT0zaYGE8++9ZrETO6FlkttQj9wnu9i4DiPPibRYRdKby9SlXDCJzMvx1iv2wvMpGi/3fHimxytIw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:27.409841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b2d6944a-550f-401a-9c46-6aa7d13273fa tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:27.417793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b2d6944a-550f-401a-9c46-6aa7d13273fa tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for user 7cec55c8e08843c2b6411c05e95a500b and project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:27.495245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2d6944a-550f-401a-9c46-6aa7d13273fa tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.123475 Aug 30 04:16:27.505555 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1004/2075] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:16:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.513418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-774cf25f-ba8d-47d4-ac9e-ce728d2e1adb tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Action: 'create', calling method: .version_select at 0x7fe96a52cd30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-933276968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgZs9TgxEeInCoSxJnyBW88c0J5XLmvQ6TwAvCEsFUU92EIHmsYRDkf+pdq6nkD8mi8mBmFEEGdQ2l7MEnuk1GmFKHxtD/48rN/qpiMXOTlkyFCcCtiYO9BuHv4K5ep0Q=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:27.557956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-774cf25f-ba8d-47d4-ac9e-ce728d2e1adb tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:27.572581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-774cf25f-ba8d-47d4-ac9e-ce728d2e1adb tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for user 7cec55c8e08843c2b6411c05e95a500b and project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:27.616361 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-774cf25f-ba8d-47d4-ac9e-ce728d2e1adb tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.109341 Aug 30 04:16:27.628236 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1005/2076] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:16:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.634960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-15d85dbe-ff76-4bdf-b141-17caafe58d48 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Action: 'create', calling method: .version_select at 0x7fe96a93eee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-613903779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7RpAUKsNx4wL3b8KggemNsEwl5/0SdYxpcz1I2LWpXGg4JH810v8XK1e+tSTR27SmCSfLIUIyhbYhNTfucObC3zKfTL2JB1iI/LJBM8L3aiuJzpafqHsd4hV9NYYsLgg=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:27.671632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-15d85dbe-ff76-4bdf-b141-17caafe58d48 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:27.688309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-15d85dbe-ff76-4bdf-b141-17caafe58d48 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Getting quotas for user 7cec55c8e08843c2b6411c05e95a500b and project a23e6fcd5b18488bafcd32f206fb3560. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:27.754331 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-15d85dbe-ff76-4bdf-b141-17caafe58d48 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.123701 Aug 30 04:16:27.765284 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1006/2077] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:16:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.773241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c25600c4-0c85-4d81-92fe-916394a57bbb tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96a8c9550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.784572 n-d-854925-5 devstack@n-api.service[122402]: WARNING oslo_db.sqlalchemy.utils [None req-c25600c4-0c85-4d81-92fe-916394a57bbb tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 04:16:27.793477 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c25600c4-0c85-4d81-92fe-916394a57bbb tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.025193 Aug 30 04:16:27.794495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:27.802141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1007/2078] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:16:27 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:27.806715 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6473c598-45d0-4e4f-aced-d0afab07af2f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.689577 Aug 30 04:16:27.807039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dae803fd-5c5d-4d0d-8ae6-38036ff0210c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96a38e8b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.809009 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1072/2079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:27 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:27.825914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9d3cdd0a-79c1-47df-9264-a7cef1ca3080 req-7bf2d4cf-612d-4fe7-aabf-0fcc5e26aa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1266aec0-b13b-4966-8aad-d413ab5a0680", "name": "network-vif-plugged", "status": "completed", "tag": "b1ef5778-36da-4620-8cc1-fc63985beadf"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:27.838632 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dae803fd-5c5d-4d0d-8ae6-38036ff0210c tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-613903779" status: 202 len: 0 microversion: 2.1 time: 0.034953 Aug 30 04:16:27.843134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9d3cdd0a-79c1-47df-9264-a7cef1ca3080 req-7bf2d4cf-612d-4fe7-aabf-0fcc5e26aa86 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:27.843670 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1008/2080] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-613903779 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:27.844923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9d3cdd0a-79c1-47df-9264-a7cef1ca3080 req-7bf2d4cf-612d-4fe7-aabf-0fcc5e26aa86 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:27.846262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9d3cdd0a-79c1-47df-9264-a7cef1ca3080 req-7bf2d4cf-612d-4fe7-aabf-0fcc5e26aa86 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:27.858507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0113e75c-c8b2-4489-a590-1cdae25b8390 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96a347ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.866791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9d3cdd0a-79c1-47df-9264-a7cef1ca3080 req-7bf2d4cf-612d-4fe7-aabf-0fcc5e26aa86 service nova] Creating event network-vif-plugged:b1ef5778-36da-4620-8cc1-fc63985beadf for instance 1266aec0-b13b-4966-8aad-d413ab5a0680 on n-h2-854925-5 Aug 30 04:16:27.872991 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9d3cdd0a-79c1-47df-9264-a7cef1ca3080 req-7bf2d4cf-612d-4fe7-aabf-0fcc5e26aa86 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058593 Aug 30 04:16:27.874280 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1073/2081] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:27.893613 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0113e75c-c8b2-4489-a590-1cdae25b8390 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-933276968" status: 202 len: 0 microversion: 2.1 time: 0.048545 Aug 30 04:16:27.895956 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1009/2082] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-933276968 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:16:27.906415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e405d42a-96cf-48ce-a36a-c4891ac0eb07 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] Calling method '.version_select at 0x7fe96a8fe820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:27.972511 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e405d42a-96cf-48ce-a36a-c4891ac0eb07 tempest-KeyPairsV2TestJSON-1294075102 tempest-KeyPairsV2TestJSON-1294075102-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-361547448" status: 202 len: 0 microversion: 2.1 time: 0.072381 Aug 30 04:16:27.975480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1074/2083] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:16:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-361547448 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:16:28.828243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:28.829511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:28.842904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:28.850068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:28.850800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:28.851738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:28.852377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:28.852999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:29.153626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:29.164598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6dccbec-4c90-4e3c-a4f9-ecab04b7051f tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1319 microversion: 2.1 time: 0.340331 Aug 30 04:16:29.165683 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1010/2084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:28 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:30.186178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:30.186926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:30.210516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:30.214805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:30.218726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:30.222063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:30.222761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:30.226325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:30.643587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:30.657027 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e1822db-26ee-4fdc-913b-14300b643984 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1469 microversion: 2.1 time: 0.475284 Aug 30 04:16:30.658008 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1075/2085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:30 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1469 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:31.297520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-908805110", "block_migration": true, "disk_over_commit": false}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:31.300019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:31.312600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:31.313100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:31.313585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:31.314298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:31.314758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:31.315186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:31.386265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lazy-loading 'flavor' on Instance uuid 1266aec0-b13b-4966-8aad-d413ab5a0680 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:16:31.400805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Going to try to live migrate instance to tempest-host-908805110 {{(pid=122402) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:16:31.422248 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] HTTP exception thrown: Compute host tempest-host-908805110 could not be found. Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Request method failure captured: Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680/action HTTP/1.1 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 106 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY8MwONjVuhBXBe8Iax0oO_2-2S9BLRm68-hJzr8XNId7_UxkxAYjwNW0YB9IaqQ8AP8mxF1C-taGc5vrokyQVqUrN_As0uviqnZC_kVeLEdm_eKVJWbzpHf3vmHkn4zdqDhqJi-ty8-NPGL17yQeepQr8lIIZ0XGjhLQFOXm1N3QyA Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c87edc8dc7da46b6b99ea32769fe0130 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveMigrationNegativeTest-870171539 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c87edc8dc7da46b6b99ea32769fe0130", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c87edc8dc7da46b6b99ea32769fe0130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c87edc8dc7da46b6b99ea32769fe0130"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c87edc8dc7da46b6b99ea32769fe0130"}]}] Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveMigrationNegativeTest-870171539 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c87edc8dc7da46b6b99ea32769fe0130 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-870171539 Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveMigrationNegativeTest-870171539-project-admin Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 662106c431bf4b48817de80065a7be6e Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveMigrationNegativeTest-870171539-project-admin Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: {"os-migrateLive": {"host": "tempest-host-908805110", "block_migration": true, "disk_over_commit": false}} Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: exception: Compute host tempest-host-908805110 could not be found. Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1266aec0-b13b-4966-8aad-d413ab5a0680', 'body': {'os-migrateLive': {'host': 'tempest-host-908805110', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5486, in live_migrate Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 30 04:16:31.430033 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-908805110 could not be found. Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-908805110 could not be found. Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-908805110 could not be found. Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Returning 400 to user: Compute host tempest-host-908805110 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c3a1121-9113-4553-bada-f60d5fc7893d tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680/action" status: 400 len: 99 microversion: 2.1 time: 0.757205 Aug 30 04:16:31.486993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1011/2086] 10.222.0.27 () {60 vars in 1279 bytes} [Tue Aug 30 04:16:30 2022] POST /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680/action => generated 99 bytes in 758 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:31.499497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:32.299753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:32.308602 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-92296670-f24f-4329-a9fc-69e37aad1c54 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1469 microversion: 2.1 time: 0.872025 Aug 30 04:16:32.309911 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1076/2087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:31 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1469 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:32.526183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1773164573", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:32.615532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:16:33.275853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:16:33.277453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:16:33.278616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:16:33.279710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:16:33.281625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:16:33.307131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.307881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.308559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.311442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:33.312688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:33.313493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:33.365479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Getting quotas for project 88ebede3b3a747d8bbad3dd1af8da400. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:33.376210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Getting quotas for user 05535ec48e11452eb2e49f89e0f2ba26 and project 88ebede3b3a747d8bbad3dd1af8da400. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:33.395760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:16:33.399600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:16:33.459404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59d2abf6-e919-4493-a21b-5fb0e287896d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.936953 Aug 30 04:16:33.468782 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1012/2088] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:16:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:16:33.486990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6fa88335-7136-43b7-af28-cfababe85cc6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:33.490475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6fa88335-7136-43b7-af28-cfababe85cc6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:33.657585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6fa88335-7136-43b7-af28-cfababe85cc6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:33.664721 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6fa88335-7136-43b7-af28-cfababe85cc6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1219 microversion: 2.1 time: 0.195189 Aug 30 04:16:33.665653 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1077/2089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:33 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1219 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:34.693301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:34.694139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:34.707016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:34.707679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:34.710895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:34.711836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:34.715272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:34.715901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:35.268458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:35.306585 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b2c197b-52c3-4000-b45b-bce0a300dc2c tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1215 microversion: 2.1 time: 0.618598 Aug 30 04:16:35.315133 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1013/2090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:34 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1215 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:36.339034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:36.339649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:36.361718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:36.363374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:36.364274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:36.365721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:36.367335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:36.369646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:36.734446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:36.760083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3d2f7875-bdeb-4c5a-9b33-9832adb43522 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1277 microversion: 2.1 time: 0.423718 Aug 30 04:16:36.760730 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1078/2091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:36 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1277 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:37.787133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:37.787812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:37.818358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:37.818916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:37.819365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:37.820314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:37.821413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:37.821870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:38.132579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:38.141275 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-50b07af6-0273-45ca-85ba-83cdc6867dee tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1277 microversion: 2.1 time: 0.363300 Aug 30 04:16:38.142614 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1014/2092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:37 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:39.165586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:39.166212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:39.200578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:39.204743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:39.205588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:39.207352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:39.211591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:39.212329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:40.856146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:40.872738 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-842fecdf-cdef-44e9-84be-fe6f81648f2b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 1.710243 Aug 30 04:16:40.889517 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1079/2093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:39 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:41.096885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-797499222", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "5bf790d5-0143-4cee-ace0-8c022de9b200"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:41.231600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] validate_networks() for [('5bf790d5-0143-4cee-ace0-8c022de9b200', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:16:41.897749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:41.900020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:41.917648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:41.919410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:41.920580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:41.923501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:41.925471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:41.927593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:42.518936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:42.528555 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-44c8a662-16e2-4318-8c35-60dfa21b32a6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 0.636134 Aug 30 04:16:42.542055 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1080/2094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:41 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:42.549817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c1fadc5b-48a8-47fd-a991-77eae2505a89 req-f436a284-758a-4b87-9adf-bc85b58cf24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050a5f4e-173f-4100-914f-f4ea5d397e68", "tag": "4e8451ff-68c7-4a66-a389-82427d8e1c41"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:42.560809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c1fadc5b-48a8-47fd-a991-77eae2505a89 req-f436a284-758a-4b87-9adf-bc85b58cf24f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:42.562459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c1fadc5b-48a8-47fd-a991-77eae2505a89 req-f436a284-758a-4b87-9adf-bc85b58cf24f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:42.563057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c1fadc5b-48a8-47fd-a991-77eae2505a89 req-f436a284-758a-4b87-9adf-bc85b58cf24f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:42.576459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c1fadc5b-48a8-47fd-a991-77eae2505a89 req-f436a284-758a-4b87-9adf-bc85b58cf24f service nova] Creating event network-changed:4e8451ff-68c7-4a66-a389-82427d8e1c41 for instance 050a5f4e-173f-4100-914f-f4ea5d397e68 on n-h1-854925-5 Aug 30 04:16:42.583935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c1fadc5b-48a8-47fd-a991-77eae2505a89 req-f436a284-758a-4b87-9adf-bc85b58cf24f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038574 Aug 30 04:16:42.585413 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1081/2095] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:43.085715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:16:43.086827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:16:43.087443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:16:43.088000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:16:43.088546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:16:43.124340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.125626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.126988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.128494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.129383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.138473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.210813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Getting quotas for project 257ce0030c904e27b498cd8cf55d7b0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:16:43.225683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Getting quotas for user 88ecec6327344b63b4216b8e520c969c and project 257ce0030c904e27b498cd8cf55d7b0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:16:43.248387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=88,nova_api:DELETE=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:43.287165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Going to run 2 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:16:43.306411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: 3e83c416-fbce-4464-a84c-0fc595002bc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:16:43.453201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=3e83c416-fbce-4464-a84c-0fc595002bc8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:16:43.571853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:43.575759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:43.590548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.591446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.596276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.597268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.601280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.601795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.654006 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4f2bb4e-0d54-42de-a4ac-95676384401f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.930071 Aug 30 04:16:43.662148 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1015/2096] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:16:43.672132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:43.673088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:43.687612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:43.688757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Searching by: {'deleted': False, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:16:43.720308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.721179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.721874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.723057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:43.723726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:43.724351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:43.749996 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-27e20497-66c2-4c75-b714-6785295439c6 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.086471 Aug 30 04:16:43.751016 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1016/2097] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:16:43 2022] GET /compute/v2.1/servers => generated 675 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:43.780382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c30b43e5-78f9-4ca8-9807-34ba259c8dc9 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:43.781655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c30b43e5-78f9-4ca8-9807-34ba259c8dc9 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:43.994671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c30b43e5-78f9-4ca8-9807-34ba259c8dc9 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:44.004758 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c30b43e5-78f9-4ca8-9807-34ba259c8dc9 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1219 microversion: 2.1 time: 0.233815 Aug 30 04:16:44.007976 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1017/2098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:43 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1219 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:44.935593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:44.965932 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a6ce57a6-8a75-459b-a939-7d15c900ad88 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 1.405662 Aug 30 04:16:44.981845 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1082/2099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:43 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:16:45.028333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca0b3fc3-794e-4340-aa76-92301f96dda3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:45.030275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca0b3fc3-794e-4340-aa76-92301f96dda3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:45.180443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca0b3fc3-794e-4340-aa76-92301f96dda3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:45.188636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca0b3fc3-794e-4340-aa76-92301f96dda3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1219 microversion: 2.1 time: 0.164091 Aug 30 04:16:45.197569 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1018/2100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:45 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:45.988328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:45.989692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:45.998180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:46.006113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:46.006904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:46.007909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:46.008907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:46.009710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:46.222932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:46.223547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:46.240692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:46.241185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:46.247135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:46.248431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:46.250185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:46.253234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:46.680754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:46.695485 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b6eac236-e508-44c3-a1a8-fd22cf05e57f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1271 microversion: 2.1 time: 0.469784 Aug 30 04:16:46.696184 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1019/2101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:46 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1271 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:46.805522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:46.821020 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c387405-03e1-44dd-8cfb-43544a6c27b4 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 0.836738 Aug 30 04:16:46.821655 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1083/2102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:45 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:47.716460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:47.717663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:47.736189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:47.736699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:47.737121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:47.737868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:47.738322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:47.738745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:47.844986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:47.845656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:47.851366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:47.880894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:47.881642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:47.882226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:47.883096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:47.883694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:47.884266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:48.118887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:48.129507 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-323fa347-88d0-4694-870a-abe61548856f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1277 microversion: 2.1 time: 0.416925 Aug 30 04:16:48.141572 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1020/2103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:47 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1277 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:48.806585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:48.818653 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f29ab4bc-a5d4-4715-8655-24849c911f34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 0.979246 Aug 30 04:16:48.841494 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1084/2104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:47 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:49.164767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:49.166226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:49.181401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:49.182126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:49.182588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:49.183348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:49.183961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:49.184517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:49.386923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:49.400353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c3c7b3c6-6d46-4049-a1e2-4c49bf907a7e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1277 microversion: 2.1 time: 0.239431 Aug 30 04:16:49.401513 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1021/2105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:49 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1277 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:49.864915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:49.866152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:49.880877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:49.881410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:49.884239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:49.885095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:49.885594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:49.890635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:50.427831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:50.429864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:50.439723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:50.440463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:50.441089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:50.442082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:50.442698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:50.443280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:50.628747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:50.650843 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d52fff1f-842a-4432-9b4c-f77fc75e4b32 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1277 microversion: 2.1 time: 0.229133 Aug 30 04:16:50.651805 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1022/2106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:50 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:50.766917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:50.783152 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d356bfb5-eab8-48db-ab98-60ca2824cf34 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 0.935343 Aug 30 04:16:50.797052 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1085/2107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:49 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:51.671729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:51.672355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:51.685046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:51.686102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:51.686547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:51.696741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:51.697476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:51.698075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:51.804561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:51.806035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:51.816683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:51.824037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:51.826297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:51.827182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:51.830823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:51.831421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:52.617197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:52.626600 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6fafdc40-0016-4d9f-adab-d5dee4c527ab tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1319 microversion: 2.1 time: 0.958688 Aug 30 04:16:52.630534 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1023/2108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:51 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1319 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:52.886565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-516b2692-3720-40dd-88f4-49ac7b2b1bf1 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a213b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1306500769", "description": "tempest-description-1293265055"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:53.058394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:53.081560 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f92d8c43-9cdc-44f4-9c0f-b08feb45c371 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 1.281035 Aug 30 04:16:53.093359 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1086/2109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:51 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:53.505278 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-516b2692-3720-40dd-88f4-49ac7b2b1bf1 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.872165 Aug 30 04:16:53.505989 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1024/2110] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:16:52 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:53.554543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e2cac68-62dd-4d43-805f-1dcefd3083e3 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a40da60>, body: {"security_group_rule": {"parent_group_id": "81dd80d1-ccce-4ce7-9d46-0593481878db", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:53.650050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d255abf7-cb89-4c8e-8bcc-d30ebf40630d tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Action: 'create', calling method: .version_select at 0x7fe96a3d48b0>, body: {"pool": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:53.739562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:54.594281 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e2cac68-62dd-4d43-805f-1dcefd3083e3 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.076890 Aug 30 04:16:54.595379 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1087/2111] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:16:53 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:54.602369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:54.603878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:54.620086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:54.620586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:54.621032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:54.621822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:54.625535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:54.626130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.188084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=36 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:55.278948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:55.287996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=79 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:55.297244 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37b3d7c3-d49b-424d-88fe-ca2deb3395a5 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1319 microversion: 2.1 time: 0.696619 Aug 30 04:16:55.299203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1088/2112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:54 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1319 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:55.310952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6249e5f0-b429-46a3-871b-fa449b4363ba req-461d31e2-0e84-4bac-afea-36587648b8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050a5f4e-173f-4100-914f-f4ea5d397e68", "name": "network-vif-plugged", "status": "completed", "tag": "4e8451ff-68c7-4a66-a389-82427d8e1c41"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:55.340696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6249e5f0-b429-46a3-871b-fa449b4363ba req-461d31e2-0e84-4bac-afea-36587648b8d6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.345115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6249e5f0-b429-46a3-871b-fa449b4363ba req-461d31e2-0e84-4bac-afea-36587648b8d6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.345891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6249e5f0-b429-46a3-871b-fa449b4363ba req-461d31e2-0e84-4bac-afea-36587648b8d6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.368687 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6249e5f0-b429-46a3-871b-fa449b4363ba req-461d31e2-0e84-4bac-afea-36587648b8d6 service nova] Creating event network-vif-plugged:4e8451ff-68c7-4a66-a389-82427d8e1c41 for instance 050a5f4e-173f-4100-914f-f4ea5d397e68 on n-h1-854925-5 Aug 30 04:16:55.380487 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6249e5f0-b429-46a3-871b-fa449b4363ba req-461d31e2-0e84-4bac-afea-36587648b8d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077940 Aug 30 04:16:55.383073 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1089/2113] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:55.392376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:55.393191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:55.408503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.409057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.411821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:55.414663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:55.415387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:55.416886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:56.781496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:56.798333 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-731d0d95-419a-453a-8d53-362d57a613c8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1319 microversion: 2.1 time: 1.411715 Aug 30 04:16:56.812209 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1090/2114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:55 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1319 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:56.817807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33f293cf-4cb5-4c45-ad97-780de69915c5 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a2ee310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-858795506", "description": "tempest-description-211805005"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:57.429289 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33f293cf-4cb5-4c45-ad97-780de69915c5 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.615718 Aug 30 04:16:57.430463 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1091/2115] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:16:56 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:57.435745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e8e98e82-c246-4849-8492-68fd046fe919 req-b46ee376-9020-400f-b0d5-7207be605354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e83c416-fbce-4464-a84c-0fc595002bc8", "tag": "7ae7b7fd-bfaf-479e-860c-dd44ce2b7beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:57.461076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e8e98e82-c246-4849-8492-68fd046fe919 req-b46ee376-9020-400f-b0d5-7207be605354 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:57.461888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e8e98e82-c246-4849-8492-68fd046fe919 req-b46ee376-9020-400f-b0d5-7207be605354 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:57.462948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e8e98e82-c246-4849-8492-68fd046fe919 req-b46ee376-9020-400f-b0d5-7207be605354 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:57.483716 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e8e98e82-c246-4849-8492-68fd046fe919 req-b46ee376-9020-400f-b0d5-7207be605354 service nova] Creating event network-changed:7ae7b7fd-bfaf-479e-860c-dd44ce2b7beb for instance 3e83c416-fbce-4464-a84c-0fc595002bc8 on n-h1-854925-5 Aug 30 04:16:57.496398 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e8e98e82-c246-4849-8492-68fd046fe919 req-b46ee376-9020-400f-b0d5-7207be605354 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064490 Aug 30 04:16:57.498730 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1092/2116] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:57.506993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ba46600f-ad04-41fa-872f-a16a9021c8c1 req-fb4cd5fd-fbf6-4ae8-9cda-20fc4101a02b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b02b32e6-e90f-4147-aa06-b46a310ce5c7", "tag": "ada4f8f8-2133-4aa5-94fd-9659a7340c84"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:57.538075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ba46600f-ad04-41fa-872f-a16a9021c8c1 req-fb4cd5fd-fbf6-4ae8-9cda-20fc4101a02b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:57.538620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ba46600f-ad04-41fa-872f-a16a9021c8c1 req-fb4cd5fd-fbf6-4ae8-9cda-20fc4101a02b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:57.539125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ba46600f-ad04-41fa-872f-a16a9021c8c1 req-fb4cd5fd-fbf6-4ae8-9cda-20fc4101a02b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:57.573434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ba46600f-ad04-41fa-872f-a16a9021c8c1 req-fb4cd5fd-fbf6-4ae8-9cda-20fc4101a02b service nova] Creating event network-changed:ada4f8f8-2133-4aa5-94fd-9659a7340c84 for instance b02b32e6-e90f-4147-aa06-b46a310ce5c7 on n-h2-854925-5 Aug 30 04:16:57.599802 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ba46600f-ad04-41fa-872f-a16a9021c8c1 req-fb4cd5fd-fbf6-4ae8-9cda-20fc4101a02b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096581 Aug 30 04:16:57.600851 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1093/2117] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:57.614137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:57.616125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:57.627232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:57.628269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:57.632340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:57.633830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:57.634600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:57.635434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:58.112132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:58.125063 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb589ed3-f516-4fdf-938a-e82d0e944ca2 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1319 microversion: 2.1 time: 0.514709 Aug 30 04:16:58.125919 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1094/2118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:57 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:58.131109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92363caf-cf03-42e5-b0e2-b56c3ba6a76a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a912790>, body: {"security_group_rule": {"parent_group_id": "067e8577-4bc0-406a-8af4-e55a80c1b31b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:59.000095 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-92363caf-cf03-42e5-b0e2-b56c3ba6a76a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.872775 Aug 30 04:16:59.001138 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1095/2119] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:16:58 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:59.005941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:59.006828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:59.022866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:59.028789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:59.029772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:59.030661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:59.031272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:59.031796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:59.138008 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d255abf7-cb89-4c8e-8bcc-d30ebf40630d tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.591275 Aug 30 04:16:59.145582 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1025/2120] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:16:53 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:16:59.147554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f06b6804-6365-416c-b390-dc1a907a583b tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a063c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1569427731", "description": "tempest-description-631655597"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:59.377312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:59.401900 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a729a95-755b-4eb4-9a80-63f3cbc0770b tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1469 microversion: 2.1 time: 0.399361 Aug 30 04:16:59.403042 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1096/2121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:59 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1469 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:16:59.551665 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f06b6804-6365-416c-b390-dc1a907a583b tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.411268 Aug 30 04:16:59.552286 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1026/2122] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:16:59 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:16:59.565611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:16:59.566495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:16:59.576957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:59.584689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:59.585599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:59.586440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:16:59.586911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:16:59.587667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:16:59.632593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=87 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:16:59.643870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-108440993", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "05d9abda-a1a4-4da1-b05e-f5673e4b4219"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:16:59.743237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] validate_networks() for [('05d9abda-a1a4-4da1-b05e-f5673e4b4219', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:16:59.975986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:16:59.985392 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e39ae521-96a9-4eed-b14d-c045aeed42ad tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1319 microversion: 2.1 time: 0.431871 Aug 30 04:17:00.002023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1027/2123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:16:59 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:00.009918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-24a84d49-b39c-4ac7-9ff8-5637af705263 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Calling method '.version_select at 0x7fe96a078160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:00.713169 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-24a84d49-b39c-4ac7-9ff8-5637af705263 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/88075323-759b-4596-b5a5-55e01e41dac7" status: 200 len: 142 microversion: 2.1 time: 0.704835 Aug 30 04:17:00.717074 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1028/2124] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:17:00 2022] GET /compute/v2.1/os-floating-ips/88075323-759b-4596-b5a5-55e01e41dac7 => generated 142 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:00.723857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:00.731658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:00.760396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:00.762183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:00.762951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:00.764610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:00.766190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:00.766888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:00.800900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lazy-loading 'flavor' on Instance uuid 050a5f4e-173f-4100-914f-f4ea5d397e68 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:00.968762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3002f75-db45-4381-a238-a81b32b2eb69 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68/action" status: 202 len: 0 microversion: 2.1 time: 0.248542 Aug 30 04:17:00.970749 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1029/2125] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:17:00 2022] POST /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:00.978321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36de3c58-c0fa-46c4-9ca0-b4af054dd195 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a213c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2134638468", "description": "tempest-description-481487818"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:02.164586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:17:02.165043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:17:02.165518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:17:02.166018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:17:02.166444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:17:02.188144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:02.188625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:02.189074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:02.190019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:02.190315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:02.190754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:02.193291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36de3c58-c0fa-46c4-9ca0-b4af054dd195 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.220218 Aug 30 04:17:02.194012 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1030/2126] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:17:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:02.198639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c1c4e00b-e2b1-44a1-979c-5e07e7a9b9b3 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Calling method '.version_select at 0x7fe96a2fcb80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:02.267036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Getting quotas for project 0b679c1c2fce4fbca70dee0e0aad7f55. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:17:02.281887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Getting quotas for user 8227d8b42c1641c9bb8f0d3dde132518 and project 0b679c1c2fce4fbca70dee0e0aad7f55. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:17:02.308176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:17:02.313018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:17:02.419102 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aa403933-3e0d-4064-ba04-753663a7f656 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.014015 Aug 30 04:17:02.429531 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1097/2127] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:16:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3025 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:17:02.439453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:02.440242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:02.449811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:02.450686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:02.451389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:02.453102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:02.454767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:02.455887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:03.175397 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c1c4e00b-e2b1-44a1-979c-5e07e7a9b9b3 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.980290 Aug 30 04:17:03.183213 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1031/2128] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:17:02 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:03.189100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:03.189862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:03.202333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:03.203938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:03.204893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:03.206339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:03.207405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:03.208771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:03.385660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:03.399157 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fd02fb42-39f3-4fe7-b758-7d4e1271f8d9 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1460 microversion: 2.1 time: 0.967504 Aug 30 04:17:03.415362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1098/2129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:02 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1460 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:03.415362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-02edda3e-52dc-4527-9228-61870303fcd5 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a44a940>, body: {"security_group_rule": {"parent_group_id": "80570121-b46f-4bda-8646-355f91ef042e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "03ae8f33-accb-4a2d-948d-d30752c7e414"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:03.537530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:03.546272 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa45926b-4e19-4704-b157-81976b46ab5c tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1319 microversion: 2.1 time: 0.362026 Aug 30 04:17:03.546871 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1032/2130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:03 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:03.558985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:03.559613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:03.579015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:03.579655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:03.580269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:03.581040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:03.581553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:03.582189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:03.756429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:03.774445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:03.780444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:03.783946 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-40dd12d2-dee6-4e04-94b7-e1c29636ee95 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1254 microversion: 2.21 time: 0.236008 Aug 30 04:17:03.805238 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1033/2131] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:03 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1254 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:03.812293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-90d66039-24fa-4f3a-bca4-a371523cd43c tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Calling method '.version_select at 0x7fe96a368280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:04.307464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-02edda3e-52dc-4527-9228-61870303fcd5 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.901349 Aug 30 04:17:04.308209 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1099/2132] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:17:03 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:04.313151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:04.313906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:04.329992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:04.331260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:04.332089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:04.336617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:04.337048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:04.337580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:05.607266 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc938bad-d669-445f-998c-a1f96189add5 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1611 microversion: 2.1 time: 1.297844 Aug 30 04:17:05.613485 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1100/2133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:04 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1611 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:05.624129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27b3c1ea-d83b-4954-a6da-2aae5d27a479 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a578670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-815918746", "description": "tempest-description-52979717"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:06.230246 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-90d66039-24fa-4f3a-bca4-a371523cd43c tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/88075323-759b-4596-b5a5-55e01e41dac7" status: 202 len: 0 microversion: 2.1 time: 2.423746 Aug 30 04:17:06.235569 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1034/2134] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:17:03 2022] DELETE /compute/v2.1/os-floating-ips/88075323-759b-4596-b5a5-55e01e41dac7 => generated 0 bytes in 2429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:06.242299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:06.242933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:06.263012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:06.270122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:06.271597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:06.274606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:06.276064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:06.279231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:06.346403 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27b3c1ea-d83b-4954-a6da-2aae5d27a479 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.731623 Aug 30 04:17:06.347010 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1101/2135] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:17:05 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:06.352332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:06.352959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:06.365698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:06.369422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:06.370373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:06.373799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:06.374456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:06.374901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:06.722069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:06.732142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:06.733642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:06.734773 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d321b7c-7205-4f7e-968a-d6546ef64210 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1316 microversion: 2.21 time: 0.386838 Aug 30 04:17:06.739938 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1102/2136] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:06 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:06.744709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:06.750198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:06.768275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:06.769615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:06.773315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:06.776468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:06.776921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:06.799712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:06.831684 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb7d79ec-ce8a-4e54-9c8e-15feb6ab696f tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1319 microversion: 2.1 time: 0.594791 Aug 30 04:17:06.838085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4222ecc-a13d-4b7a-bc66-a49fa69410f3 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.096793 Aug 30 04:17:06.838919 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1103/2137] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:17:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:06.840687 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1035/2138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:06 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:06.858012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0146ad1d-55a0-4214-8611-31b59b634465 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Action: 'create', calling method: .version_select at 0x7fe96a43fd30>, body: {"pool": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:06.861243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ac0b794-af92-4939-a7ed-48e9cf93a820 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a1d5940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1834485794", "description": "tempest-description-1780457366"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:07.660790 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ac0b794-af92-4939-a7ed-48e9cf93a820 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.809691 Aug 30 04:17:07.662412 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1036/2139] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:17:06 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:07.668608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854925-5", "block_migration": true, "disk_over_commit": false}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:07.673041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:07.686546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:07.687829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:07.688285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:07.689283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:07.690059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:07.690777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:07.742919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Lazy-loading 'flavor' on Instance uuid 050a5f4e-173f-4100-914f-f4ea5d397e68 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:07.770007 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 050a5f4e-173f-4100-914f-f4ea5d397e68 while it is in vm_state suspended Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Request method failure captured: Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68/action HTTP/1.1 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 97 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY8MwONjVuhBXBe8Iax0oO_2-2S9BLRm68-hJzr8XNId7_UxkxAYjwNW0YB9IaqQ8AP8mxF1C-taGc5vrokyQVqUrN_As0uviqnZC_kVeLEdm_eKVJWbzpHf3vmHkn4zdqDhqJi-ty8-NPGL17yQeepQr8lIIZ0XGjhLQFOXm1N3QyA Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c87edc8dc7da46b6b99ea32769fe0130 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveMigrationNegativeTest-870171539 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c87edc8dc7da46b6b99ea32769fe0130", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c87edc8dc7da46b6b99ea32769fe0130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c87edc8dc7da46b6b99ea32769fe0130"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c87edc8dc7da46b6b99ea32769fe0130"}]}] Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveMigrationNegativeTest-870171539 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c87edc8dc7da46b6b99ea32769fe0130 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-870171539 Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveMigrationNegativeTest-870171539-project-admin Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 662106c431bf4b48817de80065a7be6e Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveMigrationNegativeTest-870171539-project-admin Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: {"os-migrateLive": {"host": "n-h2-854925-5", "block_migration": true, "disk_over_commit": false}} Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: exception: Cannot 'os-migrateLive' instance 050a5f4e-173f-4100-914f-f4ea5d397e68 while it is in vm_state suspended Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '050a5f4e-173f-4100-914f-f4ea5d397e68', 'body': {'os-migrateLive': {'host': 'n-h2-854925-5', 'block_migration': True, 'disk_over_commit': False}}} Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 050a5f4e-173f-4100-914f-f4ea5d397e68 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:07.774986 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 050a5f4e-173f-4100-914f-f4ea5d397e68 while it is in vm_state suspended Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 050a5f4e-173f-4100-914f-f4ea5d397e68 while it is in vm_state suspended Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:07.780245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 050a5f4e-173f-4100-914f-f4ea5d397e68 while it is in vm_state suspended {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:07.784464 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5147b371-eb7c-4e1f-bd45-1ae6b0b6d933 tempest-LiveMigrationNegativeTest-870171539 tempest-LiveMigrationNegativeTest-870171539-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68/action" status: 409 len: 155 microversion: 2.1 time: 0.114693 Aug 30 04:17:07.786490 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1037/2140] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:17:07 2022] POST /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68/action => generated 155 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:17:07.809263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9efe3376-46e6-4493-9f0d-5fe081cd8aa6 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a162160>, body: {"security_group_rule": {"parent_group_id": "daf93885-4975-477a-bd77-747b5546740a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "37f30354-c02a-4b30-87e9-3eda3f37c302"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:09.306528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9efe3376-46e6-4493-9f0d-5fe081cd8aa6 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.514823 Aug 30 04:17:09.311937 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1038/2141] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:17:07 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:09.329793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:09.331125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:09.342183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:09.343983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:09.346538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:09.349637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:09.350327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:09.351825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:09.818154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:09.827825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:09.829361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:09.830712 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c008f97-46a8-43ab-9eca-9ff657dafb5c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 0.516527 Aug 30 04:17:09.847364 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1039/2142] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:09 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:09.863411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:09.864173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:09.878586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:09.880071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:09.882984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:09.883931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:09.890309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:09.890790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:09.975502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:10.142109 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f827afcc-2023-4771-af53-5ba1abe1acc1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "DELETE /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 204 len: 0 microversion: 2.1 time: 0.292721 Aug 30 04:17:10.142710 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1040/2143] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:17:09 2022] DELETE /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:10.148599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:10.149484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:10.164274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:10.170516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:10.171179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:10.176450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:10.177113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:10.177748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:10.531966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:10.547646 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3ae96a3a-1918-4579-8704-2355b5b25181 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1319 microversion: 2.1 time: 0.400601 Aug 30 04:17:10.548746 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1041/2144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:10 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:10.558461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d604d8bf-fdc4-43c1-872f-037ff862a70c req-bc901f38-e68d-4b80-b2ed-70260144d1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02b32e6-e90f-4147-aa06-b46a310ce5c7", "name": "network-vif-plugged", "status": "completed", "tag": "ada4f8f8-2133-4aa5-94fd-9659a7340c84"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:10.599091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d604d8bf-fdc4-43c1-872f-037ff862a70c req-bc901f38-e68d-4b80-b2ed-70260144d1c8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:10.600383 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0146ad1d-55a0-4214-8611-31b59b634465 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.760233 Aug 30 04:17:10.602075 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1104/2145] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:17:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:10.603035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d604d8bf-fdc4-43c1-872f-037ff862a70c req-bc901f38-e68d-4b80-b2ed-70260144d1c8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:10.603488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d604d8bf-fdc4-43c1-872f-037ff862a70c req-bc901f38-e68d-4b80-b2ed-70260144d1c8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:10.608511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-60a9c535-f451-40d8-89eb-c50cac000ce6 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a8e29d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:10.646782 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d604d8bf-fdc4-43c1-872f-037ff862a70c req-bc901f38-e68d-4b80-b2ed-70260144d1c8 service nova] Creating event network-vif-plugged:ada4f8f8-2133-4aa5-94fd-9659a7340c84 for instance b02b32e6-e90f-4147-aa06-b46a310ce5c7 on n-h2-854925-5 Aug 30 04:17:10.667318 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d604d8bf-fdc4-43c1-872f-037ff862a70c req-bc901f38-e68d-4b80-b2ed-70260144d1c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113391 Aug 30 04:17:10.678878 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1042/2146] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:10.689572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:10.689572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:10.718796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:10.720817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:10.723227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:10.725690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:10.727867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:10.734691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:11.068925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:11.089449 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dfd8f069-2895-42c3-b96d-f1b6824e0625 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1466 microversion: 2.1 time: 0.406753 Aug 30 04:17:11.113046 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1043/2147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:10 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1466 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:11.124410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-8ab2b01f-8f20-4588-ba79-356e27869b29 req-4de4d003-8171-48bc-9d5a-d9ce16e0a468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48629095-3618-4858-88c0-badfb3542742", "tag": "320a546b-55fd-49ce-9b2c-318c72cc68ff"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:11.128674 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-60a9c535-f451-40d8-89eb-c50cac000ce6 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/37f30354-c02a-4b30-87e9-3eda3f37c302" status: 202 len: 0 microversion: 2.1 time: 0.524813 Aug 30 04:17:11.129865 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1105/2148] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:10 2022] DELETE /compute/v2.1/os-security-groups/37f30354-c02a-4b30-87e9-3eda3f37c302 => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:11.150709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8ab2b01f-8f20-4588-ba79-356e27869b29 req-4de4d003-8171-48bc-9d5a-d9ce16e0a468 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:11.153174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8ab2b01f-8f20-4588-ba79-356e27869b29 req-4de4d003-8171-48bc-9d5a-d9ce16e0a468 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:11.153941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8ab2b01f-8f20-4588-ba79-356e27869b29 req-4de4d003-8171-48bc-9d5a-d9ce16e0a468 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:11.160920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78aace37-5f78-42f4-a6e0-44b90d3c1f84 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Calling method '.version_select at 0x7fe96b14f700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:11.174124 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-8ab2b01f-8f20-4588-ba79-356e27869b29 req-4de4d003-8171-48bc-9d5a-d9ce16e0a468 service nova] Creating event network-changed:320a546b-55fd-49ce-9b2c-318c72cc68ff for instance 48629095-3618-4858-88c0-badfb3542742 on n-h1-854925-5 Aug 30 04:17:11.179048 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-8ab2b01f-8f20-4588-ba79-356e27869b29 req-4de4d003-8171-48bc-9d5a-d9ce16e0a468 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064326 Aug 30 04:17:11.180058 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1044/2149] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:11.186819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:11.187750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:11.194888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:11.196914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:11.199763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:11.201000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:11.202195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:11.202625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:11.753028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:11.766239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:11.767942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:11.769289 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8e09e862-2174-4a58-9207-a6177b767bce tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 0.587694 Aug 30 04:17:11.772456 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1045/2150] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:11 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:11.782456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f3faf0ef-9203-405a-8691-3e6adf3351d2 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a52c9d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:12.232861 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f3faf0ef-9203-405a-8691-3e6adf3351d2 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/daf93885-4975-477a-bd77-747b5546740a" status: 200 len: 245 microversion: 2.1 time: 0.456450 Aug 30 04:17:12.233626 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1046/2151] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:17:11 2022] GET /compute/v2.1/os-security-groups/daf93885-4975-477a-bd77-747b5546740a => generated 245 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:12.243337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:12.244147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:12.254319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:12.255485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:12.256289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:12.257643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:12.260508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:12.261050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:12.298358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:13.045708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:13.064027 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-61d17abb-ae0c-4f09-a62e-c1f157550787 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 200 len: 1507 microversion: 2.1 time: 0.826987 Aug 30 04:17:13.066649 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1047/2152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:12 2022] GET /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 1507 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:13.077628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:13.081056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:13.100752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:13.101260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:13.101755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:13.102493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:13.103222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:13.103674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:13.473931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:13.476574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:13.490389 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cde0bfff-eb6c-40bc-994f-76bab1c0c3a8 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1466 microversion: 2.1 time: 0.422378 Aug 30 04:17:13.492055 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1048/2153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:13 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1466 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:13.496973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-696971e5-c8e6-403b-b491-b2a5dd778faa tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a38e160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-783133005", "description": "tempest-description-1532429428"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:14.241013 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-696971e5-c8e6-403b-b491-b2a5dd778faa tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.747511 Aug 30 04:17:14.245500 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1049/2154] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:17:13 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:14.254728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c37c184e-ff88-47ac-9bd5-4a544567eded req-f63a27f5-762b-4b4b-a033-b67147b5087f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e83c416-fbce-4464-a84c-0fc595002bc8", "name": "network-vif-plugged", "status": "completed", "tag": "7ae7b7fd-bfaf-479e-860c-dd44ce2b7beb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:14.259822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:14.270840 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78aace37-5f78-42f4-a6e0-44b90d3c1f84 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d" status: 202 len: 0 microversion: 2.1 time: 3.139731 Aug 30 04:17:14.272089 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1106/2155] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:17:11 2022] DELETE /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d => generated 0 bytes in 3142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:14.284039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:14.287249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:14.299789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c37c184e-ff88-47ac-9bd5-4a544567eded req-f63a27f5-762b-4b4b-a033-b67147b5087f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.300283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c37c184e-ff88-47ac-9bd5-4a544567eded req-f63a27f5-762b-4b4b-a033-b67147b5087f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.302721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c37c184e-ff88-47ac-9bd5-4a544567eded req-f63a27f5-762b-4b4b-a033-b67147b5087f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.328592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.329855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.330395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.331337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.332983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.333637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.348846 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c37c184e-ff88-47ac-9bd5-4a544567eded req-f63a27f5-762b-4b4b-a033-b67147b5087f service nova] Creating event network-vif-plugged:7ae7b7fd-bfaf-479e-860c-dd44ce2b7beb for instance 3e83c416-fbce-4464-a84c-0fc595002bc8 on n-h1-854925-5 Aug 30 04:17:14.359416 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c37c184e-ff88-47ac-9bd5-4a544567eded req-f63a27f5-762b-4b4b-a033-b67147b5087f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116018 Aug 30 04:17:14.371334 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1050/2156] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:14.377372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:14.378341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: 3e83c416-fbce-4464-a84c-0fc595002bc8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:14.386855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.387651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.388286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.389249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.389948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.390567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.728502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:14.737428 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a157c83-33ea-4b21-afa1-558b399654ba tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8" status: 200 len: 1319 microversion: 2.1 time: 0.364599 Aug 30 04:17:14.738038 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1051/2157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:14 2022] GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:14.750597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:14.753295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:14.754210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:14.765862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:14.767702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:14.768122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.769084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.769726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.770901 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b8978a43-3e81-40a7-b770-1d2fd010ca8b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 0.497296 Aug 30 04:17:14.771366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.772462 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1107/2158] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:14 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:14.772571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.773576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.781768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4ac5d61b-00de-4680-89b9-07a287e09901 req-7972c1f8-968f-4ea0-a216-98652dc1e17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050a5f4e-173f-4100-914f-f4ea5d397e68", "name": "network-vif-deleted", "tag": "4e8451ff-68c7-4a66-a389-82427d8e1c41"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:14.809053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4ac5d61b-00de-4680-89b9-07a287e09901 req-7972c1f8-968f-4ea0-a216-98652dc1e17d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:14.811220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4ac5d61b-00de-4680-89b9-07a287e09901 req-7972c1f8-968f-4ea0-a216-98652dc1e17d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:14.813995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4ac5d61b-00de-4680-89b9-07a287e09901 req-7972c1f8-968f-4ea0-a216-98652dc1e17d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:14.840593 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4ac5d61b-00de-4680-89b9-07a287e09901 req-7972c1f8-968f-4ea0-a216-98652dc1e17d service nova] Creating event network-vif-deleted:4e8451ff-68c7-4a66-a389-82427d8e1c41 for instance 050a5f4e-173f-4100-914f-f4ea5d397e68 on n-h1-854925-5 Aug 30 04:17:14.853787 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4ac5d61b-00de-4680-89b9-07a287e09901 req-7972c1f8-968f-4ea0-a216-98652dc1e17d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076484 Aug 30 04:17:14.859996 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1108/2159] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:14.869556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2469ac56-60af-43ba-a5a4-97a17a6bb6e2 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96e616ca0>, body: {"security_group_rule": {"parent_group_id": "77f20a83-7cf7-4193-82db-df45104d9f47", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:15.060169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 8d0a8293-be54-4224-956f-44539222c466 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:15.086207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-97c09615-512e-4967-98b6-10ca0b0b2a74 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 2345 microversion: 2.25 time: 0.346478 Aug 30 04:17:15.087227 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1052/2160] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:14 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 2345 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:15.092737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c63e9fb-af40-4c96-81ed-23dadae9f334 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Calling method '.version_select at 0x7fe96a33b670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:15.171260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-7c63e9fb-af40-4c96-81ed-23dadae9f334 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 69fd8c2e-5a20-45c1-91ff-a3235603728d could not be found", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:17:15.172172 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7c63e9fb-af40-4c96-81ed-23dadae9f334 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] HTTP exception thrown: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c63e9fb-af40-4c96-81ed-23dadae9f334 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Request method failure captured: Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d HTTP/1.1 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY81hDtuO19cmSv-ZPXomNejpcJoWM-CQXIAI_N6ohqNvgHSZyLCZpmNRIjpPilBi79nFXhgF_78G_2FsXpeNJ9-c6VzIJqvs4qJqq6_g_UvUXzA3CPJ1RmCt5TVXVPkmTjSnp2D3EdvxC6wKuLgpgwZlZ-xndhIOQWGpGNzqwSJ0ek Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: b6b5b335bb4d4396b27e784d14a486e6 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsTestJSON-1371999414 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6b5b335bb4d4396b27e784d14a486e6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6b5b335bb4d4396b27e784d14a486e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6b5b335bb4d4396b27e784d14a486e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6b5b335bb4d4396b27e784d14a486e6"}]}] Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsTestJSON-1371999414 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: b6b5b335bb4d4396b27e784d14a486e6 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1371999414 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsTestJSON-1371999414-project Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0133b473e43844aaaba260ab74fa3f2a Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsTestJSON-1371999414-project Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: exception: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '69fd8c2e-5a20-45c1-91ff-a3235603728d'} Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 69fd8c2e-5a20-45c1-91ff-a3235603728d could not be found Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f90a7f45-0f31-4626-bf0d-95565874fa26'] Aug 30 04:17:15.174409 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d. Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.178410 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.182251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c63e9fb-af40-4c96-81ed-23dadae9f334 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Returning 404 to user: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:15.183254 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c63e9fb-af40-4c96-81ed-23dadae9f334 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d" status: 404 len: 111 microversion: 2.1 time: 0.094319 Aug 30 04:17:15.184499 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1053/2161] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:17:15 2022] GET /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:17:15.195939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:15.196749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:15.204554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.205505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.206091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.206975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.207573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.208145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.263821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.264956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.265733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.266469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lazy-loading 'fault' on Instance uuid 050a5f4e-173f-4100-914f-f4ea5d397e68 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:15.317145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:15.323782 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2469ac56-60af-43ba-a5a4-97a17a6bb6e2 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.461446 Aug 30 04:17:15.324860 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1109/2162] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:17:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:15.327572 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2426ec17-6e8f-417f-9f5c-a54607f7e1f5 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1309 microversion: 2.1 time: 0.139543 Aug 30 04:17:15.332675 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1054/2163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:15 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:15.342738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f887eaa-bdcb-4842-b9f2-e41f3d0451c1 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Calling method '.version_select at 0x7fe96a5aae50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:15.350198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:15.354539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.355208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.355809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.356723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.358136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.358721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.386603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ce89030-9f55-4417-8a6b-dfc06167a489 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.060430 Aug 30 04:17:15.405157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-3f887eaa-bdcb-4842-b9f2-e41f3d0451c1 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 69fd8c2e-5a20-45c1-91ff-a3235603728d could not be found", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:17:15.405157 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-3f887eaa-bdcb-4842-b9f2-e41f3d0451c1 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] HTTP exception thrown: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f887eaa-bdcb-4842-b9f2-e41f3d0451c1 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Request method failure captured: Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d HTTP/1.1 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY81hDtuO19cmSv-ZPXomNejpcJoWM-CQXIAI_N6ohqNvgHSZyLCZpmNRIjpPilBi79nFXhgF_78G_2FsXpeNJ9-c6VzIJqvs4qJqq6_g_UvUXzA3CPJ1RmCt5TVXVPkmTjSnp2D3EdvxC6wKuLgpgwZlZ-xndhIOQWGpGNzqwSJ0ek Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: b6b5b335bb4d4396b27e784d14a486e6 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsTestJSON-1371999414 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b6b5b335bb4d4396b27e784d14a486e6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b6b5b335bb4d4396b27e784d14a486e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6b5b335bb4d4396b27e784d14a486e6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b6b5b335bb4d4396b27e784d14a486e6"}]}] Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsTestJSON-1371999414 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: b6b5b335bb4d4396b27e784d14a486e6 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1371999414 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsTestJSON-1371999414-project Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0133b473e43844aaaba260ab74fa3f2a Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsTestJSON-1371999414-project Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: exception: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '69fd8c2e-5a20-45c1-91ff-a3235603728d'} Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 69fd8c2e-5a20-45c1-91ff-a3235603728d could not be found Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee9828e1-b6e3-43e7-b0eb-e158fde0e902'] Aug 30 04:17:15.406186 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d. Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f887eaa-bdcb-4842-b9f2-e41f3d0451c1 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] Returning 404 to user: Floating IP not found for ID 69fd8c2e-5a20-45c1-91ff-a3235603728d {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3f887eaa-bdcb-4842-b9f2-e41f3d0451c1 tempest-FloatingIPsTestJSON-1371999414 tempest-FloatingIPsTestJSON-1371999414-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d" status: 404 len: 111 microversion: 2.1 time: 0.073553 Aug 30 04:17:15.409691 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1055/2164] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:17:15 2022] DELETE /compute/v2.1/os-floating-ips/69fd8c2e-5a20-45c1-91ff-a3235603728d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:17:15.413090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21d8f4ea-78ff-4148-9731-a239ac0a8332 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Action: 'create', calling method: .version_select at 0x7fe96a0788b0>, body: {"security_group_rule": {"parent_group_id": "77f20a83-7cf7-4193-82db-df45104d9f47", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:15.420841 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1110/2165] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Aug 30 04:17:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:17:15.758587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:15.759567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: 3e83c416-fbce-4464-a84c-0fc595002bc8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:15.771620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.773696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.774415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:15.776384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:15.778064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:15.780434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:16.533625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:16.548168 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b1e2450-fc8d-437d-8711-366947ea78e1 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8" status: 200 len: 1319 microversion: 2.1 time: 0.793719 Aug 30 04:17:16.562248 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1111/2166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:15 2022] GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8 => generated 1319 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:16.567847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:16.583665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:16.594464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:16.597388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:16.598046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:16.598971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:16.606137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:16.607135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.107240 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21d8f4ea-78ff-4148-9731-a239ac0a8332 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.697542 Aug 30 04:17:17.115884 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1056/2167] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:17:15 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:17.128724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:17.129865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:17.143695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:17.149198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:17.149972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.150975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:17.151657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:17.152314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.168175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:17.192032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:17.195599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:17.203459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-85d79926-f971-4c18-b6ee-a377f0ef810c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 0.640047 Aug 30 04:17:17.204657 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1112/2168] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:16 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:17.223668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a89f01a0-51ef-404c-a108-e74ce80abb12 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a3500d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:17.279002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:17.280234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:17.283396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.284056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lazy-loading 'fault' on Instance uuid 050a5f4e-173f-4100-914f-f4ea5d397e68 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:17.457074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:17.475060 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ef6d487-b812-4306-8c84-1d74484119dd tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 200 len: 1309 microversion: 2.1 time: 0.355647 Aug 30 04:17:17.477507 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1057/2169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:17 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:17.578933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:17.579866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: 3e83c416-fbce-4464-a84c-0fc595002bc8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:17.593715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:17.597974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:17.599348 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a89f01a0-51ef-404c-a108-e74ce80abb12 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/77f20a83-7cf7-4193-82db-df45104d9f47" status: 200 len: 664 microversion: 2.1 time: 0.390684 Aug 30 04:17:17.600044 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1113/2170] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:17:17 2022] GET /compute/v2.1/os-security-groups/77f20a83-7cf7-4193-82db-df45104d9f47 => generated 664 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:17.601267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.602359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:17.605285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:17.605821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:17.613869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d081bc5-506d-4daa-930b-5ab135da0715 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96e616700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:18.327839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:18.354216 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee6e2c70-90d6-4f1d-8d25-8fdfa64e4324 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8" status: 200 len: 1319 microversion: 2.1 time: 0.785199 Aug 30 04:17:18.372633 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1058/2171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:17 2022] GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8 => generated 1319 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:18.386853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:18.389843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:18.405445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.406843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.408741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:18.411132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.411909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.413933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:18.712478 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d081bc5-506d-4daa-930b-5ab135da0715 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/c42af05d-6f60-4609-8ffa-a8cd9948777d" status: 202 len: 0 microversion: 2.1 time: 1.103053 Aug 30 04:17:18.716205 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1114/2172] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Aug 30 04:17:17 2022] DELETE /compute/v2.1/os-security-group-rules/c42af05d-6f60-4609-8ffa-a8cd9948777d => generated 0 bytes in 1108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:18.726699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6696579a-4949-4d3c-af64-4bbfa59ab2a2", "device": "/dev/xvdb"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:18.734133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:18.750541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:18.755611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.756934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.777385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:18.779963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.784751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.785480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:18.906430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:18.922159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:18.923614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:18.924752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8d6f5537-6311-4449-8938-08d11ec9591a tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 0.550679 Aug 30 04:17:18.925313 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1059/2173] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:18 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:18.939543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:18.944839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 050a5f4e-173f-4100-914f-f4ea5d397e68] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:18.980161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.980663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.981089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:18.994812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:18.995175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:18.995616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:19.021906 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] HTTP exception thrown: Instance 050a5f4e-173f-4100-914f-f4ea5d397e68 could not be found. Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Request method failure captured: Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 HTTP/1.1 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY8LbC6FXmWDwDE4xYf8t67oIrzlUC27Am_5is418vVO0DHrIaWu0mgxJuHrLf0vcL8dzROqeo2M20zSJ0iHqL6nXu1i52E7ELtZqJn9GW827p1tln6NyJLFbHwxqDhquizoZ4uG9h7eiwTZv_TcW3NTcL7BczJ8uDeQydRUM2vUoHg Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 88ebede3b3a747d8bbad3dd1af8da400 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveMigrationNegativeTest-2125721714 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88ebede3b3a747d8bbad3dd1af8da400", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88ebede3b3a747d8bbad3dd1af8da400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88ebede3b3a747d8bbad3dd1af8da400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88ebede3b3a747d8bbad3dd1af8da400"}]}] Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveMigrationNegativeTest-2125721714 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 88ebede3b3a747d8bbad3dd1af8da400 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2125721714 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveMigrationNegativeTest-2125721714-project Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 05535ec48e11452eb2e49f89e0f2ba26 Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveMigrationNegativeTest-2125721714-project Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 050a5f4e-173f-4100-914f-f4ea5d397e68 could not be found. Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '050a5f4e-173f-4100-914f-f4ea5d397e68'} Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 050a5f4e-173f-4100-914f-f4ea5d397e68 could not be found. Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 050a5f4e-173f-4100-914f-f4ea5d397e68 could not be found. Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:19.027863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:19.033699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:19.033699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:19.033699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:19.033699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:19.033699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:19.033699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 050a5f4e-173f-4100-914f-f4ea5d397e68 could not be found. Aug 30 04:17:19.033699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:19.035330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Returning 404 to user: Instance 050a5f4e-173f-4100-914f-f4ea5d397e68 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:19.037649 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-16530e95-c832-4d1c-a7f4-a7a55450da24 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68" status: 404 len: 111 microversion: 2.1 time: 0.100803 Aug 30 04:17:19.040040 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1060/2174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:18 2022] GET /compute/v2.1/servers/050a5f4e-173f-4100-914f-f4ea5d397e68 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:17:19.047673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0927f870-d757-41b7-b0e5-bd2be4e2ec85 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a597430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:19.481505 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0927f870-d757-41b7-b0e5-bd2be4e2ec85 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/77f20a83-7cf7-4193-82db-df45104d9f47" status: 202 len: 0 microversion: 2.1 time: 0.440030 Aug 30 04:17:19.486795 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1061/2175] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:19 2022] DELETE /compute/v2.1/os-security-groups/77f20a83-7cf7-4193-82db-df45104d9f47 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:19.492753 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b450060-7e76-4659-999a-cf75b54bcc61 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "POST /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.770496 Aug 30 04:17:19.496535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:19.497227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:19.512593 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1115/2176] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Aug 30 04:17:18 2022] POST /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:17:19.523066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:19.523864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:19.526710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:19.529595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:19.530250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:19.531929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:19.556028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:19.557020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: 3e83c416-fbce-4464-a84c-0fc595002bc8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:19.571778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:19.573406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:19.577968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:19.580168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:19.580852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:19.584686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:19.634423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:19.867763 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3de98e2e-c449-430d-9b05-02c048f461eb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 204 len: 0 microversion: 2.1 time: 0.378373 Aug 30 04:17:19.869696 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1062/2177] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:17:19 2022] DELETE /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:19.879947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c788ec0-e8f9-4d2e-9052-dd6da6fd0c1a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a70ddc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:20.057967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-9c788ec0-e8f9-4d2e-9052-dd6da6fd0c1a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:17:20.058883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-9c788ec0-e8f9-4d2e-9052-dd6da6fd0c1a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Neutron security group 37f30354-c02a-4b30-87e9-3eda3f37c302 not found {{(pid=122402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:17:20.059587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-9c788ec0-e8f9-4d2e-9052-dd6da6fd0c1a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] HTTP exception thrown: Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist Aug 30 04:17:20.059587 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-44df010e-2631-44cb-a3b0-a306b5d5f10c'] Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c788ec0-e8f9-4d2e-9052-dd6da6fd0c1a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Request method failure captured: Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-security-groups/37f30354-c02a-4b30-87e9-3eda3f37c302 HTTP/1.1 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY80uLZ06Qp0mxXdpiVZuF16ekza5jYRRuOTZ0_LF1M3XDMv0l7BtSFPcyLsvOWiq_mx8q-3RcuPIDnGGBghvy7ulCqofbQeWVfwoEqAycRt8JsbPQ3Dpz7il1GKJ4VL5LZ3J_WKKpffLsS3kArUbyfUiUEBhihDNwt5uTN2YBx7nac Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 95f8bcd5fbd6495eb7fa81c907575280 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1955207968 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_95f8bcd5fbd6495eb7fa81c907575280", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/95f8bcd5fbd6495eb7fa81c907575280"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95f8bcd5fbd6495eb7fa81c907575280"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/95f8bcd5fbd6495eb7fa81c907575280"}]}] Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1955207968 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 95f8bcd5fbd6495eb7fa81c907575280 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1955207968 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupRulesTestJSON-1955207968-project Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: a7bbb09b80704cc5b9c6bc3e1962aba8 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1955207968-project Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-44df010e-2631-44cb-a3b0-a306b5d5f10c'] Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '37f30354-c02a-4b30-87e9-3eda3f37c302'} Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:17:20.061644 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44df010e-2631-44cb-a3b0-a306b5d5f10c'] Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44df010e-2631-44cb-a3b0-a306b5d5f10c'] Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44df010e-2631-44cb-a3b0-a306b5d5f10c'] Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44df010e-2631-44cb-a3b0-a306b5d5f10c'] Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c788ec0-e8f9-4d2e-9052-dd6da6fd0c1a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Returning 404 to user: Security group 37f30354-c02a-4b30-87e9-3eda3f37c302 does not exist Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-44df010e-2631-44cb-a3b0-a306b5d5f10c'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c788ec0-e8f9-4d2e-9052-dd6da6fd0c1a tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/37f30354-c02a-4b30-87e9-3eda3f37c302" status: 404 len: 194 microversion: 2.1 time: 0.192029 Aug 30 04:17:20.065701 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1063/2178] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:19 2022] DELETE /compute/v2.1/os-security-groups/37f30354-c02a-4b30-87e9-3eda3f37c302 => generated 194 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:17:20.080044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:20.081078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:20.098952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:20.099700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:20.100281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:20.101142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:20.101761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:20.102327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:20.396404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:20.408697 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4cf17de-7eb0-4f61-bdbd-141eb7e505c0 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8" status: 200 len: 1506 microversion: 2.1 time: 0.893683 Aug 30 04:17:20.416438 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1116/2179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:19 2022] GET /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8 => generated 1506 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:20.423548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:20.425372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:20.435721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:20.437042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:20.445408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:20.446207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:20.446689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:20.447137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:20.477308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:20.487563 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e871fa20-e8b8-4119-9fae-8042398e8dfb tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1475 microversion: 2.1 time: 0.419420 Aug 30 04:17:20.492197 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1064/2180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:20 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1475 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:20.500760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f66f9d4-95ba-486d-873e-478f1599129b tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a70ddc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:20.807872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:20.825527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:20.829367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:20.839997 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a2f75589-1791-4091-9493-fc0b80598d1c tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 0.414568 Aug 30 04:17:20.840645 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1117/2181] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:20 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:20.860508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:20.863405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: 3e83c416-fbce-4464-a84c-0fc595002bc8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:20.883329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:20.886171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:20.887356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:20.888077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:20.890086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:20.890824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:20.964385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: 3e83c416-fbce-4464-a84c-0fc595002bc8] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:20.971287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:21.084663 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bdc71674-ff09-4eb5-9c27-a87f4dbf73aa tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8" status: 204 len: 0 microversion: 2.1 time: 0.237812 Aug 30 04:17:21.088178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1118/2182] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:17:20 2022] DELETE /compute/v2.1/servers/3e83c416-fbce-4464-a84c-0fc595002bc8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:21.097460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:21.098280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:21.105657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:21.106143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:21.106737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:21.108233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:21.108828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:21.109422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:21.174730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b02b32e6-e90f-4147-aa06-b46a310ce5c7] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:21.339747 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5f66f9d4-95ba-486d-873e-478f1599129b tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/daf93885-4975-477a-bd77-747b5546740a" status: 202 len: 0 microversion: 2.1 time: 0.844056 Aug 30 04:17:21.340475 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1065/2183] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:20 2022] DELETE /compute/v2.1/os-security-groups/daf93885-4975-477a-bd77-747b5546740a => generated 0 bytes in 848 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:21.351275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-830bc45e-d6fb-492c-90e2-f4515c85312b tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a253700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:21.424806 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64395311-4310-4361-a33c-ad30fc7d0d98 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7" status: 204 len: 0 microversion: 2.1 time: 0.331553 Aug 30 04:17:21.426631 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1119/2184] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:17:21 2022] DELETE /compute/v2.1/servers/b02b32e6-e90f-4147-aa06-b46a310ce5c7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:21.524346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:21.525360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:21.539681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:21.540458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:21.542029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:21.543105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:21.549006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:21.549695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:21.981945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:21.998951 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14f20dcf-4298-424b-9c65-f64c79a54cd1 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1475 microversion: 2.1 time: 0.478059 Aug 30 04:17:21.999487 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1120/2185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:21 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1475 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:22.006845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-74616587", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "5bf790d5-0143-4cee-ace0-8c022de9b200"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:22.112284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] validate_networks() for [('5bf790d5-0143-4cee-ace0-8c022de9b200', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:17:22.614873 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-830bc45e-d6fb-492c-90e2-f4515c85312b tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/03ae8f33-accb-4a2d-948d-d30752c7e414" status: 202 len: 0 microversion: 2.1 time: 1.268956 Aug 30 04:17:22.619950 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1066/2186] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:21 2022] DELETE /compute/v2.1/os-security-groups/03ae8f33-accb-4a2d-948d-d30752c7e414 => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:22.628451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:22.630779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:22.699529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:22.700846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:22.702581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:22.706219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:22.706866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:22.707453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:23.780317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:23.799856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:23.803474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:23.808051 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bac5e60a-3776-4e7a-a8dd-44e0a0299133 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 1.185254 Aug 30 04:17:23.808841 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1067/2187] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:22 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:23.822708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83be6cc6-871a-4725-9fd8-d88333660aca tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a52cca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:24.447960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:17:24.449091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:17:24.450144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:17:24.450733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:17:24.452395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:17:24.484984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:24.485850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:24.486495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:24.487437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:24.489831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:24.493996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:24.530894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=7 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:24.587207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Getting quotas for project 257ce0030c904e27b498cd8cf55d7b0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:17:24.605527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Getting quotas for user 88ecec6327344b63b4216b8e520c969c and project 257ce0030c904e27b498cd8cf55d7b0b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:17:24.650724 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83be6cc6-871a-4725-9fd8-d88333660aca tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/80570121-b46f-4bda-8646-355f91ef042e" status: 202 len: 0 microversion: 2.1 time: 0.836190 Aug 30 04:17:24.651331 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1068/2188] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:23 2022] DELETE /compute/v2.1/os-security-groups/80570121-b46f-4bda-8646-355f91ef042e => generated 0 bytes in 842 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:24.656526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:24.657206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:24.682684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Going to run 2 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:17:24.685086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:17:24.689321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:24.689883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:24.690335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:24.691086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:24.691546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:24.691977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:24.798579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=d5c1f032-0c6e-4970-87f2-88fe9e982d5c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:17:24.938422 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d2865376-04e2-4d8b-a456-76ed407be996 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.931694 Aug 30 04:17:24.940213 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1121/2189] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:17:22 2022] POST /compute/v2.1/servers => generated 32 bytes in 2939 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:17:24.948172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d3fff7ab-70f0-4393-b714-90e196fa2929 req-8e72bf4c-8fe7-46b6-890b-b4eac89d9f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48629095-3618-4858-88c0-badfb3542742", "name": "network-vif-plugged", "status": "completed", "tag": "320a546b-55fd-49ce-9b2c-318c72cc68ff"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:24.974977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d3fff7ab-70f0-4393-b714-90e196fa2929 req-8e72bf4c-8fe7-46b6-890b-b4eac89d9f12 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:24.976447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d3fff7ab-70f0-4393-b714-90e196fa2929 req-8e72bf4c-8fe7-46b6-890b-b4eac89d9f12 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:24.979814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d3fff7ab-70f0-4393-b714-90e196fa2929 req-8e72bf4c-8fe7-46b6-890b-b4eac89d9f12 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:25.007159 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d3fff7ab-70f0-4393-b714-90e196fa2929 req-8e72bf4c-8fe7-46b6-890b-b4eac89d9f12 service nova] Creating event network-vif-plugged:320a546b-55fd-49ce-9b2c-318c72cc68ff for instance 48629095-3618-4858-88c0-badfb3542742 on n-h1-854925-5 Aug 30 04:17:25.020797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d3fff7ab-70f0-4393-b714-90e196fa2929 req-8e72bf4c-8fe7-46b6-890b-b4eac89d9f12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077405 Aug 30 04:17:25.026217 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1122/2190] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:25.035682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6ab2f1d3-769d-4390-b77f-151d421d66d0 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a3a8b80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:26.009696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:26.026304 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5c1dc61-698b-4e1c-a433-de7e77947bf6 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1475 microversion: 2.1 time: 1.370589 Aug 30 04:17:26.030650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1069/2191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:24 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1475 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:26.052011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:26.056435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:26.069258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:26.072312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:26.075267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:26.076121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:26.077137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:26.077785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.013572 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6ab2f1d3-769d-4390-b77f-151d421d66d0 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/067e8577-4bc0-406a-8af4-e55a80c1b31b" status: 202 len: 0 microversion: 2.1 time: 1.983894 Aug 30 04:17:27.014989 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1123/2192] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:25 2022] DELETE /compute/v2.1/os-security-groups/067e8577-4bc0-406a-8af4-e55a80c1b31b => generated 0 bytes in 1988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:27.022322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:27.044179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:27.044179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Searching by: {'deleted': False, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:17:27.069669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.072340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.077451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:27.087074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.089315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.092316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.092993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:27.093652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.103292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:27.105240 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d4cc3dc-adff-4e7d-b152-a7764af09d28 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 1.072999 Aug 30 04:17:27.112919 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1070/2193] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:26 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:27.130700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5c5e8762-652b-45c4-b666-c70947812279 req-785f0f71-5be5-45a1-adb8-95232dc119d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b02b32e6-e90f-4147-aa06-b46a310ce5c7", "name": "network-vif-deleted", "tag": "ada4f8f8-2133-4aa5-94fd-9659a7340c84"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:27.156243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5c5e8762-652b-45c4-b666-c70947812279 req-785f0f71-5be5-45a1-adb8-95232dc119d0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.158574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5c5e8762-652b-45c4-b666-c70947812279 req-785f0f71-5be5-45a1-adb8-95232dc119d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.159755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5c5e8762-652b-45c4-b666-c70947812279 req-785f0f71-5be5-45a1-adb8-95232dc119d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.181912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:17:27.191432 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5c5e8762-652b-45c4-b666-c70947812279 req-785f0f71-5be5-45a1-adb8-95232dc119d0 service nova] Creating event network-vif-deleted:ada4f8f8-2133-4aa5-94fd-9659a7340c84 for instance b02b32e6-e90f-4147-aa06-b46a310ce5c7 on n-h2-854925-5 Aug 30 04:17:27.206749 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5c5e8762-652b-45c4-b666-c70947812279 req-785f0f71-5be5-45a1-adb8-95232dc119d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091003 Aug 30 04:17:27.209355 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1071/2194] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:27.222815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b2cf495-5085-4b02-9551-2cf730e70fd0 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] Calling method '.version_select at 0x7fe96a368670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:27.257233 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e8e3ad81-fdd3-4e22-b91b-84103addcc25 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.236526 Aug 30 04:17:27.258057 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1124/2195] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:17:27 2022] GET /compute/v2.1/servers => generated 1000 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:27.272381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:27.273484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:27.287612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.288471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.289851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.292480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.294035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.295253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.376189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.377044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.377718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.380133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lazy-loading 'fault' on Instance uuid 1266aec0-b13b-4966-8aad-d413ab5a0680 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:27.476485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05535ec48e11452eb2e49f89e0f2ba26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88ebede3b3a747d8bbad3dd1af8da400', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:27.491453 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46496c2d-1ab9-454d-864e-65831675540d tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 200 len: 1309 microversion: 2.1 time: 0.232025 Aug 30 04:17:27.498977 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1125/2196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:27 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 1309 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:27.522964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:27.524180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:27.549258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.556470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.556988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.562797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:27.563582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:27.564031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:27.725630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:27.735678 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-223e30ae-e469-4101-8d5f-1359600ad8f7 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1220 microversion: 2.1 time: 0.232210 Aug 30 04:17:27.740857 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1126/2197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:27 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1220 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:28.082590 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b2cf495-5085-4b02-9551-2cf730e70fd0 tempest-SecurityGroupRulesTestJSON-1955207968 tempest-SecurityGroupRulesTestJSON-1955207968-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/81dd80d1-ccce-4ce7-9d46-0593481878db" status: 202 len: 0 microversion: 2.1 time: 0.869631 Aug 30 04:17:28.083187 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1072/2198] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:17:27 2022] DELETE /compute/v2.1/os-security-groups/81dd80d1-ccce-4ce7-9d46-0593481878db => generated 0 bytes in 873 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:17:28.130735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:28.131351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:28.147894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.151411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.152327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.156901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.158622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.161284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.529166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:28.530084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] [instance: 1266aec0-b13b-4966-8aad-d413ab5a0680] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:28.558539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.559281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.559920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.561451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.568948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.569641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.600982 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] HTTP exception thrown: Instance 1266aec0-b13b-4966-8aad-d413ab5a0680 could not be found. Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Request method failure captured: Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 HTTP/1.1 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY8LbC6FXmWDwDE4xYf8t67oIrzlUC27Am_5is418vVO0DHrIaWu0mgxJuHrLf0vcL8dzROqeo2M20zSJ0iHqL6nXu1i52E7ELtZqJn9GW827p1tln6NyJLFbHwxqDhquizoZ4uG9h7eiwTZv_TcW3NTcL7BczJ8uDeQydRUM2vUoHg Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 88ebede3b3a747d8bbad3dd1af8da400 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveMigrationNegativeTest-2125721714 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_88ebede3b3a747d8bbad3dd1af8da400", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/88ebede3b3a747d8bbad3dd1af8da400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88ebede3b3a747d8bbad3dd1af8da400"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/88ebede3b3a747d8bbad3dd1af8da400"}]}] Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveMigrationNegativeTest-2125721714 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 88ebede3b3a747d8bbad3dd1af8da400 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2125721714 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveMigrationNegativeTest-2125721714-project Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 05535ec48e11452eb2e49f89e0f2ba26 Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveMigrationNegativeTest-2125721714-project Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1266aec0-b13b-4966-8aad-d413ab5a0680 could not be found. Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1266aec0-b13b-4966-8aad-d413ab5a0680'} Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1266aec0-b13b-4966-8aad-d413ab5a0680 could not be found. Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1266aec0-b13b-4966-8aad-d413ab5a0680 could not be found. Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:28.603658 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:28.607762 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:28.607762 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:28.607762 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:28.607762 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:28.607762 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:28.607762 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1266aec0-b13b-4966-8aad-d413ab5a0680 could not be found. Aug 30 04:17:28.607762 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:28.613495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] Returning 404 to user: Instance 1266aec0-b13b-4966-8aad-d413ab5a0680 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:28.614687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99381c57-9b79-4c20-8915-817848633504 tempest-LiveMigrationNegativeTest-2125721714 tempest-LiveMigrationNegativeTest-2125721714-project] 10.222.0.27 "GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680" status: 404 len: 111 microversion: 2.1 time: 0.091179 Aug 30 04:17:28.615829 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1073/2199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:28 2022] GET /compute/v2.1/servers/1266aec0-b13b-4966-8aad-d413ab5a0680 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:17:28.760843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:28.761657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:28.773581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.774264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.774932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.775979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:28.776647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:28.777279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:28.936858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:28.946553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:28.959711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:28.996118 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-537c23a8-9dad-410b-8f1c-079972c1b162 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1358 microversion: 2.21 time: 0.835017 Aug 30 04:17:28.999677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:29.004295 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1127/2200] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:28 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1358 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:29.014178 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e1a438b-450a-4c19-a709-1009bff7d46b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1268 microversion: 2.1 time: 0.254513 Aug 30 04:17:29.030735 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1074/2201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:28 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1268 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:29.317237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a6316c7c-689d-4fa0-88c4-b5951271a8c2 req-d25ed3b5-0577-4d93-8cb0-e3c101db4a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e83c416-fbce-4464-a84c-0fc595002bc8", "name": "network-vif-deleted", "tag": "7ae7b7fd-bfaf-479e-860c-dd44ce2b7beb"}, {"server_uuid": "1266aec0-b13b-4966-8aad-d413ab5a0680", "name": "network-vif-deleted", "tag": "b1ef5778-36da-4620-8cc1-fc63985beadf"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:29.342665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a6316c7c-689d-4fa0-88c4-b5951271a8c2 req-d25ed3b5-0577-4d93-8cb0-e3c101db4a8a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:29.343515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a6316c7c-689d-4fa0-88c4-b5951271a8c2 req-d25ed3b5-0577-4d93-8cb0-e3c101db4a8a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:29.344185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a6316c7c-689d-4fa0-88c4-b5951271a8c2 req-d25ed3b5-0577-4d93-8cb0-e3c101db4a8a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:29.384369 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a6316c7c-689d-4fa0-88c4-b5951271a8c2 req-d25ed3b5-0577-4d93-8cb0-e3c101db4a8a service nova] Creating event network-vif-deleted:7ae7b7fd-bfaf-479e-860c-dd44ce2b7beb for instance 3e83c416-fbce-4464-a84c-0fc595002bc8 on n-h1-854925-5 Aug 30 04:17:29.388081 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a6316c7c-689d-4fa0-88c4-b5951271a8c2 req-d25ed3b5-0577-4d93-8cb0-e3c101db4a8a service nova] Creating event network-vif-deleted:b1ef5778-36da-4620-8cc1-fc63985beadf for instance 1266aec0-b13b-4966-8aad-d413ab5a0680 on n-h2-854925-5 Aug 30 04:17:29.407932 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a6316c7c-689d-4fa0-88c4-b5951271a8c2 req-d25ed3b5-0577-4d93-8cb0-e3c101db4a8a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095355 Aug 30 04:17:29.411518 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1128/2202] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:30.021591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:30.022994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:30.046226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:30.047213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:30.050577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:30.053094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:30.055640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:30.059379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:30.061243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:30.062467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:30.074861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:30.075870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:30.077973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:30.078921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:30.080725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:30.082370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:30.130258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:30.385191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:30.401596 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0c098c5-ef34-4427-b1ea-122ec2c5f1e3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1274 microversion: 2.1 time: 0.359382 Aug 30 04:17:30.404924 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1129/2203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:30 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1274 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:30.894795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:30.917869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:30.920403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:30.922531 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f54408b0-e512-4010-8bdc-73a69c9bff68 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1552 microversion: 2.21 time: 0.905947 Aug 30 04:17:30.923403 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1075/2204] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:30 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1552 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:30.950185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:30.950706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:30.959526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:30.960248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:30.960904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:30.963436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:30.964118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:30.965200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.041861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:31.338357 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9b0f21dc-d47a-446e-bf63-fd8111296ae3 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "DELETE /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 204 len: 0 microversion: 2.21 time: 0.393450 Aug 30 04:17:31.338922 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1130/2205] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:17:30 2022] DELETE /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:17:31.348233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:31.349742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:31.373766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.375094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.382686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.384450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.385109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.385761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.429109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:31.429844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:31.448357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.453114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.453643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:31.456013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:31.459537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:31.460066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:32.896827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:32.912396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9993aceb-716d-4453-8297-818d99e3223a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 1.487615 Aug 30 04:17:32.925166 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1131/2206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:31 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:33.038789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:33.048825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:33.050823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:33.052499 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d40e328c-57ce-414f-ab78-492814ee76a5 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1558 microversion: 2.21 time: 1.708616 Aug 30 04:17:33.069379 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1076/2207] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:31 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1558 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:17:33.932920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:33.934266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:33.945054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.949830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.951866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:33.952914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:33.957246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:33.957246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:34.079186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:34.080898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:34.099697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:34.100368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:34.102829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:34.103981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:34.107093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:34.109846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:34.674360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:35.047305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:35.058441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:35.067634 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3230be18-c3c5-4a37-87ce-7f761bc2d929 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 1.137779 Aug 30 04:17:35.069209 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1132/2208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:33 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:35.083149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:35.101817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:35.102701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4c8e4001-2144-4f8d-bb6b-abb2b9aa903f req-0d31b383-9ac1-4a39-9831-c5dfea7effc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9f401d4-7146-45e5-a80e-3b95b68d8c63", "tag": "5810e530-58a7-4ed8-b2bc-904dd6f736e3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:35.104260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:35.105843 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06802282-f34b-4338-aefe-219b7285d32b tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1558 microversion: 2.21 time: 1.032348 Aug 30 04:17:35.132742 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1077/2209] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:34 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1558 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:35.133214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c8e4001-2144-4f8d-bb6b-abb2b9aa903f req-0d31b383-9ac1-4a39-9831-c5dfea7effc2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:35.133718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c8e4001-2144-4f8d-bb6b-abb2b9aa903f req-0d31b383-9ac1-4a39-9831-c5dfea7effc2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:35.134255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c8e4001-2144-4f8d-bb6b-abb2b9aa903f req-0d31b383-9ac1-4a39-9831-c5dfea7effc2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:35.172042 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4c8e4001-2144-4f8d-bb6b-abb2b9aa903f req-0d31b383-9ac1-4a39-9831-c5dfea7effc2 service nova] Creating event network-changed:5810e530-58a7-4ed8-b2bc-904dd6f736e3 for instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 on n-h2-854925-5 Aug 30 04:17:35.182169 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4c8e4001-2144-4f8d-bb6b-abb2b9aa903f req-0d31b383-9ac1-4a39-9831-c5dfea7effc2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110074 Aug 30 04:17:35.183515 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1133/2210] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:36.065225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4236f999-ade3-4ecf-a6ae-f221a8263b35 req-710156e8-e79a-46b8-a9fa-6420ddbb791f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48629095-3618-4858-88c0-badfb3542742", "name": "network-vif-deleted", "tag": "320a546b-55fd-49ce-9b2c-318c72cc68ff"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:36.093192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:36.094138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:36.109444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:36.110997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4236f999-ade3-4ecf-a6ae-f221a8263b35 req-710156e8-e79a-46b8-a9fa-6420ddbb791f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:36.111448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:36.112517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.114510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:36.114830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4236f999-ade3-4ecf-a6ae-f221a8263b35 req-710156e8-e79a-46b8-a9fa-6420ddbb791f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:36.115549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4236f999-ade3-4ecf-a6ae-f221a8263b35 req-710156e8-e79a-46b8-a9fa-6420ddbb791f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.116158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:36.117173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.153168 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4236f999-ade3-4ecf-a6ae-f221a8263b35 req-710156e8-e79a-46b8-a9fa-6420ddbb791f service nova] Creating event network-vif-deleted:320a546b-55fd-49ce-9b2c-318c72cc68ff for instance 48629095-3618-4858-88c0-badfb3542742 on n-h1-854925-5 Aug 30 04:17:36.178609 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4236f999-ade3-4ecf-a6ae-f221a8263b35 req-710156e8-e79a-46b8-a9fa-6420ddbb791f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118118 Aug 30 04:17:36.179338 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1078/2211] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:36.445365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1125386992", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:36.544684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:17:36.585096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:36.594907 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e8b6ad1-7dd2-4cb5-b221-b73018b7716b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 0.507608 Aug 30 04:17:36.601352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1134/2212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:36 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:36.612546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:36.614614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:36.632102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:36.638164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:36.641130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.642820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:36.643608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:36.644377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.734128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:36.737044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:36.738559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:36.739164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lazy-loading 'fault' on Instance uuid 48629095-3618-4858-88c0-badfb3542742 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:37.134130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:37.432325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:37.446070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:37.447893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8227d8b42c1641c9bb8f0d3dde132518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b679c1c2fce4fbca70dee0e0aad7f55', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:37.449620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27854948-720d-4f8e-a394-6c646013a020 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 200 len: 1348 microversion: 2.21 time: 0.847058 Aug 30 04:17:37.451980 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1135/2213] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:36 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 1348 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:37.462069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-69af2ddf-0108-4b26-baf2-dff47092966a req-23118eda-a6cf-4c72-9b59-5b0032b53f96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5c1f032-0c6e-4970-87f2-88fe9e982d5c", "tag": "5792b02f-248e-437e-ad67-f3d940ce5e6e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:37.492948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-69af2ddf-0108-4b26-baf2-dff47092966a req-23118eda-a6cf-4c72-9b59-5b0032b53f96 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:37.493457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-69af2ddf-0108-4b26-baf2-dff47092966a req-23118eda-a6cf-4c72-9b59-5b0032b53f96 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:37.493895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-69af2ddf-0108-4b26-baf2-dff47092966a req-23118eda-a6cf-4c72-9b59-5b0032b53f96 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:37.510352 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-69af2ddf-0108-4b26-baf2-dff47092966a req-23118eda-a6cf-4c72-9b59-5b0032b53f96 service nova] Creating event network-changed:5792b02f-248e-437e-ad67-f3d940ce5e6e for instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c on n-h2-854925-5 Aug 30 04:17:37.524272 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-69af2ddf-0108-4b26-baf2-dff47092966a req-23118eda-a6cf-4c72-9b59-5b0032b53f96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066084 Aug 30 04:17:37.530679 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1136/2214] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:37.597417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:17:37.597909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:17:37.598342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:17:37.598755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:17:37.599182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:17:37.616561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:37.617282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:37.617898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:37.622014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:37.622701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:37.623357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:37.623474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:37.624835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:37.634830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:37.637513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:37.642103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:37.644968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:37.645675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:37.647709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:37.682802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Getting quotas for project 460e179136b34ed68a9f005d5963d607. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:17:37.688916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Getting quotas for user b52ad7ed970a42e085efd79148788b28 and project 460e179136b34ed68a9f005d5963d607. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:17:37.719557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:17:37.722050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:17:37.832847 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff93c587-9194-441e-8346-fea8c6de793b tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.650676 Aug 30 04:17:37.833610 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1079/2215] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:17:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:17:37.936806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-664254412", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:38.025908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:17:38.168925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:38.191479 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d2dee72-ca3a-4db8-93f1-67a5328d4868 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 0.571670 Aug 30 04:17:38.192661 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1137/2216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:37 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:38.480822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:38.483374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:38.521856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:38.524838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:38.526288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:38.528874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:38.539900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:38.541436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:38.570570 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] HTTP exception thrown: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Request method failure captured: Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 HTTP/1.1 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY86BiLyzuoNCgVP21wFjN2_9HAmuFzC7fwwqiQQYw0GvCWpTsyHe8nXKWakBvEECmVxfny5dtmJ2jMZYbHiXizgxzvalKBM_xrAIXt1_MS9QL7bIJvA7abr_5ThFPXPA-RKdnBYwotGfF5ZBGi-bwx7ELXxXN68J_o_cqCMiIxXUMI Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0b679c1c2fce4fbca70dee0e0aad7f55 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b679c1c2fce4fbca70dee0e0aad7f55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b679c1c2fce4fbca70dee0e0aad7f55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b679c1c2fce4fbca70dee0e0aad7f55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b679c1c2fce4fbca70dee0e0aad7f55"}]}] Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0b679c1c2fce4fbca70dee0e0aad7f55 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-InstanceActionsV221TestJSON-2068155346-project Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 8227d8b42c1641c9bb8f0d3dde132518 Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-InstanceActionsV221TestJSON-2068155346-project Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '48629095-3618-4858-88c0-badfb3542742'} Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:38.577482 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:38.582071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:38.591162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Returning 404 to user: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:38.594646 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a6963ea8-e16f-4698-ab69-ad9388cf2170 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 404 len: 111 microversion: 2.21 time: 0.118857 Aug 30 04:17:38.596008 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1138/2217] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:38 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:17:38.641196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '.version_select at 0x7fe96a5ca3a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:38.642377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:38.671573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:38.672372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:38.673458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:38.674389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:38.676027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:38.693970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:38.972517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9d1aaa77-2446-495f-b956-a674d7e1966f tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.353410 Aug 30 04:17:38.973589 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1139/2218] 10.222.0.27 () {60 vars in 1337 bytes} [Tue Aug 30 04:17:38 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742/os-instance-actions => generated 611 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:17:39.017646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:39.018293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:39.043692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.044213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.044719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.054439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.055924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.057095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.129042 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] HTTP exception thrown: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Request method failure captured: Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 HTTP/1.1 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY86BiLyzuoNCgVP21wFjN2_9HAmuFzC7fwwqiQQYw0GvCWpTsyHe8nXKWakBvEECmVxfny5dtmJ2jMZYbHiXizgxzvalKBM_xrAIXt1_MS9QL7bIJvA7abr_5ThFPXPA-RKdnBYwotGfF5ZBGi-bwx7ELXxXN68J_o_cqCMiIxXUMI Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0b679c1c2fce4fbca70dee0e0aad7f55 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b679c1c2fce4fbca70dee0e0aad7f55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b679c1c2fce4fbca70dee0e0aad7f55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b679c1c2fce4fbca70dee0e0aad7f55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b679c1c2fce4fbca70dee0e0aad7f55"}]}] Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0b679c1c2fce4fbca70dee0e0aad7f55 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-InstanceActionsV221TestJSON-2068155346-project Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 8227d8b42c1641c9bb8f0d3dde132518 Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-InstanceActionsV221TestJSON-2068155346-project Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '48629095-3618-4858-88c0-badfb3542742'} Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:17:39.134528 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Returning 404 to user: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:39.139265 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75f66512-1809-4a88-b712-e163b96d4188 tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "DELETE /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 404 len: 111 microversion: 2.21 time: 0.138881 Aug 30 04:17:39.141412 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1140/2219] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:17:38 2022] DELETE /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:17:39.157722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:39.158936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] [instance: 48629095-3618-4858-88c0-badfb3542742] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:39.182501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.183698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.184171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.187987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.189215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.192318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.239866 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] HTTP exception thrown: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Request method failure captured: Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 HTTP/1.1 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY86BiLyzuoNCgVP21wFjN2_9HAmuFzC7fwwqiQQYw0GvCWpTsyHe8nXKWakBvEECmVxfny5dtmJ2jMZYbHiXizgxzvalKBM_xrAIXt1_MS9QL7bIJvA7abr_5ThFPXPA-RKdnBYwotGfF5ZBGi-bwx7ELXxXN68J_o_cqCMiIxXUMI Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.21 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0b679c1c2fce4fbca70dee0e0aad7f55 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b679c1c2fce4fbca70dee0e0aad7f55", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b679c1c2fce4fbca70dee0e0aad7f55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b679c1c2fce4fbca70dee0e0aad7f55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b679c1c2fce4fbca70dee0e0aad7f55"}]}] Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0b679c1c2fce4fbca70dee0e0aad7f55 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2068155346 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-InstanceActionsV221TestJSON-2068155346-project Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 8227d8b42c1641c9bb8f0d3dde132518 Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-InstanceActionsV221TestJSON-2068155346-project Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '48629095-3618-4858-88c0-badfb3542742'} Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.244867 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] Returning 404 to user: Instance 48629095-3618-4858-88c0-badfb3542742 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:39.248802 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f1fb05c-6994-4023-bc36-14b9942505fb tempest-InstanceActionsV221TestJSON-2068155346 tempest-InstanceActionsV221TestJSON-2068155346-project] 10.222.0.27 "GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742" status: 404 len: 111 microversion: 2.21 time: 0.099854 Aug 30 04:17:39.252963 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1141/2220] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:39 2022] GET /compute/v2.1/servers/48629095-3618-4858-88c0-badfb3542742 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:17:39.261824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:39.264045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:39.283159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.285523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.286535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.289339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.290006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.291778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.546359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:17:39.547416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:17:39.548101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:17:39.548717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:17:39.549412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:17:39.566341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.567104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.568446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.569960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.570928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.571600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.601522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Getting quotas for project 460e179136b34ed68a9f005d5963d607. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:17:39.620077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Getting quotas for user b52ad7ed970a42e085efd79148788b28 and project 460e179136b34ed68a9f005d5963d607. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:17:39.655156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:17:39.662629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:17:39.808030 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-05d6bba8-b04d-4fd8-860e-6d564410ec08 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871278 Aug 30 04:17:39.809445 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1080/2221] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:17:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:17:39.829736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:39.834894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:39.868263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.868771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.869222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:39.869962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:39.870422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:39.881247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:40.152782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:40.163118 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4539baee-aba5-4a63-853d-c899fe670d87 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 0.912125 Aug 30 04:17:40.169007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1142/2222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:39 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:40.174532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a85adef1-a483-4a0d-8eb8-18fafd42a0a8 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:40.184364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a85adef1-a483-4a0d-8eb8-18fafd42a0a8 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:40.374426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a85adef1-a483-4a0d-8eb8-18fafd42a0a8 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:40.382980 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a85adef1-a483-4a0d-8eb8-18fafd42a0a8 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1213 microversion: 2.1 time: 0.212575 Aug 30 04:17:40.388084 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1143/2223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:40 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1213 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:40.551318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 8d0a8293-be54-4224-956f-44539222c466 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:40.592867 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2cda9ad2-ea67-4c7f-8319-0382612dbb09 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 2423 microversion: 2.25 time: 0.780215 Aug 30 04:17:40.594168 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1081/2224] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:39 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 2423 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:40.621935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-854925-5", "block_migration": "auto"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:40.625304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:40.644292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:40.646234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:40.647887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:40.648706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:40.650329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:40.651183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:40.739145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'flavor' on Instance uuid 8d0a8293-be54-4224-956f-44539222c466 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:40.782288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 8d0a8293-be54-4224-956f-44539222c466] Going to try to live migrate instance to n-h2-854925-5 {{(pid=122403) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:17:40.816727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:41.188745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:41.189725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:41.204454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:41.205928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:41.206719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:41.208322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:41.209890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:41.213637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:41.729637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:41.747438 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11a91772-1182-470d-8a76-b50be7e9009e tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 0.560055 Aug 30 04:17:41.748887 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1082/2225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:41 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:41.775138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:41.776678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:41.796723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:41.799231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:41.801036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:41.803444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:41.804222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:41.806837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:42.067709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:42.084318 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b2d98fc-8e6f-4f1a-a59a-85209916bb36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1265 microversion: 2.1 time: 0.334267 Aug 30 04:17:42.084934 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1083/2226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:41 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1265 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:42.775204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:42.775844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:42.797946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:42.798641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:42.799687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:42.800653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:42.801273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:42.805784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:43.925910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:43.936901 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e60586b9-2bec-4cad-8b3e-878bb16b8b63 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 1.165873 Aug 30 04:17:43.955250 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1084/2227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:42 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:43.975935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6934c938-d607-47eb-a081-d5e91ea14d50 req-3bc7f5ad-bfe5-465b-b9b6-fa5326a945ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f401d4-7146-45e5-a80e-3b95b68d8c63", "name": "network-vif-plugged", "status": "completed", "tag": "5810e530-58a7-4ed8-b2bc-904dd6f736e3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:44.001778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6934c938-d607-47eb-a081-d5e91ea14d50 req-3bc7f5ad-bfe5-465b-b9b6-fa5326a945ef service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.004011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6934c938-d607-47eb-a081-d5e91ea14d50 req-3bc7f5ad-bfe5-465b-b9b6-fa5326a945ef service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.004530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6934c938-d607-47eb-a081-d5e91ea14d50 req-3bc7f5ad-bfe5-465b-b9b6-fa5326a945ef service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.045617 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6934c938-d607-47eb-a081-d5e91ea14d50 req-3bc7f5ad-bfe5-465b-b9b6-fa5326a945ef service nova] Creating event network-vif-plugged:5810e530-58a7-4ed8-b2bc-904dd6f736e3 for instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 on n-h2-854925-5 Aug 30 04:17:44.057768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6934c938-d607-47eb-a081-d5e91ea14d50 req-3bc7f5ad-bfe5-465b-b9b6-fa5326a945ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100436 Aug 30 04:17:44.058628 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1085/2228] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:44.069955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:44.071293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:44.111339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.114381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.115665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.117878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.127282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.130794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.357277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:44.371267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9484b72-281d-41cf-b947-83c3ed55610f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1271 microversion: 2.1 time: 0.311409 Aug 30 04:17:44.376368 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1086/2229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:44 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1271 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:44.837781 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79bc6e22-01a0-4d36-93c2-8a353d6c253c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/action" status: 202 len: 0 microversion: 2.25 time: 4.220283 Aug 30 04:17:44.842064 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1144/2230] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:17:40 2022] POST /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/action => generated 0 bytes in 4226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:44.850583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:44.851202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:44.855272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:44.865820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.866323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.866759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.867481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.867943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.868369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.960634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:44.961262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:44.974342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.974847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.975294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:44.976015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:44.976473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:44.976906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:45.289811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:45.308097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:45.311403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:45.313475 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a25f5b0-d46a-4f58-addd-3467a56f2220 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.466344 Aug 30 04:17:45.315737 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1087/2231] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:44 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:45.396582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:45.397285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:45.403805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:45.405244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:45.405884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:45.406789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:45.407432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:45.408072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:45.924369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:45.930017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:45.954781 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0a930df6-ec5a-41fe-9c1f-ecca846202ef tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1271 microversion: 2.1 time: 0.562326 Aug 30 04:17:45.958865 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1088/2232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:45 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1271 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:45.959481 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3544770a-8543-4d59-b8fb-def4198bbb0a tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1316 microversion: 2.1 time: 1.001379 Aug 30 04:17:45.977063 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1145/2233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:44 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1316 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:46.126081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5dd77b75-1073-4b58-9456-39befb47b7ae req-6aa8807a-0bd8-44c5-af40-e96ddcf03660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c1f032-0c6e-4970-87f2-88fe9e982d5c", "name": "network-vif-plugged", "status": "completed", "tag": "5792b02f-248e-437e-ad67-f3d940ce5e6e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:46.179382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5dd77b75-1073-4b58-9456-39befb47b7ae req-6aa8807a-0bd8-44c5-af40-e96ddcf03660 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:46.181918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5dd77b75-1073-4b58-9456-39befb47b7ae req-6aa8807a-0bd8-44c5-af40-e96ddcf03660 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:46.186634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5dd77b75-1073-4b58-9456-39befb47b7ae req-6aa8807a-0bd8-44c5-af40-e96ddcf03660 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:46.255610 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5dd77b75-1073-4b58-9456-39befb47b7ae req-6aa8807a-0bd8-44c5-af40-e96ddcf03660 service nova] Creating event network-vif-plugged:5792b02f-248e-437e-ad67-f3d940ce5e6e for instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c on n-h2-854925-5 Aug 30 04:17:46.271258 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5dd77b75-1073-4b58-9456-39befb47b7ae req-6aa8807a-0bd8-44c5-af40-e96ddcf03660 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148992 Aug 30 04:17:46.274001 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1089/2234] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:46.339674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:46.340512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:46.354163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:46.355047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:46.355681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:46.356601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:46.357948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:46.358537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:46.884785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:46.895022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:46.897126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:46.899075 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-32e6e31c-9bb4-4516-93a0-de42de43461e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.564552 Aug 30 04:17:46.914667 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1146/2235] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:46 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:46.981071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:46.981943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:46.994887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:46.995380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:46.995812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:46.998125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:46.999514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:47.001448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:47.003855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:47.004289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:47.013422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:47.014233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:47.014816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:47.015669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:47.016263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:47.016832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:47.812202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:47.822458 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26fa9372-e6a7-487a-baea-a910833b2f5d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1503 microversion: 2.1 time: 0.834877 Aug 30 04:17:47.836202 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1147/2236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:46 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1503 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:47.862332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:47.862958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:47.875163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:47.875662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:47.876273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:47.878439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:47.879086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:47.882994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:48.343967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:48.359530 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-91a58487-aabf-4013-92a5-fa46c13feeb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 1.383193 Aug 30 04:17:48.361139 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1090/2237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:46 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:48.372723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:48.374631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:48.384834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:48.385912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:48.388150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:48.389147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:48.390580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:48.391442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:48.876880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:48.888095 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c72156b3-077f-44c8-b775-92e655057e57 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c" status: 200 len: 1316 microversion: 2.1 time: 1.030733 Aug 30 04:17:48.889158 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1148/2238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:47 2022] GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c => generated 1316 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:48.908215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-fc98de5b-dd6d-442e-a6e3-f8225e658ece req-af71ddc1-83ef-41fd-87eb-9a0aca7614b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2899b822-bdd2-4731-a44a-f67901ecae9e", "tag": "e86ad729-5dbf-4d1e-b624-c169f51ed42c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:48.929976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fc98de5b-dd6d-442e-a6e3-f8225e658ece req-af71ddc1-83ef-41fd-87eb-9a0aca7614b6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:48.930456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fc98de5b-dd6d-442e-a6e3-f8225e658ece req-af71ddc1-83ef-41fd-87eb-9a0aca7614b6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:48.930878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fc98de5b-dd6d-442e-a6e3-f8225e658ece req-af71ddc1-83ef-41fd-87eb-9a0aca7614b6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:48.968396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-fc98de5b-dd6d-442e-a6e3-f8225e658ece req-af71ddc1-83ef-41fd-87eb-9a0aca7614b6 service nova] Creating event network-changed:e86ad729-5dbf-4d1e-b624-c169f51ed42c for instance 2899b822-bdd2-4731-a44a-f67901ecae9e on n-h1-854925-5 Aug 30 04:17:48.983285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-fc98de5b-dd6d-442e-a6e3-f8225e658ece req-af71ddc1-83ef-41fd-87eb-9a0aca7614b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092405 Aug 30 04:17:48.987239 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1149/2239] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:49.170909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:49.185170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:49.188875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:49.191586 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fda91f6c-69c2-4f4f-9afb-1e7dcde3dd56 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.829138 Aug 30 04:17:49.200826 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1091/2240] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:48 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:49.383096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:49.383911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:49.395960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:49.404374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:49.404855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:49.405995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:49.406111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:49.406468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:49.910746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:49.911328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:49.932106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:49.937778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:49.939391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:49.939895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:49.940333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:49.951578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:49.952141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:49.952597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:50.382999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:51.568678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:51.585478 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-080df4d6-38f9-4c4e-bfbd-3af3aeb905b3 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c" status: 200 len: 1504 microversion: 2.1 time: 1.678779 Aug 30 04:17:51.588531 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1092/2241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:49 2022] GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c => generated 1504 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:51.592992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:51.607844 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d84897a6-16f4-4171-9c66-4c95e0dbc683 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 2.224396 Aug 30 04:17:51.613400 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1150/2242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:49 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:51.614498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:51.619857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:51.628238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:51.634943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:51.645605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.647461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.648012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:51.650037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.651757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.652321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:51.658043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.658797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.661746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:51.664277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.665864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.666852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:51.761430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:51.811799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:51.915104 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-39b9b2ee-313e-47bf-93c0-f702d284e35b tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c" status: 204 len: 0 microversion: 2.1 time: 0.299946 Aug 30 04:17:51.916671 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1151/2243] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:17:51 2022] DELETE /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:51.937897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:51.939922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:51.958682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.959196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.959648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:51.960370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:51.964943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:51.965576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:52.036923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:17:52.212858 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-354a7836-d28a-468d-a60f-08236abd2823 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 204 len: 0 microversion: 2.1 time: 0.290104 Aug 30 04:17:52.213842 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1152/2244] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:17:51 2022] DELETE /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:17:52.223867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:52.225395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:52.241038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:52.241491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:52.241930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:52.242646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:52.243099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:52.243520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:54.073596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:54.104416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:54.106386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:54.108858 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8bde89f4-0a90-4ba1-816d-9ce6d8d5fbce tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 2.518926 Aug 30 04:17:54.110764 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1093/2245] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:51 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:54.124753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:54.126122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:54.178752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:54.179393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:54.179943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:54.182132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:54.189744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:54.190493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:54.415510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:54.428381 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-87c8d274-f4f8-4629-8e5c-bca9b709239d tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c" status: 200 len: 1510 microversion: 2.1 time: 2.209329 Aug 30 04:17:54.433513 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1153/2246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:52 2022] GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c => generated 1510 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:17:54.446326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-46c9b6de-c07a-48f9-9c46-43c5b33aea3b req-f49bc0b2-e736-475a-8f6f-8a2c6c0cae4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b691652-2141-4fa3-b3e9-a8116741d2e4", "tag": "b408edb4-672e-43d9-a2d4-0d795a269662"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:54.475368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-46c9b6de-c07a-48f9-9c46-43c5b33aea3b req-f49bc0b2-e736-475a-8f6f-8a2c6c0cae4b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:54.475825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-46c9b6de-c07a-48f9-9c46-43c5b33aea3b req-f49bc0b2-e736-475a-8f6f-8a2c6c0cae4b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:54.476259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-46c9b6de-c07a-48f9-9c46-43c5b33aea3b req-f49bc0b2-e736-475a-8f6f-8a2c6c0cae4b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:54.503648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-46c9b6de-c07a-48f9-9c46-43c5b33aea3b req-f49bc0b2-e736-475a-8f6f-8a2c6c0cae4b service nova] Creating event network-changed:b408edb4-672e-43d9-a2d4-0d795a269662 for instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 on n-h1-854925-5 Aug 30 04:17:54.509722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-46c9b6de-c07a-48f9-9c46-43c5b33aea3b req-f49bc0b2-e736-475a-8f6f-8a2c6c0cae4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074864 Aug 30 04:17:54.515643 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1154/2247] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:54.882602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:54.897207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d12e4890-e712-402e-9bfb-751525119a81 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 0.784912 Aug 30 04:17:54.910765 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1094/2248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:54 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:55.143374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:55.144088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:55.153882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:55.159838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:55.173543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:55.174436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:55.175385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:55.176020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:55.453348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:55.454128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:55.476490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:55.477841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:55.490589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:55.493121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:55.502541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:55.503439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:55.508402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:17:57.241701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:57.257604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1faecdb-8b1b-4559-a201-04c30e8f67cf tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c" status: 200 len: 1510 microversion: 2.1 time: 1.808648 Aug 30 04:17:57.259379 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1095/2249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:55 2022] GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c => generated 1510 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:57.272666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:57.275673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:57.282345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:57.291014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:57.291428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:57.293578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:57.296265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:57.297001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:57.298043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:57.300772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:57.303441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:57.305201 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a14e4418-0e46-4a89-8efe-e4d3c833e83c tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 2.166606 Aug 30 04:17:57.307077 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1155/2250] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:55 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 2169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:57.343816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2f6be907-92ae-4a53-8592-07c57c82c821 req-529ea4c7-51cf-43cb-916a-a17980433c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5c1f032-0c6e-4970-87f2-88fe9e982d5c", "name": "network-vif-deleted", "tag": "5792b02f-248e-437e-ad67-f3d940ce5e6e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:57.374104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2f6be907-92ae-4a53-8592-07c57c82c821 req-529ea4c7-51cf-43cb-916a-a17980433c8c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:57.377939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2f6be907-92ae-4a53-8592-07c57c82c821 req-529ea4c7-51cf-43cb-916a-a17980433c8c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:57.381716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2f6be907-92ae-4a53-8592-07c57c82c821 req-529ea4c7-51cf-43cb-916a-a17980433c8c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:57.427797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2f6be907-92ae-4a53-8592-07c57c82c821 req-529ea4c7-51cf-43cb-916a-a17980433c8c service nova] Creating event network-vif-deleted:5792b02f-248e-437e-ad67-f3d940ce5e6e for instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c on n-h2-854925-5 Aug 30 04:17:57.441180 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2f6be907-92ae-4a53-8592-07c57c82c821 req-529ea4c7-51cf-43cb-916a-a17980433c8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100138 Aug 30 04:17:57.442359 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1156/2251] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:17:58.371248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:58.399657 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ebd61ed-e736-4024-b6c8-1827adc8cbb6 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 1.129696 Aug 30 04:17:58.400916 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1096/2252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:57 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:58.413296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:58.414232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: d5c1f032-0c6e-4970-87f2-88fe9e982d5c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:58.424585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.425374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.426003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.428388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.429024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.429632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.458466 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] HTTP exception thrown: Instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c could not be found. Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Request method failure captured: Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c HTTP/1.1 Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY8oUIEeKLA7vScd9sYAuBxSjXdHNZaOV1IBcc_5ODY-824mUWvPMTMkQDUk2fk6xsp25ZRMfqPFbexBPgIMH7FE0pEEOtkcLlRQ5z6RbSX6NH0m5732cxHmnVI4nB6XYlyUlXHCigtRtyDxPXM53VHvjN8XJOvESGVskq8-7sxa8vs Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 257ce0030c904e27b498cd8cf55d7b0b Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-MultipleCreateTestJSON-1031392226 Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_257ce0030c904e27b498cd8cf55d7b0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/257ce0030c904e27b498cd8cf55d7b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/257ce0030c904e27b498cd8cf55d7b0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/257ce0030c904e27b498cd8cf55d7b0b"}]}] Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-MultipleCreateTestJSON-1031392226 Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 257ce0030c904e27b498cd8cf55d7b0b Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1031392226 Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-MultipleCreateTestJSON-1031392226-project Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 88ecec6327344b63b4216b8e520c969c Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-MultipleCreateTestJSON-1031392226-project Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c could not be found. Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'd5c1f032-0c6e-4970-87f2-88fe9e982d5c'} Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c could not be found. Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c could not be found. Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:58.461632 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:58.465819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:58.465819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:58.465819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:58.465819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:58.465819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:58.465819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c could not be found. Aug 30 04:17:58.465819 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:17:58.468660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Returning 404 to user: Instance d5c1f032-0c6e-4970-87f2-88fe9e982d5c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:58.472089 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a1ec61fb-66dd-4e1f-b479-ee1876d66658 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c" status: 404 len: 111 microversion: 2.1 time: 0.066379 Aug 30 04:17:58.473089 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1097/2253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:58 2022] GET /compute/v2.1/servers/d5c1f032-0c6e-4970-87f2-88fe9e982d5c => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:17:58.479106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:58.479969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:58.488714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.489350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.489920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.490752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.491930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.492584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.515810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1bea987d-684c-4421-9a5c-5a4c5d9f32ec tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Calling method '.version_select at 0x7fe96e66bdc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:58.722477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1bea987d-684c-4421-9a5c-5a4c5d9f32ec tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.458617 Aug 30 04:17:58.723084 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1157/2254] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:17:58 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:17:58.732773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:58.732773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:58.741995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.742499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.742943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.743668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.744128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.744564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.822780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:58.823514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:58.824113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:58.824974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lazy-loading 'fault' on Instance uuid b9f401d4-7146-45e5-a80e-3b95b68d8c63 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:17:58.997080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88ecec6327344b63b4216b8e520c969c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '257ce0030c904e27b498cd8cf55d7b0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:59.006781 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e81f8c62-2f6c-4e0e-8ca9-66795dbacd96 tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 200 len: 1306 microversion: 2.1 time: 0.282607 Aug 30 04:17:59.007863 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1158/2255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:58 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 1306 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:17:59.014663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06180755-d47e-49b2-8f8e-24f43282c5db tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Action: 'create', calling method: .version_select at 0x7fe96e653700>, body: {"pool": "non_exist_pool"} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:59.173222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-06180755-d47e-49b2-8f8e-24f43282c5db tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] HTTP exception thrown: Floating IP pool not found. Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06180755-d47e-49b2-8f8e-24f43282c5db tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Request method failure captured: Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 26 Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY92AA7VSDJfpVV6p7Od90ZXNj0iTJ0TV0pX1gy2RzTsmcP8CpDy9u8l14IoF8PkbvKoeqdIkw5X-asvyfhMH38tE6lrKdqlU9Wq6Fuq4Ylp4wJwEZOud08lc2VZLc6PN-szspWgqLJnCxvvUcZKmXzSyuUI77ftFiLwJNDAvT_hn2U Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 2eacd1f4577245ab829f2010b494f29b Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-69858030 Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eacd1f4577245ab829f2010b494f29b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eacd1f4577245ab829f2010b494f29b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eacd1f4577245ab829f2010b494f29b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eacd1f4577245ab829f2010b494f29b"}]}] Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-69858030 Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 2eacd1f4577245ab829f2010b494f29b Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-69858030 Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FloatingIPsNegativeTestJSON-69858030-project Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ffa0ea17811d4b9082ff0d6b9cc9e81d Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-69858030-project Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: {"pool": "non_exist_pool"} Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: exception: Floating IP pool not found. Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:59.180833 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:59.192227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 30 04:17:59.192227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.197240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06180755-d47e-49b2-8f8e-24f43282c5db tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Returning 404 to user: Floating IP pool not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:59.198629 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06180755-d47e-49b2-8f8e-24f43282c5db tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.188268 Aug 30 04:17:59.204714 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1159/2256] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:17:59 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:17:59.214711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d90467bb-3250-4bd4-9f78-b2d9c9dd6468 tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Calling method '.version_select at 0x7fe96a249040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:59.288422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:59.298643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:59.301348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:17:59.303027 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd126581-7749-49e0-8644-28ea2453aaad tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.828019 Aug 30 04:17:59.304201 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1098/2257] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:17:58 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:17:59.387477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-d90467bb-3250-4bd4-9f78-b2d9c9dd6468 tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 could not be found", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:17:59.388202 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-d90467bb-3250-4bd4-9f78-b2d9c9dd6468 tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] HTTP exception thrown: Floating IP not found for ID b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d90467bb-3250-4bd4-9f78-b2d9c9dd6468 tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Request method failure captured: Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-floating-ips/b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 HTTP/1.1 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY92AA7VSDJfpVV6p7Od90ZXNj0iTJ0TV0pX1gy2RzTsmcP8CpDy9u8l14IoF8PkbvKoeqdIkw5X-asvyfhMH38tE6lrKdqlU9Wq6Fuq4Ylp4wJwEZOud08lc2VZLc6PN-szspWgqLJnCxvvUcZKmXzSyuUI77ftFiLwJNDAvT_hn2U Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 2eacd1f4577245ab829f2010b494f29b Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-69858030 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2eacd1f4577245ab829f2010b494f29b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2eacd1f4577245ab829f2010b494f29b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eacd1f4577245ab829f2010b494f29b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2eacd1f4577245ab829f2010b494f29b"}]}] Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-69858030 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 2eacd1f4577245ab829f2010b494f29b Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-69858030 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FloatingIPsNegativeTestJSON-69858030-project Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ffa0ea17811d4b9082ff0d6b9cc9e81d Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-69858030-project Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: exception: Floating IP not found for ID b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3'} Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 could not be found Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-077c8e5e-3cd6-4a19-90fd-231b2a55821b'] Aug 30 04:17:59.390846 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3. Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 Aug 30 04:17:59.394374 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:17:59.397911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d90467bb-3250-4bd4-9f78-b2d9c9dd6468 tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] Returning 404 to user: Floating IP not found for ID b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:17:59.399079 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d90467bb-3250-4bd4-9f78-b2d9c9dd6468 tempest-FloatingIPsNegativeTestJSON-69858030 tempest-FloatingIPsNegativeTestJSON-69858030-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3" status: 404 len: 111 microversion: 2.1 time: 0.191461 Aug 30 04:17:59.406325 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1160/2258] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:17:59 2022] DELETE /compute/v2.1/os-floating-ips/b24ba09a-0d3e-4d5a-bd75-0f2d5d77e2e3 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:17:59.423101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:17:59.423696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:17:59.430771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:59.435788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:59.436487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:59.438055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:59.440622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:59.441288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:59.565250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9cc5961f-2b3b-4b6f-b507-891f7edd9288 req-d156f0c9-5e1b-4a2e-bc56-26e392c6789a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9f401d4-7146-45e5-a80e-3b95b68d8c63", "name": "network-vif-deleted", "tag": "5810e530-58a7-4ed8-b2bc-904dd6f736e3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:17:59.588231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9cc5961f-2b3b-4b6f-b507-891f7edd9288 req-d156f0c9-5e1b-4a2e-bc56-26e392c6789a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:17:59.588848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9cc5961f-2b3b-4b6f-b507-891f7edd9288 req-d156f0c9-5e1b-4a2e-bc56-26e392c6789a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:17:59.589370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9cc5961f-2b3b-4b6f-b507-891f7edd9288 req-d156f0c9-5e1b-4a2e-bc56-26e392c6789a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:17:59.617543 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9cc5961f-2b3b-4b6f-b507-891f7edd9288 req-d156f0c9-5e1b-4a2e-bc56-26e392c6789a service nova] Creating event network-vif-deleted:5810e530-58a7-4ed8-b2bc-904dd6f736e3 for instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 on n-h2-854925-5 Aug 30 04:17:59.627001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9cc5961f-2b3b-4b6f-b507-891f7edd9288 req-d156f0c9-5e1b-4a2e-bc56-26e392c6789a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067811 Aug 30 04:17:59.628691 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1161/2259] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:00.032283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:00.033056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] [instance: b9f401d4-7146-45e5-a80e-3b95b68d8c63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:00.050520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:00.053799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:00.056086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:00.056852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:00.057370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:00.057804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:00.079574 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] HTTP exception thrown: Instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 could not be found. Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Request method failure captured: Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 HTTP/1.1 Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY8oUIEeKLA7vScd9sYAuBxSjXdHNZaOV1IBcc_5ODY-824mUWvPMTMkQDUk2fk6xsp25ZRMfqPFbexBPgIMH7FE0pEEOtkcLlRQ5z6RbSX6NH0m5732cxHmnVI4nB6XYlyUlXHCigtRtyDxPXM53VHvjN8XJOvESGVskq8-7sxa8vs Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 257ce0030c904e27b498cd8cf55d7b0b Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-MultipleCreateTestJSON-1031392226 Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_257ce0030c904e27b498cd8cf55d7b0b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/257ce0030c904e27b498cd8cf55d7b0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/257ce0030c904e27b498cd8cf55d7b0b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/257ce0030c904e27b498cd8cf55d7b0b"}]}] Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-MultipleCreateTestJSON-1031392226 Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 257ce0030c904e27b498cd8cf55d7b0b Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1031392226 Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-MultipleCreateTestJSON-1031392226-project Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 88ecec6327344b63b4216b8e520c969c Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-MultipleCreateTestJSON-1031392226-project Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 could not be found. Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b9f401d4-7146-45e5-a80e-3b95b68d8c63'} Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 could not be found. Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 could not be found. Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:00.081296 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:00.084804 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:00.084804 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:00.084804 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:00.084804 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:00.084804 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:00.084804 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 could not be found. Aug 30 04:18:00.084804 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:00.086793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] Returning 404 to user: Instance b9f401d4-7146-45e5-a80e-3b95b68d8c63 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:00.088303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-85a4abc4-ff10-40a9-a613-78aaf9fd55bc tempest-MultipleCreateTestJSON-1031392226 tempest-MultipleCreateTestJSON-1031392226-project] 10.222.0.27 "GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63" status: 404 len: 111 microversion: 2.1 time: 0.060764 Aug 30 04:18:00.089478 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1162/2260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:00 2022] GET /compute/v2.1/servers/b9f401d4-7146-45e5-a80e-3b95b68d8c63 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:18:00.325912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:00.326563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:00.333826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:00.334322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:00.334759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:00.335481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:00.335940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:00.336371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:01.250704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:01.264301 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f428b344-daf3-4907-adcf-a2b6c0292573 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 1.845402 Aug 30 04:18:01.293195 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1099/2261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:17:59 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:01.727176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:01.741149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:01.755022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:01.759646 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-96360b54-c9a1-40c4-8e72-3afedafb33b3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 1.437850 Aug 30 04:18:01.766838 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1163/2262] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:00 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:18:02.284895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:02.286572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:02.297902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:02.298664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:02.299262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:02.302321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:02.302808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:02.303255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:02.790190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:02.798972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:02.812758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:02.813586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:02.816185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:02.817158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:02.817800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:02.824318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:03.870523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:03.883075 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c06edc83-aceb-470c-8497-09f2bea95ed9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 1.600682 Aug 30 04:18:03.884372 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1100/2263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:02 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:03.890251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f7ee32eb-e40e-4c35-9b8a-1a9281dce00e req-1bc28eba-8f9c-47a9-a602-07252eb239fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2899b822-bdd2-4731-a44a-f67901ecae9e", "name": "network-vif-plugged", "status": "completed", "tag": "e86ad729-5dbf-4d1e-b624-c169f51ed42c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:03.925623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f7ee32eb-e40e-4c35-9b8a-1a9281dce00e req-1bc28eba-8f9c-47a9-a602-07252eb239fe service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:03.928154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f7ee32eb-e40e-4c35-9b8a-1a9281dce00e req-1bc28eba-8f9c-47a9-a602-07252eb239fe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:03.928866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f7ee32eb-e40e-4c35-9b8a-1a9281dce00e req-1bc28eba-8f9c-47a9-a602-07252eb239fe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:03.946179 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f7ee32eb-e40e-4c35-9b8a-1a9281dce00e req-1bc28eba-8f9c-47a9-a602-07252eb239fe service nova] Creating event network-vif-plugged:e86ad729-5dbf-4d1e-b624-c169f51ed42c for instance 2899b822-bdd2-4731-a44a-f67901ecae9e on n-h1-854925-5 Aug 30 04:18:03.954530 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f7ee32eb-e40e-4c35-9b8a-1a9281dce00e req-1bc28eba-8f9c-47a9-a602-07252eb239fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068303 Aug 30 04:18:03.956391 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1101/2264] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:03.964183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-893486b7-fb70-4cd2-b070-682cddc8d7fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Action: 'create', calling method: .version_select at 0x7fe969f65820>, body: {"keypair": {"name": "tempest-keypair-63939338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGz/Wq/KjvGAtSGEA25F8lxNpHz4WPVOyzdX48WrNf16LIhp3unMalSp++xutnLaCx9V1BLfHSNrqWFpYZnU/TJvn6OgiSONGuC6eCe8jsrH1vbCEYDcY1yXyuehjNFIgw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:03.994652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-893486b7-fb70-4cd2-b070-682cddc8d7fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Getting quotas for project 4475ca7f6b8743ae924217827522984f. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:04.002438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-893486b7-fb70-4cd2-b070-682cddc8d7fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Getting quotas for user 3d11c8cca77843b4a3fab73e81cb6978 and project 4475ca7f6b8743ae924217827522984f. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:04.035854 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-893486b7-fb70-4cd2-b070-682cddc8d7fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.077716 Aug 30 04:18:04.037450 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1102/2265] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:18:03 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:18:04.681027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:04.696358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:04.705502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:04.707188 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a1231eae-3079-4f2b-92fd-1632279d6ce5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 1.920834 Aug 30 04:18:04.723147 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1164/2266] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:02 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:04.923705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:04.925225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:04.935345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:04.937431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:04.938473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:04.939383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:04.941444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:04.943410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:05.011095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c3597474-6956-468f-ae2f-e00626640045 req-9a597e87-61c9-49b8-8348-e47016940220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0a8293-be54-4224-956f-44539222c466", "name": "network-vif-unplugged", "status": "completed", "tag": "fd1079f2-ffbb-4335-a81f-da6d0d027dba"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:05.042408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c3597474-6956-468f-ae2f-e00626640045 req-9a597e87-61c9-49b8-8348-e47016940220 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:05.044494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c3597474-6956-468f-ae2f-e00626640045 req-9a597e87-61c9-49b8-8348-e47016940220 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:05.048482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c3597474-6956-468f-ae2f-e00626640045 req-9a597e87-61c9-49b8-8348-e47016940220 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:05.096083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c3597474-6956-468f-ae2f-e00626640045 req-9a597e87-61c9-49b8-8348-e47016940220 service nova] Creating event network-vif-unplugged:fd1079f2-ffbb-4335-a81f-da6d0d027dba for instance 8d0a8293-be54-4224-956f-44539222c466 on n-h1-854925-5 Aug 30 04:18:05.108536 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c3597474-6956-468f-ae2f-e00626640045 req-9a597e87-61c9-49b8-8348-e47016940220 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101177 Aug 30 04:18:05.111351 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1165/2267] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:18:05.743778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:05.745769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:05.764646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:05.767399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:05.768124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:05.770542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:05.774489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:05.775116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:06.021730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:06.039537 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3d5b57b6-50a6-46ae-b972-b674b7f97c3e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 1.124607 Aug 30 04:18:06.044320 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1103/2268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:04 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:06.236793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:06.258953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:06.260508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:06.266043 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1d40d5e-dc28-4fae-80b6-15c0401fe1f1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.531633 Aug 30 04:18:06.266754 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1166/2269] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:05 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:07.067344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:07.068329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:07.090219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:07.090720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:07.106245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:07.107411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:07.112216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:07.117113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:07.295152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:07.296511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:07.307648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:07.308543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:07.309774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:07.311365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:07.312656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:07.315946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:07.995544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:08.016057 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4d318203-5995-4307-a195-efaff476cda4 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 0.955995 Aug 30 04:18:08.017065 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1104/2270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:07 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:08.033705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a4b5bded-70c3-434b-9b97-d360526eef3d req-8c13547b-e857-4678-98cf-503170f8fd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d0a8293-be54-4224-956f-44539222c466", "tag": "fd1079f2-ffbb-4335-a81f-da6d0d027dba"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:08.053792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a4b5bded-70c3-434b-9b97-d360526eef3d req-8c13547b-e857-4678-98cf-503170f8fd5e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:08.054677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a4b5bded-70c3-434b-9b97-d360526eef3d req-8c13547b-e857-4678-98cf-503170f8fd5e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:08.056481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a4b5bded-70c3-434b-9b97-d360526eef3d req-8c13547b-e857-4678-98cf-503170f8fd5e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:08.086394 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a4b5bded-70c3-434b-9b97-d360526eef3d req-8c13547b-e857-4678-98cf-503170f8fd5e service nova] Creating event network-changed:fd1079f2-ffbb-4335-a81f-da6d0d027dba for instance 8d0a8293-be54-4224-956f-44539222c466 on n-h1-854925-5 Aug 30 04:18:08.096248 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a4b5bded-70c3-434b-9b97-d360526eef3d req-8c13547b-e857-4678-98cf-503170f8fd5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077003 Aug 30 04:18:08.098087 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1105/2271] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:08.162506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:08.178484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:08.194219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:08.195707 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4d636a9-8726-4577-9c2b-de5014a81fcf tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.909044 Aug 30 04:18:08.209625 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1167/2272] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:07 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:09.043299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:09.044233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:09.061220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:09.064757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:09.065318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:09.066183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:09.066785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:09.067232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:09.226812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:09.228008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:09.240925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:09.268194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:09.269149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:09.269959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:09.270432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:09.272314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:09.834810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:09.843766 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4e4c1202-2b78-4acf-a07e-690fca1d4343 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 0.805475 Aug 30 04:18:09.854170 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1106/2273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:09 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:10.013858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:10.027825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:10.029298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:10.030762 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61d4db1d-ce5f-4b4b-a576-1f7a2e81ad3a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.807928 Aug 30 04:18:10.031339 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1168/2274] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:09 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:18:10.878997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:10.881692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:10.903786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:10.905509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:10.906224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:10.907803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:10.908487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:10.909180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:10.983686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-11121ba4-a1f3-4681-b881-76381713beb2 req-b252700f-d58c-4c19-ae00-c2599a5ab544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b691652-2141-4fa3-b3e9-a8116741d2e4", "name": "network-vif-plugged", "status": "completed", "tag": "b408edb4-672e-43d9-a2d4-0d795a269662"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:11.015245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:11.024053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-11121ba4-a1f3-4681-b881-76381713beb2 req-b252700f-d58c-4c19-ae00-c2599a5ab544 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:11.024779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-11121ba4-a1f3-4681-b881-76381713beb2 req-b252700f-d58c-4c19-ae00-c2599a5ab544 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:11.025416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-11121ba4-a1f3-4681-b881-76381713beb2 req-b252700f-d58c-4c19-ae00-c2599a5ab544 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:11.057264 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-11121ba4-a1f3-4681-b881-76381713beb2 req-b252700f-d58c-4c19-ae00-c2599a5ab544 service nova] Creating event network-vif-plugged:b408edb4-672e-43d9-a2d4-0d795a269662 for instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 on n-h1-854925-5 Aug 30 04:18:11.067229 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-11121ba4-a1f3-4681-b881-76381713beb2 req-b252700f-d58c-4c19-ae00-c2599a5ab544 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087677 Aug 30 04:18:11.074241 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1169/2275] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:11.080189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:11.080896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:11.097185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:11.097711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:11.098142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:11.106373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:11.106866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:11.107894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:12.293034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:12.310946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:12.318138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:12.332149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37e3b3ee-a872-4488-a567-2da31c1c3ecb tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 1.256502 Aug 30 04:18:12.345040 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1170/2276] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:11 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:12.558032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:12.571778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dfd1bd8c-a66d-42d8-9094-1b9d65a135d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 1.700454 Aug 30 04:18:12.572411 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1107/2277] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:10 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:12.669127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1418159220", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7a8d181f-2297-46b0-98a5-71f412161e4b"}, {"port": "42bcc2a6-99c0-41c1-8d7e-96b497240ef7", "tag": "port-1"}, {"port": "50e2ed61-9db9-49c0-a2e1-3f8787967d86", "tag": "port-2"}, {"uuid": "2417e2e9-8755-4ee2-aac4-98ff3b5999ce", "tag": "net-1"}, {"uuid": "2417e2e9-8755-4ee2-aac4-98ff3b5999ce"}, {"uuid": "f4cc4493-b0b1-4858-a752-6c39d1a41fcb", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "f4cc4493-b0b1-4858-a752-6c39d1a41fcb", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a5e96258-7e48-4ff2-bce5-d11bf08ba342", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "71ea8396-1c19-4f47-aa69-9ee9d9fcf7a2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f0bed75b-2185-4ff8-9ccb-1c91ec098bea", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1619026310"}], "key_name": "tempest-keypair-63939338", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:13.066417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] validate_networks() for [('7a8d181f-2297-46b0-98a5-71f412161e4b', None, None, None, None, None), (None, None, '42bcc2a6-99c0-41c1-8d7e-96b497240ef7', None, None, None), (None, None, '50e2ed61-9db9-49c0-a2e1-3f8787967d86', None, None, None), ('2417e2e9-8755-4ee2-aac4-98ff3b5999ce', None, None, None, None, None), ('2417e2e9-8755-4ee2-aac4-98ff3b5999ce', None, None, None, None, None), ('f4cc4493-b0b1-4858-a752-6c39d1a41fcb', '10.2.2.100', None, None, None, None), ('f4cc4493-b0b1-4858-a752-6c39d1a41fcb', '10.2.2.200', None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:18:13.373196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:13.374279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:13.391142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:13.392070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:13.392948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:13.394484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:13.395159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:13.396462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:14.012403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:14.403626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:14.420038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:14.423810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:14.428348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-60552c44-5f14-4234-9972-c3f505405c23 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 1.059900 Aug 30 04:18:14.446699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1108/2278] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:13 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:14.494779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:14.495678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:14.502649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:14.503328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:14.504105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:14.504982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:14.505666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:14.506331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:14.913139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:14.926105 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89271536-2f37-4deb-b525-9fee144f1756 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1313 microversion: 2.1 time: 0.476847 Aug 30 04:18:14.928354 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1109/2279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:14 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:15.130042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c0389c6-6f80-498a-b4bc-54e34db33c93 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe96a024dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-466057717", "description": "tempest-description-2144904192"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:16.319517 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c0389c6-6f80-498a-b4bc-54e34db33c93 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.389265 Aug 30 04:18:16.321684 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1110/2280] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:18:14 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:16.335206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:16.335829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:16.344617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:16.348543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:16.349055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:16.352398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:16.353376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:16.353909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:16.354282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:17.366808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:17.384183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:17.390749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:17.392388 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-083f023f-2d41-4b98-851e-1119b8ab7173 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 1.069682 Aug 30 04:18:17.394950 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1111/2281] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:16 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:17.408879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:17.410313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:17.430425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:17.431942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:17.433199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:17.435980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:17.439300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:17.441027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:18.329107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:18.340314 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6a209772-1fc5-48ef-8fc3-073cd3a00701 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1463 microversion: 2.1 time: 0.942845 Aug 30 04:18:18.341035 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1112/2282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:17 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1463 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:18.361966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87cb8163-9ba0-4f01-a33a-a5c45f72959b tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe96a024af0>, body: {"security_group_rule": {"parent_group_id": "d96327aa-49bd-491c-a8e2-63f6a8b9a7cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:20.203386 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-87cb8163-9ba0-4f01-a33a-a5c45f72959b tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.860432 Aug 30 04:18:20.204144 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1113/2283] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:20.209114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:20.211053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:20.225673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.233197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.235158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.238887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.239465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.240012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.756052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:20.774341 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7121468a-1731-47dc-8b3e-16896296a836 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1464 microversion: 2.1 time: 0.568919 Aug 30 04:18:20.778615 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1114/2284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:20 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1464 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:20.802917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:20.803545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:20.821925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.822439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.822882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:20.823608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:20.824068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:20.833557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:21.618608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:21.634398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:21.659136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:21.665270 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6a4685d3-0782-4384-80e2-4adc7753c341 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1814 microversion: 2.25 time: 0.883249 Aug 30 04:18:21.668599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1115/2285] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:20 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1814 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:21.681777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cff107c-9325-460a-af29-6297e66ca034 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe969f65670>, body: {"security_group_rule": {"parent_group_id": "d96327aa-49bd-491c-a8e2-63f6a8b9a7cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:22.301351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:22.398612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6cff107c-9325-460a-af29-6297e66ca034 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: This rule already exists in group d96327aa-49bd-491c-a8e2-63f6a8b9a7cd Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cff107c-9325-460a-af29-6297e66ca034 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 138 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: {"security_group_rule": {"parent_group_id": "d96327aa-49bd-491c-a8e2-63f6a8b9a7cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: exception: This rule already exists in group d96327aa-49bd-491c-a8e2-63f6a8b9a7cd Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'd96327aa-49bd-491c-a8e2-63f6a8b9a7cd', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group d96327aa-49bd-491c-a8e2-63f6a8b9a7cd Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group d96327aa-49bd-491c-a8e2-63f6a8b9a7cd Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:22.401877 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:22.407072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:22.407072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:22.407072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group d96327aa-49bd-491c-a8e2-63f6a8b9a7cd Aug 30 04:18:22.407072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:22.408652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cff107c-9325-460a-af29-6297e66ca034 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 400 to user: This rule already exists in group d96327aa-49bd-491c-a8e2-63f6a8b9a7cd {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:22.409771 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6cff107c-9325-460a-af29-6297e66ca034 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.738517 Aug 30 04:18:22.413150 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1116/2286] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:21 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 744 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:18:22.430231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1132353618", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "2899b822-bdd2-4731-a44a-f67901ecae9e"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:22.582326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:18:23.377378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:18:23.377902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:18:23.378403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:18:23.380351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:18:23.380351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:18:23.400466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.401246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.402417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.405863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.406575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.408327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.495286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Getting quotas for project 4475ca7f6b8743ae924217827522984f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:23.518667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Getting quotas for user 3d11c8cca77843b4a3fab73e81cb6978 and project 4475ca7f6b8743ae924217827522984f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:23.555042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:18:23.555511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:18:23.555937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:18:23.556349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:18:23.556763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:18:23.571841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.572347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.572796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.573573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:23.574037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:23.574474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:23.620218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Getting quotas for project 460e179136b34ed68a9f005d5963d607. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:23.635496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Getting quotas for user b52ad7ed970a42e085efd79148788b28 and project 460e179136b34ed68a9f005d5963d607. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:23.664259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:18:23.666681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:18:23.773744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23f8eba6-d4f2-4cc9-96b3-9721280b955a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.350613 Aug 30 04:18:23.774566 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1117/2287] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:18:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:18:23.786051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68348ebc-76f2-4548-b2f2-e88b83b18143 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Calling method '.version_select at 0x7fe96a1f7670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:23.931181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:18:23.934084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a5e96258-7e48-4ff2-bce5-d11bf08ba342',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='71ea8396-1c19-4f47-aa69-9ee9d9fcf7a2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0bed75b-2185-4ff8-9ccb-1c91ec098bea',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:18:24.580295 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68348ebc-76f2-4548-b2f2-e88b83b18143 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/93e5ac5f-34f5-4aac-a241-5fa628cd9aab" status: 202 len: 0 microversion: 2.1 time: 0.803655 Aug 30 04:18:24.582088 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1118/2288] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Aug 30 04:18:23 2022] DELETE /compute/v2.1/os-security-group-rules/93e5ac5f-34f5-4aac-a241-5fa628cd9aab => generated 0 bytes in 806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:24.589526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:24.591109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:24.610406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:24.610923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:24.611420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:24.612982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:24.613547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:24.614249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:24.645941 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c0790c60-084e-409d-9e25-36e403933de4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 11.980862 Aug 30 04:18:24.662126 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1171/2289] 10.222.0.27 () {62 vars in 1189 bytes} [Tue Aug 30 04:18:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 11998 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:18:24.681241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:24.684457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:24.691534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:24.733009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:24.734624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:24.735241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:24.736319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:24.736952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:24.739201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:24.870176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:24.886083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f877c5c6-1993-4bf4-9c94-2aec2f79fd36 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1218 microversion: 2.1 time: 0.222585 Aug 30 04:18:24.887377 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1172/2290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:24 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:24.892487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-458835cd-8586-4160-9b6d-330ad6fb0656 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe969938dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-686063537", "description": "tempest-description-350204700"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:25.672586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:25.684850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:25.688248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:25.689527 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e41e69b-06d3-4e30-94fe-250a2b7a9878 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1804 microversion: 2.25 time: 1.106561 Aug 30 04:18:25.690849 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1119/2291] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:24 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1804 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:25.700172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ff1c82a-d568-4820-86cb-a63dc293f0ec tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:25.701479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ff1c82a-d568-4820-86cb-a63dc293f0ec tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:26.005203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ff1c82a-d568-4820-86cb-a63dc293f0ec tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:26.018657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ff1c82a-d568-4820-86cb-a63dc293f0ec tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:26.025876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ff1c82a-d568-4820-86cb-a63dc293f0ec tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:26.035057 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ff1c82a-d568-4820-86cb-a63dc293f0ec tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1284 microversion: 2.42 time: 0.339590 Aug 30 04:18:26.038908 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1120/2292] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:25 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1284 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:26.205962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1945955420", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:26.410346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] validate_networks() for [('1f233b1d-f70d-45f6-bb63-354fc604e2ba', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:18:28.089223 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-458835cd-8586-4160-9b6d-330ad6fb0656 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 3.200194 Aug 30 04:18:28.097978 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1173/2293] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:18:24 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 3202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:28.097978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-443ce70b-26aa-451d-897b-f23c1a603123 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '.version_select at 0x7fe96a2491f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:28.104359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ce70b-26aa-451d-897b-f23c1a603123 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:28.106965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ce70b-26aa-451d-897b-f23c1a603123 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:28.109521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ce70b-26aa-451d-897b-f23c1a603123 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:28.139513 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-443ce70b-26aa-451d-897b-f23c1a603123 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1278 microversion: 2.25 time: 0.047956 Aug 30 04:18:28.149265 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1174/2294] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Aug 30 04:18:28 2022] GET /compute/v2.1/os-migrations => generated 1278 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:28.158343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:28.159053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:28.168893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:28.170675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:28.171433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:28.172557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:28.173260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:28.174176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:28.437246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:28.468130 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7aacc11c-617c-4397-8497-93b55dab1cdc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1272 microversion: 2.1 time: 0.317399 Aug 30 04:18:28.477194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1175/2295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:28 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1272 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:28.503231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:28.503922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:28.545920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:28.549882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:28.552224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:28.558523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:28.558894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:28.559344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:28.944265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:28.960424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:28.965778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:28.969428 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b623aea0-8974-4363-9c0e-6bbdcb733d83 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1592 microversion: 2.42 time: 0.489203 Aug 30 04:18:28.973561 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1176/2296] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:28 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1592 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:28.986386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3a59e6f-469c-4684-8bfd-4101dc600736 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe969a358b0>, body: {"security_group_rule": {"parent_group_id": "563d1b04-2468-4883-9d60-f63be2df987a", "ip_protocol": "tcp", "from_port": 1665054703, "to_port": 22}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:29.917412 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-c3a59e6f-469c-4684-8bfd-4101dc600736 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: Invalid port range 1665054703:22. Former value cannot be greater than the later Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3a59e6f-469c-4684-8bfd-4101dc600736 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 146 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: {"security_group_rule": {"parent_group_id": "563d1b04-2468-4883-9d60-f63be2df987a", "ip_protocol": "tcp", "from_port": 1665054703, "to_port": 22}} Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid port range 1665054703:22. Former value cannot be greater than the later Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'security_group_rule': {'parent_group_id': '563d1b04-2468-4883-9d60-f63be2df987a', 'ip_protocol': 'tcp', 'from_port': 1665054703, 'to_port': 22}}} Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1665054703:22. Former value cannot be greater than the later Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1665054703:22. Former value cannot be greater than the later Aug 30 04:18:29.920849 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1665054703:22. Former value cannot be greater than the later Aug 30 04:18:29.925271 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:29.926707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3a59e6f-469c-4684-8bfd-4101dc600736 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 400 to user: Invalid port range 1665054703:22. Former value cannot be greater than the later {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:29.927727 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c3a59e6f-469c-4684-8bfd-4101dc600736 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.952337 Aug 30 04:18:29.928815 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1177/2297] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:28 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 954 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:18:29.935581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:29.940930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:29.976091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:29.977392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:29.981084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:29.982086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:29.983815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:29.989159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:30.588645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:18:30.589200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:18:30.589812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:18:30.590335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:18:30.591270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:18:30.601529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:30.602392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:30.603073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:30.604101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:30.604804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:30.605509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:30.630208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 8d0a8293-be54-4224-956f-44539222c466 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:18:30.646664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Getting quotas for project a5c7ed92779d4d978e1054af02c1d4be. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:30.664943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25c6d211-9499-4bf0-a409-fe53a69f90ff tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 2423 microversion: 2.25 time: 0.734714 Aug 30 04:18:30.665556 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1178/2298] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:29 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 2423 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:30.666593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Getting quotas for user 9d30438293fd4ec2b7b5c2180ea5a0ea and project a5c7ed92779d4d978e1054af02c1d4be. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:30.675086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:30.686719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:30.697477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:18:30.699982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:18:30.707456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:30.707952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:30.708398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:30.709117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:30.709642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:30.710050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:30.787269 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d965cc2d-0c9a-4da3-84ea-42098a1a32f8 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.742851 Aug 30 04:18:30.788722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1121/2299] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:18:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:18:30.794223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d8d561a-20ea-4001-a8a0-911edd6173a7 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe96a162d30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-17758611", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:30.803929 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7d8d561a-20ea-4001-a8a0-911edd6173a7 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: Security group id should be uuid Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d8d561a-20ea-4001-a8a0-911edd6173a7 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 129 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-17758611", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group id should be uuid Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-17758611', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:30.806541 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:30.813726 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 30 04:18:30.813726 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:30.818170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d8d561a-20ea-4001-a8a0-911edd6173a7 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 400 to user: Security group id should be uuid {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:30.824102 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d8d561a-20ea-4001-a8a0-911edd6173a7 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.029286 Aug 30 04:18:30.825176 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1122/2300] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:30 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:30.835614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:30.836811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:30.845517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:30.846462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:30.848121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:30.849601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:30.851343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:30.853426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:31.063642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:31.085513 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-040b0df7-ec04-47f8-bfdc-efc88ff0cf52 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1272 microversion: 2.1 time: 0.418832 Aug 30 04:18:31.094496 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1179/2301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:30 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1272 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:31.109908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:31.112730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:31.133088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:31.133693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:31.134058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:31.134870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:31.135303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:31.135676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:31.293059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:31.325550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:31.338227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:31.342894 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed31c5dc-3c5d-43c6-90cd-d3d3deb47e9f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1592 microversion: 2.42 time: 0.513212 Aug 30 04:18:31.344259 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1123/2302] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:30 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1592 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:31.351426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a724b261-c1c9-4421-be46-61c4158931f1 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:31.352269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a724b261-c1c9-4421-be46-61c4158931f1 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:31.612936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a724b261-c1c9-4421-be46-61c4158931f1 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:31.640236 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a724b261-c1c9-4421-be46-61c4158931f1 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1224 microversion: 2.1 time: 0.293035 Aug 30 04:18:31.640859 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1124/2303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:31 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1224 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:31.659268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4bdbefa1-ac65-4491-8066-354dacc8084e tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe969fcce50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1511145467", "description": "tempest-description-1940479419"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:32.282634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 8d0a8293-be54-4224-956f-44539222c466 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:18:32.336211 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d77d4cd5-3144-40c8-aad6-9482da994001 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 2423 microversion: 2.25 time: 1.240105 Aug 30 04:18:32.342915 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1180/2304] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:31 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 2423 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:32.362559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:32.363502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:32.387085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:32.387596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:32.388039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:32.388876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:32.389440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:32.389873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:33.447898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:33.539297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:33.721000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:33.736500 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3af27e5c-bc0e-4638-96b2-c001f9e8efc5 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 1.387893 Aug 30 04:18:33.750790 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1181/2305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:32 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:33.756855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:33.757582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:33.792580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:33.793434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:33.794047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:33.795597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:33.796224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:33.796834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:33.971996 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4bdbefa1-ac65-4491-8066-354dacc8084e tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 2.330019 Aug 30 04:18:33.981150 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1125/2306] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:18:31 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:34.274654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:34.275154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:34.286699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:34.287189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:34.287630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:34.288339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:34.288800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:34.289212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:34.580905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lazy-loading 'services' on Instance uuid 8d0a8293-be54-4224-956f-44539222c466 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:18:34.736712 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88ebc60f-fba0-4529-86eb-62fa9de9c020 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments/6696579a-4949-4d3c-af64-4bbfa59ab2a2" status: 202 len: 0 microversion: 2.25 time: 0.753566 Aug 30 04:18:34.737440 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1126/2307] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Aug 30 04:18:33 2022] DELETE /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments/6696579a-4949-4d3c-af64-4bbfa59ab2a2 => generated 0 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:18:34.758527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:34.759800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:34.799747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:34.800861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:34.802800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:34.805049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:34.806176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:34.808746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:34.854746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:34.877008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:34.887910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:34.895222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d84a79e4-ff41-468b-b4ad-de7696a99dae tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1660 microversion: 2.42 time: 1.140175 Aug 30 04:18:34.896425 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1182/2308] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:33 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1660 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:34.903499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-570eb69c-a138-4a6b-83c0-303d7d7a0597 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe969a351f0>, body: {"security_group_rule": {"parent_group_id": "1f04e9fa-684c-4429-9a9b-5bd64042dd70", "ip_protocol": "tempest-999-32680407", "from_port": 22, "to_port": 22}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:35.049834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:35.067510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-471e35a0-a368-4fb4-8c13-77df5d484639 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1282 microversion: 2.1 time: 0.316855 Aug 30 04:18:35.068169 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1127/2309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:34 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1282 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:35.084568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:35.087253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:35.104031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:35.104912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:35.105552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:35.107875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:35.112885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:35.113570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:35.183582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-75fb4e1a-6000-40d3-a1c5-e466565babf1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.110414 Aug 30 04:18:35.189252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1128/2310] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:18:35 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:35.204918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:35.205877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:35.213632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:35.214385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:35.214986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:35.215965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:35.216643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:35.218057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:35.318822 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-570eb69c-a138-4a6b-83c0-303d7d7a0597 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: Invalid IP protocol tempest-999-32680407. Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-570eb69c-a138-4a6b-83c0-303d7d7a0597 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 155 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: {"security_group_rule": {"parent_group_id": "1f04e9fa-684c-4429-9a9b-5bd64042dd70", "ip_protocol": "tempest-999-32680407", "from_port": 22, "to_port": 22}} Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid IP protocol tempest-999-32680407. Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1f04e9fa-684c-4429-9a9b-5bd64042dd70', 'ip_protocol': 'tempest-999-32680407', 'from_port': 22, 'to_port': 22}}} Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-32680407. Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-32680407. Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:35.320390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-32680407. Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-570eb69c-a138-4a6b-83c0-303d7d7a0597 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 400 to user: Invalid IP protocol tempest-999-32680407. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-570eb69c-a138-4a6b-83c0-303d7d7a0597 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.424410 Aug 30 04:18:35.328611 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1183/2311] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:34 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 426 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:18:35.499817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ca4eca6-408a-4552-b6d7-5d2ae82d9b79 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Action: 'create', calling method: .version_select at 0x7fe96a3a83a0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:35.554698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4ca4eca6-408a-4552-b6d7-5d2ae82d9b79 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Getting quotas for project d6b0f093d73d49c3a664577fc8103b17. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:35.567870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4ca4eca6-408a-4552-b6d7-5d2ae82d9b79 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Getting quotas for user 76e064479ff841e9b959c9da0fa341ac and project d6b0f093d73d49c3a664577fc8103b17. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:35.716963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4ca4eca6-408a-4552-b6d7-5d2ae82d9b79 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Getting quotas for project d6b0f093d73d49c3a664577fc8103b17. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:18:35.734802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4ca4eca6-408a-4552-b6d7-5d2ae82d9b79 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Getting quotas for user 76e064479ff841e9b959c9da0fa341ac and project d6b0f093d73d49c3a664577fc8103b17. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:18:35.785013 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ca4eca6-408a-4552-b6d7-5d2ae82d9b79 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.456176 Aug 30 04:18:35.785749 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1184/2312] 10.222.0.27 () {62 vars in 1214 bytes} [Tue Aug 30 04:18:35 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:35.795857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc1d4db2-f868-4d4c-a7cb-b4fc9c2a0b19 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe969a350d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-233721175", "description": "tempest-description-459599367"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:36.073167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:36.087372 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26f89d6b-4a25-4161-8b4f-9044189bf146 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 0.895770 Aug 30 04:18:36.089050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1129/2313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:35 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:36.102629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4fa03f5-f0a5-4454-b7fb-409a4b54a7ca tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:36.150030 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4fa03f5-f0a5-4454-b7fb-409a4b54a7ca tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.059670 Aug 30 04:18:36.150626 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1130/2314] 10.222.0.27 () {60 vars in 1193 bytes} [Tue Aug 30 04:18:36 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:36.161085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:36.166606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:36.186911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:36.187951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:36.188401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:36.189139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:36.189613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:36.191892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:36.899766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:36.921763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:36.923736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:36.926605 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c02067cb-ecf2-4beb-a1ed-f885d6dac6a8 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1707 microversion: 2.42 time: 0.773511 Aug 30 04:18:36.939338 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1131/2315] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:36 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1707 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:36.954695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:36.957063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:36.979623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:36.980305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:36.981031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:36.984064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:36.987684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:36.989153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:37.856877 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc1d4db2-f868-4d4c-a7cb-b4fc9c2a0b19 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 2.069786 Aug 30 04:18:37.862044 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1185/2316] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:18:35 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:37.872195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00652b0a-044c-4ef1-a92d-47c426349efa tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:37.946579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:37.947072 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00652b0a-044c-4ef1-a92d-47c426349efa tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/f689804b-62c4-4b7e-8b42-75d5abdefff7" status: 200 len: 235 microversion: 2.64 time: 0.080981 Aug 30 04:18:37.949285 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1186/2317] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Aug 30 04:18:37 2022] GET /compute/v2.1/os-server-groups/f689804b-62c4-4b7e-8b42-75d5abdefff7 => generated 235 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:37.957825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6915467e-c160-4d89-8f64-d6123869c72b tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 1.017085 Aug 30 04:18:37.958426 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1132/2318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:36 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:37.964576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:37.970808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:37.993274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:37.993811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:37.995727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:37.998447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:37.999263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.000769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.001645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.002560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.015774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.016387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.016837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.017691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.018442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.019229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.078012 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-054fb203-03bc-4c2a-a995-b49a195f3757 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124462 Aug 30 04:18:38.086480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1187/2319] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:18:37 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:38.238571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7f6e31e-fa88-427a-ba40-9ff6b06530bd tempest-FloatingIPDetailsNegativeTestJSON-137641072 tempest-FloatingIPDetailsNegativeTestJSON-137641072-project] Calling method '.version_select at 0x7fe969a35dc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:38.478088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-f7f6e31e-fa88-427a-ba40-9ff6b06530bd tempest-FloatingIPDetailsNegativeTestJSON-137641072 tempest-FloatingIPDetailsNegativeTestJSON-137641072-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c7fc79c1-f3a6-4b5b-b291-3d037c7509bc could not be found", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:18:38.479391 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f7f6e31e-fa88-427a-ba40-9ff6b06530bd tempest-FloatingIPDetailsNegativeTestJSON-137641072 tempest-FloatingIPDetailsNegativeTestJSON-137641072-project] HTTP exception thrown: Floating IP not found for ID c7fc79c1-f3a6-4b5b-b291-3d037c7509bc Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7f6e31e-fa88-427a-ba40-9ff6b06530bd tempest-FloatingIPDetailsNegativeTestJSON-137641072 tempest-FloatingIPDetailsNegativeTestJSON-137641072-project] Request method failure captured: Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-floating-ips/c7fc79c1-f3a6-4b5b-b291-3d037c7509bc HTTP/1.1 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-dcF19kox8j5Fq-Qj4CMs0lcgWVaDbxkS1oZ6mmHIgE6NWUAgoNcqPrdSHGSe2bUDpj1LwrG_c_XVii9GeKkfDSTeGs2264YQ1RAv33gznjKTUwsuD4YFmGe1eecsTSN-TSwQnrZQuHqxyFtkgb10N3myNy91FCxm4xnMIAxZvWSU Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9d81cbc669c1469bbe7380bcfe7ddb34 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-137641072 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9d81cbc669c1469bbe7380bcfe7ddb34", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9d81cbc669c1469bbe7380bcfe7ddb34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d81cbc669c1469bbe7380bcfe7ddb34"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9d81cbc669c1469bbe7380bcfe7ddb34"}]}] Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-137641072 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9d81cbc669c1469bbe7380bcfe7ddb34 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-137641072 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-137641072-project Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c582a5f2e0e044068f10732cea1350c5 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-137641072-project Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: exception: Floating IP not found for ID c7fc79c1-f3a6-4b5b-b291-3d037c7509bc Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c7fc79c1-f3a6-4b5b-b291-3d037c7509bc'} Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP c7fc79c1-f3a6-4b5b-b291-3d037c7509bc could not be found Aug 30 04:18:38.481652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20982f3a-5b31-42b8-95f2-81d5ab6c8c0e'] Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID c7fc79c1-f3a6-4b5b-b291-3d037c7509bc. Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID c7fc79c1-f3a6-4b5b-b291-3d037c7509bc Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID c7fc79c1-f3a6-4b5b-b291-3d037c7509bc Aug 30 04:18:38.485827 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.492017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7f6e31e-fa88-427a-ba40-9ff6b06530bd tempest-FloatingIPDetailsNegativeTestJSON-137641072 tempest-FloatingIPDetailsNegativeTestJSON-137641072-project] Returning 404 to user: Floating IP not found for ID c7fc79c1-f3a6-4b5b-b291-3d037c7509bc {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:38.493111 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7f6e31e-fa88-427a-ba40-9ff6b06530bd tempest-FloatingIPDetailsNegativeTestJSON-137641072 tempest-FloatingIPDetailsNegativeTestJSON-137641072-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/c7fc79c1-f3a6-4b5b-b291-3d037c7509bc" status: 404 len: 111 microversion: 2.1 time: 0.405014 Aug 30 04:18:38.493924 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1188/2320] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:18:38 2022] GET /compute/v2.1/os-floating-ips/c7fc79c1-f3a6-4b5b-b291-3d037c7509bc => generated 111 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:18:38.509071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1cf645aa-2d4f-4ef8-a510-b178d54cfa51 req-2d5b86b9-6627-4b58-aa4e-09e3b3210d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66133a4d-4ffd-464c-93c9-112e162e79ff", "tag": "99720d13-124d-4994-b4c7-ecafbf4f46fd"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:38.543347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1cf645aa-2d4f-4ef8-a510-b178d54cfa51 req-2d5b86b9-6627-4b58-aa4e-09e3b3210d25 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.543776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1cf645aa-2d4f-4ef8-a510-b178d54cfa51 req-2d5b86b9-6627-4b58-aa4e-09e3b3210d25 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.549839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1cf645aa-2d4f-4ef8-a510-b178d54cfa51 req-2d5b86b9-6627-4b58-aa4e-09e3b3210d25 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.574944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1cf645aa-2d4f-4ef8-a510-b178d54cfa51 req-2d5b86b9-6627-4b58-aa4e-09e3b3210d25 service nova] Creating event network-changed:99720d13-124d-4994-b4c7-ecafbf4f46fd for instance 66133a4d-4ffd-464c-93c9-112e162e79ff on n-h1-854925-5 Aug 30 04:18:38.593680 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1cf645aa-2d4f-4ef8-a510-b178d54cfa51 req-2d5b86b9-6627-4b58-aa4e-09e3b3210d25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091955 Aug 30 04:18:38.594617 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1189/2321] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:38.604811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1433eb03-97ac-4fd4-b42e-cd7483a5a6ae tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe96973dee0>, body: {"security_group_rule": {"parent_group_id": "81220b74-1b32-42ad-949b-27722b4a2590", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:38.722194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:38.733453 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ce13c36-3f33-49d6-a2c6-b580b2c749da tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 0.752109 Aug 30 04:18:38.757353 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1133/2322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:37 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:38.757353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:38.757353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:38.799288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.799818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.800263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.801205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:38.801701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:38.802136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:38.990751 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1433eb03-97ac-4fd4-b42e-cd7483a5a6ae tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1433eb03-97ac-4fd4-b42e-cd7483a5a6ae tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 138 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: {"security_group_rule": {"parent_group_id": "81220b74-1b32-42ad-949b-27722b4a2590", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'security_group_rule': {'parent_group_id': '81220b74-1b32-42ad-949b-27722b4a2590', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 04:18:38.993490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 30 04:18:38.996912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:39.003616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1433eb03-97ac-4fd4-b42e-cd7483a5a6ae tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:39.004618 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1433eb03-97ac-4fd4-b42e-cd7483a5a6ae tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.408900 Aug 30 04:18:39.005321 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1190/2323] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:38 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 410 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:18:39.014627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4280976d-8036-483c-ab5e-7fe774b6da26 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:39.117812 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4280976d-8036-483c-ab5e-7fe774b6da26 tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/f689804b-62c4-4b7e-8b42-75d5abdefff7" status: 204 len: 0 microversion: 2.64 time: 0.111163 Aug 30 04:18:39.118440 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1191/2324] 10.222.0.27 () {60 vars in 1307 bytes} [Tue Aug 30 04:18:39 2022] DELETE /compute/v2.1/os-server-groups/f689804b-62c4-4b7e-8b42-75d5abdefff7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:18:39.142947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:39.144778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:39.172518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:39.177719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:39.180443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:39.185004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:39.194071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:39.195072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:39.951612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:39.976600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:39.978745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:39.979971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-78e09ce7-5d46-4eff-a08e-a8daf94b59dd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1707 microversion: 2.42 time: 1.232635 Aug 30 04:18:39.980544 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1134/2325] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:38 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1707 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:39.987337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:39.995757 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-165b1b7d-c1ab-4433-9945-2a58e67de649 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.876179 Aug 30 04:18:39.999233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a83a4b9-be4e-475c-9e7b-f6a1d99a953d tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe96a368430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1511315679", "description": "tempest-description-1590822601"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:40.001724 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1192/2326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:39 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:40.012748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:40.021190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:40.041601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:40.052893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:40.053768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:40.054756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:40.058277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:40.058954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:40.163673 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-56d67e1e-6fc8-43fd-b1a8-87cb3efa6d9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.152034 Aug 30 04:18:40.169496 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1193/2327] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:18:40 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:40.182194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8d5fe47-1d88-4e51-91c0-cc422cc5edaf tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:40.195126 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-d8d5fe47-1d88-4e51-91c0-cc422cc5edaf tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] HTTP exception thrown: Instance group f689804b-62c4-4b7e-8b42-75d5abdefff7 could not be found. Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8d5fe47-1d88-4e51-91c0-cc422cc5edaf tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Request method failure captured: Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-server-groups/f689804b-62c4-4b7e-8b42-75d5abdefff7 HTTP/1.1 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-bNT19Y9N3B4PECVD7a9_sFPFraZvA3gY2aYxHpCjqUmp0fn-b7ibg030hKKCce7mWHEfKr3uFXD4UNtGPwm1sUmjSCUIZowUkfeRFjVHyFM4Cn-1Qz30vHfCH5mVkNH6ccE7q-CybVGGxn_7MXb8v2ujgBiXYADU1j2o0RWfMbos Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.64 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: d6b0f093d73d49c3a664577fc8103b17 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerGroup264TestJSON-221944455 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d6b0f093d73d49c3a664577fc8103b17", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d6b0f093d73d49c3a664577fc8103b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6b0f093d73d49c3a664577fc8103b17"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d6b0f093d73d49c3a664577fc8103b17"}]}] Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerGroup264TestJSON-221944455 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: d6b0f093d73d49c3a664577fc8103b17 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerGroup264TestJSON-221944455 Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerGroup264TestJSON-221944455-project Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 76e064479ff841e9b959c9da0fa341ac Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerGroup264TestJSON-221944455-project Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance group f689804b-62c4-4b7e-8b42-75d5abdefff7 could not be found. Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'f689804b-62c4-4b7e-8b42-75d5abdefff7'} Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f689804b-62c4-4b7e-8b42-75d5abdefff7 could not be found. Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f689804b-62c4-4b7e-8b42-75d5abdefff7 could not be found. Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:40.215084 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:40.220426 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:40.220426 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:40.220426 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:40.220426 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:40.220426 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f689804b-62c4-4b7e-8b42-75d5abdefff7 could not be found. Aug 30 04:18:40.220426 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:40.221956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8d5fe47-1d88-4e51-91c0-cc422cc5edaf tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] Returning 404 to user: Instance group f689804b-62c4-4b7e-8b42-75d5abdefff7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:40.223191 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d8d5fe47-1d88-4e51-91c0-cc422cc5edaf tempest-ServerGroup264TestJSON-221944455 tempest-ServerGroup264TestJSON-221944455-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/f689804b-62c4-4b7e-8b42-75d5abdefff7" status: 404 len: 117 microversion: 2.64 time: 0.052068 Aug 30 04:18:40.224272 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1194/2328] 10.222.0.27 () {60 vars in 1307 bytes} [Tue Aug 30 04:18:40 2022] DELETE /compute/v2.1/os-server-groups/f689804b-62c4-4b7e-8b42-75d5abdefff7 => generated 117 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:18:40.229049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:40.230664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:40.242538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:40.243454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:40.244174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:40.245125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:40.245913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:40.246561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:40.620855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.399541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:41.411801 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-30c41daf-ceda-4abd-aa74-881b1b4d5903 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 1.186251 Aug 30 04:18:41.429139 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1195/2329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:40 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:41.449056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:41.450170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:41.469275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.470943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.471555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.472125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.473419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.474286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.474979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.483419 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a83a4b9-be4e-475c-9e7b-f6a1d99a953d tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.491376 Aug 30 04:18:41.484912 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1135/2330] 10.222.0.27 () {60 vars in 1180 bytes} [Tue Aug 30 04:18:39 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:41.490011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:41.490630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:41.503095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.503604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.504047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.504773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.505223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.505701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.631596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=16 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:41.805408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:41.815886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6363f54a-5a5c-403f-a765-a0cdbf1f5b82 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.329604 Aug 30 04:18:41.820693 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1136/2331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:41 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:41.832752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:41.835303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:41.842832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.844052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.844668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.845557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.846276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.846847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.916571 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da73c791-800a-4e58-b9da-61a39e416640 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094804 Aug 30 04:18:41.917750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1137/2332] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:18:41 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:41.923422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-bcd74ba2-91cd-4f4e-bb32-e5b242d4c3c7 req-09ebd599-8a6b-465e-bb39-21b36d31c5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de42eb8-fd65-4257-a2ee-5c39218a3284", "tag": "2ca08fa0-fc7f-46b4-bd6a-6120cfdfbc15"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:41.933992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bcd74ba2-91cd-4f4e-bb32-e5b242d4c3c7 req-09ebd599-8a6b-465e-bb39-21b36d31c5d9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:41.934712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bcd74ba2-91cd-4f4e-bb32-e5b242d4c3c7 req-09ebd599-8a6b-465e-bb39-21b36d31c5d9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:41.935918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bcd74ba2-91cd-4f4e-bb32-e5b242d4c3c7 req-09ebd599-8a6b-465e-bb39-21b36d31c5d9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:41.958038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-bcd74ba2-91cd-4f4e-bb32-e5b242d4c3c7 req-09ebd599-8a6b-465e-bb39-21b36d31c5d9 service nova] Creating event network-changed:2ca08fa0-fc7f-46b4-bd6a-6120cfdfbc15 for instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 on n-h1-854925-5 Aug 30 04:18:41.968010 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-bcd74ba2-91cd-4f4e-bb32-e5b242d4c3c7 req-09ebd599-8a6b-465e-bb39-21b36d31c5d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048789 Aug 30 04:18:41.969168 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1138/2333] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:41.969626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:41.978837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfce3214-cfd2-4e68-bba1-c4e74e8349db tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe96a368670>, body: {"security_group_rule": {"parent_group_id": "0e0d603c-b492-4d6d-b61a-2e361a2e29fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 154428206}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:41.980309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:41.982106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:41.994750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ff921bd-a097-4238-a7f4-0a5eaa0b2ef2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1754 microversion: 2.42 time: 0.564179 Aug 30 04:18:41.996055 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1196/2334] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:41 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1754 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:42.081140 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-cfce3214-cfd2-4e68-bba1-c4e74e8349db tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: Invalid port range 22:154428206. Valid TCP ports should be between 1-65535 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfce3214-cfd2-4e68-bba1-c4e74e8349db tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 145 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: {"security_group_rule": {"parent_group_id": "0e0d603c-b492-4d6d-b61a-2e361a2e29fe", "ip_protocol": "tcp", "from_port": 22, "to_port": 154428206}} Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid port range 22:154428206. Valid TCP ports should be between 1-65535 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'security_group_rule': {'parent_group_id': '0e0d603c-b492-4d6d-b61a-2e361a2e29fe', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 154428206}}} Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:154428206. Valid TCP ports should be between 1-65535 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:154428206. Valid TCP ports should be between 1-65535 Aug 30 04:18:42.084609 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:154428206. Valid TCP ports should be between 1-65535 Aug 30 04:18:42.089645 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.093442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfce3214-cfd2-4e68-bba1-c4e74e8349db tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 400 to user: Invalid port range 22:154428206. Valid TCP ports should be between 1-65535 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:42.094497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cfce3214-cfd2-4e68-bba1-c4e74e8349db tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.123860 Aug 30 04:18:42.095669 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1139/2335] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:41 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:18:42.106499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c4f1fcf-a256-443b-a939-60312df59c23 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Action: 'create', calling method: .version_select at 0x7fe969989310>, body: {"security_group_rule": {"parent_group_id": "10ce71b7-6b6f-4adb-a61b-4aea4245858b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:42.156122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-0c4f1fcf-a256-443b-a939-60312df59c23 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:18:42.156977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-0c4f1fcf-a256-443b-a939-60312df59c23 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Neutron security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:18:42.157749 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0c4f1fcf-a256-443b-a939-60312df59c23 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist Aug 30 04:18:42.157749 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-8c50846a-9e90-4644-b9ca-e537373347e6'] Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c4f1fcf-a256-443b-a939-60312df59c23 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 138 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: {"security_group_rule": {"parent_group_id": "10ce71b7-6b6f-4adb-a61b-4aea4245858b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-8c50846a-9e90-4644-b9ca-e537373347e6'] Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'security_group_rule': {'parent_group_id': '10ce71b7-6b6f-4adb-a61b-4aea4245858b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:18:42.160170 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c50846a-9e90-4644-b9ca-e537373347e6'] Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c50846a-9e90-4644-b9ca-e537373347e6'] Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c50846a-9e90-4644-b9ca-e537373347e6'] Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8c50846a-9e90-4644-b9ca-e537373347e6'] Aug 30 04:18:42.163618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.171368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c4f1fcf-a256-443b-a939-60312df59c23 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 404 to user: Security group 10ce71b7-6b6f-4adb-a61b-4aea4245858b does not exist Aug 30 04:18:42.171368 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-8c50846a-9e90-4644-b9ca-e537373347e6'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:42.172610 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c4f1fcf-a256-443b-a939-60312df59c23 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.070413 Aug 30 04:18:42.173810 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1197/2336] 10.222.0.27 () {60 vars in 1195 bytes} [Tue Aug 30 04:18:42 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:18:42.184887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21efc024-d19b-4f21-8d7d-1aa391778c38 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Calling method '.version_select at 0x7fe96a1dc670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:42.227317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-21efc024-d19b-4f21-8d7d-1aa391778c38 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:18:42.228460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-21efc024-d19b-4f21-8d7d-1aa391778c38 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Neutron security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f not found {{(pid=122402) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 30 04:18:42.229164 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-21efc024-d19b-4f21-8d7d-1aa391778c38 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] HTTP exception thrown: Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist Aug 30 04:18:42.229164 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-15def544-cf62-4a6e-81fd-62e3dd8f92d1'] Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21efc024-d19b-4f21-8d7d-1aa391778c38 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Request method failure captured: Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-security-group-rules/4a10b1e3-b502-4b20-9d50-b064b3736c0f HTTP/1.1 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY-GH86gOKMpExv0eMf7rGhcIyQ10yb7HpfdInRZwOmdvkXa1nvFxmkOmkQoH_k_1kkteAeBJSEt3Vtbw18sWmp_4vLb5LQa2t362NQoIlAICVWS-ma0Qzvl012DbXejGw5C_18SrG9ahi3HirjKX_39iUUgxD2fN06XAwSSHU5Ya60 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33df20d2bb3042318b053927fc39f397", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33df20d2bb3042318b053927fc39f397"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33df20d2bb3042318b053927fc39f397"}]}] Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 33df20d2bb3042318b053927fc39f397 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 73da02e98a22437a946f95e19d41c959 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-15def544-cf62-4a6e-81fd-62e3dd8f92d1'] Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '4a10b1e3-b502-4b20-9d50-b064b3736c0f'} Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:18:42.233574 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15def544-cf62-4a6e-81fd-62e3dd8f92d1'] Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15def544-cf62-4a6e-81fd-62e3dd8f92d1'] Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15def544-cf62-4a6e-81fd-62e3dd8f92d1'] Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-15def544-cf62-4a6e-81fd-62e3dd8f92d1'] Aug 30 04:18:42.237707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:18:42.245700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21efc024-d19b-4f21-8d7d-1aa391778c38 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Returning 404 to user: Security group rule 4a10b1e3-b502-4b20-9d50-b064b3736c0f does not exist Aug 30 04:18:42.245700 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-15def544-cf62-4a6e-81fd-62e3dd8f92d1'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:18:42.250075 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21efc024-d19b-4f21-8d7d-1aa391778c38 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-group-rules/4a10b1e3-b502-4b20-9d50-b064b3736c0f" status: 404 len: 199 microversion: 2.1 time: 0.067367 Aug 30 04:18:42.251579 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1140/2337] 10.222.0.27 () {58 vars in 1287 bytes} [Tue Aug 30 04:18:42 2022] DELETE /compute/v2.1/os-security-group-rules/4a10b1e3-b502-4b20-9d50-b064b3736c0f => generated 199 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:18:42.264970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7f9a7b7-1e09-4f18-9a13-6c9439478a06 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Calling method '.version_select at 0x7fe9696e21f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:42.437204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:42.438037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:42.449417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:42.450064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:42.450333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:42.457539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:42.458121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:42.461585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:42.566482 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7f9a7b7-1e09-4f18-9a13-6c9439478a06 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/0e0d603c-b492-4d6d-b61a-2e361a2e29fe" status: 202 len: 0 microversion: 2.1 time: 0.308344 Aug 30 04:18:42.568296 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1198/2338] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:18:42 2022] DELETE /compute/v2.1/os-security-groups/0e0d603c-b492-4d6d-b61a-2e361a2e29fe => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:42.578187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fd85fa32-9257-4750-a910-3f9afd7183b4 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Calling method '.version_select at 0x7fe96e5fc670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:42.870116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:42.887694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-677485ca-8735-467b-86c2-d661baf6156d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 0.454667 Aug 30 04:18:42.889609 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1141/2339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:42 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:42.895099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:42.895947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:42.903636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:42.904863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:42.905917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:42.906800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:42.907783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:42.908602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.136078 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fd85fa32-9257-4750-a910-3f9afd7183b4 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/81220b74-1b32-42ad-949b-27722b4a2590" status: 202 len: 0 microversion: 2.1 time: 0.563175 Aug 30 04:18:43.137528 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1199/2340] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:18:42 2022] DELETE /compute/v2.1/os-security-groups/81220b74-1b32-42ad-949b-27722b4a2590 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:43.143990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:43.147389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:43.158930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.159337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.159793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.166158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.166654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.168674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.279432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:43.285188 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91b1898d-30d4-4df5-92a4-13a5f5cde723 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146088 Aug 30 04:18:43.288092 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cb1a8624-b0f3-467b-8dfd-d1f11a067583 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.397277 Aug 30 04:18:43.290608 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1200/2341] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:18:43 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:43.297244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:43.298268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:43.301801 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1142/2342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:42 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:43.306722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a93301b-5734-4871-9199-81c5cd7a3eca tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Calling method '.version_select at 0x7fe96a2533a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:43.307320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.307984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.308573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.309463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.310058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.311200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.780695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:43.786763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:43.803125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:43.804785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:43.806496 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f5f2f116-ed3b-4d5b-ad8d-6269c7672d9c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1754 microversion: 2.42 time: 0.514572 Aug 30 04:18:43.807550 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1201/2343] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:43 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1754 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:43.913429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:43.914578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:43.925861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.926817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.927795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:43.929024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:43.930009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:43.931406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:44.258120 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2a93301b-5734-4871-9199-81c5cd7a3eca tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/1f04e9fa-684c-4429-9a9b-5bd64042dd70" status: 202 len: 0 microversion: 2.1 time: 0.954000 Aug 30 04:18:44.262726 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1143/2344] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:18:43 2022] DELETE /compute/v2.1/os-security-groups/1f04e9fa-684c-4429-9a9b-5bd64042dd70 => generated 0 bytes in 960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:44.268583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-33664bf7-a79e-4a11-b1c8-2f12ee5fc064 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Calling method '.version_select at 0x7fe96a3474c0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:44.477827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:44.523149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e60d0e8e-09bc-49ad-b92d-34697a771132 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 0.617673 Aug 30 04:18:44.524014 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1202/2345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:43 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:18:44.540694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:44.545594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:44.556754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:44.557802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:44.558415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:44.559316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:44.559958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:44.562402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:44.675171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c0f8383-5d45-40f0-9c4c-585af47a98aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.149153 Aug 30 04:18:44.676439 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1203/2346] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:18:44 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466/os-volume_attachments => generated 25 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:44.695507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:44.700187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:44.715463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:44.716767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:44.717800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:44.719204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:44.720839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:44.722866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:45.671682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:45.681480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0fceec28-2e31-4ecf-b8af-30b272ed9900 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 1.003705 Aug 30 04:18:45.686128 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1204/2347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:44 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:45.696043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:45.698155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:45.715929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:45.716505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:45.717254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:45.723210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:45.723847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:45.725364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:45.798953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:45.873693 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-33664bf7-a79e-4a11-b1c8-2f12ee5fc064 tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/563d1b04-2468-4883-9d60-f63be2df987a" status: 202 len: 0 microversion: 2.1 time: 1.608408 Aug 30 04:18:45.874329 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1144/2348] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:18:44 2022] DELETE /compute/v2.1/os-security-groups/563d1b04-2468-4883-9d60-f63be2df987a => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:45.886746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:45.887500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:45.914657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:45.915352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:45.915955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:45.916871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:45.917525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:45.918114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:46.240927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:46.256850 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b6ad6f9-c648-44d9-a0e6-c6e8e1dea111 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 0.380310 Aug 30 04:18:46.258070 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1145/2349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:45 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:46.263315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18d0d920-5b21-4de0-b0f7-1f426e41aa1f tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] Calling method '.version_select at 0x7fe969f86670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:46.275825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:46.289362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:46.290887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:46.292082 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dcc8414e-9cfb-4eee-9cdd-ff6dbaf3cb7f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1801 microversion: 2.42 time: 0.604723 Aug 30 04:18:46.292651 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1205/2350] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:45 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1801 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:46.665061 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18d0d920-5b21-4de0-b0f7-1f426e41aa1f tempest-SecurityGroupRulesNegativeTestJSON-1634342115 tempest-SecurityGroupRulesNegativeTestJSON-1634342115-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/d96327aa-49bd-491c-a8e2-63f6a8b9a7cd" status: 202 len: 0 microversion: 2.1 time: 0.405413 Aug 30 04:18:46.670854 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1146/2351] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:18:46 2022] DELETE /compute/v2.1/os-security-groups/d96327aa-49bd-491c-a8e2-63f6a8b9a7cd => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:18:46.708355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:46.708976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:46.717712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:46.718449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:46.719321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:46.720281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:46.720954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:46.721704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:47.115607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:47.125085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6009b47d-291c-46a0-aeba-e94fb61bfac3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.420617 Aug 30 04:18:47.126549 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1206/2352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:46 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:47.277205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:47.278198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:47.281492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:47.292201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:47.292201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:47.297564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:47.298694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:47.299193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:47.299642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:47.318826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:47.319459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:47.330407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:47.332895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:47.333584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:47.338139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:47.339413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:47.340177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:48.066504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:48.073208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:18:48.083383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b316dcac-f866-4576-a765-0c25e91efb47 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 0.810009 Aug 30 04:18:48.084659 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1147/2353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:47 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:48.092353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-8749f8fe-224e-461b-b047-2f8774e50c5c req-4100e75a-d2cb-4222-b690-27574c99b58a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66133a4d-4ffd-464c-93c9-112e162e79ff", "name": "network-vif-plugged", "status": "completed", "tag": "99720d13-124d-4994-b4c7-ecafbf4f46fd"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:48.107649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:48.122713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:48.126035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8749f8fe-224e-461b-b047-2f8774e50c5c req-4100e75a-d2cb-4222-b690-27574c99b58a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:48.126684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8749f8fe-224e-461b-b047-2f8774e50c5c req-4100e75a-d2cb-4222-b690-27574c99b58a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:48.127359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8749f8fe-224e-461b-b047-2f8774e50c5c req-4100e75a-d2cb-4222-b690-27574c99b58a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:48.127813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:48.131363 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e9c7b68-9b99-48f6-819b-fdca16927978 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1801 microversion: 2.42 time: 0.817066 Aug 30 04:18:48.133042 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1207/2354] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:47 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1801 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:18:48.150672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:48.151821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:48.158169 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-8749f8fe-224e-461b-b047-2f8774e50c5c req-4100e75a-d2cb-4222-b690-27574c99b58a service nova] Creating event network-vif-plugged:99720d13-124d-4994-b4c7-ecafbf4f46fd for instance 66133a4d-4ffd-464c-93c9-112e162e79ff on n-h1-854925-5 Aug 30 04:18:48.170829 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-8749f8fe-224e-461b-b047-2f8774e50c5c req-4100e75a-d2cb-4222-b690-27574c99b58a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083200 Aug 30 04:18:48.171634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:48.172384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:48.173164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:48.175109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:48.175801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:48.176452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:48.177793 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1148/2355] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:48.561444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:48.572535 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6563d6ad-407b-4df0-ab4b-f75141ec41df tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.425713 Aug 30 04:18:48.580610 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1208/2356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:48 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:18:49.112180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:49.113572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:49.132810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:49.133847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:49.134449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:49.137898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:49.147232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:49.147957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:49.160614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:49.161959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:49.178530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:49.179275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:49.182139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:49.186601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:49.190833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:49.191526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:50.359223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:50.387894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:50.395194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:50.408239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:50.414678 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4fc156c3-59c3-4fdf-b2e0-8a5f4aa5686f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1314 microversion: 2.1 time: 1.309192 Aug 30 04:18:50.415859 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b307f9b7-86c4-45bd-ad8a-3f16cf74c3c2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1848 microversion: 2.42 time: 1.257141 Aug 30 04:18:50.420915 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1149/2357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:49 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1314 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:50.422362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1209/2358] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:49 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1848 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:50.429033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:50.432849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:50.448269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:50.449079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:50.450290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:50.454531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:50.455597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:50.456854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:50.880979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:50.897150 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-150076c3-3c1a-4ad5-8f5b-36aa90770e7c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.474581 Aug 30 04:18:50.904971 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1150/2359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:50 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:51.444721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:51.445372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:51.462993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:51.465825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:51.475930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:51.479582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:51.480509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:51.482859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:51.483589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:51.484292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:51.484980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:51.485648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:51.490660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:51.491769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:51.495242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:51.495887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:52.195183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:52.220980 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e135b02b-a427-4ba0-ad95-d1aa258ba75e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1464 microversion: 2.1 time: 0.758714 Aug 30 04:18:52.222325 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1151/2360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:51 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1464 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:52.263385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:52.269666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:52.299109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:52.300689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:52.302269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:52.309744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:52.310580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:52.312736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:52.335833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:52.358961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:52.365024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:52.383231 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-24ba05d1-fbe8-4aa3-8b7a-562fa86a51fc tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1848 microversion: 2.42 time: 0.926325 Aug 30 04:18:52.386233 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1210/2361] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:51 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1848 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:52.710843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:52.716263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Searching by: {'deleted': False, 'project_id': 'b693ec459851452cace58e331b412437'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:18:52.728051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:52.732107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:52.733213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:52.734830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:52.735307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:52.735741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:52.804172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-84c2c1e1-563a-46da-8ae1-4307140085b0 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.414301 Aug 30 04:18:52.806497 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1211/2362] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:18:52 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:18:52.828600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:52.838224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Searching by: {'deleted': False} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:18:52.852583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:52.853069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:52.853540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:52.854266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:52.854713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:52.855126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:53.143378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:18:53.288791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:53.289636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:53.290462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:53.422890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:53.431973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b9311011-2451-4055-8812-869c157d9780 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 1.203652 Aug 30 04:18:53.442037 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1152/2363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:52 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:53.654939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-31cc2b89-c284-4ad6-8f73-00161f58b171 req-130ec0bd-2014-466f-8920-be4518ac5522 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "c60ef681-2421-4c79-99dc-cb517437fdc6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:53.678469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-31cc2b89-c284-4ad6-8f73-00161f58b171 req-130ec0bd-2014-466f-8920-be4518ac5522 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:53.679348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-31cc2b89-c284-4ad6-8f73-00161f58b171 req-130ec0bd-2014-466f-8920-be4518ac5522 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:53.682062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-31cc2b89-c284-4ad6-8f73-00161f58b171 req-130ec0bd-2014-466f-8920-be4518ac5522 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:53.723142 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-31cc2b89-c284-4ad6-8f73-00161f58b171 req-130ec0bd-2014-466f-8920-be4518ac5522 service nova] Creating event network-changed:c60ef681-2421-4c79-99dc-cb517437fdc6 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:18:53.739265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-31cc2b89-c284-4ad6-8f73-00161f58b171 req-130ec0bd-2014-466f-8920-be4518ac5522 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291798 Aug 30 04:18:53.740390 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1153/2364] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:53.757380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:53.758096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:53.768828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:53.769722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:53.771231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:53.776838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:53.777412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:53.777807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:54.397730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:54.421198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:54.429464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:54.431896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64daa06c-4a75-4027-a76b-ca12449787a1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1848 microversion: 2.42 time: 0.689669 Aug 30 04:18:54.444144 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1154/2365] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:53 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1848 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:54.466163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:54.467073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:54.484386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:54.484976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:54.485462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:54.486230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:54.486691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:54.487120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:55.432587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:55.448962 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9be8a414-edfa-4f38-8f3d-7af518b3a2bb tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.988673 Aug 30 04:18:55.450618 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1155/2366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:54 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:55.543415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fc7435bf-40b9-446b-9481-734674924c23 req-bd009263-e720-402e-81f1-97e1b3034a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de42eb8-fd65-4257-a2ee-5c39218a3284", "name": "network-vif-plugged", "status": "completed", "tag": "2ca08fa0-fc7f-46b4-bd6a-6120cfdfbc15"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:55.559099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fc7435bf-40b9-446b-9481-734674924c23 req-bd009263-e720-402e-81f1-97e1b3034a82 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:55.560069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fc7435bf-40b9-446b-9481-734674924c23 req-bd009263-e720-402e-81f1-97e1b3034a82 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:55.560942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fc7435bf-40b9-446b-9481-734674924c23 req-bd009263-e720-402e-81f1-97e1b3034a82 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:55.579367 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fc7435bf-40b9-446b-9481-734674924c23 req-bd009263-e720-402e-81f1-97e1b3034a82 service nova] Creating event network-vif-plugged:2ca08fa0-fc7f-46b4-bd6a-6120cfdfbc15 for instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 on n-h1-854925-5 Aug 30 04:18:55.594660 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fc7435bf-40b9-446b-9481-734674924c23 req-bd009263-e720-402e-81f1-97e1b3034a82 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142233 Aug 30 04:18:55.598698 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1156/2367] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:55.620550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:55.628640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:55.648607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:55.649896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:55.652779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:55.654865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:55.659659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:55.660823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.082049 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef6b8957-51bf-4dc6-b715-e4573e0a607a tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 13270 microversion: 2.1 time: 4.257079 Aug 30 04:18:57.098904 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1212/2368] 10.222.0.27 () {58 vars in 1171 bytes} [Tue Aug 30 04:18:52 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 13270 bytes in 4274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:18:57.127730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:57.128742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:57.136817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.137674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.138381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.139891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.141176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.141885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.589056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:57.611010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:57.611608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:57.613527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:57.615402 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63e74b35-0b3f-41cd-ad79-82f583e74d31 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1869 microversion: 2.42 time: 2.014428 Aug 30 04:18:57.617990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1157/2369] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:55 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1869 bytes in 2018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:57.620302 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0cb2f6d2-1602-450a-bb72-1d0ff40d9e6a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 0.519826 Aug 30 04:18:57.625466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-82e17cf2-330d-4d50-93ae-cbb4d7b36121 req-879e3117-fe4d-4758-bfeb-92589bfcc40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "42bcc2a6-99c0-41c1-8d7e-96b497240ef7"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:57.628152 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1213/2370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:57 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:57.632736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:57.639666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-82e17cf2-330d-4d50-93ae-cbb4d7b36121 req-879e3117-fe4d-4758-bfeb-92589bfcc40c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.640646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-82e17cf2-330d-4d50-93ae-cbb4d7b36121 req-879e3117-fe4d-4758-bfeb-92589bfcc40c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.641398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-82e17cf2-330d-4d50-93ae-cbb4d7b36121 req-879e3117-fe4d-4758-bfeb-92589bfcc40c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.648728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Searching by: {'deleted': False, 'project_id': 'b693ec459851452cace58e331b412437'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:18:57.667793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.668286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.668723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.669481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.670013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.670439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.682694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-82e17cf2-330d-4d50-93ae-cbb4d7b36121 req-879e3117-fe4d-4758-bfeb-92589bfcc40c service nova] Creating event network-changed:42bcc2a6-99c0-41c1-8d7e-96b497240ef7 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:18:57.736373 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-82e17cf2-330d-4d50-93ae-cbb4d7b36121 req-879e3117-fe4d-4758-bfeb-92589bfcc40c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090345 Aug 30 04:18:57.739484 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1158/2371] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:18:57.777473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f1c948e0-76e2-4c2a-8e25-b091d0e79a77 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?tenant_id=460e179136b34ed68a9f005d5963d607" status: 200 len: 15 microversion: 2.1 time: 0.148097 Aug 30 04:18:57.795616 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1214/2372] 10.222.0.27 () {58 vars in 1231 bytes} [Tue Aug 30 04:18:57 2022] GET /compute/v2.1/servers/detail?tenant_id=460e179136b34ed68a9f005d5963d607 => generated 15 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:18:57.804214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:57.810660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Searching by: {'tenant_id': '460e179136b34ed68a9f005d5963d607', 'deleted': False} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:18:57.823260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.823745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.824170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.825075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.825739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.826875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:57.880534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:18:57.984957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:57.995126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:57.996063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:58.511554 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e55de117-9c77-46e0-9b3a-3ad4a2db8dc7 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=460e179136b34ed68a9f005d5963d607" status: 200 len: 4827 microversion: 2.1 time: 0.711411 Aug 30 04:18:58.526041 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1159/2373] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Aug 30 04:18:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=460e179136b34ed68a9f005d5963d607 => generated 4827 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:58.545548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:58.552103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Searching by: {'tenant_id': 'b693ec459851452cace58e331b412437', 'deleted': False} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:18:58.558480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:58.559307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:58.559972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:58.561028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:58.561737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:58.562385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:58.652760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:58.655038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:58.661253 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfc413df-16ba-40fa-aea1-ed716b24d054 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b693ec459851452cace58e331b412437" status: 200 len: 15 microversion: 2.1 time: 0.120335 Aug 30 04:18:58.666148 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1215/2374] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Aug 30 04:18:58 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b693ec459851452cace58e331b412437 => generated 15 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:18:58.679378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:58.679623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:58.680076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:18:58.684127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:58.684885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:58.686182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:58.686876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:58.687563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:58.703677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:58.704214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:58.705993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:58.706987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:18:58.710197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:18:58.710869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:18:59.917796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:59.920594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:59.935100 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-532a6504-9ec3-43b8-880a-30cb731a8119 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1324 microversion: 2.1 time: 1.265002 Aug 30 04:18:59.935998 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1216/2375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:18:58 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1324 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:18:59.941736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:59.955937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ce53cd2-1702-438b-8dec-223d5a878429 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:18:59.959163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:18:59.960488 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f6ef32f-bf21-40ee-8ae7-2308e06a3eaf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1890 microversion: 2.42 time: 1.312269 Aug 30 04:18:59.962905 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7ce53cd2-1702-438b-8dec-223d5a878429 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.025325 Aug 30 04:18:59.964959 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1160/2376] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:18:58 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1890 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:18:59.976219 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1217/2377] 10.222.0.27 () {58 vars in 1189 bytes} [Tue Aug 30 04:18:59 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:18:59.988825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:18:59.991826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:00.006534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.009812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.011108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.013141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.014736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.015429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.125809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-89e7bbac-986c-4411-836d-c93bd1ca66ac req-72d3cf94-33f0-4349-84c6-31076a9ea31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "50e2ed61-9db9-49c0-a2e1-3f8787967d86"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:00.156562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-89e7bbac-986c-4411-836d-c93bd1ca66ac req-72d3cf94-33f0-4349-84c6-31076a9ea31a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.162527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-89e7bbac-986c-4411-836d-c93bd1ca66ac req-72d3cf94-33f0-4349-84c6-31076a9ea31a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.162527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-89e7bbac-986c-4411-836d-c93bd1ca66ac req-72d3cf94-33f0-4349-84c6-31076a9ea31a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.194901 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-89e7bbac-986c-4411-836d-c93bd1ca66ac req-72d3cf94-33f0-4349-84c6-31076a9ea31a service nova] Creating event network-changed:50e2ed61-9db9-49c0-a2e1-3f8787967d86 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:19:00.225916 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-89e7bbac-986c-4411-836d-c93bd1ca66ac req-72d3cf94-33f0-4349-84c6-31076a9ea31a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104512 Aug 30 04:19:00.227279 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1218/2378] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:00.317073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-334cbd6b-55b6-4812-968c-67d59fd0c1aa tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action" status: 202 len: 0 microversion: 2.1 time: 0.332273 Aug 30 04:19:00.328127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:00.328352 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1161/2379] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:18:59 2022] POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:19:00.336063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:00.337883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '460e179136b34ed68a9f005d5963d607'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:19:00.361904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.362436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.362879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.375248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.375843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.387485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.481863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:19:00.583989 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7fba06e5-1966-4c01-a8fb-a41727dee3d9 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.259206 Aug 30 04:19:00.586029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1219/2380] 10.222.0.27 () {58 vars in 1150 bytes} [Tue Aug 30 04:19:00 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:00.598720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:00.601306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:00.615422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.618975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.619427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.622432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.624485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.627428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.757400 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1dddd733-45c3-4b55-8a0a-460b058d0b48 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action" status: 202 len: 0 microversion: 2.1 time: 0.161864 Aug 30 04:19:00.759512 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1162/2381] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:00 2022] POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:19:00.768395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:00.769128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:00.785681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.786549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.787137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.788123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.788594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.789025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.960490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:00.963793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:00.979353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.980189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.982827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:00.983843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:00.984855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:00.986469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:01.037974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:01.400554 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4872b652-13a8-4b0d-98fc-1283532a5220 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1615 microversion: 2.1 time: 0.637111 Aug 30 04:19:01.407873 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1220/2382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:00 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1615 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:01.419728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:01.420644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:01.443766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:01.444260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:01.444697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:01.446871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:01.447819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:01.448199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:01.462733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:01.682220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:01.706256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e762516-c9e3-4bce-be84-5e1064e3a090 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1517 microversion: 2.1 time: 0.753319 Aug 30 04:19:01.707319 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1163/2383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:00 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1517 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:01.712475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:01.713095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:01.722879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:01.725933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:01.726405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:01.727161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:01.727790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:01.728221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:01.777951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:01.792842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:01.794557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:01.799360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1931d040-19ff-48d1-8cea-5dc65ca249f2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1890 microversion: 2.42 time: 0.389419 Aug 30 04:19:01.803937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1221/2384] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:01 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1890 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:01.946521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c202e39-e2d4-4846-b32a-806d71b0b13d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-358683854", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c202e39-e2d4-4846-b32a-806d71b0b13d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 242 Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-358683854", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-358683854', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1f233b1d-f70d-45f6-bb63-354fc604e2ba'}]}}} Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:19:01.950817 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:01.956279 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:01.966146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c202e39-e2d4-4846-b32a-806d71b0b13d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:01.967826 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c202e39-e2d4-4846-b32a-806d71b0b13d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.025187 Aug 30 04:19:01.969935 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1222/2385] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:01 2022] POST /compute/v2.1/servers => generated 175 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:19:01.978996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4fdd6fcc-29b8-4b91-a858-fd18bc0039d2 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:01.979869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4fdd6fcc-29b8-4b91-a858-fd18bc0039d2 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2ee02e3a-408b-476a-9858-550587d14c17] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:02.000352 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4fdd6fcc-29b8-4b91-a858-fd18bc0039d2 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] HTTP exception thrown: Instance 2ee02e3a-408b-476a-9858-550587d14c17 could not be found. Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4fdd6fcc-29b8-4b91-a858-fd18bc0039d2 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/2ee02e3a-408b-476a-9858-550587d14c17/metadata HTTP/1.1 Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 2ee02e3a-408b-476a-9858-550587d14c17 could not be found. Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': '2ee02e3a-408b-476a-9858-550587d14c17'} Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee02e3a-408b-476a-9858-550587d14c17 could not be found. Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee02e3a-408b-476a-9858-550587d14c17 could not be found. Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.007393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.011237 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:02.011237 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:02.011237 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee02e3a-408b-476a-9858-550587d14c17 could not be found. Aug 30 04:19:02.011237 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.015094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4fdd6fcc-29b8-4b91-a858-fd18bc0039d2 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 404 to user: Instance 2ee02e3a-408b-476a-9858-550587d14c17 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:02.016240 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4fdd6fcc-29b8-4b91-a858-fd18bc0039d2 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2ee02e3a-408b-476a-9858-550587d14c17/metadata" status: 404 len: 111 microversion: 2.1 time: 0.041132 Aug 30 04:19:02.017401 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1223/2386] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:19:01 2022] GET /compute/v2.1/servers/2ee02e3a-408b-476a-9858-550587d14c17/metadata => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:19:02.101345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-670c0dfb-42d1-424f-ab45-d77eb7ac551c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1918758610", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-670c0dfb-42d1-424f-ab45-d77eb7ac551c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 499 Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1918758610", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1918758610', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f233b1d-f70d-45f6-bb63-354fc604e2ba'}]}}} Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:19:02.105829 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.109856 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.115646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-670c0dfb-42d1-424f-ab45-d77eb7ac551c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:02.117705 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-670c0dfb-42d1-424f-ab45-d77eb7ac551c tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.020865 Aug 30 04:19:02.121482 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1224/2387] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:02 2022] POST /compute/v2.1/servers => generated 687 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:19:02.185073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-918686e7-a9c1-4a2a-898d-fce0b127fa5d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1260958299", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-918686e7-a9c1-4a2a-898d-fce0b127fa5d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 500 Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1260958299", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1260958299', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f233b1d-f70d-45f6-bb63-354fc604e2ba'}]}}} Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:19:02.190525 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.193363 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.203595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-918686e7-a9c1-4a2a-898d-fce0b127fa5d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:02.206289 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-918686e7-a9c1-4a2a-898d-fce0b127fa5d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.026170 Aug 30 04:19:02.210447 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1225/2388] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:02 2022] POST /compute/v2.1/servers => generated 689 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:19:02.293771 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-326b5960-7e9c-4437-8f4c-687a75a61339 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1615 microversion: 2.1 time: 0.585155 Aug 30 04:19:02.294366 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1164/2389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:01 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1615 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:02.296532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcb9cfc3-8f8c-4ac3-8078-3ce66f2a319a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-21767458", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcb9cfc3-8f8c-4ac3-8078-3ce66f2a319a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 752 Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-21767458", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-21767458', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f233b1d-f70d-45f6-bb63-354fc604e2ba'}]}}} Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:19:02.300969 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:19:02.303470 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:19:02.312469 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.312469 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.312469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcb9cfc3-8f8c-4ac3-8078-3ce66f2a319a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:02.312469 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dcb9cfc3-8f8c-4ac3-8078-3ce66f2a319a tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010274 Aug 30 04:19:02.312469 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1226/2390] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:02 2022] POST /compute/v2.1/servers => generated 1197 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 30 04:19:02.316582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:02.324164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Searching by: {'host': 'n-h1-854925-5', 'deleted': False} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:19:02.337421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.338528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.339725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.344910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.345589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.346183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.446372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3aa6b2bc-5dee-4107-9470-5bf4126c6fb3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1878978444", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3aa6b2bc-5dee-4107-9470-5bf4126c6fb3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 1266 Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1878978444", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1f233b1d-f70d-45f6-bb63-354fc604e2ba"}]}} Aug 30 04:19:02.450886 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1878978444', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1f233b1d-f70d-45f6-bb63-354fc604e2ba'}]}}} Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.453956 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:19:02.455490 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:19:02.457671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 30 04:19:02.457671 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.457671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3aa6b2bc-5dee-4107-9470-5bf4126c6fb3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:02.457671 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3aa6b2bc-5dee-4107-9470-5bf4126c6fb3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.014871 Aug 30 04:19:02.467284 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1227/2391] 10.222.0.27 () {60 vars in 1148 bytes} [Tue Aug 30 04:19:02 2022] POST /compute/v2.1/servers => generated 2221 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Aug 30 04:19:02.473080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5e8fcee-2d37-40a2-85bf-a37c811f41b5 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:02.478183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5e8fcee-2d37-40a2-85bf-a37c811f41b5 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 23a974c8-ba7e-4098-b0e4-17e6709392ae] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:02.494505 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-b5e8fcee-2d37-40a2-85bf-a37c811f41b5 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] HTTP exception thrown: Instance 23a974c8-ba7e-4098-b0e4-17e6709392ae could not be found. Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5e8fcee-2d37-40a2-85bf-a37c811f41b5 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/23a974c8-ba7e-4098-b0e4-17e6709392ae/metadata/test2 HTTP/1.1 Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 23a974c8-ba7e-4098-b0e4-17e6709392ae could not be found. Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': '23a974c8-ba7e-4098-b0e4-17e6709392ae', 'id': 'test2'} Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a974c8-ba7e-4098-b0e4-17e6709392ae could not be found. Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a974c8-ba7e-4098-b0e4-17e6709392ae could not be found. Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:02.496873 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:02.501029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:02.501029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:02.501029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a974c8-ba7e-4098-b0e4-17e6709392ae could not be found. Aug 30 04:19:02.501029 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:02.501029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5e8fcee-2d37-40a2-85bf-a37c811f41b5 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 404 to user: Instance 23a974c8-ba7e-4098-b0e4-17e6709392ae could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:02.501029 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5e8fcee-2d37-40a2-85bf-a37c811f41b5 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/23a974c8-ba7e-4098-b0e4-17e6709392ae/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.029166 Aug 30 04:19:02.501029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1228/2392] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Aug 30 04:19:02 2022] GET /compute/v2.1/servers/23a974c8-ba7e-4098-b0e4-17e6709392ae/metadata/test2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:19:02.522248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:02.522757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:02.525723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:19:02.535596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.536096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.536536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.537238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.542001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.543141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.604205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:19:02.664839 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e5cf852a-52cf-4b1a-a5de-6f54bad73a0f tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=n-h1-854925-5&all_tenants=1" status: 200 len: 1326 microversion: 2.1 time: 0.351706 Aug 30 04:19:02.668964 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1165/2393] 10.222.0.27 () {58 vars in 1190 bytes} [Tue Aug 30 04:19:02 2022] GET /compute/v2.1/servers?host=n-h1-854925-5&all_tenants=1 => generated 1326 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:02.691056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:02.698792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:19:02.720491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.723147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.723601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.727491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.732319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.732874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.796127 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51221b74-ed5a-46f3-bb83-5977aa040459 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.108591 Aug 30 04:19:02.796941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1166/2394] 10.222.0.27 () {58 vars in 1196 bytes} [Tue Aug 30 04:19:02 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:19:02.818771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:02.824932 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b7eec08-331f-4482-8f5e-125d8c4d644e tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 204 len: 0 microversion: 2.1 time: 0.313483 Aug 30 04:19:02.827313 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1229/2395] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:19:02 2022] DELETE /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:19:02.835629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:02.855147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:02.855571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.856843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.867500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.868171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:02.869793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.876051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.876631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.900885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.901861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.902589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:02.903583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:02.908889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:02.917546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:03.146632 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-65cde596-5569-43dd-8c31-ac41ccf1a280 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action" status: 202 len: 0 microversion: 2.1 time: 0.340641 Aug 30 04:19:03.147955 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1167/2396] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:02 2022] POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:19:03.158422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:03.160613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:03.199457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:03.201783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:03.203721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:03.204729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:03.206148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:03.213031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:03.272484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:03.683877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:03.695080 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-81217e9e-4522-4c61-b2c4-c7fd6a4d1985 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1523 microversion: 2.1 time: 0.545782 Aug 30 04:19:03.695865 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1168/2397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:03 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1523 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:03.717778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:03.723485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:03.738978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:03.739499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:03.740060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:03.740979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:03.743995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:03.747192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:03.928207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:03.940478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:03.941960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:03.950246 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a081dbc-6429-4f6f-83b4-3ccb803d9b88 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1890 microversion: 2.42 time: 1.120719 Aug 30 04:19:03.966696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1230/2398] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:02 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1890 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:03.982080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:03.986160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:03.987733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d77ba07d-4e4b-440f-bc8a-f6f492a6a912 req-272d816b-1c61-4aeb-83a0-bdd066fc37ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "7aabe1a2-bce3-41a4-adf6-b7b685b254d8"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:03.989018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:03.990282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:03.993108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:04.008274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d77ba07d-4e4b-440f-bc8a-f6f492a6a912 req-272d816b-1c61-4aeb-83a0-bdd066fc37ef service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.009010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d77ba07d-4e4b-440f-bc8a-f6f492a6a912 req-272d816b-1c61-4aeb-83a0-bdd066fc37ef service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.010130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d77ba07d-4e4b-440f-bc8a-f6f492a6a912 req-272d816b-1c61-4aeb-83a0-bdd066fc37ef service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.029906 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d77ba07d-4e4b-440f-bc8a-f6f492a6a912 req-272d816b-1c61-4aeb-83a0-bdd066fc37ef service nova] Creating event network-changed:7aabe1a2-bce3-41a4-adf6-b7b685b254d8 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:19:04.038575 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d77ba07d-4e4b-440f-bc8a-f6f492a6a912 req-272d816b-1c61-4aeb-83a0-bdd066fc37ef service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069057 Aug 30 04:19:04.039502 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1231/2399] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:04.125626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:04.136002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.139360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.140686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.143960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.145767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.145850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.221171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-475f723e-51a1-4ef6-b66e-b76c16ff7b56 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action" status: 202 len: 1068 microversion: 2.1 time: 0.517088 Aug 30 04:19:04.233478 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1169/2400] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:03 2022] POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action => generated 1068 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 04:19:04.245859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:04.247483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:04.257475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.258768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.261628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.262885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.263362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.264112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.700713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:04.709826 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e3bf3064-4452-4f8d-9af2-69ac1a3461dc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.469603 Aug 30 04:19:04.714490 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1232/2401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:04 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:04.725581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:04.726276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:04.739639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.742593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.743643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.745857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.746946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.749220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.982747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:04.983376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:04.995109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:04.995865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:04.996475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:04.997383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:05.001686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:05.002402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:06.480369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:06.501502 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e95fce5-2560-47ab-8bdd-cd3e53484b41 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1523 microversion: 2.1 time: 1.785850 Aug 30 04:19:06.518234 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1170/2402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:04 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1523 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:06.528218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:06.532105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:06.545485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:06.548757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:06.551048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:06.552069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:06.554594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:06.555144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:06.644428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:06.671156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:06.683533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:06.685142 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-62f5e2df-bd6b-4af2-bb40-befd44b90fb3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1890 microversion: 2.42 time: 1.711255 Aug 30 04:19:06.697620 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1233/2403] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:04 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1890 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:06.705179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5fdd3dc1-418d-4cbe-b342-2599497f9486 req-388af3e5-f94d-45f8-8e5d-f38bb1089d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "78e02f42-39d7-40d5-90cf-ba73041ae462"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:06.722345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5fdd3dc1-418d-4cbe-b342-2599497f9486 req-388af3e5-f94d-45f8-8e5d-f38bb1089d7b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:06.722614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5fdd3dc1-418d-4cbe-b342-2599497f9486 req-388af3e5-f94d-45f8-8e5d-f38bb1089d7b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:06.723045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5fdd3dc1-418d-4cbe-b342-2599497f9486 req-388af3e5-f94d-45f8-8e5d-f38bb1089d7b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:06.752063 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5fdd3dc1-418d-4cbe-b342-2599497f9486 req-388af3e5-f94d-45f8-8e5d-f38bb1089d7b service nova] Creating event network-changed:78e02f42-39d7-40d5-90cf-ba73041ae462 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:19:06.769509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5fdd3dc1-418d-4cbe-b342-2599497f9486 req-388af3e5-f94d-45f8-8e5d-f38bb1089d7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078252 Aug 30 04:19:06.770911 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1234/2404] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:07.141562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:07.150220 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd46f108-f4d1-44af-a26d-029dc49e2dab tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.630466 Aug 30 04:19:07.169034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1171/2405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:06 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:07.529622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:07.531219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:07.543910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:07.546413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:07.546908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:07.551081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:07.551567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:07.552007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:07.712595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:07.713778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:07.730088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:07.731017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:07.731773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:07.733181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:07.745708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:07.746484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:07.941631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:08.533449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:08.546490 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ced1d376-3b1d-4325-af3e-e62a90f141e3 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1523 microversion: 2.1 time: 1.024937 Aug 30 04:19:08.547099 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1235/2406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:07 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1523 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:08.551609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:08.552212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:08.580032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:08.582049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:08.582748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:08.586007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:08.586660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:08.587346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:08.617300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:08.642051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:08.647221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:08.650694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da1efad5-e4f1-42e2-ad49-ea06bdbf9481 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1890 microversion: 2.42 time: 0.941883 Aug 30 04:19:08.653394 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1172/2407] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:07 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1890 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:09.101485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5325e594-dc0d-4ab3-802d-9363d3559077 req-26bd41c9-3237-41bc-80ff-232686315baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de42eb8-fd65-4257-a2ee-5c39218a3284", "name": "network-vif-deleted", "tag": "2ca08fa0-fc7f-46b4-bd6a-6120cfdfbc15"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:09.115548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5325e594-dc0d-4ab3-802d-9363d3559077 req-26bd41c9-3237-41bc-80ff-232686315baf service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:09.116979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5325e594-dc0d-4ab3-802d-9363d3559077 req-26bd41c9-3237-41bc-80ff-232686315baf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:09.117822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5325e594-dc0d-4ab3-802d-9363d3559077 req-26bd41c9-3237-41bc-80ff-232686315baf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:09.132411 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5325e594-dc0d-4ab3-802d-9363d3559077 req-26bd41c9-3237-41bc-80ff-232686315baf service nova] Creating event network-vif-deleted:2ca08fa0-fc7f-46b4-bd6a-6120cfdfbc15 for instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 on n-h1-854925-5 Aug 30 04:19:09.152389 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5325e594-dc0d-4ab3-802d-9363d3559077 req-26bd41c9-3237-41bc-80ff-232686315baf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.494457 Aug 30 04:19:09.156215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1173/2408] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:09.442907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:09.450862 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b43a0b62-93c8-433f-a5da-1e24ecdeb96a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.902733 Aug 30 04:19:09.458467 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1236/2409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:08 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:09.585824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:09.590167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:09.624024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:09.624622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:09.625289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:09.629308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:09.635528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:09.636250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:09.689136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:09.689848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:09.713162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:09.721513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:09.724075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:09.725157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:09.726076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:09.726702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:09.735209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:09.739268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:09.739843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:09.742061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lazy-loading 'fault' on Instance uuid 2de42eb8-fd65-4257-a2ee-5c39218a3284 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:19:09.993732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30438293fd4ec2b7b5c2180ea5a0ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5c7ed92779d4d978e1054af02c1d4be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:10.003373 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-39385504-2241-48f1-a122-a4b6bd2760c7 tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 200 len: 1314 microversion: 2.1 time: 0.438113 Aug 30 04:19:10.008215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1174/2410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:09 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:10.406176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:10.471533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-509131782", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": "none"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:10.519032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:10.528982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:10.531948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:10.533584 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a6f8da6d-e830-457f-9ab8-fbadcba6c21e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.848855 Aug 30 04:19:10.546374 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1237/2411] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:09 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:10.560466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:10.564796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:10.575099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:10.575529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:10.576569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:10.576983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:10.577429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:10.578893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:10.587659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:10.588456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:10.589711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:10.590691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:10.591377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:10.601051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:10.601575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:10.602276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:10.603239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:10.603912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:10.605402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:10.640630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Getting quotas for project 0c9efb88b7c64b10aea3f1ff3e3dd4fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:10.653630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Getting quotas for user d35b589737374885bb3c62ac4e8e8e48 and project 0c9efb88b7c64b10aea3f1ff3e3dd4fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:10.674882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:10.677861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:10.754840 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44a31605-c3cd-41f4-b613-fbc268f16198 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.581894 Aug 30 04:19:10.759590 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1175/2412] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:19:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:19:10.774038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-90d15770-e302-42f3-9500-7fad8cc14d67 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:10.785927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-90d15770-e302-42f3-9500-7fad8cc14d67 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:10.962187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-90d15770-e302-42f3-9500-7fad8cc14d67 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:10.972316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-90d15770-e302-42f3-9500-7fad8cc14d67 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:10.980188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-90d15770-e302-42f3-9500-7fad8cc14d67 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:10.981759 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-90d15770-e302-42f3-9500-7fad8cc14d67 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1280 microversion: 2.47 time: 0.211565 Aug 30 04:19:10.982913 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1176/2413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:10 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:11.027825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:11.028617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] [instance: 2de42eb8-fd65-4257-a2ee-5c39218a3284] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:11.038630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:11.043935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:11.044947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:11.045656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:11.048027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:11.048684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:11.103436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] HTTP exception thrown: Instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 could not be found. Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Request method failure captured: Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 HTTP/1.1 Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY-RX50ivfHkfBuKtbXZo1RqUqgk9cOOjwwnx287LbXjp115EhGOvU3fQbrMFpbrlVcSj_ONY0A0Ny1V0Kls2bt5moiiDE0fKOCG0K5gOcplFsWMGLkxzR9Ac5_ZdHTAQoDXIZLsbwVw_2NrnaEyBbdi-kSss-JDMiY3P1wh3WJZ5zU Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a5c7ed92779d4d978e1054af02c1d4be", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a5c7ed92779d4d978e1054af02c1d4be"}]}] Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: a5c7ed92779d4d978e1054af02c1d4be Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-34121831 Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9d30438293fd4ec2b7b5c2180ea5a0ea Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-34121831-project Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 could not be found. Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2de42eb8-fd65-4257-a2ee-5c39218a3284'} Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 could not be found. Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 could not be found. Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:19:11.109894 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 could not be found. Aug 30 04:19:11.114585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:19:11.119940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] Returning 404 to user: Instance 2de42eb8-fd65-4257-a2ee-5c39218a3284 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:11.120995 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fcfaa078-8012-48f4-a924-348aa144a25d tempest-ServerMetadataNegativeTestJSON-34121831 tempest-ServerMetadataNegativeTestJSON-34121831-project] 10.222.0.27 "GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284" status: 404 len: 111 microversion: 2.1 time: 0.097654 Aug 30 04:19:11.122050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1177/2414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:11 2022] GET /compute/v2.1/servers/2de42eb8-fd65-4257-a2ee-5c39218a3284 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:19:11.211790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:11.225093 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-88f8f597-7e03-42b1-90c2-e1d5fdf3978d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.677322 Aug 30 04:19:11.236631 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1238/2415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:10 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:11.440113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e790066a-45bd-4a0c-82f6-a64fb671f1b6 req-677feebf-1c5b-41e4-8c26-cc68cda14253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "1e12d725-0a04-4649-8cbe-5b9d9b18db68"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:11.459381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e790066a-45bd-4a0c-82f6-a64fb671f1b6 req-677feebf-1c5b-41e4-8c26-cc68cda14253 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:11.459879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e790066a-45bd-4a0c-82f6-a64fb671f1b6 req-677feebf-1c5b-41e4-8c26-cc68cda14253 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:11.460316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e790066a-45bd-4a0c-82f6-a64fb671f1b6 req-677feebf-1c5b-41e4-8c26-cc68cda14253 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:11.492123 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e790066a-45bd-4a0c-82f6-a64fb671f1b6 req-677feebf-1c5b-41e4-8c26-cc68cda14253 service nova] Creating event network-changed:1e12d725-0a04-4649-8cbe-5b9d9b18db68 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:19:11.504267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e790066a-45bd-4a0c-82f6-a64fb671f1b6 req-677feebf-1c5b-41e4-8c26-cc68cda14253 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076207 Aug 30 04:19:11.505274 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1178/2416] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:11.563025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:11.563846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:11.580536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:11.581037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:11.581564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:11.582276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:11.583070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:11.583164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:12.011324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:12.012390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:12.043732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:12.044561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:12.045224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:12.046174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:12.046820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:12.047451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:12.133198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.160567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.162444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.174876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b180f855-ec97-4165-8368-52341afd3e75 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.616585 Aug 30 04:19:12.175509 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1239/2417] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:11 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:12.249771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:12.250410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:12.261032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:12.264019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:12.265151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:12.265815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:12.267819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:12.270776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:12.271457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:12.818203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.844573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.854947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.857708 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc82a992-f926-47ac-895b-1481843f8d7e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1276 microversion: 2.47 time: 0.851106 Aug 30 04:19:12.863086 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1179/2418] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:12 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1276 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:12.939851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:12.959624 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c3d31ab-2fb1-419f-b0a2-f2f1e6f1e5f0 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.706522 Aug 30 04:19:12.961480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1240/2419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:12 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:13.206171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:13.206789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:13.219733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:13.221857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:13.222523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:13.225244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:13.227115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:13.231463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:13.259759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:13.885773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:13.886393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:13.909102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:13.914078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:13.918988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:13.923085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:13.929898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:13.935353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.059054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.088254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.102952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.104803 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-02b0852a-bde9-4b45-9f87-cb5b5211588f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.902979 Aug 30 04:19:14.118260 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1180/2420] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:13 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:14.124824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:14.130822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:14.146374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.150352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.151143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.151990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:14.156601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:14.158147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:14.308534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.322795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.340650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.345079 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fd6dd363-f413-47f8-974d-90520d70385e tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1338 microversion: 2.47 time: 0.463578 Aug 30 04:19:14.353079 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1241/2421] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:13 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1338 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:14.803253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:14.815237 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-79c2e662-9652-4551-86dd-bb843510284c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.701577 Aug 30 04:19:14.819314 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1181/2422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:14 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:15.134655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:15.136283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:15.151080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.153557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.156605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.158792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.159901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.164742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.381785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:15.383373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:15.402668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.405981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.408013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.410830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.412092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.413805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.541783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.557244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.563437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.567276 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d278d7ba-7a08-4685-8f57-3832d24cbb78 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1338 microversion: 2.47 time: 0.191017 Aug 30 04:19:15.572063 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1182/2423] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:15 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:15.649156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.663753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.669264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:15.675327 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-793eb28d-9db8-4252-b934-119effa3e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.548734 Aug 30 04:19:15.679443 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1242/2424] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:15 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:15.840770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:15.842493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:15.855808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.856952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.860035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:15.862899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:15.870744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:15.871617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.332429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:16.381485 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08bed985-910d-4e59-9629-5128460e1f72 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.523343 Aug 30 04:19:16.384145 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1183/2425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:15 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:16.595966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:16.597368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:16.618498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.621526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.622236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.623844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.624495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.625100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.707463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:16.708760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:16.746100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.752566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.761787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.763065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:16.764711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:16.765366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:16.803887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:16.827076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:16.829106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:16.847285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a9cb7e7d-c248-4372-a5a0-6d467b6fe29a tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1338 microversion: 2.47 time: 0.245398 Aug 30 04:19:16.848346 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1243/2426] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:16 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1338 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:19:17.338200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:17.354708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:17.356440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:17.357766 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-61067b49-f8b0-46d8-8641-cd4f8d776f8e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.654675 Aug 30 04:19:17.358352 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1184/2427] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:16 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:17.411426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:17.412265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:17.421134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.425494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.426399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.427342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.429493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.430183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.470891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:17.794030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-425080eb-11d2-429c-ae43-d99d3a7d9950 req-f84ce464-2959-46a7-adf3-b9364686c0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "d58eca3a-311c-4ff2-aa27-f5391e5e4bad"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:17.817668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:17.824348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-425080eb-11d2-429c-ae43-d99d3a7d9950 req-f84ce464-2959-46a7-adf3-b9364686c0c2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.825443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-425080eb-11d2-429c-ae43-d99d3a7d9950 req-f84ce464-2959-46a7-adf3-b9364686c0c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.828149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-425080eb-11d2-429c-ae43-d99d3a7d9950 req-f84ce464-2959-46a7-adf3-b9364686c0c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:17.855383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-425080eb-11d2-429c-ae43-d99d3a7d9950 req-f84ce464-2959-46a7-adf3-b9364686c0c2 service nova] Creating event network-changed:d58eca3a-311c-4ff2-aa27-f5391e5e4bad for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:19:17.901191 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-425080eb-11d2-429c-ae43-d99d3a7d9950 req-f84ce464-2959-46a7-adf3-b9364686c0c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111470 Aug 30 04:19:17.906362 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1185/2428] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:17.943514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:17.958049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:17.990273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:17.992013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:17.998602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.002532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.003271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.009099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.222830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:18.243022 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4043e19-84b6-4caa-992f-b06ed80ed711 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1472 microversion: 2.1 time: 0.835403 Aug 30 04:19:18.259401 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1244/2429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:17 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1472 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:18.386611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:18.387228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:18.399174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.399680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.408190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:18.409188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:18.409690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:18.410207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:19.116480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:19.130325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:19.132181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:19.136839 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34679b95-a7cc-438e-98ba-046e2a16991c tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1338 microversion: 2.47 time: 1.228721 Aug 30 04:19:19.157348 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1186/2430] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:17 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1338 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:19.175311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1469059962", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "25481288-b646-4c38-9a19-eb4c2fee8514"}], "block_device_mapping_v2": [{"uuid": "85675f9b-f22b-4ab0-9bb7-3bf30d67ba7b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:19.320873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] validate_networks() for [('25481288-b646-4c38-9a19-eb4c2fee8514', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:19:19.877745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:19.891988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:19.897991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:19.917153 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c30445d5-c882-4336-ba41-8c6a37afe5a2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.532417 Aug 30 04:19:19.922130 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1245/2431] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:18 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:19.930374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:19.933866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:19.952959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:19.953965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:19.954516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:19.955412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:19.956226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:19.956762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.334624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:20.348753 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c01f039c-76e1-439f-9c58-f17420985543 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1478 microversion: 2.1 time: 0.425306 Aug 30 04:19:20.357524 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1246/2432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:19 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1478 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:20.362438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:20.363312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:20.370785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.371528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.371969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.372677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.373164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.377547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.517171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:20.534580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:20.536490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:20.537584 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-214422ac-ed41-40fc-95df-cd0cc3229d42 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1338 microversion: 2.47 time: 0.178975 Aug 30 04:19:20.542357 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1247/2433] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:20 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1338 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:20.625830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:20.636870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1075064297", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:20.712675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:20.713837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:20.715032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:20.716012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:20.716877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:20.735241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.736188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.737623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.740548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:20.741198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:20.741819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:20.758608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] validate_networks() for [('b7ec388d-fb3a-43eb-a589-c1170d5f3565', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:19:20.773722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:20.779639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Getting quotas for user 45901cc649784305a10c8a9278d1bef3 and project 02e52c9195cf4e3caaa492e3c093e620. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:20.879943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:20.882282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='85675f9b-f22b-4ab0-9bb7-3bf30d67ba7b',volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:21.142041 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f515c95e-8a81-4439-be50-241f05ad90be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.970551 Aug 30 04:19:21.144737 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1187/2434] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:19:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:19:21.155267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:21.157475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:21.168036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:21.169029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:21.170726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:21.171881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:21.172529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:21.173141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.345613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.375843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.381614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.390947 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-933f1f66-0b6d-474d-ab5f-f3ead6616f18 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.244183 Aug 30 04:19:22.393825 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1188/2435] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:21 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:22.399298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:22.402111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:22.422396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.423045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.423582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.424384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.425074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.425746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.890230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.903906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.906397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:22.911449 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ddeb3ab-953b-486a-b31c-b75b3a4a8d77 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1233 microversion: 2.25 time: 0.516535 Aug 30 04:19:22.912353 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1189/2436] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:22 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1233 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:22.932599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:22.933531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:22.946348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.948657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.949237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:22.951098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:22.952797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:22.953394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.629387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:23.630573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:23.631272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:23.631900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:23.632544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:23.655042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.656643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.657335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.658324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.658964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.659597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.701896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:23.710136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for user 84dd97e2c7fb48f0a9d8f93f1211dc91 and project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:23.724516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:23.727136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:23.741752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:23.757036 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d04223df-32ca-431b-b9b3-97210ebb1f4e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1478 microversion: 2.1 time: 0.840704 Aug 30 04:19:23.758600 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1190/2437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:22 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1478 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:23.758600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:23.771371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:23.790617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.791437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.792067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.794528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.797727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.798438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.806810 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aae57922-eb65-4fd2-82bf-5d76edfd6274 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.262810 Aug 30 04:19:23.808132 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1248/2438] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 3265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:23.815204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7be70fcb-576f-4c38-9a74-b2397ddd1728 req-c248fca9-0876-404c-b1c8-973f85bd7e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2899b822-bdd2-4731-a44a-f67901ecae9e", "name": "network-vif-unplugged", "status": "completed", "tag": "e86ad729-5dbf-4d1e-b624-c169f51ed42c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:23.829586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7be70fcb-576f-4c38-9a74-b2397ddd1728 req-c248fca9-0876-404c-b1c8-973f85bd7e55 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:23.830642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7be70fcb-576f-4c38-9a74-b2397ddd1728 req-c248fca9-0876-404c-b1c8-973f85bd7e55 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:23.831534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7be70fcb-576f-4c38-9a74-b2397ddd1728 req-c248fca9-0876-404c-b1c8-973f85bd7e55 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:23.848956 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7be70fcb-576f-4c38-9a74-b2397ddd1728 req-c248fca9-0876-404c-b1c8-973f85bd7e55 service nova] Creating event network-vif-unplugged:e86ad729-5dbf-4d1e-b624-c169f51ed42c for instance 2899b822-bdd2-4731-a44a-f67901ecae9e on n-h1-854925-5 Aug 30 04:19:23.857215 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7be70fcb-576f-4c38-9a74-b2397ddd1728 req-c248fca9-0876-404c-b1c8-973f85bd7e55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047499 Aug 30 04:19:23.858245 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1249/2439] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:23.949545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-534736469", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "45f92f08-9d57-42f1-af99-23717f5e800c"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:24.020291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] validate_networks() for [('45f92f08-9d57-42f1-af99-23717f5e800c', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:19:24.245860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:24.261767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:24.264209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:24.265729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-76791e2b-ee64-4aa0-93c7-61ac81745532 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1359 microversion: 2.47 time: 0.503781 Aug 30 04:19:24.266433 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1191/2440] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:23 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1359 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:24.273721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:24.275608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:24.302335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.303307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.304370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:24.306956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:24.307669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:24.313060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:25.742234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.762279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.769123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:25.779926 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd8e6bd9-1e43-4e85-919d-039c19bbbc86 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.509710 Aug 30 04:19:25.800388 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1192/2441] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:24 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:25.805643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:25.810218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:25.826091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.826745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.827846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:25.828816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:25.829875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:25.832457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.042200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.068003 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f3863ce7-00ff-44c0-bd34-4141208d6906 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1274 microversion: 2.1 time: 0.263959 Aug 30 04:19:26.068656 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1193/2442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:25 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1274 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:26.087646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:26.099605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:26.122045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.124822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.125314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.126119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.126610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.131489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.490594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.508264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.510947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:26.516436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-561f3ebc-bde4-4e93-ae23-cadf7d623996 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1251 microversion: 2.25 time: 0.445810 Aug 30 04:19:26.517421 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1194/2443] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:26 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1251 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:26.533841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-252430012"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:26.536766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:26.561425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.561957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.566283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:26.567273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:26.567906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:26.568619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.036896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32d22dfc-a097-47a8-bb05-f4f91b96330b tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "POST /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf/action" status: 202 len: 52 microversion: 2.47 time: 0.516420 Aug 30 04:19:27.040957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1195/2444] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:19:26 2022] POST /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf/action => generated 52 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:19:27.051220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:27.057187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:27.070121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.070888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.071478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.072340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.075637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.077518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.139015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:27.140436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:27.141291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:27.142103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:27.142673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:27.165842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.168593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.169172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.174164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:27.174780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:27.175302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:27.226226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:27.251059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for user 689cafef29c449fd8dd8eae3ae2ab9c5 and project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:27.279997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:27.282912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:27.396031 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be43a9fd-fe88-4413-b366-85372dab2880 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.536335 Aug 30 04:19:27.399820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1250/2445] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 3541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:27.417847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1775620415", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:27.580058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] validate_networks() for [('b7ec388d-fb3a-43eb-a589-c1170d5f3565', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:19:28.706210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:28.718876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:28.751885 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bda24286-3adf-48de-858d-27eeaf7fc1ad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1464 microversion: 2.1 time: 1.709012 Aug 30 04:19:28.756211 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1196/2446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:27 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1464 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:28.771152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:28.774239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:28.810925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.811725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.812382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:28.815896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:28.822530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:28.834100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:29.968123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:29.987604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:29.992311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:29.996510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5aca8087-5cc6-44ec-b60c-724f81566a42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.236147 Aug 30 04:19:30.006834 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1197/2447] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:28 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:30.021847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:30.024166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:30.058035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.059191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.060019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.061024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.061737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.062395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.097141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:19:30.227441 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-710ad2b6-2e6e-46a6-8c7f-36e3476238a9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 204 len: 0 microversion: 2.47 time: 0.219029 Aug 30 04:19:30.236464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1198/2448] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:19:30 2022] DELETE /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:19:30.257548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:30.262683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:30.275068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.281796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.282524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.283297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.283861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.284188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.527709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:30.539352 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-91cb78b6-a30e-4bea-acaa-ecc0c7fc829c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1265 microversion: 2.1 time: 0.300095 Aug 30 04:19:30.539961 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1199/2449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:30 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:30.553216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:30.554307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:30.570568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.573020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.573693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.579342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.580047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.580673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.763934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:30.790114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=14 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:30.933158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:30.934614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:30.935121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:30.936208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:30.937908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:30.960727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.963953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.964651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:30.965992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:30.967710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:30.970093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.026243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:31.039662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for user 84dd97e2c7fb48f0a9d8f93f1211dc91 and project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:31.069025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:31.071822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:31.072611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.082671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.087532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.091014 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-54d0b2ba-dc39-4b30-90e0-c9528d2260ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1293 microversion: 2.25 time: 0.541910 Aug 30 04:19:31.096643 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1200/2450] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:30 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1293 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:31.102395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:31.106848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:31.120771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.121745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.122438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.123431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.127024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.127760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.178530 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c37b5b0-e58f-4eae-bcbb-32d2e8ef6468 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.774200 Aug 30 04:19:31.179248 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1251/2451] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 3776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:31.185520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:31.186160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:31.193617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.194119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.194567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.195348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.195812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.196246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.558082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.570008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.571435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:31.590613 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ec0b7a8-d069-46df-b387-9cacb2d2f390 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1365 microversion: 2.47 time: 0.409968 Aug 30 04:19:31.591554 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1252/2452] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:31 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1365 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:31.609646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1eee16fb-85ba-41cc-bb22-10a14938010c req-668bee9a-f4bb-4b3d-a9cc-420a7b51dbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2899b822-bdd2-4731-a44a-f67901ecae9e", "name": "network-vif-plugged", "status": "completed", "tag": "e86ad729-5dbf-4d1e-b624-c169f51ed42c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:31.636088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1eee16fb-85ba-41cc-bb22-10a14938010c req-668bee9a-f4bb-4b3d-a9cc-420a7b51dbcb service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.645265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1eee16fb-85ba-41cc-bb22-10a14938010c req-668bee9a-f4bb-4b3d-a9cc-420a7b51dbcb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.646023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1eee16fb-85ba-41cc-bb22-10a14938010c req-668bee9a-f4bb-4b3d-a9cc-420a7b51dbcb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.669385 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1eee16fb-85ba-41cc-bb22-10a14938010c req-668bee9a-f4bb-4b3d-a9cc-420a7b51dbcb service nova] Creating event network-vif-plugged:e86ad729-5dbf-4d1e-b624-c169f51ed42c for instance 2899b822-bdd2-4731-a44a-f67901ecae9e on n-h1-854925-5 Aug 30 04:19:31.691320 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1eee16fb-85ba-41cc-bb22-10a14938010c req-668bee9a-f4bb-4b3d-a9cc-420a7b51dbcb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097748 Aug 30 04:19:31.691959 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1253/2453] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:31.710582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:31.711403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:31.724255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.725277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.725926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.727015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:31.727636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:31.728228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:31.998970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.007797 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0305dd59-a48a-47e7-a462-38d1634fb485 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1464 microversion: 2.1 time: 0.909755 Aug 30 04:19:32.014992 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1201/2454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:31 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1464 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:32.020005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-635b5647-bdef-43e3-af7a-49d23b28905d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.026139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-635b5647-bdef-43e3-af7a-49d23b28905d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.100309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.128915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.132209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.135758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ddeb531-8e76-4532-8fd4-634a1c9e8ea4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.442660 Aug 30 04:19:32.141015 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1254/2455] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:31 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:32.145292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-635b5647-bdef-43e3-af7a-49d23b28905d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.158694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-635b5647-bdef-43e3-af7a-49d23b28905d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1222 microversion: 2.1 time: 0.141157 Aug 30 04:19:32.161005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.161437 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1202/2456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1222 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:32.164385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.168013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:32.172305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.182089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.184334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.187244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.188235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.193630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.196439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.197160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.197430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.198113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.198319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.200532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.202495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.351549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:32.353023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:32.353528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:32.353948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:32.355946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:32.374929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.394834 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59a09f60-d50c-4a54-bbdc-fe31be3b565a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1265 microversion: 2.1 time: 0.251996 Aug 30 04:19:32.401146 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1255/2457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:32.414349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.416575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.439690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.445219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.448325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.451487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.453285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.454404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.532849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.544520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.547937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.548579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.549599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.550275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.551057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.601715 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df721772-79d4-4fa0-ad1c-7f894b1aaa3d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action" status: 202 len: 1068 microversion: 2.1 time: 0.438997 Aug 30 04:19:32.605477 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1203/2458] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:32 2022] POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action => generated 1068 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 04:19:32.615070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7517e6d8-a042-48c8-a6ca-0bcc0642417e req-6b21ad7f-04b4-415a-91ec-061a5f26119d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "213f3941-dfe1-4ac4-bc21-e8eaae576cb9", "tag": "1b16ff08-6ea0-4995-82bc-3fce03c11e3d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:32.639175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7517e6d8-a042-48c8-a6ca-0bcc0642417e req-6b21ad7f-04b4-415a-91ec-061a5f26119d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.639860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7517e6d8-a042-48c8-a6ca-0bcc0642417e req-6b21ad7f-04b4-415a-91ec-061a5f26119d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.641993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7517e6d8-a042-48c8-a6ca-0bcc0642417e req-6b21ad7f-04b4-415a-91ec-061a5f26119d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.676098 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7517e6d8-a042-48c8-a6ca-0bcc0642417e req-6b21ad7f-04b4-415a-91ec-061a5f26119d service nova] Creating event network-changed:1b16ff08-6ea0-4995-82bc-3fce03c11e3d for instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 on n-h2-854925-5 Aug 30 04:19:32.694644 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7517e6d8-a042-48c8-a6ca-0bcc0642417e req-6b21ad7f-04b4-415a-91ec-061a5f26119d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083125 Aug 30 04:19:32.695848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1204/2459] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:32.701144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.701992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.709037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.710664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.711292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.712207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.713044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.713645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.929978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.942376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.954964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:32.956610 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6891db5-c9e5-421e-871b-c6b846318c70 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1365 microversion: 2.47 time: 0.259487 Aug 30 04:19:32.957443 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1205/2460] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:32.974001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:32.974976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:32.987881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.988623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.989290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:32.990135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:32.990797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:32.991505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.491071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.501180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.509196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.510594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4296a6d-f9e9-4f70-9a76-84c715c58c91 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1293 microversion: 2.25 time: 1.108295 Aug 30 04:19:33.511329 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1256/2461] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1293 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:33.518165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:33.518769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:33.536215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.536990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.537649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.538831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.539598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.540251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.668607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:33.681507 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b55a379-d20c-4541-80f7-c2f5677185a7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.722680 Aug 30 04:19:33.682589 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1206/2462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:32 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:33.688251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:33.689243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:33.699236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.700804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.702511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:33.703876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:33.704658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:33.705510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.037453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.054711 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-47b636a4-c8eb-4c2b-89f9-7e18f922cc47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1274 microversion: 2.1 time: 0.366357 Aug 30 04:19:34.055373 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1207/2463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:33 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1274 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:34.066049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:34.067869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:34.104265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.104779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.105227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.115392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.115953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.119683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.577826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.595786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.600108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:34.603010 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0d0de13f-04b1-42d6-a2be-46f727b60dac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.088532 Aug 30 04:19:34.617729 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1257/2464] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:33 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:34.627769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:34.628639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:34.639040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.642677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.643356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.644539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:34.645490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:34.647643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:34.991153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.004352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.006064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.008758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-daf2c8ea-90f5-40bc-8e2c-ea3cba85d974 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1365 microversion: 2.47 time: 0.389566 Aug 30 04:19:35.022852 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1258/2465] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:34 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:35.047664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:35.047664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:35.078916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.081233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.084168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.085557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.087737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.089210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.109715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.126972 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1411687f-bc59-41cd-9a8f-2dda400baf24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1307 microversion: 2.1 time: 1.070223 Aug 30 04:19:35.133827 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1208/2466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:34 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1307 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:35.153454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:35.158671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:35.187866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.188348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.188789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.189615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.190091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.190523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.554546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.568491 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f5d2da99-bbd2-4ac0-b42b-86b01ea0bc38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.430311 Aug 30 04:19:35.569667 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1209/2467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:35 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:35.575420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:35.576300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:35.610300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.611516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.615396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.616759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.621546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.624096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.792620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.792796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.812423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.814133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:35.815314 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae9478a5-3920-4a47-9b92-112c05fcfd2b tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.791179 Aug 30 04:19:35.815896 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1259/2468] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:35 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:35.823682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:35.824928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:35.843408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.843888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.844359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.845095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:35.845744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c227c9af-cfba-4c8e-a167-9db7b454ac63 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1280 microversion: 2.1 time: 0.274171 Aug 30 04:19:35.848103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:35.848559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:35.850066 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1210/2469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:35 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1280 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:36.042058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:36.043636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:36.054516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.057078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.058983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.060221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.061570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.062442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.104479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:36.131801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.132447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.133462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.134984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lazy-loading 'fault' on Instance uuid 68797f74-9dc0-42eb-a925-174c92ec13bf {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:19:36.318014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.328977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.330681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd35b589737374885bb3c62ac4e8e8e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9efb88b7c64b10aea3f1ff3e3dd4fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.332124 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19f8810f-4637-4268-b144-65167e1a0d19 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 200 len: 1370 microversion: 2.47 time: 0.299541 Aug 30 04:19:36.337491 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1211/2470] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:36 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 1370 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:36.341660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-aef7c4c7-dbe5-4ae5-a200-84d8cab9dfda req-791a7735-ecfe-43d5-a798-f71f092d4e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b808ff1-027c-46e7-bc13-a1ee270c686d", "tag": "255c58a9-96b9-4882-8308-87a044f6c817"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:36.352694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-aef7c4c7-dbe5-4ae5-a200-84d8cab9dfda req-791a7735-ecfe-43d5-a798-f71f092d4e80 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.353483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-aef7c4c7-dbe5-4ae5-a200-84d8cab9dfda req-791a7735-ecfe-43d5-a798-f71f092d4e80 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.354225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-aef7c4c7-dbe5-4ae5-a200-84d8cab9dfda req-791a7735-ecfe-43d5-a798-f71f092d4e80 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.366973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-aef7c4c7-dbe5-4ae5-a200-84d8cab9dfda req-791a7735-ecfe-43d5-a798-f71f092d4e80 service nova] Creating event network-changed:255c58a9-96b9-4882-8308-87a044f6c817 for instance 7b808ff1-027c-46e7-bc13-a1ee270c686d on n-h2-854925-5 Aug 30 04:19:36.372412 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-aef7c4c7-dbe5-4ae5-a200-84d8cab9dfda req-791a7735-ecfe-43d5-a798-f71f092d4e80 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037862 Aug 30 04:19:36.374227 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1212/2471] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:36.380850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:36.381727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:36.389483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.390272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.390880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.391644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.392111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.392569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.720704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.731035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.733005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:36.740107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c3bf63b-b293-4415-a279-842c3f4efc50 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.922961 Aug 30 04:19:36.740699 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1260/2472] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:35 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:36.746922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:36.748935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:36.758022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.758857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.759559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:36.761038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:36.761868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:36.762462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.367184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.388649 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-70d3cb42-34a1-4069-892b-139cb8bfc9a0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1307 microversion: 2.1 time: 1.011333 Aug 30 04:19:37.391093 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1213/2473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:36 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1307 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:37.403205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.405839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.419219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.421178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.422497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.425076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.425658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.426156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.774938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:37.795797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b6db1272-4032-43b4-a63e-30723936b3cb tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 1.047150 Aug 30 04:19:37.799621 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1261/2474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:36 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:37.808909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:37.812111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:37.824202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.826486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.827135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.829045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:37.834363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:37.835023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:37.999813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.014579 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c58b75a6-cf22-46aa-8dae-5f37f96aa2fd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1280 microversion: 2.1 time: 0.213520 Aug 30 04:19:38.016092 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1262/2475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:38.022663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-30077cb1-caf5-433d-8cc5-52e4f59a85a2 req-9ba548a5-126f-4579-ac66-4d3b19211e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8256913-3e91-4d10-9b49-5a5e5fff2ae0", "tag": "02dbd89d-bfe8-4171-9039-44a821398026"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:38.038730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-30077cb1-caf5-433d-8cc5-52e4f59a85a2 req-9ba548a5-126f-4579-ac66-4d3b19211e24 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.039410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-30077cb1-caf5-433d-8cc5-52e4f59a85a2 req-9ba548a5-126f-4579-ac66-4d3b19211e24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.040499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-30077cb1-caf5-433d-8cc5-52e4f59a85a2 req-9ba548a5-126f-4579-ac66-4d3b19211e24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.070620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-30077cb1-caf5-433d-8cc5-52e4f59a85a2 req-9ba548a5-126f-4579-ac66-4d3b19211e24 service nova] Creating event network-changed:02dbd89d-bfe8-4171-9039-44a821398026 for instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 on n-h1-854925-5 Aug 30 04:19:38.081154 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-30077cb1-caf5-433d-8cc5-52e4f59a85a2 req-9ba548a5-126f-4579-ac66-4d3b19211e24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063050 Aug 30 04:19:38.082766 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1263/2476] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:38.088634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:38.089875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] [instance: 68797f74-9dc0-42eb-a925-174c92ec13bf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:38.099097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.099875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.102094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.103531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.107799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.108515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.126515 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] HTTP exception thrown: Instance 68797f74-9dc0-42eb-a925-174c92ec13bf could not be found. Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Request method failure captured: Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf HTTP/1.1 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY-9xE-um0yhIwnGuWEgDuRSh94lw3KCWj-KLAr_BerH-vAf5OL32BGWh7M0rLAwemHVMpSa1t8Mu_584p5vu6FM8l62ue7Hz4THKVjgmsdOcuIjpk2GL9z8RarHL4btDhb9A5hrwRHy2Fm4HT46wC5EvWsyjvLtzVLAR_UGLHRV8pM Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0c9efb88b7c64b10aea3f1ff3e3dd4fb Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAaction247Test-1524481427 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0c9efb88b7c64b10aea3f1ff3e3dd4fb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0c9efb88b7c64b10aea3f1ff3e3dd4fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0c9efb88b7c64b10aea3f1ff3e3dd4fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0c9efb88b7c64b10aea3f1ff3e3dd4fb"}]}] Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAaction247Test-1524481427 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0c9efb88b7c64b10aea3f1ff3e3dd4fb Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAaction247Test-1524481427 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAaction247Test-1524481427-project Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d35b589737374885bb3c62ac4e8e8e48 Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAaction247Test-1524481427-project Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 68797f74-9dc0-42eb-a925-174c92ec13bf could not be found. Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '68797f74-9dc0-42eb-a925-174c92ec13bf'} Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68797f74-9dc0-42eb-a925-174c92ec13bf could not be found. Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68797f74-9dc0-42eb-a925-174c92ec13bf could not be found. Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:38.136547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68797f74-9dc0-42eb-a925-174c92ec13bf could not be found. Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] Returning 404 to user: Instance 68797f74-9dc0-42eb-a925-174c92ec13bf could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:19:38.147587 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b12d221-259e-444e-a89a-4999934b34b9 tempest-ServersAaction247Test-1524481427 tempest-ServersAaction247Test-1524481427-project] 10.222.0.27 "GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf" status: 404 len: 111 microversion: 2.47 time: 0.062143 Aug 30 04:19:38.149636 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1264/2477] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:38 2022] GET /compute/v2.1/servers/68797f74-9dc0-42eb-a925-174c92ec13bf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:19:38.159365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:38.159998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:38.172475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.173557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.174181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.175823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.176489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.177137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.370139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.388369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.393029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:38.394246 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ab5e6938-cea8-4ee9-9d2e-d77d29b44c69 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 1.001025 Aug 30 04:19:38.399173 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1214/2478] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:37 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:38.422790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:38.424011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:38.431849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.432639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.433271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:38.436957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:38.437718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:38.438312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.197432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.206432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:39.213681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.216007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.219400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e5f8543-b70f-4b98-9996-80058740e93d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.068623 Aug 30 04:19:39.220444 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1265/2479] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:38 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:39.227273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:39.228609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:39.248719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.248719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.248719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.248719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.249210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.251653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.280838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.303494 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7bc1e3b4-9a66-42dd-86a0-aadd4b3c215f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1307 microversion: 2.1 time: 0.884698 Aug 30 04:19:39.304367 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1215/2480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:38 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1307 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:39.312193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:39.314999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:39.341434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.344034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.346126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.347127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.348133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.348735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.712998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:39.727063 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db013c34-72d8-4127-a3f1-13e1cdd413fe tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.504347 Aug 30 04:19:39.729040 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1266/2481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:39 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:39.736156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:39.737074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:39.744250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.745008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.745724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:39.747669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:39.749542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:39.751473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.030056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.052519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-47f2af39-60af-4ec7-9e9f-ef41d08b1cec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.746594 Aug 30 04:19:40.058544 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1216/2482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:39 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:40.204585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.233188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.234665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.235803 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1c7b41e-a6c3-4617-be0c-0a30100c8533 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.505027 Aug 30 04:19:40.244025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:40.244646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:40.257140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.258816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.260207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1267/2483] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:39 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:40.262248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.264335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.265282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.267462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.329759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:40.330389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:40.339526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.340020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.340711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.345848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.346342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.346772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.929560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.943465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.944755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.945985 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5994b56a-790e-4b36-ab01-bdb537a7dc70 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.706062 Aug 30 04:19:40.949062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:40.953613 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1217/2484] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:40 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:40.959946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:40.960805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:40.971492 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a0f27da-9509-4135-9ef2-67f5e4c40c23 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1307 microversion: 2.1 time: 0.640919 Aug 30 04:19:40.973307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.973498 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1268/2485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:40 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1307 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:40.981735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.986074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:40.988172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:40.994620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:40.995722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.077699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.078321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:41.088178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:41.088937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=18 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:41.092354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:41.098247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.101069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.101585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.103398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.106411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.106985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.596131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:41.611925 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4968b9b5-b12d-4b98-960c-ffa096c73934 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.538108 Aug 30 04:19:41.627251 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1269/2486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:41.629952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:41.633296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.634132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:41.642048 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d52fac8e-1299-4211-a4f6-9e951902f42a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.685576 Aug 30 04:19:41.642664 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1218/2487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:40 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:41.643242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.643924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.644557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.645491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.646751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.647680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.918753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cc2eeae1-e85f-488a-9351-85c97ab2d4bd req-b170b764-6c65-4273-8953-0a4481ced839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bed32086-1deb-4867-ba21-ecef253f35df", "tag": "f8e76d66-3c88-43bc-beb4-023271e1bab3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:41.942018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cc2eeae1-e85f-488a-9351-85c97ab2d4bd req-b170b764-6c65-4273-8953-0a4481ced839 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:41.942912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cc2eeae1-e85f-488a-9351-85c97ab2d4bd req-b170b764-6c65-4273-8953-0a4481ced839 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:41.944520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cc2eeae1-e85f-488a-9351-85c97ab2d4bd req-b170b764-6c65-4273-8953-0a4481ced839 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:41.978320 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cc2eeae1-e85f-488a-9351-85c97ab2d4bd req-b170b764-6c65-4273-8953-0a4481ced839 service nova] Creating event network-changed:f8e76d66-3c88-43bc-beb4-023271e1bab3 for instance bed32086-1deb-4867-ba21-ecef253f35df on n-h1-854925-5 Aug 30 04:19:41.986158 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cc2eeae1-e85f-488a-9351-85c97ab2d4bd req-b170b764-6c65-4273-8953-0a4481ced839 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071885 Aug 30 04:19:41.987405 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1219/2488] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:19:41.995470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:41.997150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.011636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.012962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.014275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.018056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.020000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.020672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.057064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.078476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.080196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.081362 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-073b9ce0-6de4-45d9-aa35-3c0df3a37384 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.452902 Aug 30 04:19:42.082111 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1270/2489] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:42.101455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:42.103324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.113980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.114480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.114919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.115623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.123613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.123867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.149876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:42.355752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.367727 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-15bcf133-2bed-437c-b30d-fa21f296f9f4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1307 microversion: 2.1 time: 0.284150 Aug 30 04:19:42.368705 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1271/2490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:42 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1307 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:42.412619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.422257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.423696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:42.424883 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c2a61d6e-f058-43ed-8d23-cf34c06e0dff tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.436189 Aug 30 04:19:42.430322 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1220/2491] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:41 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:42.634974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:42.636310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.643819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.644675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.645658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.646604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.647293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.647967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.664567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:42.665196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:42.682161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:42.685121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.686517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.687347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:42.703187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:42.704091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:42.704759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.436498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:43.443635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:43.472828 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bfab1ad7-00a2-4d73-9742-78ef05e1715e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.812914 Aug 30 04:19:43.475298 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d429db6-1670-4824-ad7f-f765d1341272 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.844471 Aug 30 04:19:43.475960 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1221/2492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:42 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:43.477603 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1272/2493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:42 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:43.489172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:43.494659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:43.497067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:43.501103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:43.523368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.523981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.525150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.525765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.540784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.543004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.543690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.544214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.546144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:43.548763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:43.550683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:43.551139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.128353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.136337 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c0a31497-5d9e-44d1-b06e-9f399528dda7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1307 microversion: 2.1 time: 0.656774 Aug 30 04:19:44.136945 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1273/2494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:43 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1307 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:44.144107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:44.144725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:44.157447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.158194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.158853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.159726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.160398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.161184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.187558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.207218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.208669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.209834 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-56172c62-702a-497e-a348-5c47009e56d0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.732672 Aug 30 04:19:44.217936 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1222/2495] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:43 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:44.498847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:44.499996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:44.513213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.521627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.522413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.523698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.524741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.526163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.825877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.840160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.842636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:44.852919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-68991669-4a2c-4ae1-a3d5-bcfc112b410d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.712463 Aug 30 04:19:44.853887 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1274/2496] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:44 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:44.865793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:44.865793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:44.880080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.880322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.880611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:44.881402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:44.881858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:44.882283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.231594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.256147 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a95cccb-d00f-4a07-8a27-8c8263cd99cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.762095 Aug 30 04:19:45.257302 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1223/2497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:44 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:45.286572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b8d328ae-6962-47f9-8340-023d8214aa04 req-ac11d97e-796a-40bd-bcbf-0578777088ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b808ff1-027c-46e7-bc13-a1ee270c686d", "name": "network-vif-plugged", "status": "completed", "tag": "255c58a9-96b9-4882-8308-87a044f6c817"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:45.299476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b8d328ae-6962-47f9-8340-023d8214aa04 req-ac11d97e-796a-40bd-bcbf-0578777088ba service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.300070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b8d328ae-6962-47f9-8340-023d8214aa04 req-ac11d97e-796a-40bd-bcbf-0578777088ba service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.300812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b8d328ae-6962-47f9-8340-023d8214aa04 req-ac11d97e-796a-40bd-bcbf-0578777088ba service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.317278 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b8d328ae-6962-47f9-8340-023d8214aa04 req-ac11d97e-796a-40bd-bcbf-0578777088ba service nova] Creating event network-vif-plugged:255c58a9-96b9-4882-8308-87a044f6c817 for instance 7b808ff1-027c-46e7-bc13-a1ee270c686d on n-h2-854925-5 Aug 30 04:19:45.323120 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b8d328ae-6962-47f9-8340-023d8214aa04 req-ac11d97e-796a-40bd-bcbf-0578777088ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051737 Aug 30 04:19:45.324184 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1224/2498] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:45.330156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.331084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.338802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.339532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.340136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.341246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.342823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.343407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.386983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.395836 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c0a6408c-ef37-4388-b465-f86fe6483388 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.540883 Aug 30 04:19:45.396436 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1275/2499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:44 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:45.401527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.402322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.413510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.414130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.414570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.415650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.416117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.416720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.665548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.682450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06a8ed18-8ed5-4193-b060-c88fb6681e3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1307 microversion: 2.1 time: 0.356882 Aug 30 04:19:45.683632 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1225/2500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:45.733250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.745753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.748029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:45.749461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd054d98-4957-43bf-8ab5-a86f1d2fcc67 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.351895 Aug 30 04:19:45.762151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1276/2501] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:45.871444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-103365471", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "340a3696-7392-4a2b-afd0-791dfd670a54"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:45.881964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:45.882573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:45.890995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.891491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.891930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.892632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:45.893079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:45.893532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:45.958762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] validate_networks() for [('340a3696-7392-4a2b-afd0-791dfd670a54', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:19:46.398210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:46.421114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:46.422773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:46.426393 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ca25c9cb-74a3-4b66-b1ca-2ba1b9b2b77f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.548632 Aug 30 04:19:46.437890 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1277/2502] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:45 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:46.447425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:46.448079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:46.455268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.455379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.455732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:46.456619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:46.457317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:46.457772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.092233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.102549 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d95fd4b4-1694-4b5e-bb96-d7c1c8d3257d tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.662794 Aug 30 04:19:47.103684 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1278/2503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:46 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:47.120438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.121084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:47.130913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.131754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.132451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.133852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.135314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.136631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.290008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:47.290600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:47.291143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:47.291633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:47.292126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:47.307937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.308789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.310491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.312095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.315682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.317474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.353264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Getting quotas for project e7d386d020984cd38997b58d490df536. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:47.359199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Getting quotas for user 0a2e36c4d46f401086128df4cf77de60 and project e7d386d020984cd38997b58d490df536. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:47.374203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:47.377494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:47.443285 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23761828-0477-4a9e-b68d-3c7e58f1fb0d tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758306 Aug 30 04:19:47.444283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1226/2504] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:47.457366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.468014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:47.474797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.475187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.475626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.476384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.476869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.477292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.552951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.567565 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20d4258e-f17b-4f50-9f61-e326db95ddd9 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.457899 Aug 30 04:19:47.585100 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1279/2505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:47.594440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.595610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:47.647885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.648406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.648851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.655280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.655777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.656225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.719021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.730466 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f8ac0b99-d1cc-41a9-bed2-b7b96b51cbce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1487 microversion: 2.1 time: 0.284461 Aug 30 04:19:47.756118 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1227/2506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1487 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:47.772198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.773490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:47.781664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.782390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.783002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.784200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:47.784663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:47.785077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:47.883034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.899146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.900593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:47.901758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98cdc77a-c4df-4e7d-a426-78203ad90db0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.314646 Aug 30 04:19:47.925212 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1280/2507] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:47.930145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b141b3db-38cc-42ef-acef-b13b00c36c26 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:47.930768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b141b3db-38cc-42ef-acef-b13b00c36c26 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:48.178098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b141b3db-38cc-42ef-acef-b13b00c36c26 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.186535 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b141b3db-38cc-42ef-acef-b13b00c36c26 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1215 microversion: 2.1 time: 0.260132 Aug 30 04:19:48.194176 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1281/2508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1215 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:48.209168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6d7e55c8-776a-43fd-8851-9831755130d5 req-a981f946-4628-415e-9b31-d8a24b3bf828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8256913-3e91-4d10-9b49-5a5e5fff2ae0", "name": "network-vif-plugged", "status": "completed", "tag": "02dbd89d-bfe8-4171-9039-44a821398026"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:48.227787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6d7e55c8-776a-43fd-8851-9831755130d5 req-a981f946-4628-415e-9b31-d8a24b3bf828 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.228791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6d7e55c8-776a-43fd-8851-9831755130d5 req-a981f946-4628-415e-9b31-d8a24b3bf828 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.229498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6d7e55c8-776a-43fd-8851-9831755130d5 req-a981f946-4628-415e-9b31-d8a24b3bf828 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.242437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6d7e55c8-776a-43fd-8851-9831755130d5 req-a981f946-4628-415e-9b31-d8a24b3bf828 service nova] Creating event network-vif-plugged:02dbd89d-bfe8-4171-9039-44a821398026 for instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 on n-h1-854925-5 Aug 30 04:19:48.249063 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6d7e55c8-776a-43fd-8851-9831755130d5 req-a981f946-4628-415e-9b31-d8a24b3bf828 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052815 Aug 30 04:19:48.249951 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1282/2509] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:48.260382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:48.261411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:48.279854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.282954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.283587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.284952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.288098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.289812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.318331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.345916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.351555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:48.355137 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a16f442-7a66-40e4-8e93-a4481eef40f9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.597206 Aug 30 04:19:48.356254 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1228/2510] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:47 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:48.373361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.378635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:48.389499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:48.406907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.408735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.409406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.412353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.413042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.414463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.422852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e9f766c-d1e3-4f93-8bf6-d2305b977818 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d/action" status: 202 len: 0 microversion: 2.1 time: 0.166901 Aug 30 04:19:48.429267 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1283/2511] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:48 2022] POST /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:19:48.443539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:48.446453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:48.460041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.462755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.463488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:48.464325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:48.465897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:48.468528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.032583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.056026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.062337 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1b0001e-7edd-4de0-901f-51453700d542 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1492 microversion: 2.1 time: 0.629369 Aug 30 04:19:49.067115 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3cf5f1bf-1b4a-4874-81e8-efa1b333aabd tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.709654 Aug 30 04:19:49.095689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1229/2512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:49.100133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1284/2513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:48 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1492 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:49.149054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.153669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.154292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.165397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.178292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.178789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.179280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.180180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.180815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.181250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.182001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.182452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.182875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.183817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.184343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.184773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.236999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:49.544481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.558412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.560156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.561884 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3287a02d-74b6-482c-b81d-7a332ab827b6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.460785 Aug 30 04:19:49.562665 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1285/2514] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:49.582424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.583112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.597307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.598063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.598579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.610173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.610912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.611379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.644992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.654873 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-453b91df-2450-4044-b7c8-1c6048d371a4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.556840 Aug 30 04:19:49.655971 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1230/2515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:49.671999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:49.672895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:49.691774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.700653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.701938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.702993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:49.703537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:49.704054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:49.734442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:49.743009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0d1e13ec-63e1-4586-aeac-3c7e108c7a6f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1267 microversion: 2.1 time: 0.178733 Aug 30 04:19:49.754906 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1286/2516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:50.094056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.094778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.101234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.106029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.106534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.108052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.108807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.109276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.109739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.121224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.125512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.128327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3380ece-2b6d-4d1c-9a63-b9d32e99bcbd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.470369 Aug 30 04:19:50.129607 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1231/2517] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:49 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:50.140095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.141709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.188316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.192634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.041s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.196624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.198486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.203471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.204452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.685532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.694026 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-17737b3c-a9bb-460d-af9e-5e0f22acade2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 200 len: 1472 microversion: 2.1 time: 0.559967 Aug 30 04:19:50.701524 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1232/2518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 1472 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:50.733670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:50.743413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.744040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.746670 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28bbbbdf-4a21-44c0-8e91-1f5f0fef7d38 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1473 microversion: 2.1 time: 0.662292 Aug 30 04:19:50.747271 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1287/2519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1473 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:50.767741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.768251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.768694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.769452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.770028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:50.771001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:50.778205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.778205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.780890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.781960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.782741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:50.783706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:50.786228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:50.786931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.093772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.113722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-717225a6-3039-482e-9934-92ed93a0854f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.345269 Aug 30 04:19:51.115629 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1288/2520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:51.126922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-614999196"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:51.132803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:51.174306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.177794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.179693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.183423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.184097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.186343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.259022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.280314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.285320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.291515 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-29e69504-d6de-4f19-a4b8-0fcad6ec9a89 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.586984 Aug 30 04:19:51.297699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1233/2521] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:50 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:51.320012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.323715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:51.333141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.334037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.334729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.335725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.336782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.337540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.513560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:51.528519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c1613cbd-90a5-45cd-81f0-afba65b2057f tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1267 microversion: 2.1 time: 0.229351 Aug 30 04:19:51.541467 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1234/2522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:51.547306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-8695e9e9-0934-4f60-8e41-37b9097d3f2e req-2edf0cdd-95af-40be-9141-31fb20eb1b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213f3941-dfe1-4ac4-bc21-e8eaae576cb9", "name": "network-vif-plugged", "status": "completed", "tag": "1b16ff08-6ea0-4995-82bc-3fce03c11e3d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:51.576037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8695e9e9-0934-4f60-8e41-37b9097d3f2e req-2edf0cdd-95af-40be-9141-31fb20eb1b8e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.576904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8695e9e9-0934-4f60-8e41-37b9097d3f2e req-2edf0cdd-95af-40be-9141-31fb20eb1b8e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.577514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8695e9e9-0934-4f60-8e41-37b9097d3f2e req-2edf0cdd-95af-40be-9141-31fb20eb1b8e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.606103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-8695e9e9-0934-4f60-8e41-37b9097d3f2e req-2edf0cdd-95af-40be-9141-31fb20eb1b8e service nova] Creating event network-vif-plugged:1b16ff08-6ea0-4995-82bc-3fce03c11e3d for instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 on n-h2-854925-5 Aug 30 04:19:51.618058 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-8695e9e9-0934-4f60-8e41-37b9097d3f2e req-2edf0cdd-95af-40be-9141-31fb20eb1b8e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074909 Aug 30 04:19:51.618927 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1235/2523] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:51.624354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.632845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:51.648750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.654686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.655364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.656283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.656891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.657519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.724346 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61c54500-e793-428c-9957-f03bb6ee5a63 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d/action" status: 202 len: 0 microversion: 2.1 time: 0.604852 Aug 30 04:19:51.725930 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1289/2524] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:19:51 2022] POST /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:19:51.763073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc0d9e34-4bd3-474c-b260-748c1a199d33 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a3a8550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.855737 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc0d9e34-4bd3-474c-b260-748c1a199d33 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.107633 Aug 30 04:19:51.865481 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1290/2525] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:51.872732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:51.874327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:51.883324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.884331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.885851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:51.887177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:51.889189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:51.890224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.023499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.033294 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c6377f1-6cf5-4a1d-ad41-d772fabd369e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1479 microversion: 2.1 time: 1.166615 Aug 30 04:19:53.046978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.048182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1291/2526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1479 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:53.055285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:53.055925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.056403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:53.063116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.064495 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee732616-98ed-4482-9a0a-2e078c7442a9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.444207 Aug 30 04:19:53.065534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.068132 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1236/2527] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:51 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:53.077519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:53.079714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:53.082565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.083380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.084345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.084924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.085491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.087945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.089169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.089849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.090982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.091631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.092074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.324910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.337084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.339301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.342304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.342974 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd4dbaeb-b220-4618-a86a-d9db98cf5d64 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1281 microversion: 2.25 time: 0.272294 Aug 30 04:19:53.344278 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1237/2528] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:53 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1281 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:53.350012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:53.351068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:53.354540 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3432aee9-2c02-4c1f-84c6-151440fc8bd4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.302104 Aug 30 04:19:53.367808 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1292/2529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:53 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:53.372224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.373672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.374359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.375325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:53.375442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e55d7818-60eb-4941-a307-8d4ea93a1d4f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9695aeb80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:53.376147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:53.376920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:53.457426 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e55d7818-60eb-4941-a307-8d4ea93a1d4f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.097838 Aug 30 04:19:53.461372 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1293/2530] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:53 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:53.472769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:53.484328 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b99cafa3-d7c2-4f6c-833f-c24e80ac05a2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1273 microversion: 2.1 time: 0.138410 Aug 30 04:19:53.502240 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1238/2531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:53 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:53.594717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1509390895", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "067deb1b-41f6-4664-99ed-a33396adf7c7"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:53.675108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] validate_networks() for [('067deb1b-41f6-4664-99ed-a33396adf7c7', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:19:54.060543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.061937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:54.069097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.069935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.070585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.071539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.072197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.072951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.324445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:54.334792 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cb31b9e1-40c6-4a89-97a5-b46567528f96 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1479 microversion: 2.1 time: 0.279156 Aug 30 04:19:54.353351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1239/2532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1479 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:19:54.366702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:54.367332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:54.376818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.377317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.377780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.378479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.378930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.379348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.898040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:19:54.899044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:19:54.899732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:19:54.900660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:19:54.901556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:19:54.915321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.916189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.916836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.918008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:54.918907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:54.919565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:54.943618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Getting quotas for project c5ff9b2d7e924da187232d6efed3ac79. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:19:54.949268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Getting quotas for user f30b57a5e44c4233914335ed406bb9fd and project c5ff9b2d7e924da187232d6efed3ac79. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:19:54.963212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:19:54.967295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:19:54.982542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:54.998306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.000228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.001564 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d62d226-798c-4774-bc4d-27f27d3614e0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.647013 Aug 30 04:19:55.015628 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1240/2533] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:54 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:55.021489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.022131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:55.028821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.029918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.030369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.031064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.031521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.031950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.037458 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1eca110c-bff4-4d7b-af4d-d9be044ad96d tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576571 Aug 30 04:19:55.044133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1294/2534] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:19:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:19:55.049556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.050392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:55.057782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.058534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.059136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.060095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.061455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.062070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.510826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.526830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.528291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.529716 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25459372-cbe5-48d3-a55f-2bd3577459e3 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1477 microversion: 2.25 time: 0.512988 Aug 30 04:19:55.530453 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1241/2535] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1477 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:55.535217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8509832-38d1-49c3-821d-a7666b7ff7b1 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a005b80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.563678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.574434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f496b8a-1898-49dd-b1c1-f565a368e6ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.528887 Aug 30 04:19:55.582596 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1295/2536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:55.596358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.598045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:55.605361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.610106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8509832-38d1-49c3-821d-a7666b7ff7b1 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.078377 Aug 30 04:19:55.610776 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1242/2537] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:55.613678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.614353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.615291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.616158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.616733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.626218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-151052d0-5fb1-4438-9e77-1837a039e097 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.628717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-151052d0-5fb1-4438-9e77-1837a039e097 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:55.777532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.794096 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b958b8b9-24e1-41f0-a827-0030369de7ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1273 microversion: 2.1 time: 0.205789 Aug 30 04:19:55.794988 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1296/2538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:55.818755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:55.819659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:55.827185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.827788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.828535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-151052d0-5fb1-4438-9e77-1837a039e097 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:55.829744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.831683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:55.833014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:55.833487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:55.837611 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-151052d0-5fb1-4438-9e77-1837a039e097 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1217 microversion: 2.1 time: 0.220066 Aug 30 04:19:55.851378 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1243/2539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1217 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:56.144768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:56.145539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:56.158247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.158840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.159378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.162160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.162734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.163244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.350414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:56.363065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-474a780d-59b7-4313-ad09-befa6debb449 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1479 microversion: 2.1 time: 0.550470 Aug 30 04:19:56.364883 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1297/2540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1479 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:56.377142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:56.378703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:56.394465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.396391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.398118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.399292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.400187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.400803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.558292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:19:56.584465 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d61a436-8f68-4a2d-8b0a-39666ae6e94d tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1970 microversion: 2.25 time: 0.741099 Aug 30 04:19:56.587353 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1244/2541] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:55 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1970 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:56.618369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:56.619731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:56.629309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.630116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.630829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:56.631766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:56.632443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:56.633656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.179682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.193370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.199431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.204324 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-49bd220c-1ee9-473d-9396-edd69d703e4c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.836023 Aug 30 04:19:57.205196 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1298/2542] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:56 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:57.229450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.230826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:57.251709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.255014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.257244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.261780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.270920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.271872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.342665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:57.369434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:57.381838 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26bcc09f-e77a-472b-889a-70902e864dd1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.777398 Aug 30 04:19:57.389423 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1245/2543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:56 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:57.400776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c9e8567-299d-41da-adbf-08195ec43ee2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a1f7e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.476344 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c9e8567-299d-41da-adbf-08195ec43ee2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.085752 Aug 30 04:19:57.477243 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1246/2544] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:57.494560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.495688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:57.504983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.505926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.506534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.507475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.508820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.509599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.547012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:19:57.588658 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4e108ac-5800-4779-b345-bdf802370b88 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1970 microversion: 2.25 time: 0.381018 Aug 30 04:19:57.605791 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1299/2545] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1970 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:57.611533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:57.640539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:57.653721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.656927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.664650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:57.665581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:57.669744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:57.671794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.003874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.012488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:58.023888 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9719a90b-6d0b-4b17-9f7f-56775802326b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1275 microversion: 2.1 time: 0.414423 Aug 30 04:19:58.038362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1300/2546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1275 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:58.051555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:58.052175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:58.058376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.070873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.071619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.072238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.073103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.073748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.074322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.077386 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d6c13b87-794d-44ec-b163-582c919f2dbe tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.598878 Aug 30 04:19:58.086050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1247/2547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:57 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:58.100390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:58.111809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.114525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.115630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.117540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.119482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.124884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.198725 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6bc4e22f-9d10-4f56-a07e-637929792eac tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.111338 Aug 30 04:19:58.206455 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1248/2548] 10.222.0.27 () {60 vars in 1217 bytes} [Tue Aug 30 04:19:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:19:58.214666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-854925-5", "block_migration": "auto"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:58.218646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:58.242754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.243795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.253174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.254427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.255050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.255632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.316998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'flavor' on Instance uuid 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:19:58.341261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Going to try to live migrate instance to n-h1-854925-5 {{(pid=122402) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:19:58.432966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:19:58.698537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:58.708876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-259b19fe-a512-42e8-a25f-6a15da6a9ffa tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1464 microversion: 2.1 time: 0.668963 Aug 30 04:19:58.709536 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1301/2549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:58 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1464 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:58.726067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:58.730717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:58.746007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.746761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.747361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:58.753311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:58.754183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:58.754959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.105283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.142531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.148570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.152199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a39dfee0-0c7a-4960-a3d8-7f1ff1f4f7ba tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.440985 Aug 30 04:19:59.153408 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1302/2550] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:19:58 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:19:59.165603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-496ee760-6349-4f9d-8a06-84d848094140 req-fe2a504a-206d-459b-8d2c-c2f6ba6b13f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed32086-1deb-4867-ba21-ecef253f35df", "name": "network-vif-plugged", "status": "completed", "tag": "f8e76d66-3c88-43bc-beb4-023271e1bab3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:19:59.189924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-496ee760-6349-4f9d-8a06-84d848094140 req-fe2a504a-206d-459b-8d2c-c2f6ba6b13f7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.194445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-496ee760-6349-4f9d-8a06-84d848094140 req-fe2a504a-206d-459b-8d2c-c2f6ba6b13f7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.194925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-496ee760-6349-4f9d-8a06-84d848094140 req-fe2a504a-206d-459b-8d2c-c2f6ba6b13f7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.228057 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-496ee760-6349-4f9d-8a06-84d848094140 req-fe2a504a-206d-459b-8d2c-c2f6ba6b13f7 service nova] Creating event network-vif-plugged:f8e76d66-3c88-43bc-beb4-023271e1bab3 for instance bed32086-1deb-4867-ba21-ecef253f35df on n-h1-854925-5 Aug 30 04:19:59.242439 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-496ee760-6349-4f9d-8a06-84d848094140 req-fe2a504a-206d-459b-8d2c-c2f6ba6b13f7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084810 Aug 30 04:19:59.243460 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1303/2551] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:19:59.249640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:19:59.250436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:19:59.258421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.259024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.259763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.266595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:19:59.267091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:19:59.267537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:19:59.889523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:19:59.900343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-49245e1a-9b72-4c2e-9fbc-ecb06fd590ff tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1322 microversion: 2.1 time: 0.655601 Aug 30 04:19:59.905703 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1304/2552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:19:59 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:19:59.917870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9b780d6-a00d-419e-9600-dfeec76168b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96e5fc820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:00.002491 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9b780d6-a00d-419e-9600-dfeec76168b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.094973 Aug 30 04:20:00.011131 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1305/2553] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:19:59 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:00.044398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:00.052964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:00.075582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.076663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.077103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.081022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.082223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.084312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.245838 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-08872f4c-4d9f-40b8-ae0d-aca942bb3c2b tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action" status: 202 len: 0 microversion: 2.1 time: 0.233142 Aug 30 04:20:00.246494 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1306/2554] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:00 2022] POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:20:00.252379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:00.253003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:00.264151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.264653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.265094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.265835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.266271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.266697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.551451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:00.561745 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f792ed49-06e5-4ba8-bea9-903543132b1a tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.314183 Aug 30 04:20:00.563525 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1307/2555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:00 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:00.570044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:00.571034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:00.582184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.583425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.584042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.585061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.585649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.586155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.812894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:00.825157 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-662b7d6e-d25d-4458-9aba-0e6d5c2db4ec tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.260183 Aug 30 04:20:00.826643 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1308/2556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:00 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:00.858718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-63903348-97cc-4bba-9a56-ebd94a0df8dc req-8a851191-f2b4-4bfb-b26c-4736f6d147c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81caf73f-e9ba-4158-8a8e-19d691eff9cc", "tag": "cfdc4e9c-9658-42e2-add8-81e3d8e259ac"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:00.894683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63903348-97cc-4bba-9a56-ebd94a0df8dc req-8a851191-f2b4-4bfb-b26c-4736f6d147c0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.895371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63903348-97cc-4bba-9a56-ebd94a0df8dc req-8a851191-f2b4-4bfb-b26c-4736f6d147c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.913597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63903348-97cc-4bba-9a56-ebd94a0df8dc req-8a851191-f2b4-4bfb-b26c-4736f6d147c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:00.946040 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-63903348-97cc-4bba-9a56-ebd94a0df8dc req-8a851191-f2b4-4bfb-b26c-4736f6d147c0 service nova] Creating event network-changed:cfdc4e9c-9658-42e2-add8-81e3d8e259ac for instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc on n-h1-854925-5 Aug 30 04:20:00.967822 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-63903348-97cc-4bba-9a56-ebd94a0df8dc req-8a851191-f2b4-4bfb-b26c-4736f6d147c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115763 Aug 30 04:20:00.967822 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1309/2557] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:00.971404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:00.972098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:00.992379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:00.992883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:00.993321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.004747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.005238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.005781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.171249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be56eba8-7f94-4efc-9c6e-68a2fe8b3732 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9/action" status: 202 len: 0 microversion: 2.25 time: 2.959494 Aug 30 04:20:01.183452 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1249/2558] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:19:58 2022] POST /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9/action => generated 0 bytes in 2973 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:20:01.208109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:01.212801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:01.258611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.263126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.265294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.266379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.269082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.273788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.377506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:01.377993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:01.382230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:01.382927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lazy-loading 'fault' on Instance uuid 2899b822-bdd2-4731-a44a-f67901ecae9e {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:02.240530 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-71ebf27d-4c2a-491d-ad73-3cf83cd49b32 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1598 microversion: 2.1 time: 1.054974 Aug 30 04:20:02.246548 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1250/2559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:01 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1598 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:02.271914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.282561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.284303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:02.299987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.306481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.308106 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e9b6eca0-0994-4e22-82d6-4112489e23cf tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.340810 Aug 30 04:20:02.320014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.321591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.324658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.326840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.327677 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1310/2560] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:00 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:02.332269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.335048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.339533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdfe4f07-a4d6-43e0-9741-1d213b632d76 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969576b80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.428231 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cdfe4f07-a4d6-43e0-9741-1d213b632d76 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.095004 Aug 30 04:20:02.435289 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1311/2561] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:02.446984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.455692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:02.469406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.470297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.474818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.475817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.476449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.477081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.719197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.723632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.730486 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0e18d8a-e890-44f1-84cc-9417f1e08f31 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1515 microversion: 2.1 time: 0.480533 Aug 30 04:20:02.733902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.734403 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1251/2562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1515 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:02.735502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:02.736908 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-03faf829-ecbb-4d89-bec2-49314d978f55 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.300341 Aug 30 04:20:02.749357 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1312/2563] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:02.752152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.756947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:02.765561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.766790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5419a89a-4b2b-452a-b8a1-866f2c565ef4 req-a6f026b2-3fda-42e5-8e26-a295606e8269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-plugged", "status": "completed", "tag": "50e2ed61-9db9-49c0-a2e1-3f8787967d86"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:02.770468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.770958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.771762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.772238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.772701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.779996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5419a89a-4b2b-452a-b8a1-866f2c565ef4 req-a6f026b2-3fda-42e5-8e26-a295606e8269 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.786086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5419a89a-4b2b-452a-b8a1-866f2c565ef4 req-a6f026b2-3fda-42e5-8e26-a295606e8269 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.786819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5419a89a-4b2b-452a-b8a1-866f2c565ef4 req-a6f026b2-3fda-42e5-8e26-a295606e8269 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.803445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5419a89a-4b2b-452a-b8a1-866f2c565ef4 req-a6f026b2-3fda-42e5-8e26-a295606e8269 service nova] Creating event network-vif-plugged:50e2ed61-9db9-49c0-a2e1-3f8787967d86 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:02.817858 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5419a89a-4b2b-452a-b8a1-866f2c565ef4 req-a6f026b2-3fda-42e5-8e26-a295606e8269 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081956 Aug 30 04:20:02.819345 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1252/2564] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:02.826754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:02.828372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:02.837426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.839229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.839876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:02.845924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:02.846695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:02.847319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.099068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:03.108026 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25ec9aa4-f1eb-4105-9a02-ad38868f15b2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.368538 Aug 30 04:20:03.125909 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1313/2565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:03.130812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-326db3da-239b-43a2-962e-dc504a8f202b req-8a0efb86-6033-4b91-95ce-60432920f4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a", "tag": "8b682dba-46dd-4f89-9e95-9d9a105fd4de"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:03.162280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-326db3da-239b-43a2-962e-dc504a8f202b req-8a0efb86-6033-4b91-95ce-60432920f4d7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.162815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-326db3da-239b-43a2-962e-dc504a8f202b req-8a0efb86-6033-4b91-95ce-60432920f4d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.163186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-326db3da-239b-43a2-962e-dc504a8f202b req-8a0efb86-6033-4b91-95ce-60432920f4d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.184752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:03.197126 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-326db3da-239b-43a2-962e-dc504a8f202b req-8a0efb86-6033-4b91-95ce-60432920f4d7 service nova] Creating event network-changed:8b682dba-46dd-4f89-9e95-9d9a105fd4de for instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a on n-h2-854925-5 Aug 30 04:20:03.200687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cfe8909e-1880-433e-b602-3732f26d8514 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.372161 Aug 30 04:20:03.201985 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1253/2566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:02 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:03.204905 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-326db3da-239b-43a2-962e-dc504a8f202b req-8a0efb86-6033-4b91-95ce-60432920f4d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077678 Aug 30 04:20:03.206110 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1314/2567] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:03.211750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:03.214255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:03.219119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:03.221579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:03.232592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.235504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:03.236323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.236942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.238890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.240425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.241768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.242736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.245695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.246280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.246990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.247447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.247912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.314867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lazy-loading 'flavor' on Instance uuid bed32086-1deb-4867-ba21-ecef253f35df {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:03.403383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-283c1b42-5cd9-448e-91f5-fde25bc3be4c tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action" status: 202 len: 0 microversion: 2.1 time: 0.199337 Aug 30 04:20:03.404714 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1254/2568] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:03 2022] POST /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:20:03.413177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:03.414078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:03.443340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.444310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.444939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.447526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.453546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.454249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.733185 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51ffac74-0a41-4835-9868-01ab9366f874 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action" status: 200 len: 32 microversion: 2.1 time: 0.524485 Aug 30 04:20:03.739221 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1315/2569] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:03 2022] POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action => generated 32 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:20:03.758215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:03.759069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:03.783630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.796845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.796845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.797537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:03.798152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:03.798648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:03.966349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:03.997321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.001007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.002164 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-10b1122c-aa4a-4355-97fa-faa9c09538ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.596103 Aug 30 04:20:04.007463 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1255/2570] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:03 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:04.017037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be2f0b63-1ee2-4853-8423-1e69a3c3e5b8 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96949cc10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:04.095583 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be2f0b63-1ee2-4853-8423-1e69a3c3e5b8 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.086835 Aug 30 04:20:04.096177 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1256/2571] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:04 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:04.112127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:04.112755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:04.132529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.133039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.137883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.138791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.139287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.139735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.206199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7ecfd2a7-cfc1-45ac-b952-5f0d93f8dc71 tempest-ServersAdminTestJSON-1843818293 tempest-ServersAdminTestJSON-1843818293-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1615 microversion: 2.1 time: 0.469396 Aug 30 04:20:04.225414 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1316/2572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:03 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1615 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:04.230890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:04.231625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:04.258644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.261718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.262595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.263705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.264195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.264637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.529039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.563086 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-00835785-cbd2-42c0-ba2a-663e8c602590 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.450030 Aug 30 04:20:04.566269 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1257/2573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:04 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:04.586717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:04.587992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:04.607043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.607876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.608782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.615569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.619035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.619654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.665857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.676246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.684408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.688161 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9da41d8d-e54e-402e-be2c-d43079d269ed tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.459714 Aug 30 04:20:04.693644 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1317/2574] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:04 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:04.704801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:04.706395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:04.729411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.729928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.731897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.732697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:04.733170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:04.733645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:04.736788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:04.932317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:04.934800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:04.956396 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee8ada64-b1eb-4f2d-8626-e623af44c5bf tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.385140 Aug 30 04:20:04.969872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:04.970119 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1258/2575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:04 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:04.975732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:04.976257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:05.016000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.016520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.016976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.023918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.026142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.026625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.142628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:05.240363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.259596 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3cbe3691-ca76-442b-ae55-e3336424b7f5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.561137 Aug 30 04:20:05.260437 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1318/2576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:04 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:05.273273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:05.278246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:05.305464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.311882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.314328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.315898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.319257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.320652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.414448 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2774a537-cc13-4142-bb3b-5053357b1e50 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "DELETE /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 204 len: 0 microversion: 2.1 time: 0.451410 Aug 30 04:20:05.423687 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1259/2577] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:04 2022] DELETE /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:05.433536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-plugged", "status": "completed", "tag": "c60ef681-2421-4c79-99dc-cb517437fdc6"}, {"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-plugged", "status": "completed", "tag": "42bcc2a6-99c0-41c1-8d7e-96b497240ef7"}, {"server_uuid": "2899b822-bdd2-4731-a44a-f67901ecae9e", "name": "network-vif-plugged", "status": "completed", "tag": "e86ad729-5dbf-4d1e-b624-c169f51ed42c"}, {"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-plugged", "status": "completed", "tag": "78e02f42-39d7-40d5-90cf-ba73041ae462"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:05.462098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:05.464860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.467126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.468532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.496287 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Creating event network-vif-plugged:c60ef681-2421-4c79-99dc-cb517437fdc6 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:05.497135 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Creating event network-vif-plugged:42bcc2a6-99c0-41c1-8d7e-96b497240ef7 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:05.497875 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Creating event network-vif-plugged:e86ad729-5dbf-4d1e-b624-c169f51ed42c for instance 2899b822-bdd2-4731-a44a-f67901ecae9e on n-h1-854925-5 Aug 30 04:20:05.499246 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] Creating event network-vif-plugged:78e02f42-39d7-40d5-90cf-ba73041ae462 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:05.512331 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fd4a9ff0-82e2-4eb2-b956-574659417b60 req-2300e6d3-cbe5-46f9-ae8f-e931872701f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.087106 Aug 30 04:20:05.513914 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1260/2578] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:05.519924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b7f669d-82b1-4ff4-976c-a41510a21bb2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969434a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:05.584942 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b7f669d-82b1-4ff4-976c-a41510a21bb2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.069386 Aug 30 04:20:05.593819 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1261/2579] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:05 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:05.600428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:05.602670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:05.624817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.625456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.626346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.627151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.627682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.628340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.833235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:05.882841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.901695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.903481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:05.910703 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2237149b-c214-47e6-a139-2a3eca9b9708 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.648252 Aug 30 04:20:05.926171 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1319/2580] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:05 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:05.927686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:05.928588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:05.951064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.952068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.952517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:05.953269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:05.966314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:05.968382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.062195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.119813 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f93d9af-17c1-4a68-9ac2-cebf7425a7cc tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1470 microversion: 2.1 time: 0.523890 Aug 30 04:20:06.136607 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1262/2581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:05 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1470 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:06.143374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.144444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.151884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.152595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.153247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.154634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.178951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.185078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.474528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.485955 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a1b42f7b-5754-4c44-8a96-a96ea3bd5f06 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.562961 Aug 30 04:20:06.488907 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1320/2582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:05 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:06.497571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.498589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.522227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.524505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.525199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.531200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.532009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.533286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.579512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.596861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.611388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:06.614945 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc8b9733-4cb3-4494-bb1a-05900a8630ea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.475004 Aug 30 04:20:06.623572 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1263/2583] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:06 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:06.641902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:06.643942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:06.695451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.696184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.704038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:06.704866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:06.705376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:06.705830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.156572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:07.173668 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d6c23589-543f-4b08-8775-61881fcc0d79 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.677117 Aug 30 04:20:07.175163 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1321/2584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:06 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:07.188113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d87186d6-a07f-4929-a575-4f3871efc03a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969585dc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:07.268809 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d87186d6-a07f-4929-a575-4f3871efc03a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.092045 Aug 30 04:20:07.277127 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1322/2585] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:07 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:07.285684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:07.289991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:07.321674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.326831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.328760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:07.332816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.334077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.334925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.335671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.347132 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-867f8396-e04c-461f-82bc-3e05d4b8961b tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.722111 Aug 30 04:20:07.348712 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1264/2586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:06 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:07.355836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:07.356899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:07.382708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.383957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.388160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:07.391113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:07.394044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:07.395132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.141458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:08.225809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.228698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:08.241581 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-96433c15-6569-461c-847a-8544c7f6d5ae tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1470 microversion: 2.1 time: 0.891165 Aug 30 04:20:08.267216 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1265/2587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:07 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1470 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:08.283557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.304780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:08.311418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:08.312826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.323849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.325104 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb26843e-94d9-4135-ac1f-88b3754e4d03 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 1.044956 Aug 30 04:20:08.325696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1323/2588] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:07 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:08.356801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.358718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.361570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.362978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:08.366167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.367065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:08.370293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.370992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.394239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.399027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.399886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.410270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.412812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.413276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:08.863505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:08.919103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1383a32-b77c-41e5-a670-e28cc8f9e9a1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.647275 Aug 30 04:20:08.939423 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1266/2589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:08 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:08.962068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e371eb12-3e65-401e-9316-f5a5e8942139 req-77823ae1-acd3-4dfb-80af-00cd7aba971f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-plugged", "status": "completed", "tag": "7aabe1a2-bce3-41a4-adf6-b7b685b254d8"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:08.986944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e371eb12-3e65-401e-9316-f5a5e8942139 req-77823ae1-acd3-4dfb-80af-00cd7aba971f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:08.987724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e371eb12-3e65-401e-9316-f5a5e8942139 req-77823ae1-acd3-4dfb-80af-00cd7aba971f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:08.988469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e371eb12-3e65-401e-9316-f5a5e8942139 req-77823ae1-acd3-4dfb-80af-00cd7aba971f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.005142 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e371eb12-3e65-401e-9316-f5a5e8942139 req-77823ae1-acd3-4dfb-80af-00cd7aba971f service nova] Creating event network-vif-plugged:7aabe1a2-bce3-41a4-adf6-b7b685b254d8 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:09.015114 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e371eb12-3e65-401e-9316-f5a5e8942139 req-77823ae1-acd3-4dfb-80af-00cd7aba971f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070642 Aug 30 04:20:09.016416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1267/2590] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:09.023183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.024208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:09.031922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.032737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.033556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.034504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.035171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.035826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.046625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.067084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.074955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.076334 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf6c6994-a097-4c3c-b4a3-cffdd6622241 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.740892 Aug 30 04:20:09.076932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1324/2591] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:08 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:09.101905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b56807b-6327-48a2-bd46-cf6151f8c52b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96958a160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.202220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b56807b-6327-48a2-bd46-cf6151f8c52b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.124180 Aug 30 04:20:09.203764 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1325/2592] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:09.222701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.227929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:09.243923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.244934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.251511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.252998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.254140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.256497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.744832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.760750 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a2b39dbe-f9f1-4b96-8343-25896d44dfd2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.737877 Aug 30 04:20:09.766762 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1268/2593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:09.795844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:09.797924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.800697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:09.805442 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb4e3ae4-8cb4-48f3-8313-cbaa51ca1319 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.592111 Aug 30 04:20:09.818292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.820115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.833919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.833919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.833919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.833919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.838729 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1326/2594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:09.857027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:09.866908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:09.887590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.888243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.888908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:09.897925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:09.898440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:09.898887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.415300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.437821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.439867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.446818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.449066 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e453dd8c-3e93-405a-a84d-3a7f782f626a tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 200 len: 1470 microversion: 2.1 time: 0.680833 Aug 30 04:20:10.452685 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f763b18d-5acd-455f-8530-fe0ed6b3e940 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.612176 Aug 30 04:20:10.453990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1269/2595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 1470 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:10.462658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:10.467708 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1327/2596] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:09 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:10.470672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:10.483932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:10.485609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:10.499772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.501158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.503127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.503306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.504154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.505973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.507771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.509437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.509896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.510647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:10.511115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:10.511713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:10.977671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:10.992144 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a118e143-b12e-465b-929c-b4340355298f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.536890 Aug 30 04:20:11.009694 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1270/2597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:10 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:11.023076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9de27cba-bdd4-426b-8e10-3a5c77218af3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969fbcaf0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.105577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.106513 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9de27cba-bdd4-426b-8e10-3a5c77218af3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.095414 Aug 30 04:20:11.115149 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1271/2598] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:11.121805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d8cc6f19-a260-4db7-91c2-e214faaba596 req-8946f5dd-3e4c-442d-997a-62d79f287e15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66133a4d-4ffd-464c-93c9-112e162e79ff", "name": "network-vif-deleted", "tag": "99720d13-124d-4994-b4c7-ecafbf4f46fd"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:11.133563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.142120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d8cc6f19-a260-4db7-91c2-e214faaba596 req-8946f5dd-3e4c-442d-997a-62d79f287e15 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.143459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d8cc6f19-a260-4db7-91c2-e214faaba596 req-8946f5dd-3e4c-442d-997a-62d79f287e15 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.144954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.145197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d8cc6f19-a260-4db7-91c2-e214faaba596 req-8946f5dd-3e4c-442d-997a-62d79f287e15 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.147882 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9c5fbf9-a1a9-46e2-b9be-b9fbc00444b0 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.678839 Aug 30 04:20:11.148755 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1328/2599] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:10 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:11.160379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.161237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:11.176790 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d8cc6f19-a260-4db7-91c2-e214faaba596 req-8946f5dd-3e4c-442d-997a-62d79f287e15 service nova] Creating event network-vif-deleted:99720d13-124d-4994-b4c7-ecafbf4f46fd for instance 66133a4d-4ffd-464c-93c9-112e162e79ff on n-h1-854925-5 Aug 30 04:20:11.177367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.178194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.178873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.181104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.182940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.183703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.193212 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d8cc6f19-a260-4db7-91c2-e214faaba596 req-8946f5dd-3e4c-442d-997a-62d79f287e15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076421 Aug 30 04:20:11.194363 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1272/2600] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:11.208081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.208787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:11.240304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.241152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.241970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.243128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.243892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.244468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.915447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.919019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:11.924756 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-022820db-315c-451b-8f71-358523bf80fc tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.721645 Aug 30 04:20:11.927551 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae6b749d-bd05-4eae-8f97-6f367f93c37e tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.775456 Aug 30 04:20:11.945603 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1329/2601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:11.946724 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1273/2602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:11.952427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-63ce5fc7-eda7-418b-a1af-e75a3934273b req-ac3fcfd2-2d9f-4ae2-8b8a-536e2b505ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-plugged", "status": "completed", "tag": "1e12d725-0a04-4649-8cbe-5b9d9b18db68"}, {"server_uuid": "7b808ff1-027c-46e7-bc13-a1ee270c686d", "name": "network-vif-plugged", "status": "completed", "tag": "255c58a9-96b9-4882-8308-87a044f6c817"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:11.973341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:11.973995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 66133a4d-4ffd-464c-93c9-112e162e79ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:11.977452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63ce5fc7-eda7-418b-a1af-e75a3934273b req-ac3fcfd2-2d9f-4ae2-8b8a-536e2b505ea2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.978956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63ce5fc7-eda7-418b-a1af-e75a3934273b req-ac3fcfd2-2d9f-4ae2-8b8a-536e2b505ea2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.979506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63ce5fc7-eda7-418b-a1af-e75a3934273b req-ac3fcfd2-2d9f-4ae2-8b8a-536e2b505ea2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:11.990367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:11.996742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:11.997212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.002879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.003394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.003959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.023691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] HTTP exception thrown: Instance 66133a4d-4ffd-464c-93c9-112e162e79ff could not be found. Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Request method failure captured: Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff HTTP/1.1 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY9e8lhe91RBo3XPYUtr95TrKElUtpu4ovcxMDOMUO86O9lRGxIT30IconGzV0iQMQQWpib1MDU9TmmNvpDI51gOjFpcJAuHvTDSqSwcWzxFlFSGM-7M8fDJVLc66fcoxfTaLzNQunlPxHnK2dugxomfjsvm1xlTV8mRwvIEyVoXb68 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 460e179136b34ed68a9f005d5963d607 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_460e179136b34ed68a9f005d5963d607", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/460e179136b34ed68a9f005d5963d607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/460e179136b34ed68a9f005d5963d607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/460e179136b34ed68a9f005d5963d607"}]}] Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 460e179136b34ed68a9f005d5963d607 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersAdminTestJSON-1702572658-project Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b52ad7ed970a42e085efd79148788b28 Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersAdminTestJSON-1702572658-project Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 66133a4d-4ffd-464c-93c9-112e162e79ff could not be found. Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '66133a4d-4ffd-464c-93c9-112e162e79ff'} Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66133a4d-4ffd-464c-93c9-112e162e79ff could not be found. Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66133a4d-4ffd-464c-93c9-112e162e79ff could not be found. Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:12.025673 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:12.030539 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:12.030539 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:12.030539 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:12.030539 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:12.030539 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:12.030539 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66133a4d-4ffd-464c-93c9-112e162e79ff could not be found. Aug 30 04:20:12.030539 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:12.036199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Returning 404 to user: Instance 66133a4d-4ffd-464c-93c9-112e162e79ff could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:12.038020 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d61133d0-a502-44a6-9fce-e05172a5bd76 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff" status: 404 len: 111 microversion: 2.1 time: 0.089952 Aug 30 04:20:12.043205 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1274/2603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:11 2022] GET /compute/v2.1/servers/66133a4d-4ffd-464c-93c9-112e162e79ff => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:12.049596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.050443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.057508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.058380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.058985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.059856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.063223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.064013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.396953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-63ce5fc7-eda7-418b-a1af-e75a3934273b req-ac3fcfd2-2d9f-4ae2-8b8a-536e2b505ea2 service nova] Creating event network-vif-plugged:1e12d725-0a04-4649-8cbe-5b9d9b18db68 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:12.398126 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-63ce5fc7-eda7-418b-a1af-e75a3934273b req-ac3fcfd2-2d9f-4ae2-8b8a-536e2b505ea2 service nova] Creating event network-vif-plugged:255c58a9-96b9-4882-8308-87a044f6c817 for instance 7b808ff1-027c-46e7-bc13-a1ee270c686d on n-h2-854925-5 Aug 30 04:20:12.408060 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-63ce5fc7-eda7-418b-a1af-e75a3934273b req-ac3fcfd2-2d9f-4ae2-8b8a-536e2b505ea2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.460984 Aug 30 04:20:12.410017 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1330/2604] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:12.464266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.465865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.486341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.487196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.488014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.489169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.492131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.493298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.682269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.707733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.710238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.711872 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0fa3e743-b9f2-45bd-9d52-090a4e5679ac tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.667303 Aug 30 04:20:12.737310 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1275/2605] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:12.747666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.749079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:12.755997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.757083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.758072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.759092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:12.760299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:12.760966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:12.804167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:12.978193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-392ae5ef-927c-45ea-a540-4982c8de92b7 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 204 len: 0 microversion: 2.1 time: 0.238992 Aug 30 04:20:12.982026 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1276/2606] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:12 2022] DELETE /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:12.984179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:12.985703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-57559bfe-6b0a-4788-9c3d-12318cf68768 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9699fbaf0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:12.998962 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-430f2646-5cd8-4662-92a0-ffefc375fd59 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.587044 Aug 30 04:20:13.001170 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1331/2607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:13.007940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:13.008735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:13.038116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.039241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.040329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.041600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.042396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.043194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.069228 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-57559bfe-6b0a-4788-9c3d-12318cf68768 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.087336 Aug 30 04:20:13.070204 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1277/2608] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:12 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:13.078500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:13.080600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:13.092812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.093629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.094997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.095903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.097050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.097675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.663080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:13.674663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:13.676414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:13.680404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7d6c552-7003-4cfb-a7c6-f79f33c72cc1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.677502 Aug 30 04:20:13.682404 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1332/2609] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:13 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:13.698721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:13.702407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:13.703640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:13.717405 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b4765201-46c0-48af-b750-add60bedaaf5 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.645467 Aug 30 04:20:13.718003 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1278/2610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:13 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:13.723530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:13.725934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:13.740726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.741481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.742222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.754700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.755798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.756478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.756631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.757476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.758085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:13.758995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:13.759814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:13.763279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.072253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.093585 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2645d5a2-ad9b-496d-ac44-6ed8841db0ad tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.405843 Aug 30 04:20:14.094561 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1333/2611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:13 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:14.102645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.103610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:14.125815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.126652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.127447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.128412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.130602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.131602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.148546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.164601 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a6c7417d-c92b-4512-94e6-fb7c63354dad tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1469 microversion: 2.1 time: 0.444551 Aug 30 04:20:14.165943 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1279/2612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:13 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1469 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:14.173253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.179025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:14.196910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.202434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.203144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.204058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.204682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.205278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.788069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.817082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.822971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.823332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:14.825165 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ddbe6d8d-a838-4a9b-95df-0561a75af133 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.728753 Aug 30 04:20:14.832532 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e5bd567-66ad-48c4-ad86-3564368a9245 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.665331 Aug 30 04:20:14.839739 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1334/2613] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:14.840558 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1280/2614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:14.852485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86db192c-83b2-47df-a489-4d689555b16a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96973db80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.853283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2c9ea24e-77d4-4e2f-8409-f035896e8345 req-953cc4df-6891-4747-8c22-fe5d36401372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-plugged", "status": "completed", "tag": "d58eca3a-311c-4ff2-aa27-f5391e5e4bad"}, {"server_uuid": "b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a", "name": "network-vif-plugged", "status": "completed", "tag": "8b682dba-46dd-4f89-9e95-9d9a105fd4de"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:14.873723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2c9ea24e-77d4-4e2f-8409-f035896e8345 req-953cc4df-6891-4747-8c22-fe5d36401372 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.874455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2c9ea24e-77d4-4e2f-8409-f035896e8345 req-953cc4df-6891-4747-8c22-fe5d36401372 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.875062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2c9ea24e-77d4-4e2f-8409-f035896e8345 req-953cc4df-6891-4747-8c22-fe5d36401372 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.920581 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2c9ea24e-77d4-4e2f-8409-f035896e8345 req-953cc4df-6891-4747-8c22-fe5d36401372 service nova] Creating event network-vif-plugged:d58eca3a-311c-4ff2-aa27-f5391e5e4bad for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:14.923230 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86db192c-83b2-47df-a489-4d689555b16a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.075548 Aug 30 04:20:14.925054 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1335/2615] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:14.925668 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2c9ea24e-77d4-4e2f-8409-f035896e8345 req-953cc4df-6891-4747-8c22-fe5d36401372 service nova] Creating event network-vif-plugged:8b682dba-46dd-4f89-9e95-9d9a105fd4de for instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a on n-h2-854925-5 Aug 30 04:20:14.937654 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2c9ea24e-77d4-4e2f-8409-f035896e8345 req-953cc4df-6891-4747-8c22-fe5d36401372 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094624 Aug 30 04:20:14.940601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.941066 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1281/2616] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:14.942506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:14.948861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:14.952734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.953882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:14.954323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.954898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.955844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.956478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.957066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.970516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.971212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.971973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:14.974556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:14.975243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:14.976917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.427028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:15.440593 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c909ecbb-20db-4e62-9ddb-37865f7cddd1 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.497942 Aug 30 04:20:15.448478 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1282/2617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:15.453583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:15.454201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:15.468313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.468813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.469250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.475847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.478336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.478945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.648753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:15.660882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:15.666650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:15.671647 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a1552b05-7f59-48cf-8285-73012ee782d2 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.744535 Aug 30 04:20:15.672742 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1336/2618] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:14 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:15.678773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:15.685557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:15.703780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.707976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.708611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.712330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.713025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.713780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.821365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:15.835581 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e186b40-b410-4ba6-a2b1-824a813abee5 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.385691 Aug 30 04:20:15.836200 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1283/2619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:15 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:15.853125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:15.853787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:15.867116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.868123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.868721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:15.869722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:15.870353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:15.870949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.254847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:16.291429 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d4b38d0-57d2-400f-8772-8477bbb1785e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1469 microversion: 2.1 time: 0.617386 Aug 30 04:20:16.298780 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1337/2620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:15 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1469 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:16.312070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:16.325965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:16.354354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.354868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.355315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.356044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.356939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.356939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.440989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:16.456219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:16.478075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:16.491542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:16.497460 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8243432d-c469-48a1-9a66-68e25fdb3bda tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1878 microversion: 2.42 time: 0.647989 Aug 30 04:20:16.498873 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1284/2621] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:15 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1878 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:16.508472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c136a5a3-c3b4-455a-9295-3c4c6cf145da tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96942ddc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:16.672626 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c136a5a3-c3b4-455a-9295-3c4c6cf145da tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.171953 Aug 30 04:20:16.679821 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1285/2622] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:16 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:16.686929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:16.687582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:16.706374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.707027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.709071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.711449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.712056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.712507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:16.764868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:16.815715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:16.832810 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b864338-d68a-46fa-8405-6e8af2304834 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.529995 Aug 30 04:20:16.849493 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1338/2623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:16 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:16.886952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4365fe35-8974-4717-8e70-59890d8e6495 req-f72dd08b-0114-4763-9993-4a787db146ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b691652-2141-4fa3-b3e9-a8116741d2e4", "name": "network-vif-deleted", "tag": "b408edb4-672e-43d9-a2d4-0d795a269662"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:16.954302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4365fe35-8974-4717-8e70-59890d8e6495 req-f72dd08b-0114-4763-9993-4a787db146ca service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:16.957974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4365fe35-8974-4717-8e70-59890d8e6495 req-f72dd08b-0114-4763-9993-4a787db146ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:16.972922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4365fe35-8974-4717-8e70-59890d8e6495 req-f72dd08b-0114-4763-9993-4a787db146ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.050900 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4365fe35-8974-4717-8e70-59890d8e6495 req-f72dd08b-0114-4763-9993-4a787db146ca service nova] Creating event network-vif-deleted:b408edb4-672e-43d9-a2d4-0d795a269662 for instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 on n-h1-854925-5 Aug 30 04:20:17.086387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4365fe35-8974-4717-8e70-59890d8e6495 req-f72dd08b-0114-4763-9993-4a787db146ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239216 Aug 30 04:20:17.092426 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1339/2624] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:17.120437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:17.142239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:17.162449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.162964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.163413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.164131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.164596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.165032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.174148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:17.183148 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-379ec6d0-c2d2-498c-bb28-e6ddae0a6428 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1317 microversion: 2.1 time: 0.506174 Aug 30 04:20:17.188282 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1286/2625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:16 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:17.198864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:17.206100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:17.223182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.223970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.224581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.229454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.230207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.230839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.559807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:17.578103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-318d4b94-ef4f-4fdb-b2e1-67c9dba123af tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 0.387900 Aug 30 04:20:17.595410 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1287/2626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:17 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:17.611620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fc692ea9-2519-4434-938e-44a3d17d54c9 req-a5459bdb-d6a9-48a2-9e22-e0b453e30f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81caf73f-e9ba-4158-8a8e-19d691eff9cc", "name": "network-vif-plugged", "status": "completed", "tag": "cfdc4e9c-9658-42e2-add8-81e3d8e259ac"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:17.628509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fc692ea9-2519-4434-938e-44a3d17d54c9 req-a5459bdb-d6a9-48a2-9e22-e0b453e30f76 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.629167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fc692ea9-2519-4434-938e-44a3d17d54c9 req-a5459bdb-d6a9-48a2-9e22-e0b453e30f76 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.629714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fc692ea9-2519-4434-938e-44a3d17d54c9 req-a5459bdb-d6a9-48a2-9e22-e0b453e30f76 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.692412 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fc692ea9-2519-4434-938e-44a3d17d54c9 req-a5459bdb-d6a9-48a2-9e22-e0b453e30f76 service nova] Creating event network-vif-plugged:cfdc4e9c-9658-42e2-add8-81e3d8e259ac for instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc on n-h1-854925-5 Aug 30 04:20:17.710176 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fc692ea9-2519-4434-938e-44a3d17d54c9 req-a5459bdb-d6a9-48a2-9e22-e0b453e30f76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111459 Aug 30 04:20:17.712617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1288/2627] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:17.726665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:17.727386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:17.747228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.751350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.751878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.752630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.753106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.753637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.792057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:17.809119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:17.815594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:17.819799 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27f7da46-ccf8-4cce-867a-4d390912bebd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.715948 Aug 30 04:20:17.825786 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1340/2628] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:17 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:17.840338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:17.842655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:17.864038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.867558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.868352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.870673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.875239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.876322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:17.877527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:17.878320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:17.879618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lazy-loading 'fault' on Instance uuid 3b691652-2141-4fa3-b3e9-a8116741d2e4 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:17.881787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.018116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:18.038886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a05abd31-d2d0-455d-a3b8-a6bfadf3ef3c tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 200 len: 1303 microversion: 2.1 time: 0.321239 Aug 30 04:20:18.045802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1289/2629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:17 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 1303 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:18.075073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2019d09-9579-45ba-8c25-8cbcfd5f892e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9694461f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:18.185960 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2019d09-9579-45ba-8c25-8cbcfd5f892e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.135131 Aug 30 04:20:18.193566 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1290/2630] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:18 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:18.209576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:18.210512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:18.227946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.229459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.232361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.234727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.235364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.238033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.476841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:18.499227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:18.501663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:18.508805 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-63bcbf8f-4f39-4fe1-90a4-33e9772dce34 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2833 microversion: 2.42 time: 0.681011 Aug 30 04:20:18.510427 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1341/2631] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:17 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2833 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:18.523210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:18.524992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:18.541309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.542239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.542906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.543929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.545300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.548445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.615431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:18.629410 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a378ec2a-0736-4932-984a-95f17c920a65 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.430981 Aug 30 04:20:18.630496 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1291/2632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:18 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:18.642695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:18.643801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:18.650990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.651982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.652577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.653503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.655104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.656638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.829612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aca5ed35-7194-45bf-beef-5d85e846502f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.197177 Aug 30 04:20:18.840286 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1292/2633] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 04:20:18 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7/os-interface => generated 1830 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:18.845787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:18.846437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:18.860995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.861546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.861992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:18.862761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:18.868284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:18.868534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.715041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:19.730180 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0d774542-d51f-4233-b140-9b8f5c1def44 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1505 microversion: 2.1 time: 1.217174 Aug 30 04:20:19.734742 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1342/2634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:18 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1505 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:19.744921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:19.745992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:19.769465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.770541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.771642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.774069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.774783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.775806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.876956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:19.928859 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a12e4dbb-2793-4aec-9b2d-39af00d02138 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1315 microversion: 2.1 time: 1.083823 Aug 30 04:20:19.947332 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1293/2635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:18 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1315 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:19.954889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:19.955568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 3b691652-2141-4fa3-b3e9-a8116741d2e4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:19.966863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.967376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.967868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:19.968625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:19.969198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:19.969875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.009392 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] HTTP exception thrown: Instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 could not be found. Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Request method failure captured: Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 HTTP/1.1 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY9e8lhe91RBo3XPYUtr95TrKElUtpu4ovcxMDOMUO86O9lRGxIT30IconGzV0iQMQQWpib1MDU9TmmNvpDI51gOjFpcJAuHvTDSqSwcWzxFlFSGM-7M8fDJVLc66fcoxfTaLzNQunlPxHnK2dugxomfjsvm1xlTV8mRwvIEyVoXb68 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 460e179136b34ed68a9f005d5963d607 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_460e179136b34ed68a9f005d5963d607", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/460e179136b34ed68a9f005d5963d607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/460e179136b34ed68a9f005d5963d607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/460e179136b34ed68a9f005d5963d607"}]}] Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 460e179136b34ed68a9f005d5963d607 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersAdminTestJSON-1702572658-project Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b52ad7ed970a42e085efd79148788b28 Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersAdminTestJSON-1702572658-project Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 could not be found. Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '3b691652-2141-4fa3-b3e9-a8116741d2e4'} Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 could not be found. Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 could not be found. Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:20.009964 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 could not be found. Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Returning 404 to user: Instance 3b691652-2141-4fa3-b3e9-a8116741d2e4 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:20.014382 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59ec201c-1130-4c35-b79f-4b985c980569 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4" status: 404 len: 111 microversion: 2.1 time: 0.063401 Aug 30 04:20:20.018366 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1294/2636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:19 2022] GET /compute/v2.1/servers/3b691652-2141-4fa3-b3e9-a8116741d2e4 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:20.029419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-631deee2-78aa-48e6-b369-a00d7d79ff10 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969f78310>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.109320 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-631deee2-78aa-48e6-b369-a00d7d79ff10 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1411 microversion: 2.1 time: 0.089697 Aug 30 04:20:20.110104 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1295/2637] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:20 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:20.127774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.128400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.149528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.150156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.151375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.153943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.154549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.156084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.187643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:20.202726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:20.215327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:20.223375 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23f37e88-f4f1-4481-8715-176800b1de53 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.486763 Aug 30 04:20:20.229794 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1343/2638] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:19 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:20.237876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.244422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.257855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.259822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.261298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.262563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.264860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.266306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.355107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-439b5b08-c613-41d5-8073-e1805f2cde28 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a/ips" status: 200 len: 108 microversion: 2.1 time: 0.120980 Aug 30 04:20:20.360287 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1344/2639] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:20:20 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a/ips => generated 108 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:20.375791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.382065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.403202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.407215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.410377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.412272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.413514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.415947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.473262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:20.628266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:20.643551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6bc4345b-fedd-4d73-881d-124441263c67 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.528881 Aug 30 04:20:20.646897 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1296/2640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:20 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:20.672040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.673512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.699802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.700602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.701352 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c3bf4c1f-99ee-4439-8c88-a0c88222721e tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 204 len: 0 microversion: 2.1 time: 0.334812 Aug 30 04:20:20.703567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.704797 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1345/2641] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:20 2022] DELETE /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:20.705318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.706105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.706784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.720240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.723382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.741960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.742847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.744065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.745236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.746087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.747908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.788037 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-70945b0f-6e71-4edb-a033-13a218a4e92f tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a/ips" status: 200 len: 108 microversion: 2.1 time: 0.138686 Aug 30 04:20:20.792961 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1297/2642] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:20:20 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a/ips => generated 108 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:20.812998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.814087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.825080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.829600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.831383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.835350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.836081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.839754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.883986 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84d39c2d-41bb-4e62-8e69-242afee76dee tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a/ips/tempest-ServerAddressesTestJSON-442060294-network" status: 200 len: 93 microversion: 2.1 time: 0.083917 Aug 30 04:20:20.893230 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1298/2643] 10.222.0.27 () {58 vars in 1398 bytes} [Tue Aug 30 04:20:20 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a/ips/tempest-ServerAddressesTestJSON-442060294-network => generated 93 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:20:20.899693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:20.900251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:20.907082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.907561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.908169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.909112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:20.909746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:20.910324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:20.942664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:21.119104 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b59057d8-4637-4c93-8f95-40106be705a2 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 204 len: 0 microversion: 2.1 time: 0.218709 Aug 30 04:20:21.123449 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1299/2644] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:20 2022] DELETE /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:21.132066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:21.133792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:21.142051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.142571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.143123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.143847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.144420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.144876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.613958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:21.621760 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-252f4a72-265b-4164-a6a3-03a2841d5851 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1470 microversion: 2.1 time: 0.911987 Aug 30 04:20:21.639167 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1346/2645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:20 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1470 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:21.639167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e5d26216-52ab-43a8-bcbd-843b06803625 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969573430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:21.687440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:21.691921 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e5d26216-52ab-43a8-bcbd-843b06803625 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1420 microversion: 2.1 time: 0.063034 Aug 30 04:20:21.692819 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1347/2646] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:21 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:21.699230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:21.700114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:21.707842 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d906e088-5c22-4907-9413-a86b5775aecf tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1503 microversion: 2.1 time: 0.583054 Aug 30 04:20:21.708429 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1300/2647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:21 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:21.710014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.710687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.711316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.712195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.713169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.713800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.735755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:21.736500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:21.744405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.744897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.745370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:21.746142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:21.746631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:21.747062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.016928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:22.034635 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18004b21-4140-44ea-9bfd-2e4750a90a2b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1511 microversion: 2.1 time: 0.340398 Aug 30 04:20:22.045352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1348/2648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:21 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:22.045352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.045352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.051511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.051511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.051511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.051511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.051511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.051975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.183444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:22.203613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:22.209427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:22.212256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e891a950-3bc7-4a68-b879-0ab19d571fb8 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.485486 Aug 30 04:20:22.215426 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1301/2649] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:21 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:22.239854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c0f918a3-42bf-4ade-9637-5c3720db37af tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969424a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.334521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:22.335765 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c0f918a3-42bf-4ade-9637-5c3720db37af tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 200 len: 1420 microversion: 2.1 time: 0.115964 Aug 30 04:20:22.337981 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1302/2650] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:20:22 2022] GET /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:22.344804 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6fe6a37c-cff6-4011-ba4d-272aa9f83044 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.307935 Aug 30 04:20:22.350939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.353261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.353724 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1349/2651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:22 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:22.361041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.361685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-846bb1ef-03b4-4106-ba43-a24a89852ed4 req-6f4f3ea1-acf5-440d-9d41-6bf4f70cf52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "tag": "c60ef681-2421-4c79-99dc-cb517437fdc6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:22.366697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.369066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.370138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.373343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.374016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.390501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-846bb1ef-03b4-4106-ba43-a24a89852ed4 req-6f4f3ea1-acf5-440d-9d41-6bf4f70cf52d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.391236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-846bb1ef-03b4-4106-ba43-a24a89852ed4 req-6f4f3ea1-acf5-440d-9d41-6bf4f70cf52d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.392175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-846bb1ef-03b4-4106-ba43-a24a89852ed4 req-6f4f3ea1-acf5-440d-9d41-6bf4f70cf52d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.413626 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-846bb1ef-03b4-4106-ba43-a24a89852ed4 req-6f4f3ea1-acf5-440d-9d41-6bf4f70cf52d service nova] Creating event network-changed:c60ef681-2421-4c79-99dc-cb517437fdc6 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:20:22.421837 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-846bb1ef-03b4-4106-ba43-a24a89852ed4 req-6f4f3ea1-acf5-440d-9d41-6bf4f70cf52d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065894 Aug 30 04:20:22.422671 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1350/2652] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:22.436517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-de4de0ec-bbe7-48b7-ad15-2c6c4aecd33e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969544e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.482287 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-134ba26c-c014-441e-ad66-f8be652f23e0 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.136827 Aug 30 04:20:22.490133 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1303/2653] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Aug 30 04:20:22 2022] DELETE /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc/os-server-password => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:22.499006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.499895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.507631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.508254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.508811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.509935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.510633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.511168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.539840 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd97193f-313e-4f31-9536-34f073ad74d7 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.047709 Aug 30 04:20:22.541276 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1304/2654] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Aug 30 04:20:22 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc/os-server-password => generated 16 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:20:22.553606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.554278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.564432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.565527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.566639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.567461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.568347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.569024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.597950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:22.613358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:22.798326 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa4bd0dc-68f0-4be3-b292-5451be75093a tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "DELETE /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 204 len: 0 microversion: 2.1 time: 0.250058 Aug 30 04:20:22.804462 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1305/2655] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:22 2022] DELETE /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:20:22.822898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:22.826515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:22.845569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.846319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.848007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:22.850566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:22.852452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:22.854288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.179607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:23.193786 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-85957909-6f75-42a4-bd83-16682f4de6c3 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1470 microversion: 2.1 time: 0.390184 Aug 30 04:20:23.195501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1306/2656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:22 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1470 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:23.200843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:23.206067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:23.209125 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-de4de0ec-bbe7-48b7-ad15-2c6c4aecd33e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 204 len: 0 microversion: 2.1 time: 0.781393 Aug 30 04:20:23.213870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1351/2657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:22 2022] DELETE /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:23.215172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:23.220950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.221450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.221978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.222614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.222832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:23.223080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.223493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.224367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:23.235124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.236723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.237348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.238343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.238959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.239589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.631875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:23.640325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:23.646764 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c891359d-d262-4bb8-9d74-6f1472cf9605 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1509 microversion: 2.1 time: 0.449731 Aug 30 04:20:23.648025 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1307/2658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:23 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1509 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:23.653923 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab0ccd62-39f6-40ba-aee2-37bf9d2cfb3b tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1511 microversion: 2.1 time: 0.436705 Aug 30 04:20:23.655034 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1352/2659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:23 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:23.666553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:23.667430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:23.675568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:23.676282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:23.680805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.681581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.682691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.688252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.689066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.690425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.690624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.691367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.691534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.691998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.692266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.692505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.754690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:23.936786 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-812ee3d0-237d-4dfa-a01d-70b1c682f728 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 204 len: 0 microversion: 2.1 time: 0.286440 Aug 30 04:20:23.940484 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1308/2660] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:20:23 2022] DELETE /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:20:23.944063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:23.944833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:23.989791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.990342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.993694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:23.994457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:23.994941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:23.995383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.168642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:24.182217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:24.185893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:24.187195 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be0ec243-cbdc-450f-9af0-d3c558acf294 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.531082 Aug 30 04:20:24.196903 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1353/2661] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:23 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:24.202659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-eef10bb6-536b-4753-968d-0e6f525da47c req-f99c637e-9360-4fd6-8d91-40ec3c602532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a", "name": "network-vif-deleted", "tag": "8b682dba-46dd-4f89-9e95-9d9a105fd4de"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:24.217206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eef10bb6-536b-4753-968d-0e6f525da47c req-f99c637e-9360-4fd6-8d91-40ec3c602532 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.218514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eef10bb6-536b-4753-968d-0e6f525da47c req-f99c637e-9360-4fd6-8d91-40ec3c602532 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.219133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eef10bb6-536b-4753-968d-0e6f525da47c req-f99c637e-9360-4fd6-8d91-40ec3c602532 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.232963 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-eef10bb6-536b-4753-968d-0e6f525da47c req-f99c637e-9360-4fd6-8d91-40ec3c602532 service nova] Creating event network-vif-deleted:8b682dba-46dd-4f89-9e95-9d9a105fd4de for instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a on n-h2-854925-5 Aug 30 04:20:24.240208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-eef10bb6-536b-4753-968d-0e6f525da47c req-f99c637e-9360-4fd6-8d91-40ec3c602532 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041848 Aug 30 04:20:24.241440 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1354/2662] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:24.246958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1652722797", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "45f92f08-9d57-42f1-af99-23717f5e800c"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:24.273320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:24.285383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-93c6bc3b-090f-4ebe-952d-41691728139d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.345001 Aug 30 04:20:24.286579 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1309/2663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:23 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:24.291563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:24.292246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:24.302160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.302160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.302160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.303130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.303661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.304201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.328243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] validate_networks() for [('45f92f08-9d57-42f1-af99-23717f5e800c', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:20:24.587334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:24.597626 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-95fe0a85-9752-4ec0-bdbd-bd9b15bf7c78 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1470 microversion: 2.1 time: 0.309235 Aug 30 04:20:24.613937 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1310/2664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:24 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:24.673274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:24.674169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:24.682254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.683001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.683589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.684534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.685142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.685820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.915910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:24.929608 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-681949e6-5b68-40ac-80d6-7bd4fdb2edb6 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1509 microversion: 2.1 time: 0.261194 Aug 30 04:20:24.931456 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1311/2665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:24 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:24.939580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:24.940456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:24.948486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.949253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.949897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.952036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.953283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.953969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.970655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:20:24.971082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:20:24.971644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:20:24.972061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:20:24.972482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:20:24.985228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.985758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.986205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:24.987204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:24.988119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:24.988714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.001457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.002268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.003369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.004332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lazy-loading 'fault' on Instance uuid b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:25.013877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:20:25.033297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for user 689cafef29c449fd8dd8eae3ae2ab9c5 and project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:20:25.048053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:20:25.051829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:20:25.071682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:25.086624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51ee2870-12a7-4d4c-b55e-820253d3dd72 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1307 microversion: 2.1 time: 0.152865 Aug 30 04:20:25.107106 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1312/2666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:24 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:25.133860 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38941e48-d232-4331-94f9-d5c11c303857 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890959 Aug 30 04:20:25.135375 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1355/2667] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:20:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:20:25.148637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b4f32e2-5b44-4c22-8a97-740dc44e0ec4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:25.150622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4b4f32e2-5b44-4c22-8a97-740dc44e0ec4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:25.210554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:25.211187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:25.224831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.225465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b4f32e2-5b44-4c22-8a97-740dc44e0ec4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:25.226342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.226888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.227630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.228094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.228588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.238273 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b4f32e2-5b44-4c22-8a97-740dc44e0ec4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1208 microversion: 2.1 time: 0.096057 Aug 30 04:20:25.247501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1313/2668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:25 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1208 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:25.310854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:25.313460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:25.331905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.336477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.337115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.350297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.362342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.366005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.527799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:25.537311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:25.538792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:25.539985 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33b272c5-913e-4587-b2ab-58dca9457d50 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.333725 Aug 30 04:20:25.556447 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1356/2669] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:25 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:25.623386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:25.624311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:25.648266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.654573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.655291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.656070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.659936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.660545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.700665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:25.730252 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7030a004-e3fc-4b14-9062-cf4bdf1471c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.411177 Aug 30 04:20:25.746216 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1314/2670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:25 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:25.951964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:25.952588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:25.959283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.960015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.960211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:25.960919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:25.961429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:25.961869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.134636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:26.148325 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ba62baa4-9854-4d56-8650-af091e684213 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1470 microversion: 2.1 time: 0.531873 Aug 30 04:20:26.148955 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1357/2671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:25 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1470 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:26.164963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:26.165896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:26.182470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.185073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.188044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.188896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.194547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.195282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.214648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:26.243940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.245132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.245776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.246401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lazy-loading 'fault' on Instance uuid b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:26.379625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f30b57a5e44c4233914335ed406bb9fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ff9b2d7e924da187232d6efed3ac79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:26.392881 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a8ac9a2f-c34c-45a9-958a-60413962d850 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 200 len: 1307 microversion: 2.1 time: 0.242635 Aug 30 04:20:26.396519 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1358/2672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:26 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 1307 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:26.423047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:26.424204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:26.441403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:26.448395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:26.455877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.458683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.459305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.460151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.461910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.462488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.464498 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d05ea70b-4690-450c-9950-f035549a50b2 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1509 microversion: 2.1 time: 0.516099 Aug 30 04:20:26.468698 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1315/2673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:25 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1509 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:26.564279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:26.564915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:26.577964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.578741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.586663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.591654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.592188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.592653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.798129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:26.812393 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0eeddae6-7fa8-4af2-8372-c1feaeb8ad97 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1260 microversion: 2.1 time: 0.400741 Aug 30 04:20:26.828257 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1359/2674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:26 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1260 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:26.835581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:26.837429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:26.851398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.855966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.859433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:26.860707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:26.861492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:26.862441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.201692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:27.214877 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d6c9ebe-0b97-47cf-bd36-f8d5fca4e461 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.383204 Aug 30 04:20:27.216335 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1360/2675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:26 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:27.228045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6764c6ab-cc3a-45b3-8b94-4479de60b1b6 req-7b54da92-d2db-47f5-9adc-d97fa9fcfb13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2899b822-bdd2-4731-a44a-f67901ecae9e", "name": "network-vif-deleted", "tag": "e86ad729-5dbf-4d1e-b624-c169f51ed42c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:27.251588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6764c6ab-cc3a-45b3-8b94-4479de60b1b6 req-7b54da92-d2db-47f5-9adc-d97fa9fcfb13 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.252847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6764c6ab-cc3a-45b3-8b94-4479de60b1b6 req-7b54da92-d2db-47f5-9adc-d97fa9fcfb13 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.253650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:27.253903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6764c6ab-cc3a-45b3-8b94-4479de60b1b6 req-7b54da92-d2db-47f5-9adc-d97fa9fcfb13 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.268237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:27.269896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:27.276203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6764c6ab-cc3a-45b3-8b94-4479de60b1b6 req-7b54da92-d2db-47f5-9adc-d97fa9fcfb13 service nova] Creating event network-vif-deleted:e86ad729-5dbf-4d1e-b624-c169f51ed42c for instance 2899b822-bdd2-4731-a44a-f67901ecae9e on n-h1-854925-5 Aug 30 04:20:27.277847 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bab021e2-b144-4008-ac1a-80844336e447 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.712179 Aug 30 04:20:27.281554 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1316/2676] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:26 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:20:27.287681 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6764c6ab-cc3a-45b3-8b94-4479de60b1b6 req-7b54da92-d2db-47f5-9adc-d97fa9fcfb13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069373 Aug 30 04:20:27.289703 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1361/2677] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:27.293012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ac498555-e562-4681-90bf-e388e0d2198e req-cb05e54d-415e-4383-ae2d-52fefda6932e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81caf73f-e9ba-4158-8a8e-19d691eff9cc", "name": "network-vif-deleted", "tag": "cfdc4e9c-9658-42e2-add8-81e3d8e259ac"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:27.296206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:27.297155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:27.304496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.305535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.306146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.307081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.307806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.308464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.319202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ac498555-e562-4681-90bf-e388e0d2198e req-cb05e54d-415e-4383-ae2d-52fefda6932e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.323990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ac498555-e562-4681-90bf-e388e0d2198e req-cb05e54d-415e-4383-ae2d-52fefda6932e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.324705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ac498555-e562-4681-90bf-e388e0d2198e req-cb05e54d-415e-4383-ae2d-52fefda6932e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.353884 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ac498555-e562-4681-90bf-e388e0d2198e req-cb05e54d-415e-4383-ae2d-52fefda6932e service nova] Creating event network-vif-deleted:cfdc4e9c-9658-42e2-add8-81e3d8e259ac for instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc on n-h1-854925-5 Aug 30 04:20:27.373679 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ac498555-e562-4681-90bf-e388e0d2198e req-cb05e54d-415e-4383-ae2d-52fefda6932e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085189 Aug 30 04:20:27.377279 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1317/2678] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:27.419481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:27.420649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] [instance: b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:27.434899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.436325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.439764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.441168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.442809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.443851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.482890 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] HTTP exception thrown: Instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a could not be found. Aug 30 04:20:27.483495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b52ad7ed970a42e085efd79148788b28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '460e179136b34ed68a9f005d5963d607', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Request method failure captured: Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a HTTP/1.1 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_olRyr2vFEw_ouftTZTky7pN4a7GqoDbMahrbvEtxitOq4oD9EkE4hH2CR77xXnQG9haeW46u2DWX3ZS-BtoCBSEVJsF4jFfj7eki19wzHx1o1XH-vX4IVSuFJX-hIQnTzDfzoA2XqlB5wDcb8wv_R0TGy19i0tIIOYDX6_5yCBSk Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: c5ff9b2d7e924da187232d6efed3ac79 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerAddressesTestJSON-758251487 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c5ff9b2d7e924da187232d6efed3ac79", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c5ff9b2d7e924da187232d6efed3ac79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5ff9b2d7e924da187232d6efed3ac79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c5ff9b2d7e924da187232d6efed3ac79"}]}] Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerAddressesTestJSON-758251487 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: c5ff9b2d7e924da187232d6efed3ac79 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerAddressesTestJSON-758251487 Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerAddressesTestJSON-758251487-project Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f30b57a5e44c4233914335ed406bb9fd Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerAddressesTestJSON-758251487-project Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a could not be found. Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a'} Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a could not be found. Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a could not be found. Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:27.485885 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.490139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:27.490139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:27.490139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:27.490139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:27.490139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:27.490139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a could not be found. Aug 30 04:20:27.490139 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:27.494177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] Returning 404 to user: Instance b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:27.496030 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7af36e15-dcb1-409e-9cec-0d825a8378a2 tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 200 len: 1299 microversion: 2.1 time: 0.204819 Aug 30 04:20:27.498058 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34ccd664-94c5-48fe-881f-0b7b64cfbe77 tempest-ServerAddressesTestJSON-758251487 tempest-ServerAddressesTestJSON-758251487-project] 10.222.0.27 "GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a" status: 404 len: 111 microversion: 2.1 time: 0.081839 Aug 30 04:20:27.505477 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1362/2679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:27 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:27.507191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1318/2680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:27 2022] GET /compute/v2.1/servers/b9ee3cac-a1ff-4a4c-a54f-a0330fe1d09a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:27.515824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:27.522800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:27.550422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.552235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.553006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.554758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.556161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.557756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.644071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.644580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.645175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.645677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lazy-loading 'fault' on Instance uuid 81caf73f-e9ba-4158-8a8e-19d691eff9cc {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:27.844381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:27.844987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:27.857349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.858234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.858866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:27.859803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:27.860549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:27.861218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.223128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:28.234093 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d0acaba8-76b7-4b28-8691-5103a105563b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1266 microversion: 2.1 time: 0.396855 Aug 30 04:20:28.248031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1319/2681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:27 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:28.258120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a2e36c4d46f401086128df4cf77de60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7d386d020984cd38997b58d490df536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:28.272472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-427ee172-453d-43e9-89a1-cebe7452a4b0 req-ef53f53d-c1cb-4457-9528-03a92890b8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b808ff1-027c-46e7-bc13-a1ee270c686d", "name": "network-vif-unplugged", "status": "completed", "tag": "255c58a9-96b9-4882-8308-87a044f6c817"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:28.272940 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b683887-a34b-49e7-b13b-e5372318ba3e tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 200 len: 1305 microversion: 2.1 time: 0.769264 Aug 30 04:20:28.275384 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1363/2682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:27 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 1305 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:28.287516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:28.288400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:28.294898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-427ee172-453d-43e9-89a1-cebe7452a4b0 req-ef53f53d-c1cb-4457-9528-03a92890b8e7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.295797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-427ee172-453d-43e9-89a1-cebe7452a4b0 req-ef53f53d-c1cb-4457-9528-03a92890b8e7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.297646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-427ee172-453d-43e9-89a1-cebe7452a4b0 req-ef53f53d-c1cb-4457-9528-03a92890b8e7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.306607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.307117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.307620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.308543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.309100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.310190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.316338 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-427ee172-453d-43e9-89a1-cebe7452a4b0 req-ef53f53d-c1cb-4457-9528-03a92890b8e7 service nova] Creating event network-vif-unplugged:255c58a9-96b9-4882-8308-87a044f6c817 for instance 7b808ff1-027c-46e7-bc13-a1ee270c686d on n-h2-854925-5 Aug 30 04:20:28.326861 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-427ee172-453d-43e9-89a1-cebe7452a4b0 req-ef53f53d-c1cb-4457-9528-03a92890b8e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074286 Aug 30 04:20:28.328312 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1320/2683] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:28.335808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:28.337172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:28.349735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.351192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.352226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.354383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.354922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.355442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.394727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:28.875644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:28.890588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:28.894491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:28.898571 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6910dd56-896c-4632-9794-e72400cf2b7d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.568621 Aug 30 04:20:28.921233 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1321/2684] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:28 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:28.948591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:28.957886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] [instance: 2899b822-bdd2-4731-a44a-f67901ecae9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:28.971335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.973748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.974478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:28.975412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:28.976063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:28.976713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.007631 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] HTTP exception thrown: Instance 2899b822-bdd2-4731-a44a-f67901ecae9e could not be found. Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Request method failure captured: Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e HTTP/1.1 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY9e8lhe91RBo3XPYUtr95TrKElUtpu4ovcxMDOMUO86O9lRGxIT30IconGzV0iQMQQWpib1MDU9TmmNvpDI51gOjFpcJAuHvTDSqSwcWzxFlFSGM-7M8fDJVLc66fcoxfTaLzNQunlPxHnK2dugxomfjsvm1xlTV8mRwvIEyVoXb68 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 460e179136b34ed68a9f005d5963d607 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_460e179136b34ed68a9f005d5963d607", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/460e179136b34ed68a9f005d5963d607"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/460e179136b34ed68a9f005d5963d607"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/460e179136b34ed68a9f005d5963d607"}]}] Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 460e179136b34ed68a9f005d5963d607 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersAdminTestJSON-1702572658 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersAdminTestJSON-1702572658-project Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b52ad7ed970a42e085efd79148788b28 Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersAdminTestJSON-1702572658-project Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2899b822-bdd2-4731-a44a-f67901ecae9e could not be found. Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2899b822-bdd2-4731-a44a-f67901ecae9e'} Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2899b822-bdd2-4731-a44a-f67901ecae9e could not be found. Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2899b822-bdd2-4731-a44a-f67901ecae9e could not be found. Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:29.012687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.017027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:29.017027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:29.017027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:29.017027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:29.017027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:29.017027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2899b822-bdd2-4731-a44a-f67901ecae9e could not be found. Aug 30 04:20:29.017027 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.018566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] Returning 404 to user: Instance 2899b822-bdd2-4731-a44a-f67901ecae9e could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:29.023821 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d424eb8a-df2f-4db8-9a18-b00456f1a42f tempest-ServersAdminTestJSON-1702572658 tempest-ServersAdminTestJSON-1702572658-project] 10.222.0.27 "GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e" status: 404 len: 111 microversion: 2.1 time: 0.095381 Aug 30 04:20:29.029483 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1322/2685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:28 2022] GET /compute/v2.1/servers/2899b822-bdd2-4731-a44a-f67901ecae9e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:29.100751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:29.128430 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06507fa6-0508-4fde-9a21-caf1e4a305f7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.848465 Aug 30 04:20:29.130871 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1364/2686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:28 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:29.258008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:29.258735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:29.283665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.288362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.288928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.293650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.295696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.298383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.298971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:29.300180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] [instance: 81caf73f-e9ba-4158-8a8e-19d691eff9cc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:29.308559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.309677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.310323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.311436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.312064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.312774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.343529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] HTTP exception thrown: Instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc could not be found. Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Request method failure captured: Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc HTTP/1.1 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_hLGHdWiKqTDJLeDE8mWc09OwQ_5UJiVjkconMk35MLwinmWUkCmGiNLyw-nIuWb-CzyvbuIot7mPF_IykTF-y3WxGerZr9okGsg1GU3dUJbLrWV2DZMAikNzkFy-F_I755tY4mkHiA_HHiqkBo5NWYCUJaPxMFuwFLwWiz-LF5rQ Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e7d386d020984cd38997b58d490df536 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerPasswordTestJSON-176204040 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7d386d020984cd38997b58d490df536", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7d386d020984cd38997b58d490df536"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7d386d020984cd38997b58d490df536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7d386d020984cd38997b58d490df536"}]}] Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerPasswordTestJSON-176204040 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e7d386d020984cd38997b58d490df536 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerPasswordTestJSON-176204040 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerPasswordTestJSON-176204040-project Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0a2e36c4d46f401086128df4cf77de60 Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerPasswordTestJSON-176204040-project Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc could not be found. Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '81caf73f-e9ba-4158-8a8e-19d691eff9cc'} Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc could not be found. Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc could not be found. Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:29.345710 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.350928 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:29.350928 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:29.350928 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:29.350928 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:29.350928 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:29.350928 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc could not be found. Aug 30 04:20:29.350928 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:29.352891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] Returning 404 to user: Instance 81caf73f-e9ba-4158-8a8e-19d691eff9cc could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:29.354064 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-12797256-27de-4bb3-91e3-cbff437051c9 tempest-ServerPasswordTestJSON-176204040 tempest-ServerPasswordTestJSON-176204040-project] 10.222.0.27 "GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc" status: 404 len: 111 microversion: 2.1 time: 0.061650 Aug 30 04:20:29.356734 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1365/2687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:29 2022] GET /compute/v2.1/servers/81caf73f-e9ba-4158-8a8e-19d691eff9cc => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:20:29.532000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:29.546785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c1115f7e-0c21-44eb-8580-97fa25299e13 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1266 microversion: 2.1 time: 0.293389 Aug 30 04:20:29.548606 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1323/2688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:29 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:29.580924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6124f398-57d9-4fdd-a008-a7fb78731417 req-9b7bdea3-4248-44f2-ba1c-7265ec908a91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213f3941-dfe1-4ac4-bc21-e8eaae576cb9", "name": "network-vif-unplugged", "status": "completed", "tag": "1b16ff08-6ea0-4995-82bc-3fce03c11e3d"}, {"server_uuid": "7b808ff1-027c-46e7-bc13-a1ee270c686d", "name": "network-vif-deleted", "tag": "255c58a9-96b9-4882-8308-87a044f6c817"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:29.610212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6124f398-57d9-4fdd-a008-a7fb78731417 req-9b7bdea3-4248-44f2-ba1c-7265ec908a91 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.617045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6124f398-57d9-4fdd-a008-a7fb78731417 req-9b7bdea3-4248-44f2-ba1c-7265ec908a91 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.619290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6124f398-57d9-4fdd-a008-a7fb78731417 req-9b7bdea3-4248-44f2-ba1c-7265ec908a91 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.650568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6124f398-57d9-4fdd-a008-a7fb78731417 req-9b7bdea3-4248-44f2-ba1c-7265ec908a91 service nova] Creating event network-vif-unplugged:1b16ff08-6ea0-4995-82bc-3fce03c11e3d for instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 on n-h2-854925-5 Aug 30 04:20:29.651518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6124f398-57d9-4fdd-a008-a7fb78731417 req-9b7bdea3-4248-44f2-ba1c-7265ec908a91 service nova] Creating event network-vif-deleted:255c58a9-96b9-4882-8308-87a044f6c817 for instance 7b808ff1-027c-46e7-bc13-a1ee270c686d on n-h2-854925-5 Aug 30 04:20:29.681515 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6124f398-57d9-4fdd-a008-a7fb78731417 req-9b7bdea3-4248-44f2-ba1c-7265ec908a91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.103419 Aug 30 04:20:29.682370 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1366/2689] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:29.935019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:29.937171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:29.947485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.948440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.949058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:29.950712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:29.951326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:29.952553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:30.160068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:30.160953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:30.169780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:30.170272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:30.170938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:30.172431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:30.173059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:30.173686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:30.666098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:30.676520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:30.678588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:30.680048 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49af7e78-4db8-46f0-b093-b21e350ad34d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.753627 Aug 30 04:20:30.681185 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1324/2690] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:29 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:30.686453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:30.687349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:30.693977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:30.694860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:30.695547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:30.697055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:30.697808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:30.698498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:30.915193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:30.944652 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-953a8cff-4ad2-4e74-8f76-19cc1aa9b157 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1266 microversion: 2.1 time: 0.262205 Aug 30 04:20:30.945381 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1325/2691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:30 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:31.087927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:31.097908 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7b219b6-d780-4e63-923c-fb925267c077 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.947790 Aug 30 04:20:31.099223 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1367/2692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:30 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:31.703878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:31.704497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:31.711849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:31.712339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:31.712772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:31.713577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:31.714202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:31.714804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:31.778053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a1d4b065-6ffa-41b9-b2df-6d6b10920624 req-caae0dd9-663f-43dd-b798-a9bfafc85239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "213f3941-dfe1-4ac4-bc21-e8eaae576cb9", "tag": "1b16ff08-6ea0-4995-82bc-3fce03c11e3d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:31.797522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1d4b065-6ffa-41b9-b2df-6d6b10920624 req-caae0dd9-663f-43dd-b798-a9bfafc85239 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:31.799305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1d4b065-6ffa-41b9-b2df-6d6b10920624 req-caae0dd9-663f-43dd-b798-a9bfafc85239 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:31.799848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1d4b065-6ffa-41b9-b2df-6d6b10920624 req-caae0dd9-663f-43dd-b798-a9bfafc85239 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:31.824741 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a1d4b065-6ffa-41b9-b2df-6d6b10920624 req-caae0dd9-663f-43dd-b798-a9bfafc85239 service nova] Creating event network-changed:1b16ff08-6ea0-4995-82bc-3fce03c11e3d for instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 on n-h2-854925-5 Aug 30 04:20:31.843262 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a1d4b065-6ffa-41b9-b2df-6d6b10920624 req-caae0dd9-663f-43dd-b798-a9bfafc85239 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069728 Aug 30 04:20:31.843896 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1368/2693] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:20:31.970041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:31.972417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:31.985045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:31.985634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:31.986087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:31.986808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:31.987272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:31.989516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:32.815836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:32.827688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:32.829505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:32.831024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-effbc71a-e460-4036-b2f7-40309faf3fbe tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 1.131100 Aug 30 04:20:32.832089 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1326/2694] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:31 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:32.846047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:32.851611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:32.859630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:32.860052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:32.860493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:32.861208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:32.861801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:32.862239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:33.023559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:33.044485 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1721a09f-b6f8-4313-b293-2466e73fa441 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 1.080109 Aug 30 04:20:33.051343 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1369/2695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:31 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:33.346770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:33.365964 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8e16911-fcaa-40d2-a02c-255ec172c30b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.532376 Aug 30 04:20:33.367958 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1327/2696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:32 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:33.864705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:33.866246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:33.875834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:33.876620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:33.877967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:33.879335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:33.880111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:33.880740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.058165 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-444b7edb-1c3b-439b-8a63-058092f44660 tempest-TenantUsagesNegativeTestJSON-734026647 tempest-TenantUsagesNegativeTestJSON-734026647-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T04%3A20%3A33.838291&end=2022-08-31T04%3A20%3A33.838291" status: 404 len: 112 microversion: - time: 0.215748 Aug 30 04:20:34.058701 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1370/2697] 10.222.0.27 () {58 vars in 1316 bytes} [Tue Aug 30 04:20:33 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-29T04%3A20%3A33.838291&end=2022-08-31T04%3A20%3A33.838291 => generated 112 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:20:34.069810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab33c63c-6e1b-47f4-85dc-2ad630c1976e tempest-TenantUsagesNegativeTestJSON-734026647 tempest-TenantUsagesNegativeTestJSON-734026647-project-admin] Calling method '.version_select at 0x7fe96a39ad30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:34.076399 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ab33c63c-6e1b-47f4-85dc-2ad630c1976e tempest-TenantUsagesNegativeTestJSON-734026647 tempest-TenantUsagesNegativeTestJSON-734026647-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab33c63c-6e1b-47f4-85dc-2ad630c1976e tempest-TenantUsagesNegativeTestJSON-734026647 tempest-TenantUsagesNegativeTestJSON-734026647-project-admin] Request method failure captured: Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-simple-tenant-usage/e14a4dcca8c547dcaa9120a96deed463?start=2022-08-31T04%3A20%3A33.838291&end=2022-08-29T04%3A20%3A33.838291 HTTP/1.1 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZAR40FGqcAQyIZUDeg4Mic3bXv05D9Nnqn3XE6KvREYW7uolXWXs6GHPI4Z7X9ZeVXjsOKHubHiY95oXsInlAVpN91IbGOC1EY1UH8BuRLY0vXY225Ggc88pB7julTRGWMA_ZYVy2lmmttCxCrtbEx2OhBK6cHkx7JbIM-Qq2gmqyc Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 6ad4fe208e7d4f82bfb4af965a1db892 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-734026647 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6ad4fe208e7d4f82bfb4af965a1db892", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6ad4fe208e7d4f82bfb4af965a1db892"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6ad4fe208e7d4f82bfb4af965a1db892"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6ad4fe208e7d4f82bfb4af965a1db892"}]}] Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-734026647 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 6ad4fe208e7d4f82bfb4af965a1db892 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-734026647 Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TenantUsagesNegativeTestJSON-734026647-project-admin Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 98f3f7a4758d407fb7b7c833b1e194de Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-734026647-project-admin Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid start time. The start time cannot occur after the end time. Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'e14a4dcca8c547dcaa9120a96deed463'} Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 30 04:20:34.092117 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:34.098692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab33c63c-6e1b-47f4-85dc-2ad630c1976e tempest-TenantUsagesNegativeTestJSON-734026647 tempest-TenantUsagesNegativeTestJSON-734026647-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:34.099580 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab33c63c-6e1b-47f4-85dc-2ad630c1976e tempest-TenantUsagesNegativeTestJSON-734026647 tempest-TenantUsagesNegativeTestJSON-734026647-project-admin] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage/e14a4dcca8c547dcaa9120a96deed463?start=2022-08-31T04%3A20%3A33.838291&end=2022-08-29T04%3A20%3A33.838291" status: 400 len: 111 microversion: 2.1 time: 0.034164 Aug 30 04:20:34.100158 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1371/2698] 10.222.0.27 () {58 vars in 1412 bytes} [Tue Aug 30 04:20:34 2022] GET /compute/v2.1/os-simple-tenant-usage/e14a4dcca8c547dcaa9120a96deed463?start=2022-08-31T04%3A20%3A33.838291&end=2022-08-29T04%3A20%3A33.838291 => generated 111 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:20:34.108190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:34.111032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:34.126222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:34.126971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:34.127583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.128464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:34.129073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:34.129746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.387331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:34.404412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:34.406902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:34.408487 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a89b6bac-e700-4094-8819-cb0f3c3546fd tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.556789 Aug 30 04:20:34.431993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1328/2699] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:33 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:20:34.606669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbf0b5c1-6e83-4c46-9775-63fee8114ac7 tempest-TenantUsagesNegativeTestJSON-314276077 tempest-TenantUsagesNegativeTestJSON-314276077-project] Calling method '.version_select at 0x7fe96940d940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:34.611022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dbf0b5c1-6e83-4c46-9775-63fee8114ac7 tempest-TenantUsagesNegativeTestJSON-314276077 tempest-TenantUsagesNegativeTestJSON-314276077-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e459fc4f31d847efa0ce3024928d9a9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14a4dcca8c547dcaa9120a96deed463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbf0b5c1-6e83-4c46-9775-63fee8114ac7 tempest-TenantUsagesNegativeTestJSON-314276077 tempest-TenantUsagesNegativeTestJSON-314276077-project] Request method failure captured: Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T04%3A20%3A33.838291&end=2022-08-31T04%3A20%3A33.838291&detailed=1 HTTP/1.1 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZAQNvUS7a162luFWPHzcebCgLPUkHcvaH5ETU_sKbQr_hQ_RjyXRlzoiXTECZvcUjkWhPip--aXCD7PYrjCQKPj1NMm6V9YZ57ZDnNfBTLUpU_TRQZezc_ZSDE08swHcjFAv6N_rnpmKvp910QiUd9wfx2MjuV3OvtU9XRG-H3IVS8 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e14a4dcca8c547dcaa9120a96deed463 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-314276077 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e14a4dcca8c547dcaa9120a96deed463", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e14a4dcca8c547dcaa9120a96deed463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e14a4dcca8c547dcaa9120a96deed463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e14a4dcca8c547dcaa9120a96deed463"}]}] Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-314276077 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e14a4dcca8c547dcaa9120a96deed463 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-314276077 Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TenantUsagesNegativeTestJSON-314276077-project Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: e459fc4f31d847efa0ce3024928d9a9c Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-314276077-project Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: action_args: {} Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise self.value Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 30 04:20:34.617568 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 30 04:20:34.623282 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:34.625505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbf0b5c1-6e83-4c46-9775-63fee8114ac7 tempest-TenantUsagesNegativeTestJSON-314276077 tempest-TenantUsagesNegativeTestJSON-314276077-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:34.628399 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dbf0b5c1-6e83-4c46-9775-63fee8114ac7 tempest-TenantUsagesNegativeTestJSON-314276077 tempest-TenantUsagesNegativeTestJSON-314276077-project] 10.222.0.27 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T04%3A20%3A33.838291&end=2022-08-31T04%3A20%3A33.838291&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.193193 Aug 30 04:20:34.629201 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1329/2700] 10.222.0.27 () {58 vars in 1335 bytes} [Tue Aug 30 04:20:34 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-29T04%3A20%3A33.838291&end=2022-08-31T04%3A20%3A33.838291&detailed=1 => generated 123 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:34.642425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:34.645894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:34.660411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:34.661220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:34.661906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.662844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:34.670973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:34.671793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.735461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:34.759996 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c057fe11-4c86-4341-92bb-1c5c4a57f805 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.654350 Aug 30 04:20:34.768299 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1372/2701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:34 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:34.865779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-48df6418-0fa6-47e6-a6c1-fd3477d32510 req-5b480286-3927-468e-b338-0a5d7ab7c50e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ded16a4-47e1-44cc-8113-aa7538c0c786", "tag": "347553e6-ccd3-4b81-91f8-e6545b41a764"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:34.904744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-48df6418-0fa6-47e6-a6c1-fd3477d32510 req-5b480286-3927-468e-b338-0a5d7ab7c50e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:34.914748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-48df6418-0fa6-47e6-a6c1-fd3477d32510 req-5b480286-3927-468e-b338-0a5d7ab7c50e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:34.917107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-48df6418-0fa6-47e6-a6c1-fd3477d32510 req-5b480286-3927-468e-b338-0a5d7ab7c50e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:34.966825 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-48df6418-0fa6-47e6-a6c1-fd3477d32510 req-5b480286-3927-468e-b338-0a5d7ab7c50e service nova] Creating event network-changed:347553e6-ccd3-4b81-91f8-e6545b41a764 for instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 on n-h1-854925-5 Aug 30 04:20:34.981088 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-48df6418-0fa6-47e6-a6c1-fd3477d32510 req-5b480286-3927-468e-b338-0a5d7ab7c50e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119840 Aug 30 04:20:34.992490 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1373/2702] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:35.232734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:35.431437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:35.432538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:35.438138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:35.439159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:35.447127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:35.447776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:35.448321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:35.449156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:35.449895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:35.450433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:36.592838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:36.603099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a0af886-9d4f-4e8d-9427-0e1a534b97a6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 1.971393 Aug 30 04:20:36.604319 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1330/2703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:34 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:36.611665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:36.612604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:36.625568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:36.626745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:36.628066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:36.629059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:36.629733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:36.630545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:36.836382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:36.857463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:36.861024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:36.863168 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29cab3dc-0c5d-47ab-beed-18593bbb0833 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 1.432674 Aug 30 04:20:36.865256 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1374/2704] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:35 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:20:37.268927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:37.312679 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22ade442-5685-4829-8318-13d2fa3e9365 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.706979 Aug 30 04:20:37.327846 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1331/2705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:36 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:37.631740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:37.632602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:37.663408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:37.665392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:37.667113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:37.669839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:37.671899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:37.674407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:37.889146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:37.889839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:37.904176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:37.909237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:37.909862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:37.910634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:37.911120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:37.911563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:38.083346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:38.099187 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e25328cf-b0b5-4fb9-8f91-c697e9cdfb91 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.472453 Aug 30 04:20:38.115261 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1375/2706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:37 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:38.248337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:38.256978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:38.264564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:38.266160 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-130fd210-3b68-4906-bebc-95fc702e5b27 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.382759 Aug 30 04:20:38.270007 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1332/2707] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:37 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:38.341354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:38.342268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:38.364404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:38.365414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:38.366084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:38.368599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:38.369629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:38.372435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:38.664252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:38.675881 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4acc3b86-9fa3-4c83-99b1-bb29852245e6 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.341137 Aug 30 04:20:38.679957 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1376/2708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:38 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:39.144584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:39.149700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:39.182123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.184355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-620998368", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": "none"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:39.187746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.188420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.189874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.202806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.203605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.293392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:20:39.297195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:20:39.298135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:20:39.298878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:20:39.299631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:20:39.313675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.314666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.317409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.318938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.319710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.320440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.349604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Getting quotas for project 0eb06c960e3c49bbb8ba09bf518e61b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:20:39.368377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Getting quotas for user 83e508715c9443adb381ada40b383523 and project 0eb06c960e3c49bbb8ba09bf518e61b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:20:39.430584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:20:39.434721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:20:39.538589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:39.552998 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59069a80-9a91-40cf-96a1-91e04c5fd078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.430130 Aug 30 04:20:39.572164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1377/2709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:39 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:39.575566 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f1ef826-9660-45fc-9952-aca986dbce14 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.748726 Aug 30 04:20:39.576179 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1333/2710] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:20:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:20:39.583081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:39.583081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:39.588750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3ce76624-7236-4b45-8afe-a078c4ba4f56 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:39.591908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.592777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.593771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.594716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.594833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ce76624-7236-4b45-8afe-a078c4ba4f56 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:39.595428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.596067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.847741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ce76624-7236-4b45-8afe-a078c4ba4f56 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:39.862810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ce76624-7236-4b45-8afe-a078c4ba4f56 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:39.867176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ce76624-7236-4b45-8afe-a078c4ba4f56 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:39.872329 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3ce76624-7236-4b45-8afe-a078c4ba4f56 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1277 microversion: 2.54 time: 0.287442 Aug 30 04:20:39.874494 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1334/2711] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:39 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:39.888508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:39.889557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:39.908611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.910139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.916551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:39.918409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:39.919228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:39.920054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:40.148938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:40.165150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:40.166885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:40.168911 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f684f2a-78c4-48ea-837f-f9e23b64a097 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.593871 Aug 30 04:20:40.175196 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1378/2712] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:39 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:40.381697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:40.399561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b49698dd-9d5d-47cb-baf2-0be5949d1f56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.519073 Aug 30 04:20:40.409041 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1335/2713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:39 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:40.582351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:40.583363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:40.594849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:40.595947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:40.596727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:40.598007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:40.615267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:40.616014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:40.906884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:40.907959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:40.956160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:40.968769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:40.974478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:40.982627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:40.985481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:40.986508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:41.389311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:41.404158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:41.407803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:41.409190 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44f051cb-fdb2-4dd1-a6c6-f07b83f8c94e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1281 microversion: 2.54 time: 0.511280 Aug 30 04:20:41.412464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1336/2714] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:40 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1281 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:41.426421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:41.427275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:41.447594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:41.447802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:41.448512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:41.449568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:41.450245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:41.450844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:41.629552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:41.632867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:41.648876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd654179-5961-4a03-a642-53845bbb9881 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 1.071664 Aug 30 04:20:41.650340 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1379/2715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:40 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:41.658848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:41.660321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:41.677633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:41.678557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:41.679756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:41.681499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:41.684626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:41.686026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.043907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.056489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.077473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.084317 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e89e268-7108-40f6-a4ab-c954c0f8442f tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.666571 Aug 30 04:20:42.085214 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1337/2716] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:41 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:42.171389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.185197 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36bedb1d-3dcf-497b-8a6a-557796e3801e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.531229 Aug 30 04:20:42.218799 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1380/2717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:41 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:42.455811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:42.456872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:42.471517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:42.474314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:42.475731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.478050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:42.480970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:42.482950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.692276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.742131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.749272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:42.751146 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-286d68d3-2aba-45a3-bdae-5305aeb9cc94 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1347 microversion: 2.54 time: 0.309958 Aug 30 04:20:42.771899 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1381/2718] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:42 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1347 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:42.784305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:42.797320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:42.818685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:42.819286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:42.819728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.820503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:42.822520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:42.826365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:42.950654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1fa6c92-6857-4465-a562-ca7847b1a23d tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:42.965249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1fa6c92-6857-4465-a562-ca7847b1a23d tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.616417 Aug 30 04:20:42.966209 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1338/2719] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:20:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:43.110411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:43.111051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:43.131271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.131994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.134960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.136289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.138074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.143111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.225963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:43.243617 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b3b4f3ab-096e-417a-9e60-7118cbf810e4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1521 microversion: 2.1 time: 0.466881 Aug 30 04:20:43.247722 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1382/2720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:42 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1521 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:43.254607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:43.255487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:43.276060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.280924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.283336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.284320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.286496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.287655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.602694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:43.614682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:43.618594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:43.626168 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-246aeb1c-eb4e-4c2d-9f07-ba4d84aa168e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1487 microversion: 2.25 time: 0.521871 Aug 30 04:20:43.641362 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1339/2721] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:43 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1487 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:20:43.787618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:43.788239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:43.796711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.799852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.802725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.803780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:43.804479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:43.805226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:43.848097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:43.864213 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b113833-e7da-4617-9de3-4946f394b69d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.614169 Aug 30 04:20:43.869776 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1383/2722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:43 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:44.007268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:44.025955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09ce6070-395e-4310-a46b-367ea06e14d4 tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1862387950", "imageRef": "2b1759ae-ed80-4d52-9e12-bddeb4c9c829", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:44.034280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:44.037826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:44.042304 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-33c26810-c35f-4e21-8e19-ca54fb968925 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1335 microversion: 2.54 time: 0.261476 Aug 30 04:20:44.044117 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1340/2723] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:43 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1335 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:44.113663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-09ce6070-395e-4310-a46b-367ea06e14d4 tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:20:44.270821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:44.272128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:44.279924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:44.280873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:44.281664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:44.282661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:44.283490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:44.284143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:44.621623 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-09ce6070-395e-4310-a46b-367ea06e14d4 tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09ce6070-395e-4310-a46b-367ea06e14d4 tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] Request method failure captured: Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 143 Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZAa9xRiMj2yu5HWjbAGBwGq1U_nojV2Nt6nWtnrZg1mn_Ffu_vMVT0WVvDD44TqKAHYKjEkXukFbK05xWJomxhZEwlPQVeNeVBpHiapDpWGAEqDYMg2zBMvPlSuTm9kabT_V2qEVCX-TZlRCod01rZE2plUKlNzrM9mPYJtmf74tfk Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 39393805266c4ce29ed1f14360d52ece Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FlavorsV2NegativeTest-2093737839 Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_39393805266c4ce29ed1f14360d52ece", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/39393805266c4ce29ed1f14360d52ece"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39393805266c4ce29ed1f14360d52ece"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/39393805266c4ce29ed1f14360d52ece"}]}] Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FlavorsV2NegativeTest-2093737839 Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 39393805266c4ce29ed1f14360d52ece Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-2093737839 Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FlavorsV2NegativeTest-2093737839-project Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 6dd59c18be6d451f88ec781a3f63fc1b Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FlavorsV2NegativeTest-2093737839-project Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1862387950", "imageRef": "2b1759ae-ed80-4d52-9e12-bddeb4c9c829", "flavorRef": "452"}} Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor's memory is too small for requested image. Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1862387950', 'imageRef': '2b1759ae-ed80-4d52-9e12-bddeb4c9c829', 'flavorRef': '452'}}} Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:20:44.623600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09ce6070-395e-4310-a46b-367ea06e14d4 tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:44.628231 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-09ce6070-395e-4310-a46b-367ea06e14d4 tempest-FlavorsV2NegativeTest-2093737839 tempest-FlavorsV2NegativeTest-2093737839-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.604404 Aug 30 04:20:44.630654 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1384/2724] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:20:44 2022] POST /compute/v2.1/servers => generated 93 bytes in 611 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:20:44.653012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:44.653681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:44.665252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:44.669186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:44.669726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:44.670472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:44.670945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:44.671386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:44.878886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:44.888935 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3501704-5bed-435a-bd24-9f811f59a36d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1501 microversion: 2.1 time: 0.624038 Aug 30 04:20:44.890289 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1341/2725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:44 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1501 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:44.908006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:44.909675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:44.921831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:44.922531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:44.924177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:44.925138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:44.925785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:44.926952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:44.947064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:45.106712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.120603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.122226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.124871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2df7de9c-d5c4-453a-8722-b1eb46dedf4a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1477 microversion: 2.25 time: 0.476587 Aug 30 04:20:45.141818 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1385/2726] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:44 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1477 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:20:45.156538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:45.159750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:45.173489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.178192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.178805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.179559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.180024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.180452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.219268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.233973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a685cae-f4c5-44c0-ac68-78cab37e5c8c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.341653 Aug 30 04:20:45.239010 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1342/2727] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:44 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:45.252064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:45.253165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:45.269478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.270519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.271337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.272533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.276674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.277728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.505605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.525435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.531411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.535429 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-501c176a-60f8-429d-8304-8360751c0e8d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1356 microversion: 2.54 time: 0.292061 Aug 30 04:20:45.538650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1343/2728] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:45 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1356 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:45.556249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d1bbb950-627a-4153-ad51-92d7b049ac3c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '.version_select at 0x7fe9693c21f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:45.573850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1bbb950-627a-4153-ad51-92d7b049ac3c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.579633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1bbb950-627a-4153-ad51-92d7b049ac3c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.583588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1bbb950-627a-4153-ad51-92d7b049ac3c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.612736 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d1bbb950-627a-4153-ad51-92d7b049ac3c tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/os-migrations" status: 200 len: 1945 microversion: 2.25 time: 0.064516 Aug 30 04:20:45.616674 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1344/2729] 10.222.0.27 () {60 vars in 1184 bytes} [Tue Aug 30 04:20:45 2022] GET /compute/v2.1/os-migrations => generated 1945 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:45.649811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d19808f4-11c6-4f85-b0a7-37fc652d7b67 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Action: 'create', calling method: .version_select at 0x7fe9693e3040>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1452106651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMWg+5n0n1AHZW+W6ykVyWVBqpoS2MvxWLirugHYJD2+U6UoCaT2wrf1sAWvOCuOVT5IJEM+n/wTdiskgWNMlExJtlMfD2LT4ZBmtKG+0zKGDKgK3e2TVRoWSSo4MYf2FQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:45.692669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:45.712861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d19808f4-11c6-4f85-b0a7-37fc652d7b67 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Getting quotas for project 0eb06c960e3c49bbb8ba09bf518e61b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:20:45.727953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d19808f4-11c6-4f85-b0a7-37fc652d7b67 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Getting quotas for user 83e508715c9443adb381ada40b383523 and project 0eb06c960e3c49bbb8ba09bf518e61b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:20:45.769577 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d19808f4-11c6-4f85-b0a7-37fc652d7b67 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.150905 Aug 30 04:20:45.770562 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1345/2730] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:20:45 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:20:45.783976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:45.785826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:45.797634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.798491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.799288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.800409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.801788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.802456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.822432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:45.842309 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6395eb1b-5ede-4498-bd49-cd9ee1064664 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1515 microversion: 2.1 time: 0.695590 Aug 30 04:20:45.842954 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1386/2731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:45 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1515 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:45.870188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1452106651", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:45.879221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:45.893686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.898465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.899715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:45.907144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:45.907899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:45.908783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.055187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:20:46.055942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:20:46.056619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:20:46.057224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:20:46.059198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:20:46.229978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] Lazy-loading 'services' on Instance uuid 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:46.235046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:46.255100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.256168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.257164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.259266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.260711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.261713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.275283 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-95013dcb-f54e-4b07-9d6f-ef44c841b965 tempest-LiveAutoBlockMigrationV225Test-1488240715 tempest-LiveAutoBlockMigrationV225Test-1488240715-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1970 microversion: 2.25 time: 0.492714 Aug 30 04:20:46.275945 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1346/2732] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:45 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1970 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:46.311445 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c6321ee-df86-4d89-b5f4-ac1faa2f5ae1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "POST /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02/action" status: 202 len: 1139 microversion: 2.54 time: 0.452308 Aug 30 04:20:46.319908 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1387/2733] 10.222.0.27 () {62 vars in 1320 bytes} [Tue Aug 30 04:20:45 2022] POST /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02/action => generated 1139 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 04:20:46.335025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:46.336806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:46.345640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.346502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.347455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.347888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff215e92-1f18-48a3-ab7b-0f618202d27e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:46.348742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.349746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.350754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.364500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff215e92-1f18-48a3-ab7b-0f618202d27e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2916d8f5-a5a8-43fc-ba16-4c747c87b710] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:46.393738 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ff215e92-1f18-48a3-ab7b-0f618202d27e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Instance 2916d8f5-a5a8-43fc-ba16-4c747c87b710 could not be found. Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff215e92-1f18-48a3-ab7b-0f618202d27e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/2916d8f5-a5a8-43fc-ba16-4c747c87b710/action HTTP/1.1 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 14 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: {"rescue": {}} Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2916d8f5-a5a8-43fc-ba16-4c747c87b710 could not be found. Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2916d8f5-a5a8-43fc-ba16-4c747c87b710', 'body': {'rescue': {}}} Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2916d8f5-a5a8-43fc-ba16-4c747c87b710 could not be found. Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2916d8f5-a5a8-43fc-ba16-4c747c87b710 could not be found. Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:46.410212 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:46.414687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:46.414687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:46.414687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:46.414687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:46.414687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2916d8f5-a5a8-43fc-ba16-4c747c87b710 could not be found. Aug 30 04:20:46.414687 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:20:46.417852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff215e92-1f18-48a3-ab7b-0f618202d27e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 404 to user: Instance 2916d8f5-a5a8-43fc-ba16-4c747c87b710 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:46.419106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff215e92-1f18-48a3-ab7b-0f618202d27e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/2916d8f5-a5a8-43fc-ba16-4c747c87b710/action" status: 404 len: 111 microversion: 2.1 time: 0.126671 Aug 30 04:20:46.419951 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1347/2734] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:46 2022] POST /compute/v2.1/servers/2916d8f5-a5a8-43fc-ba16-4c747c87b710/action => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:20:46.432347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:46.435622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:46.465049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.466956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.468304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.470090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.472002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.475348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.546856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:20:46.750351 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c2e7202-a224-4222-8381-0ebac6dc40aa tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 204 len: 0 microversion: 2.25 time: 0.328794 Aug 30 04:20:46.757674 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1348/2735] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:20:46 2022] DELETE /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:20:46.775392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:46.778042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:46.794380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.795430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.798633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:46.799732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:46.801661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:46.802450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.168857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.178434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.186631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.194556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-481979f3-7a73-4250-93ec-4d43716c1609 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.435053 Aug 30 04:20:47.195287 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1349/2736] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:46 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:47.216697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:47.217537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:47.227027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.227630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.228162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.228956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.229540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.230569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.248434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.268616 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-74494393-943c-4253-aee0-969cd5a2e57c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.947134 Aug 30 04:20:47.273757 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1388/2737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:46 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:47.290899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:47.295868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:47.316843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.319277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.321525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.323526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.325988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.326441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.434079 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2a5a4c6-aa63-4070-a857-4f596aefb185 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action" status: 202 len: 0 microversion: 2.1 time: 0.221663 Aug 30 04:20:47.438660 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1350/2738] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:47 2022] POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:20:47.451537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-40c1a517-153e-4230-b319-ea57bb194d75 req-54bc5840-121f-4d25-89c3-ecea2892a608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded16a4-47e1-44cc-8113-aa7538c0c786", "name": "network-vif-plugged", "status": "completed", "tag": "347553e6-ccd3-4b81-91f8-e6545b41a764"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:47.473023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-40c1a517-153e-4230-b319-ea57bb194d75 req-54bc5840-121f-4d25-89c3-ecea2892a608 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.473549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-40c1a517-153e-4230-b319-ea57bb194d75 req-54bc5840-121f-4d25-89c3-ecea2892a608 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.473991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-40c1a517-153e-4230-b319-ea57bb194d75 req-54bc5840-121f-4d25-89c3-ecea2892a608 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.506648 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-40c1a517-153e-4230-b319-ea57bb194d75 req-54bc5840-121f-4d25-89c3-ecea2892a608 service nova] Creating event network-vif-plugged:347553e6-ccd3-4b81-91f8-e6545b41a764 for instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 on n-h1-854925-5 Aug 30 04:20:47.516468 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-40c1a517-153e-4230-b319-ea57bb194d75 req-54bc5840-121f-4d25-89c3-ecea2892a608 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075891 Aug 30 04:20:47.517086 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1351/2739] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:20:47.532464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:47.533258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:47.551077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.551754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.552889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.553667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:47.554269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:47.554885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:47.919141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.926680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.928764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.932866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:47.935205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-03538320-fe0d-4ad1-9604-9dfa4984eb38 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1483 microversion: 2.25 time: 0.660540 Aug 30 04:20:47.938658 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1389/2740] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:47 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1483 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:47.952695 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e500889d-fcf3-4140-9222-eca822e4a582 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1520 microversion: 2.1 time: 0.430648 Aug 30 04:20:47.957166 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1352/2741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:47 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1520 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:48.219935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:48.220995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:48.236076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:48.237166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:48.237909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:48.238929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:48.239975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:48.240740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:48.304289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:48.305887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:48.325879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:48.327057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:48.327897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:48.328929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:48.329659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:48.330385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:48.957088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:48.971728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:48.981509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:48.983457 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-12907eda-a71a-4e68-9ae3-9bbf84b3eaa3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.768798 Aug 30 04:20:48.985083 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1390/2742] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:48 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:20:48.997319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:48.998747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:49.012163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.013156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.014049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.015477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.019483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.020747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.113353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:49.124556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3975b1f-9cbc-4fe1-a33c-bf03e09fe76c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.825877 Aug 30 04:20:49.126802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1353/2743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:48 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:49.132585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:49.133452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:49.149640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.150379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.151051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.152441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.153249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.153951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.336524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:49.374656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:49.384971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:49.387568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:49.389203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-915e5ec6-b854-41a9-a171-1dfd2349fbab tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1483 microversion: 2.25 time: 0.401188 Aug 30 04:20:49.389890 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1391/2744] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:48 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1483 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:49.477957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:49.494554 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6bb1478a-d9c9-46b9-adb0-730e69008062 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1500 microversion: 2.1 time: 0.366187 Aug 30 04:20:49.497115 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1354/2745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:49 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1500 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:49.516171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:49.518769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:49.525391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.526074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.526759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.527483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.528103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.528724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.564624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lazy-loading 'flavor' on Instance uuid b8256913-3e91-4d10-9b49-5a5e5fff2ae0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:49.586677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Cannot 'rescue' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state paused Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action HTTP/1.1 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 14 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: {"rescue": {}} Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'rescue' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state paused Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b8256913-3e91-4d10-9b49-5a5e5fff2ae0', 'body': {'rescue': {}}} Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 in vm_state paused. Cannot rescue while the instance is in this state. Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state paused Aug 30 04:20:49.589138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state paused Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:20:49.596728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 409 to user: Cannot 'rescue' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state paused {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:20:49.598215 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c90b851-b84c-4425-85f5-4f6ce52b8c6a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action" status: 409 len: 144 microversion: 2.1 time: 0.083291 Aug 30 04:20:49.598870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1392/2746] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:49 2022] POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action => generated 144 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:20:49.606265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:49.606796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:49.618595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.619796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.620533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.621934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.622822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.623495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.727687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0167770-77aa-43c5-860c-8fbc246e3eb6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action" status: 202 len: 0 microversion: 2.1 time: 0.125116 Aug 30 04:20:49.730275 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1355/2747] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:49 2022] POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:20:49.749411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:49.752527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:49.771072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.771829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.773237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.774292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.774982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.776220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.853101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5ec5b4c1-75ec-46e8-aef7-1b462eb27c0a req-3837aa71-5fa5-4095-870d-faef21f8e413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "213f3941-dfe1-4ac4-bc21-e8eaae576cb9", "name": "network-vif-deleted", "tag": "1b16ff08-6ea0-4995-82bc-3fce03c11e3d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:49.872249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5ec5b4c1-75ec-46e8-aef7-1b462eb27c0a req-3837aa71-5fa5-4095-870d-faef21f8e413 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:49.873157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5ec5b4c1-75ec-46e8-aef7-1b462eb27c0a req-3837aa71-5fa5-4095-870d-faef21f8e413 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:49.874102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5ec5b4c1-75ec-46e8-aef7-1b462eb27c0a req-3837aa71-5fa5-4095-870d-faef21f8e413 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:49.892592 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5ec5b4c1-75ec-46e8-aef7-1b462eb27c0a req-3837aa71-5fa5-4095-870d-faef21f8e413 service nova] Creating event network-vif-deleted:1b16ff08-6ea0-4995-82bc-3fce03c11e3d for instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 on n-h1-854925-5 Aug 30 04:20:49.915748 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5ec5b4c1-75ec-46e8-aef7-1b462eb27c0a req-3837aa71-5fa5-4095-870d-faef21f8e413 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069504 Aug 30 04:20:49.916969 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1356/2748] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:20:50.028987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:50.031644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:50.056416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.057642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.059792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.060719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.061644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.062274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.144385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.158344 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-919530ab-6ee1-40e3-bc42-1e67fe441ef2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1507 microversion: 2.1 time: 0.421037 Aug 30 04:20:50.159588 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1393/2749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:49 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1507 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:50.164574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:50.177538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:50.192168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.192683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.193163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.193944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.194408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.194858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.241587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.253256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.255046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.257668 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d207e5aa-c6c3-4dc9-9577-481501596c9f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.251540 Aug 30 04:20:50.279023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1357/2750] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:50 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:50.415721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:50.417085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:50.434913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.435672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.436334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.437286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:50.440669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:50.441458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:50.728026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.743220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.747769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.751103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d24a1055-0799-4004-af94-2811f4a9aac5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1266 microversion: 2.25 time: 0.338862 Aug 30 04:20:50.757521 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1358/2751] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:50 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1266 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:50.844514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:50.855915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f5a6497d-5139-4b5b-b392-be6ac6f171d0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1308 microversion: 2.1 time: 0.695024 Aug 30 04:20:50.863347 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1394/2752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:50 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1308 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:51.183480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:51.185025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:51.199144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.199642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.200083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.205393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.205975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.206443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.263775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:51.283990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:51.285358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:51.300745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.304400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.308523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.312622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.318115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.323055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.340146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:51.599520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:51.609279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:51.616246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:51.617800 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bfc84cc3-22dc-40cc-95aa-4f3243fb3653 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.338227 Aug 30 04:20:51.618524 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1395/2753] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:51 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:51.662488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:51.676692 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5eaf25a6-96d6-4f1a-a127-9b136ef7b31b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1515 microversion: 2.1 time: 0.499103 Aug 30 04:20:51.677299 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1359/2754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:51 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1515 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:51.780609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:51.782185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:51.803701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.805567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.807544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.809425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.810998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.811607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.895505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:51.896131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:51.932566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.933104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.933568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:51.934271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:51.935115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:51.937267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:52.061931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:52.082158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:52.087657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:52.091894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42ab7848-3e80-4f2a-b742-1509dda44432 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1266 microversion: 2.25 time: 0.317792 Aug 30 04:20:52.096032 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1396/2755] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:51 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:52.541121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:52.560422 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b013f44-1906-48b4-9f02-c63c5d9aa907 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1488 microversion: 2.1 time: 0.677772 Aug 30 04:20:52.562414 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1360/2756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:51 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1488 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:20:52.593783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cf06bd5e-9954-4cc7-b290-c6c315cbaede tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:52.603570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf06bd5e-9954-4cc7-b290-c6c315cbaede tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:52.612725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf06bd5e-9954-4cc7-b290-c6c315cbaede tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:52.613521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf06bd5e-9954-4cc7-b290-c6c315cbaede tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:52.647576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:52.650038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:52.671259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:52.675513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:52.676146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:52.684477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:52.686766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:52.688927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:52.884637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cf06bd5e-9954-4cc7-b290-c6c315cbaede tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Going to try to stop instance {{(pid=122403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:20:53.085651 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cf06bd5e-9954-4cc7-b290-c6c315cbaede tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786/action" status: 202 len: 0 microversion: 2.1 time: 0.488028 Aug 30 04:20:53.087877 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1397/2757] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:52 2022] POST /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:20:53.119904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.138855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:53.148565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:53.149450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:53.150109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:53.151040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:53.152312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:53.152965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:53.215986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.227247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.229078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.233611 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3160b627-ed20-4dff-a183-e9b22f7287a8 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.590139 Aug 30 04:20:53.245688 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1361/2758] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:52 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:53.252986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:53.254171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:53.261447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:53.262275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:53.262915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:53.265882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:53.266658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:53.267337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:53.577904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.614344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.627577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.640820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc2296ad-2928-4938-8b20-5a3f4a2c29c6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1266 microversion: 2.25 time: 0.385282 Aug 30 04:20:53.642673 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1362/2759] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1266 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:53.899999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:53.914709 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4264e010-1e31-4a83-b00c-ede782cbedce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.813856 Aug 30 04:20:53.916661 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1398/2760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:53 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:54.272472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:54.273098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:54.295822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.296363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.296817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:54.297578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.298109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.309236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:54.475850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:54.494147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:54.498692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:54.508404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c70bacc-a2b2-42b6-bf90-ec4d67348627 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.240688 Aug 30 04:20:54.517013 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1363/2761] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:54 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:54.677735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:54.679148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:54.701791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.711186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.726448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:54.727675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.731222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.732037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:54.894296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:54.917922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:54.922028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:54.929120 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da7836a4-6456-412e-a6fd-2a5b30637c74 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1266 microversion: 2.25 time: 0.257091 Aug 30 04:20:54.930140 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1399/2762] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:54 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1266 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:54.942890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:54.943514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:54.957654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.958092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.958551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:54.959302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:54.962579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:54.963087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:55.389469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:55.407701 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f4da1237-359b-4da4-aaea-6ccbda37bb1f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.467765 Aug 30 04:20:55.410607 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1364/2763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:54 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:55.539213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:55.540035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:55.557033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:55.557653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:55.558170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:55.559025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:55.559493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:55.560014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:55.716097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:55.730489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:55.732702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:55.736396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fca38b6a-f61d-44fd-b224-9ea65257047a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.204191 Aug 30 04:20:55.739695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1400/2764] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:55 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:55.760344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:55.883201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:55.888174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:55.899554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:55.900055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:55.900504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:55.901256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:55.901761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:55.902206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:55.963028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lazy-loading 'flavor' on Instance uuid b8256913-3e91-4d10-9b49-5a5e5fff2ae0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:20:56.019546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1388682263", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "0f0c5d18-1589-4270-bc6f-d28cf2d683a5"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:20:56.128121 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-697a884c-fa9e-4806-b4b9-fe63050cda11 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action" status: 200 len: 32 microversion: 2.1 time: 0.256034 Aug 30 04:20:56.129149 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1401/2765] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:20:55 2022] POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action => generated 32 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:20:56.130781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] validate_networks() for [('0f0c5d18-1589-4270-bc6f-d28cf2d683a5', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:20:56.156830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:56.159171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:56.172948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:56.173819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:56.174509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:56.175424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:56.176207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:56.176799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:56.374235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:56.386964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:56.388490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:56.389698 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b364d469-0671-4b40-a44b-3c8acd4e20f5 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1266 microversion: 2.25 time: 0.259314 Aug 30 04:20:56.397546 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1402/2766] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:56 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:56.415199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:56.415972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:56.434872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:56.435383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:56.436406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:56.437207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:56.437702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:56.440540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:57.319404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:57.327566 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-216abdef-0d32-4040-920c-99c2366ebdae tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.928813 Aug 30 04:20:57.339187 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1403/2767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:56 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:57.345729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:57.349251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:57.369489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=94 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:57.384198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:57.385280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:57.386033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:57.387012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:57.387714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:57.388382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:57.857220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:57.873625 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c00a2db-15a5-401e-8440-1a08e9f50c5f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.531814 Aug 30 04:20:57.876471 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1404/2768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:57 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:57.892938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:57.894530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:57.917511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:57.919245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:57.921084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:57.923837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:57.924620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:57.925935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.119115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:20:58.120502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:20:58.121223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:20:58.121902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:20:58.122534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:20:58.122958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.142045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.143143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.144210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.144617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.145491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.146560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.147291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.149379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.150784 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c3919bd-1efc-4a62-aee2-0ce075bcce39 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.273012 Aug 30 04:20:58.157787 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1405/2769] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:57 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:58.172597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:58.173158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:58.192004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Getting quotas for project 552a894bc9be4817a7c3adee1f2af40a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:20:58.194899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.196015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.196719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.197668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.198542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.199467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Getting quotas for user bcef695e467040c6a2285f79bdda0ebc and project 552a894bc9be4817a7c3adee1f2af40a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:20:58.199682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.222483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:20:58.225534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:20:58.330526 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c16ccff9-1aef-41b0-b42a-ac53b03bf751 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.575862 Aug 30 04:20:58.338429 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1365/2770] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:20:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:20:58.344402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac8c7724-963d-4ed8-85dc-030040e019ec tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:58.345255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ac8c7724-963d-4ed8-85dc-030040e019ec tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:58.540144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.559626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.561752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.565378 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb79e74e-853b-4087-bad9-ba79b4e16326 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1266 microversion: 2.25 time: 0.403038 Aug 30 04:20:58.566164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1406/2771] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:58 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:20:58.567769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ac8c7724-963d-4ed8-85dc-030040e019ec tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:58.573149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:58.574158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:58.582271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.583180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.583857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.584803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.585464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.586082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.593512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac8c7724-963d-4ed8-85dc-030040e019ec tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1225 microversion: 2.1 time: 0.251666 Aug 30 04:20:58.595123 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1366/2772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:58 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1225 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:58.908860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:58.910266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:58.922630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.926037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.927403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:58.931449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:58.932280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:58.933206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:59.569397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:59.596793 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db7407dc-dd89-430d-8566-f05518b84513 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 1.028838 Aug 30 04:20:59.599849 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1407/2773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:58 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:59.618681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:59.620338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:59.638862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:59.641809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:59.647027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:59.649698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:59.650605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:59.651337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:59.667978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:59.681688 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7682b80c-010d-4943-99bc-551cc17cd194 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.780424 Aug 30 04:20:59.697820 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1367/2774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:58 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:20:59.708246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:20:59.708899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:20:59.721905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:59.737048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:59.737606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:59.740618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:20:59.741142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:20:59.741621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:20:59.940958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:59.943347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:20:59.980030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:59.981704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:59.985902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:20:59.987458 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d34227ed-7e8a-42fa-ae9d-7e10950e6c98 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.384838 Aug 30 04:20:59.991981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1408/2775] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:59 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:00.010292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:00.011001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:00.019803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:00.021690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:00.026840 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-56cfed5f-36b4-41b8-937d-27d3eb019320 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 200 len: 1266 microversion: 2.25 time: 0.327815 Aug 30 04:21:00.033853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:00.034547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:00.035753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:00.037784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:00.043533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:00.043761 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1368/2776] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:20:59 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:00.046242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:00.139476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:00.157132 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95eb88ac-f1c5-44cc-8026-5970a656d6eb tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1277 microversion: 2.1 time: 0.158641 Aug 30 04:21:00.159440 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1409/2777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:20:59 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:00.623254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:00.624177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:00.653445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:00.654211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:00.656153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:00.657070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:00.662920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:00.665758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:00.704615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:00.705274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:00.712599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:00.713161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:00.713612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:00.714607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:00.715081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:00.715489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.045201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:02.057537 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b6d38419-3c90-4f00-9d6f-5cb930b0af7e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 1.438500 Aug 30 04:21:02.069965 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1369/2778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:00 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:02.087905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:02.103684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:02.117297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:02.122183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.123730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.124596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.127077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.132271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.134955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.154715 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-470c5cb4-b3bd-458b-85e5-fd1df60d3318 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 1.452091 Aug 30 04:21:02.164903 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1410/2779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:00 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:02.172834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:02.174564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 213f3941-dfe1-4ac4-bc21-e8eaae576cb9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:02.194042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.195851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.196327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.199313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.200910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.201399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.243877 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] HTTP exception thrown: Instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 could not be found. Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Request method failure captured: Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 HTTP/1.1 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY5Zw-Pl1gLiQL1xqMYS1PBGX-3CvtFLeJin-6zfrHjtE16RML5jTqrYl3usPPD7Fp02FBIeu8e6bmVaUF4wb2kzIa_pGnlHTaqtbvB9ZGOjZFA5BB5NbyZepz1eZvngkXqOCOHl8JwviuZmUbL1Q3rxsWRrwfvDnK218NFnSkWncNI Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02e52c9195cf4e3caaa492e3c093e620", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}] Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 45901cc649784305a10c8a9278d1bef3 Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 could not be found. Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '213f3941-dfe1-4ac4-bc21-e8eaae576cb9'} Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 could not be found. Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 could not be found. Aug 30 04:21:02.251492 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 could not be found. Aug 30 04:21:02.257748 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:02.261225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Returning 404 to user: Instance 213f3941-dfe1-4ac4-bc21-e8eaae576cb9 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:02.264719 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f228a924-3114-4efa-ae96-943511624a57 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9" status: 404 len: 111 microversion: 2.25 time: 0.106603 Aug 30 04:21:02.265898 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1411/2780] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:02 2022] GET /compute/v2.1/servers/213f3941-dfe1-4ac4-bc21-e8eaae576cb9 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:21:02.285940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:02.288102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:02.305966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.307047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.309652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.311261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:02.313849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:02.314641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:02.467616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:02.485649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:02.487661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:02.502778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f58c8a0e-fffd-4b3f-a7e5-62eaaa53605d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.425103 Aug 30 04:21:02.505593 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1370/2781] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:02 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:02.514560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:02.527000 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4320e24b-b7c4-4031-b20d-f6bc9241002a tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1283 microversion: 2.1 time: 0.255186 Aug 30 04:21:02.528435 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1412/2782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:02 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1283 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:03.093306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:03.098060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:03.116967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.124998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.125686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.126721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.134711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.136311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.184683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:03.185440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:03.214076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.214927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.215346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.224104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.224626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.225074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.642565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:03.662344 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-282f14b0-5f09-4fab-adb8-e5c15f10a312 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.573986 Aug 30 04:21:03.663526 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1371/2783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:03 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:03.775683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-453705735", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "f1e14a65-aaa1-4738-b8ee-8982958c9b28"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:03.806919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:03.817308 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-35054262-6ed5-42a8-88a7-7801dbb29914 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.637022 Aug 30 04:21:03.820786 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1413/2784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:03 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:03.828768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:03.835680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:03.852464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] validate_networks() for [('f1e14a65-aaa1-4738-b8ee-8982958c9b28', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:21:03.870079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.870894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.871773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:03.876528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:03.877454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:03.880016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.080720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:04.100021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:04.109389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:04.110084 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-22b63872-bfc5-4db0-8387-9348f7ba5b6c tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.288018 Aug 30 04:21:04.129866 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1414/2785] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:03 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:04.146988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:04.151714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:04.178387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.178901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.179345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:04.180077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:04.180537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:04.193891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:05.409577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:05.420829 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f20d7e8-f323-4412-aa9d-a1703d1eee35 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1325 microversion: 2.1 time: 1.285911 Aug 30 04:21:05.422414 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1415/2786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:04 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1325 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:05.430856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:05.432754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:05.449389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:05.450212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:05.455477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:05.458100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:05.458775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:05.460130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:05.841080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:05.870027 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-08a7a4b9-a6ca-450e-add9-88cc48e7f2b3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.446049 Aug 30 04:21:05.870734 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1416/2787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:05 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:05.886909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:05.887888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:05.905213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:05.906054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:05.906690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:05.907590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:05.908057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:05.908498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.062320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:06.063496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:06.064320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:06.064900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:06.065498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:06.081727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.082489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.083099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.089009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.089980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.090576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.127657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Getting quotas for project 6c7facb64d7a41a0974d2b5aa58c66ab. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:06.142170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Getting quotas for user 34f73ac855ca447286ee1788fd2520f2 and project 6c7facb64d7a41a0974d2b5aa58c66ab. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:06.172637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:06.176939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:06.277251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b4458d8a-6661-427c-a9da-5891e75e96d2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.611077 Aug 30 04:21:06.282606 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1372/2788] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:21:06.293800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5d499d0f-c53d-47d4-827e-c8c8bed4cebc req-3197d251-dd24-40a7-865b-6e7bd863b717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c70b8cb-dd02-4546-99c4-5a2a226bd2ce", "tag": "849caa1e-2af2-48d2-b587-0036eb8917d6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:06.313789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:06.315735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5d499d0f-c53d-47d4-827e-c8c8bed4cebc req-3197d251-dd24-40a7-865b-6e7bd863b717 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.316250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5d499d0f-c53d-47d4-827e-c8c8bed4cebc req-3197d251-dd24-40a7-865b-6e7bd863b717 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.316681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5d499d0f-c53d-47d4-827e-c8c8bed4cebc req-3197d251-dd24-40a7-865b-6e7bd863b717 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.348888 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5d499d0f-c53d-47d4-827e-c8c8bed4cebc req-3197d251-dd24-40a7-865b-6e7bd863b717 service nova] Creating event network-changed:849caa1e-2af2-48d2-b587-0036eb8917d6 for instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce on n-h2-854925-5 Aug 30 04:21:06.364232 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5d499d0f-c53d-47d4-827e-c8c8bed4cebc req-3197d251-dd24-40a7-865b-6e7bd863b717 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079283 Aug 30 04:21:06.365237 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1373/2789] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:06.371208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:06.372413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:06.396477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.396896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.397367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.404787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.405559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.406179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.636250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:06.658876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:06.665366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:06.672173 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-026004ff-bd71-47f5-b00e-0a5ee9a86c3a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.301040 Aug 30 04:21:06.673878 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1374/2790] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:06 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:06.687822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e5dec9a-0824-4952-ba29-4fa018c45980 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:06.689880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e5dec9a-0824-4952-ba29-4fa018c45980 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:06.816045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:06.830180 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e7c414ba-990d-4147-8012-4f37dd25d58d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.947450 Aug 30 04:21:06.830778 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1417/2791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:05 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:06.838119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:06.838995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:06.849685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.850402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.866361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.867639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.868019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.870290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.920385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e5dec9a-0824-4952-ba29-4fa018c45980 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:06.927505 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e5dec9a-0824-4952-ba29-4fa018c45980 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1223 microversion: 2.1 time: 0.251365 Aug 30 04:21:06.930157 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1375/2792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:06 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1223 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:06.935414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:06.936023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:06.977626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.982144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.984465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:06.987948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:06.992267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:06.993718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.290363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:07.304526 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7725765f-22a0-4f78-b818-042743650c9c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1325 microversion: 2.1 time: 0.466983 Aug 30 04:21:07.305676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1418/2793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:06 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1325 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:07.324869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:07.334622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e0e63c9f-b398-4b65-909d-8e72cd113808 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.403369 Aug 30 04:21:07.337774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1376/2794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:06 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:07.702416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:07.703431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:07.716765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.720966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.721953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.723096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.723845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.724611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.856034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:07.856275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:07.857391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:07.866339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:07.866733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.868863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:07.870294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.870746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.871468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.871626 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ddff49ed-ca6a-4278-a553-9f159d9bd851 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.173113 Aug 30 04:21:07.871925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.872375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.873216 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1419/2795] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:07 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:07.952107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:07.953040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:07.968061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.974949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.977611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:07.980170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:07.981195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:07.984459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.190441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:08.207056 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-11b5047e-7f1e-465e-9732-dc5de5ca0b24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1275 microversion: 2.1 time: 0.261995 Aug 30 04:21:08.226756 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1420/2796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:07 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1275 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:08.329481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:08.330290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:08.350861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.355509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.359300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.360725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.361848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:08.362867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.365822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.371987 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea4ca2a6-7d9e-4e06-8a32-e4b8c5deb121 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.521247 Aug 30 04:21:08.372593 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1377/2797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:07 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:08.381632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:08.382185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:08.404607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.405210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.407167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.407899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.409760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.411582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.869393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:08.884873 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bda78f71-88d2-4a79-b168-1b5ed46fbd6d tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1325 microversion: 2.1 time: 0.559924 Aug 30 04:21:08.887137 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1421/2798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:08 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1325 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:08.902379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:08.907982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:08.936291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.937475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.940259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:08.941234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:08.943170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:08.944464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.125386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.136557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.145384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.151664 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33f6e4af-ca2b-4436-9e0b-b4f637270fe3 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.255578 Aug 30 04:21:09.171551 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1422/2799] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:08 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:09.219025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:09.219310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:09.238134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.238725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.239182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.240015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.240564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.241456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.318661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:21:09.473432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.475818 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3756e6de-2995-4be7-bc10-8f0f05ce8a02 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 204 len: 0 microversion: 2.25 time: 0.259985 Aug 30 04:21:09.478520 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1423/2800] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:21:09 2022] DELETE /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:21:09.493057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:09.495118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:09.514214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.515646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.516292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.517387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.519245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.519939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.536449 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-57486eae-bdda-4d62-8bdc-18bfc6692096 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 1.161700 Aug 30 04:21:09.550972 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1378/2801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:08 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:09.550972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:09.550972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:09.550972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.550972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.550972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.552397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.552608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.553249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.600244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:09.750307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.759387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-53cdf4ae-9b5d-45f3-b497-e63f3ae14d57 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1281 microversion: 2.1 time: 0.279056 Aug 30 04:21:09.763958 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1424/2802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:09 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1281 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:09.770880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:09.771752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:09.789460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.790507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:09.793909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.795673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:09.795987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.799264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.799909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.802677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.822608 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c3871f6-d919-4068-8594-b872e832435e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.283808 Aug 30 04:21:09.840285 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1379/2803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:09 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:09.917118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:09.918812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:09.934157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.934664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.935299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:09.936616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:09.937642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:09.939377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.220835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.243844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.253279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.258237 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a1a4832-ba8d-4c9a-b2a2-0f7a12adedd3 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1325 microversion: 2.1 time: 0.354525 Aug 30 04:21:10.270980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.277064 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1380/2804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:09 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1325 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:10.281050 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c66c81bf-9259-4559-809d-a883d3ffa1a4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1732 microversion: 2.25 time: 0.514761 Aug 30 04:21:10.285377 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1425/2805] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:09 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1732 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:10.286418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:10.287295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:10.305627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.306244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.306741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.307578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.308087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.308523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.416852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.428800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.434520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.438892 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0fa5a118-5d99-4801-9d31-95878dd8e75f tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.160397 Aug 30 04:21:10.439494 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1381/2806] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:10 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:10.562623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:10.563256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:10.572609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.573120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.573592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.574653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.575244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.575686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.734987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.744140 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f7dcfec-fab7-4ea1-8fd0-fb62ba1dc078 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.189156 Aug 30 04:21:10.759133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1426/2807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:10 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:10.784934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:10.785753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:10.797878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.798384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.799001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.799927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.800619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.801220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.849164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:10.850319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:10.858789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.859290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.859789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.860882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:10.861009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:10.861480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:10.922702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:10.934646 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-597522bb-45c2-4f1c-9cbe-7cd612dbc048 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1281 microversion: 2.1 time: 0.153449 Aug 30 04:21:10.954614 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1382/2808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:10 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:11.045992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.055214 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-710e1a47-a1eb-4266-8e07-2411e71d8908 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.210995 Aug 30 04:21:11.056255 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1427/2809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:10 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:11.282295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:11.283087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:11.293492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.294290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.294950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.295666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.296293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.296909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.305623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:11.306182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:11.312903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.313432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.314064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.314971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.315596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.316187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.557034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.570359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.572058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.574200 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d3cd8c86-a6ea-400d-a609-e7cfa91655ff tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1732 microversion: 2.25 time: 0.272550 Aug 30 04:21:11.575009 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1428/2810] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:11 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1732 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:11.580864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:11.581921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:11.587393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.600621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-232226a7-57e8-4672-924e-422f6544940e tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1325 microversion: 2.1 time: 0.321153 Aug 30 04:21:11.601254 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1383/2811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:11 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1325 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:11.604269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.605094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.605771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.606659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.607264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.607895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.692002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.706312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.711969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:11.714286 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd278168-9908-413e-9ac4-44698c05e84d tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.137916 Aug 30 04:21:11.715072 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1429/2812] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:11 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:11.772861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:11.774907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:11.793300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.793985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.794724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.798601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.799111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.799547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.958971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:11.961039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:11.974460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.978208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.979602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:11.980550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:11.981202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:11.982078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.039012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:12.052121 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3823ccf6-6893-48b4-8c31-b516bd8542f3 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.288050 Aug 30 04:21:12.052725 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1384/2813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:11 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:12.076122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:12.077046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:12.086268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.087019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.087718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.088771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.090194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.090805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.255831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:12.278776 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-08da5dc1-0292-4754-b2fb-706de5a497fe tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.326250 Aug 30 04:21:12.280072 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1430/2814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:11 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:12.337270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:12.349930 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5e198bd-8f53-4e9d-9604-63c749042a3e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.276580 Aug 30 04:21:12.351283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1385/2815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:12 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:12.531056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1877b8ad-4b65-49f2-ba93-682c00cf2bf5 req-c98ecbc4-b96e-4797-a471-a45c547792ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c70b8cb-dd02-4546-99c4-5a2a226bd2ce", "name": "network-vif-plugged", "status": "completed", "tag": "849caa1e-2af2-48d2-b587-0036eb8917d6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:12.545365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1877b8ad-4b65-49f2-ba93-682c00cf2bf5 req-c98ecbc4-b96e-4797-a471-a45c547792ca service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.546211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1877b8ad-4b65-49f2-ba93-682c00cf2bf5 req-c98ecbc4-b96e-4797-a471-a45c547792ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.546925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1877b8ad-4b65-49f2-ba93-682c00cf2bf5 req-c98ecbc4-b96e-4797-a471-a45c547792ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.562124 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1877b8ad-4b65-49f2-ba93-682c00cf2bf5 req-c98ecbc4-b96e-4797-a471-a45c547792ca service nova] Creating event network-vif-plugged:849caa1e-2af2-48d2-b587-0036eb8917d6 for instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce on n-h2-854925-5 Aug 30 04:21:12.567811 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1877b8ad-4b65-49f2-ba93-682c00cf2bf5 req-c98ecbc4-b96e-4797-a471-a45c547792ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040983 Aug 30 04:21:12.568920 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1431/2816] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:12.605105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:12.609012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:12.626634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:12.627753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:12.643461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.644262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.644907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.646377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.647083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.647696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.650730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.651254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.653136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.653927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.654402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.654845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:12.862107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:12.879066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:12.901122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:12.913561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1223ee60-52c0-4657-8cbd-6524343d3925 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1664 microversion: 2.25 time: 0.313741 Aug 30 04:21:12.923486 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1386/2817] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:12 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1664 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:12.945273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-64c0d486-9de0-42c5-957f-a98c643a1daa req-f4764e6c-41c8-47c3-af98-d6a421d9e805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d0a8293-be54-4224-956f-44539222c466", "name": "network-vif-deleted", "tag": "fd1079f2-ffbb-4335-a81f-da6d0d027dba"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:12.973186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-64c0d486-9de0-42c5-957f-a98c643a1daa req-f4764e6c-41c8-47c3-af98-d6a421d9e805 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:12.974088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-64c0d486-9de0-42c5-957f-a98c643a1daa req-f4764e6c-41c8-47c3-af98-d6a421d9e805 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:12.974768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-64c0d486-9de0-42c5-957f-a98c643a1daa req-f4764e6c-41c8-47c3-af98-d6a421d9e805 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.003542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-64c0d486-9de0-42c5-957f-a98c643a1daa req-f4764e6c-41c8-47c3-af98-d6a421d9e805 service nova] Creating event network-vif-deleted:fd1079f2-ffbb-4335-a81f-da6d0d027dba for instance 8d0a8293-be54-4224-956f-44539222c466 on n-h2-854925-5 Aug 30 04:21:13.019824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-64c0d486-9de0-42c5-957f-a98c643a1daa req-f4764e6c-41c8-47c3-af98-d6a421d9e805 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083625 Aug 30 04:21:13.020765 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1387/2818] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:13.049142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:13.059398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.073051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.082050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.082714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.083518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b7b13c3-3d80-4f66-98e0-c7bba283f597 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1325 microversion: 2.1 time: 0.462686 Aug 30 04:21:13.084169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.086130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.089373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.090484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.097900 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1432/2819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:12 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:13.108353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:13.110063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.118692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.121429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.123433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.125457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.128424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.129205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.239607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.250329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.252122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.253760 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa1e9c5f-fab1-476b-9291-094f8687e0d1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.222438 Aug 30 04:21:13.254511 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1388/2820] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:13 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:13.299934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:13.300566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.307945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.308711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.309315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.310228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.310849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.311438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.542302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.558152 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21673147-43e9-4382-a31a-549925917e84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.456025 Aug 30 04:21:13.559203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1433/2821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:13 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:13.564748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:13.565800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.573503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.574864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.575876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.576759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.577459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.578056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.590100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.600102 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df4d2c27-903e-4fc6-8d12-84719079db4d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.303896 Aug 30 04:21:13.601003 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1389/2822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:13 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:13.742983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:13.753248 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef97741b-b059-4e6e-ab4e-c4fe11b87c65 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.192708 Aug 30 04:21:13.754162 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1434/2823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:13 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:13.941384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:13.942124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:13.948398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.948892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.949497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.950051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.950504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.950928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.990557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:13.991074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:13.991507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:13.991957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lazy-loading 'fault' on Instance uuid 8d0a8293-be54-4224-956f-44539222c466 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:21:14.043145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.051736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.053182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.054409 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-00cb2769-9462-47fd-b068-ed3aaa9729b1 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 200 len: 1375 microversion: 2.25 time: 0.117008 Aug 30 04:21:14.054982 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1390/2824] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:13 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 1375 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:14.114945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.115849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.123078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.123655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.124240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.125375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.126257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.126799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.280332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.281203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.294026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.295716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.298133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.299351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.299994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.301924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.321553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.330951 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6c86381-71cf-43ae-960a-8b3014d8b3a9 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1325 microversion: 2.1 time: 0.220389 Aug 30 04:21:14.344922 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1435/2825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1325 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:14.380103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.389890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.391713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.392988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f4185e7-53c7-4226-8f66-acf549bf14f4 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.116817 Aug 30 04:21:14.393968 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1391/2826] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:14.581317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.582081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.588715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.589593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.590111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.590902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.591428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.591931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.622818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.623702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.630511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.631004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.631575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.632279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.633016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.633693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.842248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.848501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:14.850464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-24ce0a50-e1e0-4299-9e29-c891902602e5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.273095 Aug 30 04:21:14.851383 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1436/2827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:14.856014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:14.856628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:14.863143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.863635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.864079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.864780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:14.865234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:14.865857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:14.870764 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da9ca77a-5e8c-42e9-8bce-8cde1435e1bf tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.254508 Aug 30 04:21:14.871761 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1392/2828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:15.080214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f8e82a6a-b5a6-49e6-8d2f-6b2db2047fe3 req-79113d57-44f5-45cb-ae20-7e3d43197d8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e35e-b6af-4419-b964-4f7a1b665945", "tag": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:15.091967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f8e82a6a-b5a6-49e6-8d2f-6b2db2047fe3 req-79113d57-44f5-45cb-ae20-7e3d43197d8b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.092555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f8e82a6a-b5a6-49e6-8d2f-6b2db2047fe3 req-79113d57-44f5-45cb-ae20-7e3d43197d8b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.093051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f8e82a6a-b5a6-49e6-8d2f-6b2db2047fe3 req-79113d57-44f5-45cb-ae20-7e3d43197d8b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.106197 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f8e82a6a-b5a6-49e6-8d2f-6b2db2047fe3 req-79113d57-44f5-45cb-ae20-7e3d43197d8b service nova] Creating event network-changed:3a0f694a-1f77-44c2-8170-8b4cb5f4985a for instance 89b5e35e-b6af-4419-b964-4f7a1b665945 on n-h1-854925-5 Aug 30 04:21:15.109177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.111289 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f8e82a6a-b5a6-49e6-8d2f-6b2db2047fe3 req-79113d57-44f5-45cb-ae20-7e3d43197d8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036016 Aug 30 04:21:15.112221 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1393/2829] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:15.119310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.120199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 8d0a8293-be54-4224-956f-44539222c466] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.120997 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-468f1455-31c2-46c4-9ec3-be905a82807a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.268553 Aug 30 04:21:15.127187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.127940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.128587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.129503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.130137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.130743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.137317 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1437/2830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:14 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:15.146528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] HTTP exception thrown: Instance 8d0a8293-be54-4224-956f-44539222c466 could not be found. Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Request method failure captured: Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 HTTP/1.1 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY5Zw-Pl1gLiQL1xqMYS1PBGX-3CvtFLeJin-6zfrHjtE16RML5jTqrYl3usPPD7Fp02FBIeu8e6bmVaUF4wb2kzIa_pGnlHTaqtbvB9ZGOjZFA5BB5NbyZepz1eZvngkXqOCOHl8JwviuZmUbL1Q3rxsWRrwfvDnK218NFnSkWncNI Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02e52c9195cf4e3caaa492e3c093e620", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}] Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 45901cc649784305a10c8a9278d1bef3 Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 8d0a8293-be54-4224-956f-44539222c466 could not be found. Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '8d0a8293-be54-4224-956f-44539222c466'} Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d0a8293-be54-4224-956f-44539222c466 could not be found. Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d0a8293-be54-4224-956f-44539222c466 could not be found. Aug 30 04:21:15.148156 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d0a8293-be54-4224-956f-44539222c466 could not be found. Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Returning 404 to user: Instance 8d0a8293-be54-4224-956f-44539222c466 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7580a157-bd93-459d-ac9c-3512d2548c9d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466" status: 404 len: 111 microversion: 2.25 time: 0.036081 Aug 30 04:21:15.152252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1394/2831] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/8d0a8293-be54-4224-956f-44539222c466 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:21:15.160718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6276240-2a32-41c2-9865-1595fff478be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '.version_select at 0x7fe96a8e2700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.180194 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6276240-2a32-41c2-9865-1595fff478be tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409078519" status: 204 len: 0 microversion: 2.25 time: 0.023351 Aug 30 04:21:15.180784 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1438/2832] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Aug 30 04:21:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409078519 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:21:15.352167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.353713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.362267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.363273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.365262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.366299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.367000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.367681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.420389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.421364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.427512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.429531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.430256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.431315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.431928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.432538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.547078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.556525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.558029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.559224 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-221e0136-1362-42d5-9e9b-25a88a94d58e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.143769 Aug 30 04:21:15.559973 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1439/2833] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:15.564554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.565356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.572312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.572801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.573358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.574086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.574544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.575239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.698088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.709218 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e253e495-75ff-4ca8-b602-e2ddcd8d6b0c tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1521 microversion: 2.1 time: 0.360845 Aug 30 04:21:15.710654 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1395/2834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:15.733837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.734391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.741220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.741815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.742319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.745703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.745703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.745703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.772921 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] HTTP exception thrown: Instance is not a member of specified network Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Request method failure captured: Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce/ips/invalid HTTP/1.1 Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZAn8lJN7V5XAGxtu3njjdpoLLrgy6le9yddOB7jFjuy_WF3LuItt-F6AXK7Yp34sTjZqBoceb-Oq3_lcSWQ0Yy175NkjDAbiNHnTg4ZDMj6ydVYPxcWy6eW3FKaXdr6ELdKThx5f5iJ4wOSmnRjx57GJ0FZIE0lkr8_4RJWxH8n_4I Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 552a894bc9be4817a7c3adee1f2af40a Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_552a894bc9be4817a7c3adee1f2af40a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/552a894bc9be4817a7c3adee1f2af40a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/552a894bc9be4817a7c3adee1f2af40a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/552a894bc9be4817a7c3adee1f2af40a"}]}] Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 552a894bc9be4817a7c3adee1f2af40a Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerAddressesNegativeTestJSON-877818191-project Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: bcef695e467040c6a2285f79bdda0ebc Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-877818191-project Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance is not a member of specified network Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '7c70b8cb-dd02-4546-99c4-5a2a226bd2ce', 'id': 'invalid'} Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 30 04:21:15.783283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.789861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:15.789861 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f3c72224-3931-4f10-be45-2445ad7c7aaa tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.055960 Aug 30 04:21:15.789861 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1396/2835] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce/ips/invalid => generated 91 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:21:15.797897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-50653111-ecec-4274-b83b-8d49adcb387f tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.798376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-50653111-ecec-4274-b83b-8d49adcb387f tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Failed to fetch instance by id 999 {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 04:21:15.798883 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-50653111-ecec-4274-b83b-8d49adcb387f tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] HTTP exception thrown: Instance 999 could not be found. Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-50653111-ecec-4274-b83b-8d49adcb387f tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Request method failure captured: Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZAn8lJN7V5XAGxtu3njjdpoLLrgy6le9yddOB7jFjuy_WF3LuItt-F6AXK7Yp34sTjZqBoceb-Oq3_lcSWQ0Yy175NkjDAbiNHnTg4ZDMj6ydVYPxcWy6eW3FKaXdr6ELdKThx5f5iJ4wOSmnRjx57GJ0FZIE0lkr8_4RJWxH8n_4I Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 552a894bc9be4817a7c3adee1f2af40a Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_552a894bc9be4817a7c3adee1f2af40a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/552a894bc9be4817a7c3adee1f2af40a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/552a894bc9be4817a7c3adee1f2af40a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/552a894bc9be4817a7c3adee1f2af40a"}]}] Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 552a894bc9be4817a7c3adee1f2af40a Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerAddressesNegativeTestJSON-877818191-project Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: bcef695e467040c6a2285f79bdda0ebc Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-877818191-project Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 999 could not be found. Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '999'} Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 30 04:21:15.800345 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:15.814830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-50653111-ecec-4274-b83b-8d49adcb387f tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:15.814830 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-50653111-ecec-4274-b83b-8d49adcb387f tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007732 Aug 30 04:21:15.814830 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1397/2836] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:21:15.814830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.814830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.822926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.824193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.824595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.825409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.825956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.826367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.854734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:21:15.880001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:15.924392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.939174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.940988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:15.943632 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-62e19599-3609-4931-9491-98f87c3161cb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2952 microversion: 2.42 time: 0.381938 Aug 30 04:21:15.944400 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1440/2837] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2952 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:15.954886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.955339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.962210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.962739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.963430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.964596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.968032 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eeeb5e53-d24c-4057-b01b-b3d1efa49b60 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 204 len: 0 microversion: 2.1 time: 0.158096 Aug 30 04:21:15.969032 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1398/2838] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:21:15 2022] DELETE /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:21:15.971392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.975647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:15.976354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:15.979128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.983438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.983924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.984539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:15.985292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:15.985794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:15.986226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.111557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:16.593877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.604145 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a85ccc9-9771-404b-8559-1f5b59368209 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.633460 Aug 30 04:21:16.604797 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1399/2839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:16.611508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:16.612057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.612519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:16.621105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.621939 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-edab8288-a736-49a7-9d49-d14c7fdb73ee tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.670573 Aug 30 04:21:16.622079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.622481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.623152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.623681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.624124 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1441/2840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:15 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:16.625957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.629770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:16.630424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:16.638550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.639221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.639965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.640971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.641531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.642151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.785310 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fd678b3-40c7-446f-b817-1a819134ccf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.178349 Aug 30 04:21:16.786083 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1400/2841] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 04:21:16 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7/os-interface => generated 1830 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:16.792080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:16.792776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:16.802347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.803222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.803861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.804760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.805466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.806610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.872394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.874740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:16.882040 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c1efb57-2160-44bb-9bcc-bdec2aaf8de5 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1527 microversion: 2.1 time: 0.256636 Aug 30 04:21:16.882834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1442/2842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:16 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1527 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:16.889361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:16.890254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:16.898571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.899077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.899543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.900381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:16.908379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:16.908844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:16.933705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=16 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:16.987778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.997039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.998529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:16.999722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf1c911b-7e95-4280-b400-39ad4aeab056 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.116145 Aug 30 04:21:17.000278 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1443/2843] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:16 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:17.011502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:17.012076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.016639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.018666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.019157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.019598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.020307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.020762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.021191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.026555 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d00591b-c27b-4192-a925-0de16b6b15ad tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.238995 Aug 30 04:21:17.027408 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1401/2844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:16 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:17.050716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:21:17.129028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36fe7011-4c6d-4a36-aad6-275001478eea tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 204 len: 0 microversion: 2.25 time: 0.127243 Aug 30 04:21:17.129672 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1444/2845] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:21:17 2022] DELETE /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:21:17.137890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:17.138989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.145164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.145883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.146325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.147024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.147478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.147902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.304276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.313822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.315291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.316474 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-023f8b24-00f5-4214-b12f-68cb41577251 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1548 microversion: 2.25 time: 0.182597 Aug 30 04:21:17.317191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1402/2846] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:17 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:17.626390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:17.627105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.633931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.634965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.635424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.636128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.636588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.637018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.647860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:17.648486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.655264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.655858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.656526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.657235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.658081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.658524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.880178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.887116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:17.889107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff7aeffd-ac85-4e0c-8bce-12035d51fa43 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.266752 Aug 30 04:21:17.889985 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1445/2847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:17 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:17.899858 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d650c134-6d5a-4b16-904d-20ee185b01d1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.255662 Aug 30 04:21:17.901252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1403/2848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:17 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:17.917984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:17.918664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:17.928900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.929838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.930457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:17.931940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:17.932768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:17.933552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.025247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.025899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.037477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.038178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.038786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.039662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.040288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.041637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.092256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.108631 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aaba9553-213a-4070-a29a-97ab1f7532c1 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1527 microversion: 2.1 time: 0.197749 Aug 30 04:21:18.109252 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1446/2849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:17 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1527 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:18.118421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.119050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.121165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:18.136214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.136731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.137184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.137956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.138492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.138936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.156001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.175781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.178103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.179689 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8ff3bae-1c3f-4b30-9f31-34c0e92f4c1a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1408 microversion: 2.54 time: 0.158425 Aug 30 04:21:18.189182 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1404/2850] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:18.315049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.325126 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad6f8cef-e453-4927-b9a5-839e27690ff7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.214785 Aug 30 04:21:18.326153 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1447/2851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:18.341936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.343391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.350459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.351078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.351643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.353913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.354626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.355419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.531911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.543079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.544944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:18.550103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e35d79cb-8f9b-456e-baba-4ea92d3a3a17 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1548 microversion: 2.25 time: 0.209980 Aug 30 04:21:18.551127 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1405/2852] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1548 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:18.942287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.943309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.944148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:18.946839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:18.957603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.958111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.958822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.961274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.962028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.962599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.962763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.964675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.965368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:18.966320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:18.966982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:18.967612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.192257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.208127 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ba3e2cd-0b76-44c4-ba02-673ff1562ec4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.284532 Aug 30 04:21:19.211550 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1448/2853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:19.218455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:19.219296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.226269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.226967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.227617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.229109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.229918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.230516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.276092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.287094 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4513b54-f131-403f-a002-7d2669429c8a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1501 microversion: 2.1 time: 0.360759 Aug 30 04:21:19.288139 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1406/2854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:18 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1501 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:19.294076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:19.294899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.306468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.307489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.308575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.309765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.310433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.311060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.341905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.358714 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-74763bd8-52bd-4d84-be54-a992f378a6a8 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1485 microversion: 2.1 time: 0.143066 Aug 30 04:21:19.359348 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1449/2855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:19 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1485 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:19.367140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a47a4586-38b4-4ffd-8f13-4cd39ee1c938"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:19.369720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.379782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.380344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.380887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.381572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.382217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.382813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.397366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.413472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.419809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.422545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3951abc-444b-4e9b-8869-97a33c96bbcb tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1414 microversion: 2.54 time: 0.131709 Aug 30 04:21:19.425410 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1407/2856] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:19 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1414 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:19.438107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:19.438775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.441868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Cannot 'attach_volume' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state rescued Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/os-volume_attachments HTTP/1.1 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 74 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: {"volumeAttachment": {"volumeId": "a47a4586-38b4-4ffd-8f13-4cd39ee1c938"}} Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'attach_volume' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state rescued Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': 'b8256913-3e91-4d10-9b49-5a5e5fff2ae0', 'body': {'volumeAttachment': {'volumeId': 'a47a4586-38b4-4ffd-8f13-4cd39ee1c938'}}} Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 04:21:19.445775 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state rescued Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state rescued Aug 30 04:21:19.451340 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:19.452520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.452520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.452520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.452520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.452862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 409 to user: Cannot 'attach_volume' instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 while it is in vm_state rescued {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:19.452956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.452956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.453628 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e3eec36-cb29-432a-a4e7-35ba4b56aea4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.091174 Aug 30 04:21:19.458513 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1450/2857] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:21:19 2022] POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:21:19.465240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b4d8f938-72ed-4523-ae36-4494aa85adbf req-e12ddd14-56e5-4fe6-ac73-eefef7095cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c70b8cb-dd02-4546-99c4-5a2a226bd2ce", "name": "network-vif-deleted", "tag": "849caa1e-2af2-48d2-b587-0036eb8917d6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:19.475800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b4d8f938-72ed-4523-ae36-4494aa85adbf req-e12ddd14-56e5-4fe6-ac73-eefef7095cf6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.476452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b4d8f938-72ed-4523-ae36-4494aa85adbf req-e12ddd14-56e5-4fe6-ac73-eefef7095cf6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.477048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b4d8f938-72ed-4523-ae36-4494aa85adbf req-e12ddd14-56e5-4fe6-ac73-eefef7095cf6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.498908 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b4d8f938-72ed-4523-ae36-4494aa85adbf req-e12ddd14-56e5-4fe6-ac73-eefef7095cf6 service nova] Creating event network-vif-deleted:849caa1e-2af2-48d2-b587-0036eb8917d6 for instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce on n-h2-854925-5 Aug 30 04:21:19.508598 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b4d8f938-72ed-4523-ae36-4494aa85adbf req-e12ddd14-56e5-4fe6-ac73-eefef7095cf6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048018 Aug 30 04:21:19.510894 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1451/2858] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:19.529795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:19.530626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.537508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.537997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.538434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.539133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.539585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.540011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.675183 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d03f6a18-8b47-4b87-a6d9-fc5f302889c8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action" status: 202 len: 0 microversion: 2.1 time: 0.161401 Aug 30 04:21:19.679743 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1452/2859] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:19 2022] POST /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:21:19.692187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:19.693002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.706023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.714588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.715111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.715930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.716408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.716844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.766709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:19.776587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2bb18a6b-a9d1-4c35-a01f-b2bba63f88fb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.349925 Aug 30 04:21:19.777165 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1408/2860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:19 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:19.787747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:19.795894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:19.811443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.811956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.812405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:19.813134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:19.813695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:19.814098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.036592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.053344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.055234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.057656 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3588db3c-ff23-4e00-ae82-222d355765d6 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1548 microversion: 2.25 time: 0.376236 Aug 30 04:21:20.058413 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1453/2861] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:19 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1548 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:20.111144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.130080 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-69a49089-c439-4e16-89f3-9cc40ef5ebab tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1509 microversion: 2.1 time: 0.345965 Aug 30 04:21:20.131045 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1409/2862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:19 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1509 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:20.237281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:20.249698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.275628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.276325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.280060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.281003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.282475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.283255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.382357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:20.383663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.394543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.397226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.398409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.400470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.400973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.401463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.468200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.469132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.469612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.470077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lazy-loading 'fault' on Instance uuid 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:21:20.537847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcef695e467040c6a2285f79bdda0ebc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '552a894bc9be4817a7c3adee1f2af40a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.547826 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99096d31-9417-4e67-b1ba-0d657bd19429 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 200 len: 1315 microversion: 2.1 time: 0.170368 Aug 30 04:21:20.567699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1410/2863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:20 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:20.577214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:20.578099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.585078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.585672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.586115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.590650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.591546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.592499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.647669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.659997 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17a8cc9b-adfd-435d-b585-d4e40506d4a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.427971 Aug 30 04:21:20.660907 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1454/2864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:20 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:20.706436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.724053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.734847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:20.738257 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8593ae70-46d6-4c18-b7f3-2d668774d76b tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1414 microversion: 2.54 time: 0.169343 Aug 30 04:21:20.761276 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1411/2865] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:20 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1414 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:20.805084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:20.807774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:20.816002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.817198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.817904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:20.819010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:20.819704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:20.821035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.084122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.085127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.100458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.103430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.105352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.108716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.112789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.113575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.186743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.187227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.187998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.188123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lazy-loading 'fault' on Instance uuid e146cd9a-2f09-46fc-a6f0-c91ae439ec69 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:21:21.312646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.326243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.327709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.329211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.330450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-75da3961-d29b-45fd-97cd-f1e3f9ac51f4 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 200 len: 1351 microversion: 2.25 time: 0.250860 Aug 30 04:21:21.332962 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1412/2866] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 1351 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:21.341248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.344110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.351192 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-321af65d-8d1a-4d5f-90c9-94c6c0e0a26f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.550640 Aug 30 04:21:21.351719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.352216 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1455/2867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:20 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:21.352346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.352691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.353799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.354281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.354720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.526089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.537510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9274b7d3-bb8a-4d64-b080-8b6fb0102243 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1509 microversion: 2.1 time: 0.203233 Aug 30 04:21:21.545500 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1413/2868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:21.562999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-915d715d-a608-4f19-94c3-17fc1f75e67c req-2b4f119e-e8f2-4bc1-87b3-c7a5bbaaa9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e146cd9a-2f09-46fc-a6f0-c91ae439ec69", "name": "network-vif-deleted", "tag": "48649702-bdde-4500-91fc-108723f11e96"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:21.577389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-915d715d-a608-4f19-94c3-17fc1f75e67c req-2b4f119e-e8f2-4bc1-87b3-c7a5bbaaa9dd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.578029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-915d715d-a608-4f19-94c3-17fc1f75e67c req-2b4f119e-e8f2-4bc1-87b3-c7a5bbaaa9dd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.578460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-915d715d-a608-4f19-94c3-17fc1f75e67c req-2b4f119e-e8f2-4bc1-87b3-c7a5bbaaa9dd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.583585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.584302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] [instance: 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.595005 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-915d715d-a608-4f19-94c3-17fc1f75e67c req-2b4f119e-e8f2-4bc1-87b3-c7a5bbaaa9dd service nova] Creating event network-vif-deleted:48649702-bdde-4500-91fc-108723f11e96 for instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 on n-h2-854925-5 Aug 30 04:21:21.600659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.601148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.601610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.602316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.602801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.603228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.605597 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-915d715d-a608-4f19-94c3-17fc1f75e67c req-2b4f119e-e8f2-4bc1-87b3-c7a5bbaaa9dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046356 Aug 30 04:21:21.606449 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1456/2869] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:21.608241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:21.619087 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] HTTP exception thrown: Instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce could not be found. Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Request method failure captured: Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce HTTP/1.1 Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZAn8lJN7V5XAGxtu3njjdpoLLrgy6le9yddOB7jFjuy_WF3LuItt-F6AXK7Yp34sTjZqBoceb-Oq3_lcSWQ0Yy175NkjDAbiNHnTg4ZDMj6ydVYPxcWy6eW3FKaXdr6ELdKThx5f5iJ4wOSmnRjx57GJ0FZIE0lkr8_4RJWxH8n_4I Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 552a894bc9be4817a7c3adee1f2af40a Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_552a894bc9be4817a7c3adee1f2af40a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/552a894bc9be4817a7c3adee1f2af40a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/552a894bc9be4817a7c3adee1f2af40a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/552a894bc9be4817a7c3adee1f2af40a"}]}] Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 552a894bc9be4817a7c3adee1f2af40a Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-877818191 Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerAddressesNegativeTestJSON-877818191-project Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: bcef695e467040c6a2285f79bdda0ebc Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-877818191-project Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce could not be found. Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '7c70b8cb-dd02-4546-99c4-5a2a226bd2ce'} Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce could not be found. Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce could not be found. Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:21.620784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce could not be found. Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] Returning 404 to user: Instance 7c70b8cb-dd02-4546-99c4-5a2a226bd2ce could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c89ca864-b99e-4c74-a215-8778b3adbbb7 tempest-ServerAddressesNegativeTestJSON-877818191 tempest-ServerAddressesNegativeTestJSON-877818191-project] 10.222.0.27 "GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce" status: 404 len: 111 microversion: 2.1 time: 0.052289 Aug 30 04:21:21.624945 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1414/2870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/7c70b8cb-dd02-4546-99c4-5a2a226bd2ce => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:21:21.686224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.688153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.695208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.696235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.697789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.699301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.699962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.700467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.767892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.768520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:21.776758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.777255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.777959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.778672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:21.779189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:21.779827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:21.920574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.933576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.936202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.937968 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-773c2b95-22ae-4439-ac23-88a13473e43a tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1399 microversion: 2.54 time: 0.173981 Aug 30 04:21:21.939480 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1415/2871] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1399 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:21.966627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6be4b3c0-596d-4948-a25c-4560ee3567c1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '.version_select at 0x7fe96949c1f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:21.978508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:21.988515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:21.993299 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c24eacfa-4d4e-4e92-930a-1b43bae3495a tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.313007 Aug 30 04:21:21.995366 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1457/2872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:21 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:22.003215 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6be4b3c0-596d-4948-a25c-4560ee3567c1 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1452106651" status: 204 len: 0 microversion: 2.54 time: 0.043440 Aug 30 04:21:22.005312 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1416/2873] 10.222.0.27 () {60 vars in 1319 bytes} [Tue Aug 30 04:21:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1452106651 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:21:22.018159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.019936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.027809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.028724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.029241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.030350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.030889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.031483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.053665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:22.069257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:21:22.178331 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b26e6ba9-e406-44ba-aa9a-1ed3f34a8649 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "DELETE /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 204 len: 0 microversion: 2.54 time: 0.164400 Aug 30 04:21:22.188160 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1458/2874] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:21:22 2022] DELETE /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:21:22.199691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.201197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.212934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.213916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.214854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.215982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.216767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.217514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.336127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.348094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.349581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.361349 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c171fe37-76f4-4fb1-8df3-a6ecdecebc68 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1405 microversion: 2.54 time: 0.160606 Aug 30 04:21:22.361349 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1417/2875] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:22.368738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.373382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.374040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.379776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: e146cd9a-2f09-46fc-a6f0-c91ae439ec69] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.385771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.386504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.386918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.387460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.387736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.388281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.389079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.389228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.389754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.389897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.390196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.390300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.406080 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] HTTP exception thrown: Instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 could not be found. Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Request method failure captured: Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 HTTP/1.1 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY5Zw-Pl1gLiQL1xqMYS1PBGX-3CvtFLeJin-6zfrHjtE16RML5jTqrYl3usPPD7Fp02FBIeu8e6bmVaUF4wb2kzIa_pGnlHTaqtbvB9ZGOjZFA5BB5NbyZepz1eZvngkXqOCOHl8JwviuZmUbL1Q3rxsWRrwfvDnK218NFnSkWncNI Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02e52c9195cf4e3caaa492e3c093e620", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}] Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 45901cc649784305a10c8a9278d1bef3 Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 could not be found. Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'e146cd9a-2f09-46fc-a6f0-c91ae439ec69'} Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 could not be found. Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 could not be found. Aug 30 04:21:22.408154 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 could not be found. Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:22.412943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Returning 404 to user: Instance e146cd9a-2f09-46fc-a6f0-c91ae439ec69 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:22.414617 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f49c8738-f01f-4bb7-a7fc-103baf83d05d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69" status: 404 len: 111 microversion: 2.25 time: 0.059868 Aug 30 04:21:22.414984 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1459/2876] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/e146cd9a-2f09-46fc-a6f0-c91ae439ec69 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:21:22.425355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.426092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.432226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.432805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.433320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.434056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.434511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.434941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.464035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:21:22.583569 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db92b303-7a22-4aca-a781-dc9a37a68b21 tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 204 len: 0 microversion: 2.25 time: 0.163501 Aug 30 04:21:22.589095 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1460/2877] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:21:22 2022] DELETE /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:21:22.591455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.592166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.600020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.600663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.600827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.601768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.601960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.603251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.647142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.658756 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9a799acd-da43-4d7b-b837-1c119ceeee1d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.290127 Aug 30 04:21:22.659936 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1418/2878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:22.679531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:22.680461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:22.688592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.689388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.689997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.690886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:22.691629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:22.692253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:22.990228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.998265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:22.999267 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6320f516-846b-4fed-b056-60c6c863473e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1509 microversion: 2.1 time: 0.413203 Aug 30 04:21:23.000360 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1461/2879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1509 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:23.005742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8327833e-7451-4270-89bd-3711e9e3f67e req-dab51dba-3593-4f5d-a56e-58e39e2c3499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b5e35e-b6af-4419-b964-4f7a1b665945", "name": "network-vif-plugged", "status": "completed", "tag": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:23.017085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8327833e-7451-4270-89bd-3711e9e3f67e req-dab51dba-3593-4f5d-a56e-58e39e2c3499 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.017607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8327833e-7451-4270-89bd-3711e9e3f67e req-dab51dba-3593-4f5d-a56e-58e39e2c3499 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.018046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8327833e-7451-4270-89bd-3711e9e3f67e req-dab51dba-3593-4f5d-a56e-58e39e2c3499 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.022267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.023718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.025140 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ab7c55e8-6879-48bd-bd3f-5e14a5b793da tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1564 microversion: 2.25 time: 0.359881 Aug 30 04:21:23.025920 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1419/2880] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:22 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1564 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:23.030899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:23.031207 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8327833e-7451-4270-89bd-3711e9e3f67e req-dab51dba-3593-4f5d-a56e-58e39e2c3499 service nova] Creating event network-vif-plugged:3a0f694a-1f77-44c2-8170-8b4cb5f4985a for instance 89b5e35e-b6af-4419-b964-4f7a1b665945 on n-h1-854925-5 Aug 30 04:21:23.031904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:23.038223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.039008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.039646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.040570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.041214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.041847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.042154 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8327833e-7451-4270-89bd-3711e9e3f67e req-dab51dba-3593-4f5d-a56e-58e39e2c3499 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039263 Aug 30 04:21:23.042799 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1462/2881] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:23.381718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:23.383287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:23.390956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.391454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.391918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.392632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.393245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.393710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.634832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.635060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.643332 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e5d0de77-a4c8-40e4-83e2-b0027f7cdb65 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.616174 Aug 30 04:21:23.653523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.653523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:23.653523 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9bc7ca2e-3437-4b1e-98b2-012e2d011259 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1405 microversion: 2.54 time: 0.274761 Aug 30 04:21:23.658474 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1463/2882] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:23 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1405 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:23.658811 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1420/2883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:23 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:23.681928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:23.683238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:23.691393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.691922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.692350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:23.693077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:23.693556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:23.694094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.024152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.025695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.034753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.036266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.039894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.040532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.041400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.042136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.042653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.047814 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-faf426ac-7317-4c53-8c5e-3e6af66c513c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1498 microversion: 2.1 time: 0.366873 Aug 30 04:21:24.049072 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1464/2884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:23 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1498 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:24.054180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.055093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.079494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.079999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.080444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.082096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.083111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.083767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.612387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.622595 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82935ff5-0621-4114-8b82-14d0fede322a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1515 microversion: 2.1 time: 0.602280 Aug 30 04:21:24.623348 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1421/2885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1515 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:24.633594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.655769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.662159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.665995 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00dad9fd-0fb4-490c-9c72-e4c4fe1cb92a tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1564 microversion: 2.25 time: 0.614649 Aug 30 04:21:24.667390 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1465/2886] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1564 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:24.669105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.670277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.680405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:24.681303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:24.687034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.689884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.691177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.694435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.695605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.697167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.698097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.699388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.702989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.704067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.704752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.706034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.816618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:24.817975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:24.819220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:24.820325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lazy-loading 'fault' on Instance uuid 671cffc6-323f-4e22-b2c5-b32ac0750a02 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:21:24.948574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.957800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.959483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83e508715c9443adb381ada40b383523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eb06c960e3c49bbb8ba09bf518e61b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:24.961022 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95bf672c-4e9c-4b6c-92f3-cffd24ade153 tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 200 len: 1410 microversion: 2.54 time: 0.285324 Aug 30 04:21:24.978609 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1466/2887] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 1410 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:25.081099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:25.082474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:25.104456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.105004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.109233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.110079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.111142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.125660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.270639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.280903 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-71420251-233f-44cf-9d10-39bcd59ab284 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1323 microversion: 2.1 time: 0.617441 Aug 30 04:21:25.281904 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1422/2888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:24 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:25.503112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-010de63d-4408-48dd-b8ac-47e2ee64d458 req-c679863d-8814-4b1a-9ffa-a6885145a84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79cab24f-d0e3-4f5b-9c03-160d24dee5cd", "name": "network-vif-deleted", "tag": "68819321-643b-4b16-8e40-c2405c0e617b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:25.532361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-010de63d-4408-48dd-b8ac-47e2ee64d458 req-c679863d-8814-4b1a-9ffa-a6885145a84b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.538229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.542437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-010de63d-4408-48dd-b8ac-47e2ee64d458 req-c679863d-8814-4b1a-9ffa-a6885145a84b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.542895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-010de63d-4408-48dd-b8ac-47e2ee64d458 req-c679863d-8814-4b1a-9ffa-a6885145a84b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.547932 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-349bebdf-ad80-4507-ab1a-097612ea766e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 200 len: 1475 microversion: 2.1 time: 0.472622 Aug 30 04:21:25.550425 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1467/2889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:25 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 1475 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:25.570698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1750126854"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:25.574067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:25.590979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.591341 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-010de63d-4408-48dd-b8ac-47e2ee64d458 req-c679863d-8814-4b1a-9ffa-a6885145a84b service nova] Creating event network-vif-deleted:68819321-643b-4b16-8e40-c2405c0e617b for instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd on n-h2-854925-5 Aug 30 04:21:25.591462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.591891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.592615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.593072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.597713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.607175 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-010de63d-4408-48dd-b8ac-47e2ee64d458 req-c679863d-8814-4b1a-9ffa-a6885145a84b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106985 Aug 30 04:21:25.608747 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1423/2890] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:25.696828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:25.698260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:25.711279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.714020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.714658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.717362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.718103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.720213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.797477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:25.800002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:25.803152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:25.803989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lazy-loading 'fault' on Instance uuid 79cab24f-d0e3-4f5b-9c03-160d24dee5cd {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:21:25.927900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.946274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.949041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45901cc649784305a10c8a9278d1bef3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02e52c9195cf4e3caaa492e3c093e620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:25.952934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca72916c-9dec-4c4f-ae30-ec2da544df0d tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 200 len: 1351 microversion: 2.25 time: 0.259852 Aug 30 04:21:25.956484 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1424/2891] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:25 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 1351 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:25.990126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:25.991282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] [instance: 671cffc6-323f-4e22-b2c5-b32ac0750a02] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.005802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.006562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.007214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.008147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.009733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.010523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.044158 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] HTTP exception thrown: Instance 671cffc6-323f-4e22-b2c5-b32ac0750a02 could not be found. Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Request method failure captured: Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 HTTP/1.1 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZAW6pfpXnJbAhZiofWuN8p2GOodUYCOX0tuyQYQZyRcFezslXKxOBWYFTNLJGYzqrUI-dS55sjA-mdfj31EWZyoARtB_a1g-cfeGarJ-B-y6D6iUHWho1ecT3NPgzV8BakBLdMurQkvW650Ei1peAazLoXMfd-sKhvpAI2F_WKSUBA Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.54 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0eb06c960e3c49bbb8ba09bf518e61b9 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerShowV254Test-1020553072 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0eb06c960e3c49bbb8ba09bf518e61b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0eb06c960e3c49bbb8ba09bf518e61b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0eb06c960e3c49bbb8ba09bf518e61b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0eb06c960e3c49bbb8ba09bf518e61b9"}]}] Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerShowV254Test-1020553072 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0eb06c960e3c49bbb8ba09bf518e61b9 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerShowV254Test-1020553072 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerShowV254Test-1020553072-project Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 83e508715c9443adb381ada40b383523 Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerShowV254Test-1020553072-project Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 671cffc6-323f-4e22-b2c5-b32ac0750a02 could not be found. Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '671cffc6-323f-4e22-b2c5-b32ac0750a02'} Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 671cffc6-323f-4e22-b2c5-b32ac0750a02 could not be found. Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 671cffc6-323f-4e22-b2c5-b32ac0750a02 could not be found. Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:26.046381 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:26.050564 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:26.050564 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:26.050564 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:26.050564 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:26.050564 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:26.050564 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 671cffc6-323f-4e22-b2c5-b32ac0750a02 could not be found. Aug 30 04:21:26.050564 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:21:26.057956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] Returning 404 to user: Instance 671cffc6-323f-4e22-b2c5-b32ac0750a02 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:26.059204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-414bc45d-dce9-4648-a9b4-c1f79b45386e tempest-ServerShowV254Test-1020553072 tempest-ServerShowV254Test-1020553072-project] 10.222.0.27 "GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02" status: 404 len: 111 microversion: 2.54 time: 0.075566 Aug 30 04:21:26.060324 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1425/2892] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:25 2022] GET /compute/v2.1/servers/671cffc6-323f-4e22-b2c5-b32ac0750a02 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:21:26.085222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-297df004-839c-4360-959a-983eb3c805b0 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786/action" status: 202 len: 0 microversion: 2.1 time: 0.514111 Aug 30 04:21:26.089300 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1468/2893] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:25 2022] POST /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 30 04:21:26.101779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-96bfe32e-fbc2-45f8-8e12-70ee24ff9bc1 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969487550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.191019 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-96bfe32e-fbc2-45f8-8e12-70ee24ff9bc1 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.093277 Aug 30 04:21:26.203760 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1426/2894] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:26.304141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.305016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.324078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.324623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.326157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.326884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.327347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.331407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:26.856777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:26.865417 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83cd87c8-8798-4c85-a04a-03edee623042 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1520 microversion: 2.1 time: 0.566314 Aug 30 04:21:26.866946 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1469/2895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1520 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:26.888178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b6b272bb-6f5c-43b2-9e40-ed3d4bc6185d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'create', calling method: .version_select at 0x7fe969448790>, body: {"pool": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:26.981335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:26.981967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] [instance: 79cab24f-d0e3-4f5b-9c03-160d24dee5cd] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:26.997623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:26.998393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:26.999118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.000175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:27.001088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:27.001771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:27.024644 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] HTTP exception thrown: Instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd could not be found. Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Request method failure captured: Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd HTTP/1.1 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY5Zw-Pl1gLiQL1xqMYS1PBGX-3CvtFLeJin-6zfrHjtE16RML5jTqrYl3usPPD7Fp02FBIeu8e6bmVaUF4wb2kzIa_pGnlHTaqtbvB9ZGOjZFA5BB5NbyZepz1eZvngkXqOCOHl8JwviuZmUbL1Q3rxsWRrwfvDnK218NFnSkWncNI Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.25 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_02e52c9195cf4e3caaa492e3c093e620", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/02e52c9195cf4e3caaa492e3c093e620"}]}] Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 02e52c9195cf4e3caaa492e3c093e620 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-337586636 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 45901cc649784305a10c8a9278d1bef3 Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-337586636-project Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd could not be found. Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '79cab24f-d0e3-4f5b-9c03-160d24dee5cd'} Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd could not be found. Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd could not be found. Aug 30 04:21:27.027011 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd could not be found. Aug 30 04:21:27.033406 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:21:27.035806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] Returning 404 to user: Instance 79cab24f-d0e3-4f5b-9c03-160d24dee5cd could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:21:27.036800 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8e1087f3-918f-4172-92d2-9ac77484e34e tempest-LiveAutoBlockMigrationV225Test-337586636 tempest-LiveAutoBlockMigrationV225Test-337586636-project] 10.222.0.27 "GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd" status: 404 len: 111 microversion: 2.25 time: 0.060008 Aug 30 04:21:27.038936 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1470/2896] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:26 2022] GET /compute/v2.1/servers/79cab24f-d0e3-4f5b-9c03-160d24dee5cd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:21:27.224744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b25615b2-5438-4e0e-8511-e5911793f482 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a7fc820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:27.324544 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b25615b2-5438-4e0e-8511-e5911793f482 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.115496 Aug 30 04:21:27.332298 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1471/2897] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:27 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:27.424371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1e215939-37bc-4c5f-9e38-e5b758b8f268 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'create', calling method: .version_select at 0x7fe96a743700>, body: {"keypair": {"name": "tempest-keypair-375704477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeTM+fcwopjRf+U5nnwVHTCB1VZWEp5IT6Th2a2BxOjt79xqubjaZRtW2wiohGrqbMtpji4fgmyaeVDion8SFyk7d9HjetSqW3Eotl3iYVW0JCPjDJnqi8w75R8huNAIA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:27.443778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1e215939-37bc-4c5f-9e38-e5b758b8f268 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:27.449590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1e215939-37bc-4c5f-9e38-e5b758b8f268 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for user 84dd97e2c7fb48f0a9d8f93f1211dc91 and project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:27.477917 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1e215939-37bc-4c5f-9e38-e5b758b8f268 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056840 Aug 30 04:21:27.478776 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1472/2898] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:21:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:28.342030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83430b5d-b36d-4921-a3cd-5b567cf9ca18 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96acded30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:28.395572 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83430b5d-b36d-4921-a3cd-5b567cf9ca18 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.059406 Aug 30 04:21:28.404949 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1473/2899] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:28 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:29.411731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c510baf1-8887-41b3-af23-23bf7ecca0a2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a7fc3a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:29.462343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c510baf1-8887-41b3-af23-23bf7ecca0a2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.054094 Aug 30 04:21:29.463081 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1474/2900] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:29 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:30.136476 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b6b272bb-6f5c-43b2-9e40-ed3d4bc6185d tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.253263 Aug 30 04:21:30.137968 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1427/2901] 10.222.0.27 () {60 vars in 1170 bytes} [Tue Aug 30 04:21:26 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:30.294178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1814994426", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "f1e14a65-aaa1-4738-b8ee-8982958c9b28"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:30.387251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] validate_networks() for [('f1e14a65-aaa1-4738-b8ee-8982958c9b28', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:21:30.485561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3d7029d-9726-42f6-9e7e-d05526438f64 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9699fbca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:30.567273 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3d7029d-9726-42f6-9e7e-d05526438f64 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.091967 Aug 30 04:21:30.582918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1428/2902] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:30 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:31.009662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:31.011381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:31.012300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:31.012943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:31.013744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:31.056424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.056915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.057425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.058360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:31.059077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:31.059665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:31.078983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Getting quotas for project 6c7facb64d7a41a0974d2b5aa58c66ab. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:31.087913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Getting quotas for user 34f73ac855ca447286ee1788fd2520f2 and project 6c7facb64d7a41a0974d2b5aa58c66ab. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:31.111176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:31.116136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:31.207531 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91c19ccf-12f3-46a2-a463-26f2bf4c3ea4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923498 Aug 30 04:21:31.208807 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1475/2903] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:21:31.224108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9620da15-1829-4032-b3d0-301a449c7409 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:31.226515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9620da15-1829-4032-b3d0-301a449c7409 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:31.297359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9620da15-1829-4032-b3d0-301a449c7409 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:31.307378 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9620da15-1829-4032-b3d0-301a449c7409 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1224 microversion: 2.1 time: 0.088250 Aug 30 04:21:31.308965 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1429/2904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:31 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:31.584240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b12e02eb-0019-43ef-a034-4a230c6a36a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a5d3040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:31.647545 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b12e02eb-0019-43ef-a034-4a230c6a36a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.068634 Aug 30 04:21:31.657144 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1476/2905] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:31 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:32.338699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:32.341359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:32.375257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.377340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.380521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.384137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:32.385942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:32.387476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:32.604419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:32.625790 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28d33cf3-1f8a-4662-be09-a206c29d22d0 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1276 microversion: 2.1 time: 0.290144 Aug 30 04:21:32.639939 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1430/2906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:32 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1276 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:32.679790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a98dfb24-a743-42fa-9dc0-9497e55b8887 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a537550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:32.792829 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a98dfb24-a743-42fa-9dc0-9497e55b8887 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.131313 Aug 30 04:21:32.806577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1477/2907] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:32 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:33.663984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.665171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:33.679086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.679600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.680077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.680810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:33.681385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:33.685019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:33.799749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:33.815359 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a01ec1f-1d68-4a8e-b144-67553f07ec22 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1282 microversion: 2.1 time: 0.147961 Aug 30 04:21:33.816334 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1431/2908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1282 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:33.829306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b8028304-5124-493d-8703-a20d5e5454ce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9693e3af0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:33.891289 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b8028304-5124-493d-8703-a20d5e5454ce tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.073529 Aug 30 04:21:33.892333 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1432/2909] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:33 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:33.979038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1776347756", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": "none"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:33.995133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1bdbec84-5b46-464e-a9d2-8fcf3b163090 req-b8b1acc9-42ad-4bcc-b155-4492b0416cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded16a4-47e1-44cc-8113-aa7538c0c786", "name": "network-vif-plugged", "status": "completed", "tag": "347553e6-ccd3-4b81-91f8-e6545b41a764"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:34.012337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1bdbec84-5b46-464e-a9d2-8fcf3b163090 req-b8b1acc9-42ad-4bcc-b155-4492b0416cb5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.012835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1bdbec84-5b46-464e-a9d2-8fcf3b163090 req-b8b1acc9-42ad-4bcc-b155-4492b0416cb5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.013277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1bdbec84-5b46-464e-a9d2-8fcf3b163090 req-b8b1acc9-42ad-4bcc-b155-4492b0416cb5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.041941 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1bdbec84-5b46-464e-a9d2-8fcf3b163090 req-b8b1acc9-42ad-4bcc-b155-4492b0416cb5 service nova] Creating event network-vif-plugged:347553e6-ccd3-4b81-91f8-e6545b41a764 for instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 on n-h1-854925-5 Aug 30 04:21:34.055562 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1bdbec84-5b46-464e-a9d2-8fcf3b163090 req-b8b1acc9-42ad-4bcc-b155-4492b0416cb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064594 Aug 30 04:21:34.056845 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1433/2910] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:34.066104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:34.067706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:34.068925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:34.069536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:34.070335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:34.083831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.084681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.085307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.086517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.087303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.088172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.123823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Getting quotas for project f3262ed2851b411d8a9e6273292a80fe. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:34.137934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Getting quotas for user 424b82c5691b4b1fbbeb624fcfb80dee and project f3262ed2851b411d8a9e6273292a80fe. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:34.155033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:34.160211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:34.163076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:34.245117 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-939f31cb-536e-476a-85aa-ef03414f2a0a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.471381 Aug 30 04:21:34.246637 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1478/2911] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:21:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:21:34.267632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63060222-814a-4cb4-978b-bd7114170119 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.282959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63060222-814a-4cb4-978b-bd7114170119 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.568184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63060222-814a-4cb4-978b-bd7114170119 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.576864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63060222-814a-4cb4-978b-bd7114170119 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.590705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63060222-814a-4cb4-978b-bd7114170119 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:34.594481 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63060222-814a-4cb4-978b-bd7114170119 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e" status: 200 len: 1278 microversion: 2.47 time: 0.338839 Aug 30 04:21:34.597175 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1434/2912] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e => generated 1278 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:34.712204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-49185828", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": "none"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:34.842392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:34.843123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:34.857882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.858759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.860517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.862362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.868303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.869018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.937527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:34.937954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:34.938424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:34.938836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:34.939245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:34.976064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.981990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.982648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:34.983332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:34.983806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:34.984231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:35.048044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Getting quotas for project f3262ed2851b411d8a9e6273292a80fe. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:35.060190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Getting quotas for user 424b82c5691b4b1fbbeb624fcfb80dee and project f3262ed2851b411d8a9e6273292a80fe. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:35.082327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:35.084210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:35.088112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:35.093014 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73a716c1-c1ac-4686-95c9-2b3260337b45 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1282 microversion: 2.1 time: 0.255528 Aug 30 04:21:35.095294 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1435/2913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:34 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:35.116526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5a9034e-43b0-4a60-b798-1515962d4e4e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96b0863a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.206472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5a9034e-43b0-4a60-b798-1515962d4e4e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.109680 Aug 30 04:21:35.207487 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1436/2914] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:35 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:35.229687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1861763285", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b7ec388d-fb3a-43eb-a589-c1170d5f3565"}], "security_groups": [{"name": "tempest-securitygroup--828862832"}], "key_name": "tempest-keypair-375704477", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:35.243091 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d92ecaef-da81-4246-b9c5-e420fd825e74 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.536394 Aug 30 04:21:35.246358 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1479/2915] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:21:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:21:35.259509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-22b8bfbe-c033-44ab-9247-5575578d8b96 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:35.287929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-22b8bfbe-c033-44ab-9247-5575578d8b96 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:35.421343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-22b8bfbe-c033-44ab-9247-5575578d8b96 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "PUT /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 990 microversion: 2.47 time: 0.167816 Aug 30 04:21:35.423191 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1480/2916] 10.222.0.27 () {62 vars in 1297 bytes} [Tue Aug 30 04:21:35 2022] PUT /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 990 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:21:35.441912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f02ff9a-5dfc-48db-93bf-766cf4bbf266 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:35.442837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1f02ff9a-5dfc-48db-93bf-766cf4bbf266 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:36.228561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1f02ff9a-5dfc-48db-93bf-766cf4bbf266 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.240034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1f02ff9a-5dfc-48db-93bf-766cf4bbf266 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.243040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1f02ff9a-5dfc-48db-93bf-766cf4bbf266 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.246934 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f02ff9a-5dfc-48db-93bf-766cf4bbf266 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1276 microversion: 2.47 time: 0.810741 Aug 30 04:21:36.249453 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1481/2917] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:35 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1276 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:36.271070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:36.275889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:36.297587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.315112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.319951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.336293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:36.339245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:36.341269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:36.348924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:36.577606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:36.590952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a43cece3-b6e5-49e1-97b8-bebd38f1cfa4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1282 microversion: 2.1 time: 0.332540 Aug 30 04:21:36.591756 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1482/2918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:36 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1282 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:36.622709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1949f966-e401-4ead-9c26-feba56706eca tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969ce7ca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:36.656337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] validate_networks() for [('b7ec388d-fb3a-43eb-a589-c1170d5f3565', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:21:36.728643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1949f966-e401-4ead-9c26-feba56706eca tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.121178 Aug 30 04:21:36.738575 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1483/2919] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:36 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:37.285372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:37.287359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:37.304634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.321759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.330466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.332964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.334895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.335517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.648476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.661144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.662671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:37.671329 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64906ef1-e4e2-4a42-aa6e-1abd496c0b82 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1272 microversion: 2.47 time: 0.399644 Aug 30 04:21:37.672301 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1484/2920] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:37 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1272 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:37.677161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:37.686338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:37.694497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.699523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.700602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:37.701666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:37.702306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:37.703484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.365929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:38.379036 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41ace461-fbb1-4297-9f33-ed6a5bf9dbc4 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.705412 Aug 30 04:21:38.395910 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1485/2921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:37 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:38.413875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37cce098-448f-4c02-8d69-c9aa1548961a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969cadaf0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.517615 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37cce098-448f-4c02-8d69-c9aa1548961a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.120285 Aug 30 04:21:38.518725 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1486/2922] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:38.698126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:38.698898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:38.728014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.742859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.743551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.744448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.745947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.750744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.777884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:38.777884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:38.778497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:38.778842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:38.779189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:38.804073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.804572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.805815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.806734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:38.807760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:38.808169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:38.959796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:21:38.994736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Getting quotas for user 84dd97e2c7fb48f0a9d8f93f1211dc91 and project 4ddddf2cb39446c6b3bf9ce1e163d60f. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:21:39.032026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:21:39.035240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:21:39.159792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.168811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.179127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.182458 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eff3a7bc-f05b-4fd2-b087-76e9411e7bdb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1328 microversion: 2.47 time: 0.490874 Aug 30 04:21:39.186308 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1487/2923] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:38 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1328 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:39.191971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-76e77c3b-f28d-467d-8532-7d044435eaea tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.980219 Aug 30 04:21:39.195164 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1437/2924] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:21:35 2022] POST /compute/v2.1/servers => generated 408 bytes in 3984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:21:39.212954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-290585e8-7b88-40d9-8800-0a9a0114134b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.214125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-290585e8-7b88-40d9-8800-0a9a0114134b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:39.363512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-290585e8-7b88-40d9-8800-0a9a0114134b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.371827 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-290585e8-7b88-40d9-8800-0a9a0114134b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1245 microversion: 2.1 time: 0.163500 Aug 30 04:21:39.385864 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1488/2925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1245 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:39.401282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.401955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:39.414022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.418039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.419064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.420219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:39.422263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:39.422910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:39.533994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-851b2944-0325-42e4-8db9-c52708c64c48 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a6e93a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:39.644082 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-851b2944-0325-42e4-8db9-c52708c64c48 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.113985 Aug 30 04:21:39.645172 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1489/2926] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:39.820914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:39.832097 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c659446a-ac14-442d-ad58-b5d045b4d74e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.435529 Aug 30 04:21:39.835687 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1438/2927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:39 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:40.214594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.215556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:40.229583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.233551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.234243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.237365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:40.238658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:40.240382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:40.397798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e156a11-ec4d-4a1c-94c6-f0caddfab446 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:40.399341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e156a11-ec4d-4a1c-94c6-f0caddfab446 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:41.449493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.454700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e156a11-ec4d-4a1c-94c6-f0caddfab446 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.463803 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e156a11-ec4d-4a1c-94c6-f0caddfab446 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1245 microversion: 2.1 time: 1.069538 Aug 30 04:21:41.467865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.472526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:41.478247 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1439/2928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1245 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:41.480394 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c8b5a9c-d720-4d12-a859-7910079a87c1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1336 microversion: 2.47 time: 1.271981 Aug 30 04:21:41.483878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-babc5c44-927f-433f-80b6-e614dde8e3bb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969f868b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:41.486531 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1490/2929] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:40 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1336 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:41.528435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:41.536632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:41.564949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.568322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.568858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.570485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:41.572905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:41.577558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:41.609309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-babc5c44-927f-433f-80b6-e614dde8e3bb tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.129592 Aug 30 04:21:41.611859 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1440/2930] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:41 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:42.491701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.492925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:42.525543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.534666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.535886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.536677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.537165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.537643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.701175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.716474 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18c4fa85-c2a1-481d-80f1-236526728d46 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 1.226224 Aug 30 04:21:42.746405 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1491/2931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:41 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:42.765198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.765880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:42.775918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.777744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.778772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.779542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:42.781205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:42.784319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:42.806265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:42.826917 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b480ed2-1244-4370-bd4b-414a46c5102a tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1297 microversion: 2.1 time: 0.338940 Aug 30 04:21:42.840957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1441/2932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1297 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:42.840957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a10f6919-1ef3-4f87-b401-3c24dc236159 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9699fb3a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:42.944828 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a10f6919-1ef3-4f87-b401-3c24dc236159 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.115769 Aug 30 04:21:42.945985 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1442/2933] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:43.069728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.089163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.091890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:43.095307 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e851f1d1-2385-4eaf-9212-526f48605698 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1334 microversion: 2.47 time: 0.347568 Aug 30 04:21:43.119209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ee52dc4d-7c1c-4d04-bcc2-a028b30f9b5f req-64854164-844e-4646-99f9-fe703319ad6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187938a1-c38b-4179-85fd-5d7af72f5344", "tag": "f4c874fd-abee-42f2-8868-c964c2487dda"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:43.121037 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1492/2934] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:42 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1334 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:43.147125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ee52dc4d-7c1c-4d04-bcc2-a028b30f9b5f req-64854164-844e-4646-99f9-fe703319ad6d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.147701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ee52dc4d-7c1c-4d04-bcc2-a028b30f9b5f req-64854164-844e-4646-99f9-fe703319ad6d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.149666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ee52dc4d-7c1c-4d04-bcc2-a028b30f9b5f req-64854164-844e-4646-99f9-fe703319ad6d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.180112 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ee52dc4d-7c1c-4d04-bcc2-a028b30f9b5f req-64854164-844e-4646-99f9-fe703319ad6d service nova] Creating event network-changed:f4c874fd-abee-42f2-8868-c964c2487dda for instance 187938a1-c38b-4179-85fd-5d7af72f5344 on n-h2-854925-5 Aug 30 04:21:43.191192 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ee52dc4d-7c1c-4d04-bcc2-a028b30f9b5f req-64854164-844e-4646-99f9-fe703319ad6d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087814 Aug 30 04:21:43.201581 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1443/2935] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:43.785039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.791758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.839958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.842706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.850020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.850577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:43.852587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:43.852738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.853507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.857056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.868766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.874114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.882139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:43.883555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:43.884233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:43.884850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.077426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.095810 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32bb08ec-a46a-4485-a3ec-70f997e358bd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1315 microversion: 2.1 time: 0.242610 Aug 30 04:21:44.118069 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1444/2936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:44.131806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-85cdda68-77d4-4a51-8a2a-7a21b3d5c299 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9693baa60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:44.224365 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-85cdda68-77d4-4a51-8a2a-7a21b3d5c299 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.104426 Aug 30 04:21:44.225486 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1445/2937] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:44 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:44.235354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:44.236674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:44.252649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.258765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.265301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.266586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.267225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.267816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.326970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:44.590244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.600563 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f291296-d4cd-4748-96ac-cc0ba451ff53 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.835665 Aug 30 04:21:44.602447 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1493/2938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:43 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:44.659871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.674673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.676469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:44.679072 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-836473a0-210a-4cc8-a8ba-889b29877b78 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1355 microversion: 2.47 time: 0.447933 Aug 30 04:21:44.682289 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1446/2939] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:44 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1355 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:44.710536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:44.714133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:44.738149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.739915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.740387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.741137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:44.741631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:44.747484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:44.991131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:21:44.991696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:21:44.997369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:21:44.998046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:21:44.998658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:21:45.031778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:45.132175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.132753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.134775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.147920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.148479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.148985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.149401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.149546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.150179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.150299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.150627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.153959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.155195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.156345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.159510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.229762 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf5cb089-07a8-41bc-894a-90fef05490e1 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "POST /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb/action" status: 202 len: 1077 microversion: 2.47 time: 0.524182 Aug 30 04:21:45.233091 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1494/2940] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:21:44 2022] POST /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb/action => generated 1077 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 30 04:21:45.253981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7180064-d6c3-4f4a-a5ff-47ae0f930eae tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a537550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.352637 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7180064-d6c3-4f4a-a5ff-47ae0f930eae tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.107241 Aug 30 04:21:45.354327 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1495/2941] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:45.359949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.360804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.370214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.370701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.371769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.373639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.375417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.376366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.421094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.431883 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de2190ba-db8e-4197-bb19-f55c786cab77 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1303 microversion: 2.1 time: 0.303732 Aug 30 04:21:45.455934 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1447/2942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1303 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:45.532377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.548156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.549736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:45.551791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f10e7c7-3a2c-411b-9a02-95a8d057f650 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.196263 Aug 30 04:21:45.553765 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1496/2943] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:45.628044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:45.628746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:45.662329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.663403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.664636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:45.668088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:45.669042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:45.671157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.297997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.313768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d5e3851-e373-489d-954e-5652cc2aba84 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.689733 Aug 30 04:21:46.314708 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1448/2944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:45 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:46.374842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e9236d0-fe24-4a74-8590-e802dbfe7549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a8181f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.479520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.480592 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e9236d0-fe24-4a74-8590-e802dbfe7549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.115475 Aug 30 04:21:46.480922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:46.483570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1497/2945] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:46.493807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.494756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.495397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.497819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.498742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.501787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.585376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:46.585723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:46.597859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.599557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.600181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.600908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:46.601913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:46.602348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:46.704650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.716449 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2fe128d7-ac89-4f69-b159-4fb5f04184c5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1303 microversion: 2.1 time: 0.241109 Aug 30 04:21:46.718245 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1449/2946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1303 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:46.790054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.807095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.816889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:46.822477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28e1f7a0-1708-46ae-8773-067b00334580 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.241079 Aug 30 04:21:46.837555 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1498/2947] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:46 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:21:47.339459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:47.340306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:47.355158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.356105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.356755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.357567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.358124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.358771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.496850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c1be6ab-e5e0-4b88-8413-5acacab2bf69 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a8181f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:47.578483 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c1be6ab-e5e0-4b88-8413-5acacab2bf69 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.086563 Aug 30 04:21:47.579362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1499/2948] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:47 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:47.654479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.663614 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cce25e8b-e39b-4138-876d-6b1405cfb59e tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.329015 Aug 30 04:21:47.668665 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1450/2949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:47 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:47.740263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:47.741478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:47.767681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.768564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.769209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.770301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.771062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.771786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.852120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:47.854488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:47.869749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.876518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.878179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.885118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:47.886128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:47.886805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:47.946966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:47.966260 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-35ead161-88dd-4213-b2b0-3df23ceeea15 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1303 microversion: 2.1 time: 0.229187 Aug 30 04:21:47.980342 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1500/2950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:47 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1303 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:48.055725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:48.092141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:48.094646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:48.096762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c3d07d1-ad81-4900-9c19-4fc4bdc7ec01 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.252042 Aug 30 04:21:48.114721 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1451/2951] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:47 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:48.593891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-289bd810-441e-4b25-8d4e-fb9cdd02c5cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a7744c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:48.692511 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-289bd810-441e-4b25-8d4e-fb9cdd02c5cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.102393 Aug 30 04:21:48.696306 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1501/2952] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:48 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:48.704494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:48.705112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:48.722151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.722645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.723086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.723796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:48.724249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:48.724675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:48.885549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:49.007184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:49.012309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:49.040543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.060923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.062844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.069234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.069941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.070666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.282586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.297007 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6555463e-1a1c-4ab5-bb18-f8afc5857faa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.599327 Aug 30 04:21:49.298900 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1452/2953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:48 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:49.315010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:49.316044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:49.332526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.334077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.336199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.337208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:49.340291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:49.341280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:49.368085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=26 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:49.493646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.513525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.518840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.520213 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aba9f375-0a00-4f2a-a098-d49336f897c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.220097 Aug 30 04:21:49.541355 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1453/2954] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:49 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:49.576871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:49.586111 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fcbd1552-59d4-4d19-8781-8213309ac6f1 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.585427 Aug 30 04:21:49.601695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1502/2955] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:48 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:49.708390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-09dfb913-6a39-4547-add3-426a51d33bd2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a0059d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:49.777128 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-09dfb913-6a39-4547-add3-426a51d33bd2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.072706 Aug 30 04:21:49.777946 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1454/2956] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:49 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:50.322707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.323735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:50.331999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.332928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.333646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.334604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.335944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.336614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.554211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.555596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:50.571126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.572316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.572778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.573544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.574283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.574964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.632600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.641921 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10a734d9-4f97-475c-8ab1-9e7f1a145aa8 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.323698 Aug 30 04:21:50.657789 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1503/2957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:50 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:50.674730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.675630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:50.690669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.693006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.697303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.699179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:50.700066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:50.700750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:50.728770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.743240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.744876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:50.754490 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6faf8a86-7bcc-46f3-bb65-cc01ac4b8c84 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.204288 Aug 30 04:21:50.772006 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1455/2958] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:50 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:50.797264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f886ddcc-a93a-492b-95b5-76267f734b2e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969f5fee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:50.904733 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f886ddcc-a93a-492b-95b5-76267f734b2e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.113306 Aug 30 04:21:50.912261 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1456/2959] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:50 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:51.001966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:51.005076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:51.018777 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-307c2283-dead-49ca-9a25-05606a793975 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.358927 Aug 30 04:21:51.019982 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1504/2960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:50 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:51.660433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:51.665913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:51.666671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:51.696648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.718183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.727888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.729168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.738295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.748894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.778994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:51.780513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:51.792350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.798260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.802049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:51.803079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:51.803910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:51.809058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.229105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.250794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.258143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.259782 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc6efb20-3e5b-4bcf-b2c7-c8b908527958 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.485214 Aug 30 04:21:52.260386 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1505/2961] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:51 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:52.287777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8bd9a309-abe2-4c5f-a844-d5cdd57ebbc7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a7350d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:52.370072 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8bd9a309-abe2-4c5f-a844-d5cdd57ebbc7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.108388 Aug 30 04:21:52.370886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1506/2962] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:52 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:52.382785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:52.388695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:52.400782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:52.401642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:52.402281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.410422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:52.411190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:52.411812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:52.642035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.659998 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e5e45be-af7e-440f-83a5-88ee2b2556d3 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 1.000337 Aug 30 04:21:52.660616 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1457/2963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:51 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:52.874358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:52.893320 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6a505160-a5f4-4aec-a35f-113156dbf827 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.519233 Aug 30 04:21:52.897186 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1507/2964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:52 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:52.956142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3117dada-8937-4ade-9ab1-0450c7c09fc5 req-f7d70f40-319a-44f4-bcfe-07f923c59969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187938a1-c38b-4179-85fd-5d7af72f5344", "name": "network-vif-plugged", "status": "completed", "tag": "f4c874fd-abee-42f2-8868-c964c2487dda"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:53.010354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=84,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:21:53.020031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3117dada-8937-4ade-9ab1-0450c7c09fc5 req-f7d70f40-319a-44f4-bcfe-07f923c59969 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.020620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3117dada-8937-4ade-9ab1-0450c7c09fc5 req-f7d70f40-319a-44f4-bcfe-07f923c59969 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.021096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3117dada-8937-4ade-9ab1-0450c7c09fc5 req-f7d70f40-319a-44f4-bcfe-07f923c59969 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.061054 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3117dada-8937-4ade-9ab1-0450c7c09fc5 req-f7d70f40-319a-44f4-bcfe-07f923c59969 service nova] Creating event network-vif-plugged:f4c874fd-abee-42f2-8868-c964c2487dda for instance 187938a1-c38b-4179-85fd-5d7af72f5344 on n-h2-854925-5 Aug 30 04:21:53.072229 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3117dada-8937-4ade-9ab1-0450c7c09fc5 req-f7d70f40-319a-44f4-bcfe-07f923c59969 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120921 Aug 30 04:21:53.078076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1458/2965] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:21:53.287305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.288110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:53.306891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.313131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.320499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.322974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.330733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.331555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.389605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1816b71-c674-4df8-9b8f-379f9a371ae3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969f5fb80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.519393 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1816b71-c674-4df8-9b8f-379f9a371ae3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.137378 Aug 30 04:21:53.522616 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1459/2966] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:53.599987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.613668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.621297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:53.623012 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42acae27-3bde-40c5-9777-d98237134323 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.340003 Aug 30 04:21:53.624151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1508/2967] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:53.689608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.690561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:53.708792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-94ba8036-a6fc-4d34-a3da-ff9f42b3d266 req-ed86dfa3-52de-430e-a25b-a9bef62353e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46", "tag": "308b9057-99c9-4500-b785-230fa19d288b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:53.721884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.724737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.725471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.738485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.740533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.745575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.748904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-94ba8036-a6fc-4d34-a3da-ff9f42b3d266 req-ed86dfa3-52de-430e-a25b-a9bef62353e4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.749537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-94ba8036-a6fc-4d34-a3da-ff9f42b3d266 req-ed86dfa3-52de-430e-a25b-a9bef62353e4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.750716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-94ba8036-a6fc-4d34-a3da-ff9f42b3d266 req-ed86dfa3-52de-430e-a25b-a9bef62353e4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.780791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-94ba8036-a6fc-4d34-a3da-ff9f42b3d266 req-ed86dfa3-52de-430e-a25b-a9bef62353e4 service nova] Creating event network-changed:308b9057-99c9-4500-b785-230fa19d288b for instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 on n-h2-854925-5 Aug 30 04:21:53.790328 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-94ba8036-a6fc-4d34-a3da-ff9f42b3d266 req-ed86dfa3-52de-430e-a25b-a9bef62353e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085275 Aug 30 04:21:53.793213 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1509/2968] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:21:53.925703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:53.926543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:53.950700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.967892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.968779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:53.970498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:53.979973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:53.981002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.181060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.204096 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-010ea9dc-fe50-4aee-ab9a-063c860b5f6c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1324 microversion: 2.1 time: 0.519197 Aug 30 04:21:54.205709 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1460/2969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1324 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:54.330184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.345615 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00e645f5-2e39-4f9f-a8f2-a903d1438ab6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.431885 Aug 30 04:21:54.353586 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1510/2970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:53 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:54.535245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0162305-5f22-43c7-b506-4fc3c16d343b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969f5f430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:54.623751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0162305-5f22-43c7-b506-4fc3c16d343b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.093020 Aug 30 04:21:54.637707 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1461/2971] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:54 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:54.653680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:54.654343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:54.669423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.671238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.673815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.676079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:54.693459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:54.694257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:54.824473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.839757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.842121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:54.843527 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-989036e8-507d-41f5-89fa-bcebc863e5e2 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.196362 Aug 30 04:21:54.845067 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1511/2972] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:54 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:55.225837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:55.227662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:55.240490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.244477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.245462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.248048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.248787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.251840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.373125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:55.374656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:55.403985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.405514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.406559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.408066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.409170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.410205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.559389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:55.585188 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3a56265-7967-47ee-bfa9-b3948ab001ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 200 len: 1521 microversion: 2.1 time: 0.361291 Aug 30 04:21:55.586758 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1462/2973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:55 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:55.613550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.125"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:21:55.617268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:55.632481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.633588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.635350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.636592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:55.640561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:55.644245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:55.752551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:21:55.753879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquired lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:21:56.019995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:56.038909 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a5ac4d5-4d67-406a-bf53-ade4b3b3017f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.671424 Aug 30 04:21:56.042454 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1512/2974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:55 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:56.051758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c0980ab0-5fa6-4adb-91b3-bc6ab828886b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a5d3b80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:56.160633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c0980ab0-5fa6-4adb-91b3-bc6ab828886b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.116377 Aug 30 04:21:56.168574 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1513/2975] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:56 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:56.192158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:56.192962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:56.220326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:56.221498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:56.222232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:56.223194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:56.223689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:56.224123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:56.366936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:56.380146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:56.386304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:56.390199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5559939b-0800-4ff4-a9a2-c8dbb4699378 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.219627 Aug 30 04:21:56.392061 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1514/2976] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:56 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:57.063226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:57.063891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:57.083553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.084063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.084529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:57.085842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:57.086304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:57.086742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.068533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:58.092167 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4b348f5-f9d4-451c-9fc9-932ac275995b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 1.033336 Aug 30 04:21:58.094459 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1515/2977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:57 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:21:58.100134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8020adb0-54d2-4c1d-962a-cdcd5cc397ba tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969ce7c10>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:58.167555 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8020adb0-54d2-4c1d-962a-cdcd5cc397ba tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.071586 Aug 30 04:21:58.168158 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1516/2978] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:58 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:58.176095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:58.176712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:58.185914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.186696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.187280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.188153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:58.189421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:58.190033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:58.450928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:58.486019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:58.493733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:58.501902 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-43c6d596-93e7-44e8-8787-1ff2851b6d4a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.328299 Aug 30 04:21:58.506110 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1517/2979] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:58 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:21:59.123205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:59.124258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:59.161739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:59.162391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:59.162702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:59.163442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:59.163947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:59.170209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:59.706845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:21:59.724375 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-680e0e28-270a-42e8-b6a3-0d2358031761 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.605735 Aug 30 04:21:59.734345 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1518/2980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:21:59 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:59.760125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-748eb855-7e2d-493d-aed9-4ec818df2fb4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a3135e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:59.868131 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-748eb855-7e2d-493d-aed9-4ec818df2fb4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1412 microversion: 2.1 time: 0.128544 Aug 30 04:21:59.873728 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1519/2981] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:21:59 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:21:59.890486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:21:59.899736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:21:59.936950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:59.941038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:59.945142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:21:59.948488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:21:59.951509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:21:59.953652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:00.175694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:00.190771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:00.196053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Building network info cache for instance {{(pid=122402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:22:00.196553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:00.198052 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d2ca5468-5f11-4097-848e-4a5329c475de tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.323195 Aug 30 04:22:00.207875 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1520/2982] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:21:59 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:00.250042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3a7ad8ae-aff9-4ddf-90f5-b6f156d9af13 req-137e391d-b54b-4992-92e4-266b6c27d669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e35e-b6af-4419-b964-4f7a1b665945", "tag": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:00.281049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3a7ad8ae-aff9-4ddf-90f5-b6f156d9af13 req-137e391d-b54b-4992-92e4-266b6c27d669 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:00.290686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3a7ad8ae-aff9-4ddf-90f5-b6f156d9af13 req-137e391d-b54b-4992-92e4-266b6c27d669 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:00.291391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3a7ad8ae-aff9-4ddf-90f5-b6f156d9af13 req-137e391d-b54b-4992-92e4-266b6c27d669 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:00.342568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3a7ad8ae-aff9-4ddf-90f5-b6f156d9af13 req-137e391d-b54b-4992-92e4-266b6c27d669 service nova] Creating event network-changed:3a0f694a-1f77-44c2-8170-8b4cb5f4985a for instance 89b5e35e-b6af-4419-b964-4f7a1b665945 on n-h1-854925-5 Aug 30 04:22:00.368786 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3a7ad8ae-aff9-4ddf-90f5-b6f156d9af13 req-137e391d-b54b-4992-92e4-266b6c27d669 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123324 Aug 30 04:22:00.370158 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1521/2983] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:00.755495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:00.757185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:00.777853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:00.781498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:00.784509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:00.785774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:00.788788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:00.792083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.645658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:01.658491 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-edffaee3-879d-4ad8-aced-5a701eed6c09 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.907669 Aug 30 04:22:01.662138 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1522/2984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:00 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:01.681719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8b9f415-5ebd-4389-b2aa-383a62d5c005 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969977f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:01.761938 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8b9f415-5ebd-4389-b2aa-383a62d5c005 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1421 microversion: 2.1 time: 0.097238 Aug 30 04:22:01.769067 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1523/2985] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:01 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1421 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:01.771583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:01.784057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:01.798492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:01.802533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.806489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.806961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.810139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:01.810888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:01.811606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:01.981552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:01.998234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:02.003525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:02.010459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-de948b70-1a22-43b8-955d-0ce970770974 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.241716 Aug 30 04:22:02.011404 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1524/2986] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:01 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:02.026785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1953a9dd-36f6-4059-8f0c-23afe17f3642 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a774940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:02.131205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1953a9dd-36f6-4059-8f0c-23afe17f3642 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 200 len: 1421 microversion: 2.1 time: 0.116815 Aug 30 04:22:02.132239 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1525/2987] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:02 2022] GET /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:02.146776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdc707ca-473e-40a1-abed-0a3b8dc1ab20 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a7fc5e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:02.372037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Updating instance_info_cache with network_info: [{"id": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a", "address": "fa:16:3e:f4:81:bc", "network": {"id": "f1e14a65-aaa1-4738-b8ee-8982958c9b28", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1647061102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6c7facb64d7a41a0974d2b5aa58c66ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a0f694a-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:22:02.388544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Releasing lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:22:02.393688 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a0c5e2e-ef96-4395-9381-05213a67f4b2 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action" status: 202 len: 0 microversion: 2.1 time: 6.781725 Aug 30 04:22:02.396989 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1463/2988] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:21:55 2022] POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action => generated 0 bytes in 6790 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:22:02.419530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.125"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:02.433040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:02.450192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.451394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.455700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.456671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:02.457316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:02.458277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:02.534025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "refresh_cache-187938a1-c38b-4179-85fd-5d7af72f5344" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:22:02.539752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquired lock "refresh_cache-187938a1-c38b-4179-85fd-5d7af72f5344" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:22:03.588911 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cdc707ca-473e-40a1-abed-0a3b8dc1ab20 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 204 len: 0 microversion: 2.1 time: 1.446918 Aug 30 04:22:03.589617 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1526/2989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:02 2022] DELETE /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:22:03.595049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:03.596585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:03.619628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:03.620424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:03.621232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:03.622658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:03.623670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:03.624284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.331563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.342725 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc82bbba-2977-4467-8250-54cc887c2c45 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.751915 Aug 30 04:22:04.345695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1527/2990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:03 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:04.355913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:04.356670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:04.371443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.372091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.372779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.373758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.374889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.376019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.601152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.623900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.629226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:04.632892 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ad88d1d-0587-4437-b0fe-e5a9512cb56e tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.284050 Aug 30 04:22:04.653238 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1528/2991] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:04 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:04.659703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:04.660651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:04.669509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.670338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.670991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.671911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.672560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.673181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.707155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:22:04.712244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:04.919724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-225062c1-3133-4e5d-b85d-8002fc1b1dc2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 204 len: 0 microversion: 2.1 time: 0.264588 Aug 30 04:22:04.926808 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1529/2992] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:22:04 2022] DELETE /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:22:04.948869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9b9f80a5-f107-4f9c-8e05-cb00a3c268ec req-208bb329-e58e-48ef-916b-a6dcd043cc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46", "name": "network-vif-plugged", "status": "completed", "tag": "308b9057-99c9-4500-b785-230fa19d288b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:04.965177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b9f80a5-f107-4f9c-8e05-cb00a3c268ec req-208bb329-e58e-48ef-916b-a6dcd043cc51 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:04.967593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b9f80a5-f107-4f9c-8e05-cb00a3c268ec req-208bb329-e58e-48ef-916b-a6dcd043cc51 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:04.968242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9b9f80a5-f107-4f9c-8e05-cb00a3c268ec req-208bb329-e58e-48ef-916b-a6dcd043cc51 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:04.991756 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9b9f80a5-f107-4f9c-8e05-cb00a3c268ec req-208bb329-e58e-48ef-916b-a6dcd043cc51 service nova] Creating event network-vif-plugged:308b9057-99c9-4500-b785-230fa19d288b for instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 on n-h2-854925-5 Aug 30 04:22:05.002420 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9b9f80a5-f107-4f9c-8e05-cb00a3c268ec req-208bb329-e58e-48ef-916b-a6dcd043cc51 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073323 Aug 30 04:22:05.003697 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1530/2993] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:05.374709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae2fe435-ce0b-4852-82ca-9ebe7821cf24 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Calling method '.version_select at 0x7fe96a735430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:05.492748 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae2fe435-ce0b-4852-82ca-9ebe7821cf24 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4" status: 200 len: 371 microversion: 2.1 time: 0.413101 Aug 30 04:22:05.500290 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1531/2994] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:22:05 2022] GET /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4 => generated 371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:05.505752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1339963194", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "45f92f08-9d57-42f1-af99-23717f5e800c"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:05.572450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] validate_networks() for [('45f92f08-9d57-42f1-af99-23717f5e800c', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:22:06.669520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:22:06.670739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:22:06.692132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:22:06.696209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:22:06.696896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:22:06.728643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:06.730107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:06.730576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:06.735249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:06.735997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:06.737127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:06.772876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:22:06.779760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for user 689cafef29c449fd8dd8eae3ae2ab9c5 and project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:22:06.811110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:22:06.815077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:22:06.883912 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-128c6572-56a4-4e95-9be9-2a15b77489bf tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382311 Aug 30 04:22:06.885163 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1532/2995] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:22:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:22:06.890214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:06.891387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:06.903290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:06.905756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:06.906413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:06.908173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:06.909477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:06.911742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.341476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:07.357257 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-85347e60-1807-4f70-afaa-7fb73f7e82ec tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1370 microversion: 2.1 time: 0.470376 Aug 30 04:22:07.358178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1533/2996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:06 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1370 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:07.373347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a5d3550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:07.555522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:07.556031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:07.562050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.563566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:07.564007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:07.564637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.705544 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4830a42c-61e9-48a8-9066-b9a741f12780 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4" status: 200 len: 328 microversion: 2.1 time: 0.345414 Aug 30 04:22:07.716868 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1534/2997] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:22:07 2022] PUT /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4 => generated 328 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:07.726909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:07.728368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:07.753825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:07.754516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:07.755146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:07.756032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:07.757588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:07.758272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:08.246146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:08.262941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:08.271393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:08.276333 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d948a593-688d-4fd9-a4a7-5025c3365e66 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.558099 Aug 30 04:22:08.281652 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1535/2998] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:07 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:08.466991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1716351652", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "7c8bda86-24d3-4479-af53-d0a2bba501de"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:08.574264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] validate_networks() for [('7c8bda86-24d3-4479-af53-d0a2bba501de', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:22:09.356094 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.network.neutron [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] re-assign floating IP 172.25.2.125 from instance 89b5e35e-b6af-4419-b964-4f7a1b665945 Aug 30 04:22:09.427254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Building network info cache for instance {{(pid=122402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:22:09.875955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:22:09.877505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:22:09.878236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:22:09.878668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:22:09.879095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:22:09.927671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.928223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.928673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:09.932490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:09.933847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:09.934324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:09.959814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Getting quotas for project 8e714811d9ad4d69a1d78fae3deadeab. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:22:09.969027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Getting quotas for user e2088cb87e3e45f2b3a6c674442d2792 and project 8e714811d9ad4d69a1d78fae3deadeab. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:22:09.988160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:22:09.996251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:22:10.118655 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-918884ca-1984-4823-8943-eab76cb8da11 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.833694 Aug 30 04:22:10.122947 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1536/2999] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:22:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:22:10.152246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:10.157072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:10.191738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.193183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.196000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.198477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.199061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.202676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.595159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:10.609418 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f632efe-d643-4c41-a7c6-932aa0681142 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1266 microversion: 2.1 time: 0.485169 Aug 30 04:22:10.611783 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1537/3000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:10 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1266 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:10.616403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a13da0d5-be90-48a8-9803-e8f39c799b12 req-3bca4643-9ba3-4e59-8f2b-75b4e517a130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded16a4-47e1-44cc-8113-aa7538c0c786", "name": "network-vif-unplugged", "status": "completed", "tag": "347553e6-ccd3-4b81-91f8-e6545b41a764"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:10.639600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a13da0d5-be90-48a8-9803-e8f39c799b12 req-3bca4643-9ba3-4e59-8f2b-75b4e517a130 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.640983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a13da0d5-be90-48a8-9803-e8f39c799b12 req-3bca4643-9ba3-4e59-8f2b-75b4e517a130 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.641463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a13da0d5-be90-48a8-9803-e8f39c799b12 req-3bca4643-9ba3-4e59-8f2b-75b4e517a130 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.656689 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a13da0d5-be90-48a8-9803-e8f39c799b12 req-3bca4643-9ba3-4e59-8f2b-75b4e517a130 service nova] Creating event network-vif-unplugged:347553e6-ccd3-4b81-91f8-e6545b41a764 for instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 on n-h1-854925-5 Aug 30 04:22:10.663708 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a13da0d5-be90-48a8-9803-e8f39c799b12 req-3bca4643-9ba3-4e59-8f2b-75b4e517a130 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050683 Aug 30 04:22:10.664986 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1538/3001] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:10.678725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ccf684f4-4b79-4a6a-aed4-3b1848f190c9 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:10.699033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ccf684f4-4b79-4a6a-aed4-3b1848f190c9 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4" status: 202 len: 0 microversion: 2.1 time: 0.032234 Aug 30 04:22:10.709974 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1539/3002] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:22:10 2022] DELETE /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:22:10.724106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:10.726687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:10.742499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.743149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.755979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.773813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:10.778450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:10.780078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:10.794719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Updating instance_info_cache with network_info: [{"id": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a", "address": "fa:16:3e:f4:81:bc", "network": {"id": "f1e14a65-aaa1-4738-b8ee-8982958c9b28", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1647061102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6c7facb64d7a41a0974d2b5aa58c66ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a0f694a-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:22:10.807926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Building network info cache for instance {{(pid=122402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:22:11.236273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.251480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-54d74829-c4b5-471c-bad5-c24cbf19d612 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1563 microversion: 2.1 time: 0.531060 Aug 30 04:22:11.252515 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1540/3003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:10 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1563 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:11.263368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f5d7c813-de41-4494-95f7-a31b882965a6 req-346cd5ba-4b64-4245-a81f-30f7a93f1c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ded16a4-47e1-44cc-8113-aa7538c0c786", "name": "network-vif-deleted", "tag": "347553e6-ccd3-4b81-91f8-e6545b41a764"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:11.294299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5d7c813-de41-4494-95f7-a31b882965a6 req-346cd5ba-4b64-4245-a81f-30f7a93f1c4f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.294949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5d7c813-de41-4494-95f7-a31b882965a6 req-346cd5ba-4b64-4245-a81f-30f7a93f1c4f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.295880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5d7c813-de41-4494-95f7-a31b882965a6 req-346cd5ba-4b64-4245-a81f-30f7a93f1c4f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.311934 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f5d7c813-de41-4494-95f7-a31b882965a6 req-346cd5ba-4b64-4245-a81f-30f7a93f1c4f service nova] Creating event network-vif-deleted:347553e6-ccd3-4b81-91f8-e6545b41a764 for instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 on n-h1-854925-5 Aug 30 04:22:11.319898 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f5d7c813-de41-4494-95f7-a31b882965a6 req-346cd5ba-4b64-4245-a81f-30f7a93f1c4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064808 Aug 30 04:22:11.320784 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1541/3004] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:11.326305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bd8e16a3-b7e7-4cec-b4fe-ee497eb76cb8 req-ddd6409e-0f2c-4ae4-b99f-a2e85ac97a75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e35e-b6af-4419-b964-4f7a1b665945", "tag": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:11.339739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bd8e16a3-b7e7-4cec-b4fe-ee497eb76cb8 req-ddd6409e-0f2c-4ae4-b99f-a2e85ac97a75 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.340577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bd8e16a3-b7e7-4cec-b4fe-ee497eb76cb8 req-ddd6409e-0f2c-4ae4-b99f-a2e85ac97a75 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.341096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bd8e16a3-b7e7-4cec-b4fe-ee497eb76cb8 req-ddd6409e-0f2c-4ae4-b99f-a2e85ac97a75 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.377895 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bd8e16a3-b7e7-4cec-b4fe-ee497eb76cb8 req-ddd6409e-0f2c-4ae4-b99f-a2e85ac97a75 service nova] Creating event network-changed:3a0f694a-1f77-44c2-8170-8b4cb5f4985a for instance 89b5e35e-b6af-4419-b964-4f7a1b665945 on n-h1-854925-5 Aug 30 04:22:11.400989 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bd8e16a3-b7e7-4cec-b4fe-ee497eb76cb8 req-ddd6409e-0f2c-4ae4-b99f-a2e85ac97a75 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078650 Aug 30 04:22:11.404654 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1542/3005] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:11.416891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:11.419225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:11.469806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.478528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.479264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.481158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.483378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.490591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.695682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.706974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.708725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.715241 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab9726a0-4f0a-4cbc-b496-d8335fdc84b3 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.309136 Aug 30 04:22:11.719680 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1543/3006] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:11 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:11.731479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:11.734787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:11.743755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.744629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.745884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.746948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.747662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.748311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:11.920808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:11.931008 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be0c119d-e2e6-41cd-95a0-5452978bd1aa tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1280 microversion: 2.1 time: 0.208954 Aug 30 04:22:11.931730 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1544/3007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:11 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1280 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:11.952573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-024a6a6a-0675-4187-b20d-e5bed511e480 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Calling method '.version_select at 0x7fe96a7a64c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:11.961981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Updating instance_info_cache with network_info: [{"id": "f4c874fd-abee-42f2-8868-c964c2487dda", "address": "fa:16:3e:2c:49:b4", "network": {"id": "f1e14a65-aaa1-4738-b8ee-8982958c9b28", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1647061102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6c7facb64d7a41a0974d2b5aa58c66ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf4c874fd-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:22:11.972662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=2,nova_cell1:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:11.979515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Releasing lock "refresh_cache-187938a1-c38b-4179-85fd-5d7af72f5344" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:22:11.980594 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-191b2574-920c-4997-9069-7e98b3e1218b tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344/action" status: 202 len: 0 microversion: 2.1 time: 9.578640 Aug 30 04:22:11.984521 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1464/3008] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:02 2022] POST /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344/action => generated 0 bytes in 9580 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:22:11.987035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:11.987663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:11.998741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:11.999323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:11.999849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.000646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.001303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.002029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.087410 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-024a6a6a-0675-4187-b20d-e5bed511e480 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4" status: 200 len: 371 microversion: 2.1 time: 0.140058 Aug 30 04:22:12.088330 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1545/3009] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:22:11 2022] GET /compute/v2.1/os-quota-sets/0d0776a6a06c4b94abb522f19b0030a4 => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:12.101714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:12.102363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:12.102661 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-085fee83-098f-412f-b497-5e7f896219b6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119270 Aug 30 04:22:12.103488 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1465/3010] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:22:11 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:12.114240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.125"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:12.125567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.130018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.130898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.134019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.135141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.135849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.793573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:12.807107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.807619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.810115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.810898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:12.814382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:12.814911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:12.974084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:12.982723 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4dd58f9f-cbad-41c3-8908-dad0a9abe15d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.892368 Aug 30 04:22:12.983321 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1546/3011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:12 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:12.989645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-abfebbf6-4258-49f6-bfb5-44987957caac tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Calling method '.version_select at 0x7fe96a53bca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:13.249525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-abfebbf6-4258-49f6-bfb5-44987957caac tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.265101 Aug 30 04:22:13.250187 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1547/3012] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:22:12 2022] GET /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc/defaults => generated 371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:13.263133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:13.264664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:13.278132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:13.280659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:13.281308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:13.284805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:13.285501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:13.286131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.106304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.116089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.117895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.119332 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c6583f7-9069-4f05-acd3-6164e465f8f6 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.868043 Aug 30 04:22:14.133837 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1548/3013] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:13 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:14.141709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:14.142712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:14.149656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.150729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.151391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.152315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.153037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.153713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.331472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:14.345300 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-451f6c1a-548c-4419-b79c-efd716d8e608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1286 microversion: 2.1 time: 0.209804 Aug 30 04:22:14.348065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1549/3014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:14 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1286 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:14.354117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-52a21924-4a39-444c-9e7e-2c7726ed96b6 req-397aad31-1a3d-4c43-9185-43fef78d5556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187938a1-c38b-4179-85fd-5d7af72f5344", "tag": "f4c874fd-abee-42f2-8868-c964c2487dda"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:14.363739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:14.374156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-52a21924-4a39-444c-9e7e-2c7726ed96b6 req-397aad31-1a3d-4c43-9185-43fef78d5556 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.374848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-52a21924-4a39-444c-9e7e-2c7726ed96b6 req-397aad31-1a3d-4c43-9185-43fef78d5556 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.376138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-52a21924-4a39-444c-9e7e-2c7726ed96b6 req-397aad31-1a3d-4c43-9185-43fef78d5556 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.401317 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-52a21924-4a39-444c-9e7e-2c7726ed96b6 req-397aad31-1a3d-4c43-9185-43fef78d5556 service nova] Creating event network-changed:f4c874fd-abee-42f2-8868-c964c2487dda for instance 187938a1-c38b-4179-85fd-5d7af72f5344 on n-h2-854925-5 Aug 30 04:22:14.415312 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-52a21924-4a39-444c-9e7e-2c7726ed96b6 req-397aad31-1a3d-4c43-9185-43fef78d5556 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065719 Aug 30 04:22:14.423034 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1550/3015] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:14.436386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a2f2430>, body: {"quota_set": {"ram": "5120"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:14.684102 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] HTTP exception thrown: Floating IP 172.25.2.125 is not associated with instance 89b5e35e-b6af-4419-b964-4f7a1b665945. Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Request method failure captured: Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action HTTP/1.1 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 49 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZAvY7IeA9hqDYydtkhy7MHqYs7PL1PLivEeUPaql7uS5vaNZeUSsvhGBbtXctBDQOlJgdr5nKLaIvIUTIFAaYf1-kRp4yJYlf7mRk22Tzh7KJ8wG9rE3o7xCqlohCF9Xje55wUt61FI2xsWDPbVs-agCAI2kRUJIZeP14IfBmSrAGE Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c7facb64d7a41a0974d2b5aa58c66ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}] Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 34f73ac855ca447286ee1788fd2520f2 Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: {"removeFloatingIp": {"address": "172.25.2.125"}} Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: exception: Floating IP 172.25.2.125 is not associated with instance 89b5e35e-b6af-4419-b964-4f7a1b665945. Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '89b5e35e-b6af-4419-b964-4f7a1b665945', 'body': {'removeFloatingIp': {'address': '172.25.2.125'}}} Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.125 is not associated with instance 89b5e35e-b6af-4419-b964-4f7a1b665945. Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.125 is not associated with instance 89b5e35e-b6af-4419-b964-4f7a1b665945. Aug 30 04:22:14.685776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:14.691938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Returning 409 to user: Floating IP 172.25.2.125 is not associated with instance 89b5e35e-b6af-4419-b964-4f7a1b665945. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:14.691938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2959b798-f4df-4958-8ea7-b924c6faac24 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action" status: 409 len: 146 microversion: 2.1 time: 2.580617 Aug 30 04:22:14.691938 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1466/3016] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:12 2022] POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action => generated 146 bytes in 2582 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:22:14.694968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cf5f5279-386b-4e05-9139-1ce5bd542a9f req-5ec549a9-8ac7-4676-9594-1ca539e5aec7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb63a2f-23a4-478f-9377-b3c21e4a59d0", "tag": "78eafa8d-f968-4acc-a70d-bf67e4cdcc39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:14.723622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cf5f5279-386b-4e05-9139-1ce5bd542a9f req-5ec549a9-8ac7-4676-9594-1ca539e5aec7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.724116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cf5f5279-386b-4e05-9139-1ce5bd542a9f req-5ec549a9-8ac7-4676-9594-1ca539e5aec7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.724618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cf5f5279-386b-4e05-9139-1ce5bd542a9f req-5ec549a9-8ac7-4676-9594-1ca539e5aec7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.750440 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cf5f5279-386b-4e05-9139-1ce5bd542a9f req-5ec549a9-8ac7-4676-9594-1ca539e5aec7 service nova] Creating event network-changed:78eafa8d-f968-4acc-a70d-bf67e4cdcc39 for instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 on n-h1-854925-5 Aug 30 04:22:14.755416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.762226 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cf5f5279-386b-4e05-9139-1ce5bd542a9f req-5ec549a9-8ac7-4676-9594-1ca539e5aec7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072332 Aug 30 04:22:14.763301 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1467/3017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:14.763564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.764930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.766735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.768998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:14.769948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:14.774250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.774764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.780124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.781292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.781947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.782851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:14.783496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:14.784097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:14.932767 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7adbb86e-5bb3-4966-875c-e832510db20b tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca" status: 200 len: 328 microversion: 2.1 time: 0.507675 Aug 30 04:22:14.939869 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1551/3018] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:22:14 2022] PUT /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca => generated 328 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:14.942222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.125"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:15.283727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.299671 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b0eb492-a18c-4a24-ae5a-3e6d64958501 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.535077 Aug 30 04:22:15.301164 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1468/3019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:14 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:15.309269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Calling method '.version_select at 0x7fe9693c5940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:15.355566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:15.369175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.371021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.371740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.372807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.373789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.374565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.420170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.420684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.421142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.422655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.423430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.423874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.444572 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6066bde8-2857-4b3c-9098-239602faf900 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca/detail" status: 200 len: 916 microversion: 2.1 time: 0.141829 Aug 30 04:22:15.445819 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1469/3020] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:22:15 2022] GET /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca/detail => generated 916 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:15.451213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:15.451941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:15.458190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.459577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.460217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.461295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.461963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.462813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.575124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.615813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.617253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.624697 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77f92630-af31-4017-a377-00dcf79e1070 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.177665 Aug 30 04:22:15.658565 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1470/3021] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:15 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:15.667364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:15.668225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:15.683463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.684848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.687021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.687997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.688681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.706356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:15.887688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:15.914840 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e970d3e0-d9b9-48b2-8ee4-48360187d642 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1286 microversion: 2.1 time: 0.254657 Aug 30 04:22:15.915454 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1471/3022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:15 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:15.921320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Action: 'update', calling method: .version_select at 0x7fe969448d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:15.953790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "refresh_cache-187938a1-c38b-4179-85fd-5d7af72f5344" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:22:15.955051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquired lock "refresh_cache-187938a1-c38b-4179-85fd-5d7af72f5344" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:22:15.996921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:15.998405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:15.999060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.000077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.000762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.001472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.044533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.045414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.046050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.047171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.047827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.048262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.126946 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-899388a6-7653-44dd-9b5a-216ef4739f4a tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca?user_id=1d85c5b08e7c47a8b574014cf2a6f9b5" status: 200 len: 328 microversion: 2.1 time: 0.208998 Aug 30 04:22:16.127905 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1472/3023] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:22:15 2022] PUT /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca?user_id=1d85c5b08e7c47a8b574014cf2a6f9b5 => generated 328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:16.142844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3d65fd7-e715-43c7-a5e5-22f2780a0bde tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Calling method '.version_select at 0x7fe9693ef820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:16.272578 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3d65fd7-e715-43c7-a5e5-22f2780a0bde tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca?user_id=1d85c5b08e7c47a8b574014cf2a6f9b5" status: 200 len: 370 microversion: 2.1 time: 0.133367 Aug 30 04:22:16.298095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1473/3024] 10.222.0.27 () {58 vars in 1323 bytes} [Tue Aug 30 04:22:16 2022] GET /compute/v2.1/os-quota-sets/8196990623564349bf838c2f65243bca?user_id=1d85c5b08e7c47a8b574014cf2a6f9b5 => generated 370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:16.321463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:16.322186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:16.344672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.345388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.348478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.349319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.350502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.354004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.758150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:16.767029 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3452ba26-6cb2-4a3b-897a-9fef8a985a56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.450496 Aug 30 04:22:16.773745 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1474/3025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:16 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:16.778636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-33ab47f8-d0be-4d4f-a99b-0cef5b17588e req-d957a6d5-9a77-47ed-bb5b-83f1722a43ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46", "tag": "308b9057-99c9-4500-b785-230fa19d288b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:16.799342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33ab47f8-d0be-4d4f-a99b-0cef5b17588e req-d957a6d5-9a77-47ed-bb5b-83f1722a43ec service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.802149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33ab47f8-d0be-4d4f-a99b-0cef5b17588e req-d957a6d5-9a77-47ed-bb5b-83f1722a43ec service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.804974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33ab47f8-d0be-4d4f-a99b-0cef5b17588e req-d957a6d5-9a77-47ed-bb5b-83f1722a43ec service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.842204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-33ab47f8-d0be-4d4f-a99b-0cef5b17588e req-d957a6d5-9a77-47ed-bb5b-83f1722a43ec service nova] Creating event network-changed:308b9057-99c9-4500-b785-230fa19d288b for instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 on n-h2-854925-5 Aug 30 04:22:16.848575 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-33ab47f8-d0be-4d4f-a99b-0cef5b17588e req-d957a6d5-9a77-47ed-bb5b-83f1722a43ec service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073470 Aug 30 04:22:16.869266 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1475/3026] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:16.891284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:16.899401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:16.915547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.916326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.917099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:16.918750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:16.919380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:16.920158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:17.032239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.047434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.049505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.051978 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a933410-efa8-4043-a535-404659e82399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1364 microversion: 2.47 time: 0.177785 Aug 30 04:22:17.053644 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1476/3027] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:16 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:17.059649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb85f07d-155a-4287-8c22-c915bd9208dc tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Calling method '.version_select at 0x7fe96a253ca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:17.301514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Building network info cache for instance {{(pid=122403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:22:17.375190 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb85f07d-155a-4287-8c22-c915bd9208dc tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.319909 Aug 30 04:22:17.384359 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1477/3028] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:22:17 2022] GET /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc/defaults => generated 371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:17.412590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:17.415959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:17.436123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:17.436629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:17.437075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:17.437812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:17.438266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:17.438693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:17.661675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:17.669873 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9dce9cb9-3bb3-4013-b59a-d4d542a0c38d tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.278915 Aug 30 04:22:17.675682 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1478/3029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:17 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:17.690439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Action: 'update', calling method: .version_select at 0x7fe9694d04c0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:17.815533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:17.817146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:17.819302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:17.823533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:17.824565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:17.825797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.137078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:18.173117 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f393aee3-0e5b-4b43-b76e-cdc0316c6c3f tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc" status: 200 len: 329 microversion: 2.1 time: 0.496121 Aug 30 04:22:18.177744 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1479/3030] 10.222.0.27 () {60 vars in 1263 bytes} [Tue Aug 30 04:22:17 2022] PUT /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc => generated 329 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:18.189168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:18.190570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:18.203409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.204182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.204709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.206373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.207022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.207493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.741276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:18.774050 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c2b3119-bb61-4a8c-a715-af4cd8f4d549 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.594703 Aug 30 04:22:18.791319 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1480/3031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:18 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:18.802135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:18.804036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:18.812911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.813930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.814706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.816589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:18.818622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:18.819396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:18.948706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Updating instance_info_cache with network_info: [{"id": "f4c874fd-abee-42f2-8868-c964c2487dda", "address": "fa:16:3e:2c:49:b4", "network": {"id": "f1e14a65-aaa1-4738-b8ee-8982958c9b28", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1647061102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6c7facb64d7a41a0974d2b5aa58c66ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf4c874fd-ab", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:22:18.966137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Releasing lock "refresh_cache-187938a1-c38b-4179-85fd-5d7af72f5344" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:22:18.967637 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-066f2249-d440-4d90-a17c-2ef4b56025e5 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344/action" status: 202 len: 0 microversion: 2.1 time: 4.032820 Aug 30 04:22:18.968583 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1552/3032] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:14 2022] POST /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344/action => generated 0 bytes in 4034 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:22:18.976675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Action: 'update', calling method: .version_select at 0x7fe96c89d940>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:19.015861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.032240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.033736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.035582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4275afd1-918e-4397-86d5-8457ee8d7f0f tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1370 microversion: 2.47 time: 0.241518 Aug 30 04:22:19.036332 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1481/3033] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:18 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:19.044840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:19.057807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:19.067792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.078085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.080807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.081892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.082571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.098129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.107231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.108329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.110877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.114668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.115882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.118880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.436315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:19.448189 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-61c5344c-8c79-41ce-a7b4-7ae248a221cf tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.409212 Aug 30 04:22:19.448826 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1482/3034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:19 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:19.472576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2ff675eb-d721-4b6a-82c8-4ee03f8ac02c req-27cc0c4b-3e42-46d1-8c4f-2e6d55330715 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "187938a1-c38b-4179-85fd-5d7af72f5344", "tag": "f4c874fd-abee-42f2-8868-c964c2487dda"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:19.502460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2ff675eb-d721-4b6a-82c8-4ee03f8ac02c req-27cc0c4b-3e42-46d1-8c4f-2e6d55330715 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.503343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2ff675eb-d721-4b6a-82c8-4ee03f8ac02c req-27cc0c4b-3e42-46d1-8c4f-2e6d55330715 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.504376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2ff675eb-d721-4b6a-82c8-4ee03f8ac02c req-27cc0c4b-3e42-46d1-8c4f-2e6d55330715 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.524676 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2ff675eb-d721-4b6a-82c8-4ee03f8ac02c req-27cc0c4b-3e42-46d1-8c4f-2e6d55330715 service nova] Creating event network-changed:f4c874fd-abee-42f2-8868-c964c2487dda for instance 187938a1-c38b-4179-85fd-5d7af72f5344 on n-h2-854925-5 Aug 30 04:22:19.530938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2ff675eb-d721-4b6a-82c8-4ee03f8ac02c req-27cc0c4b-3e42-46d1-8c4f-2e6d55330715 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080751 Aug 30 04:22:19.531814 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1483/3035] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:19.539144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:19.539559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:19.547476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.548193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.548640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.549434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.549955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.550399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.592097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:22:19.776924 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-369d3b9a-5bac-4361-b702-d8fdcd5131c0 tempest-QuotasAdminTestJSON-1341379893 tempest-QuotasAdminTestJSON-1341379893-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc" status: 200 len: 329 microversion: 2.1 time: 0.806392 Aug 30 04:22:19.779972 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1553/3036] 10.222.0.27 () {60 vars in 1263 bytes} [Tue Aug 30 04:22:18 2022] PUT /compute/v2.1/os-quota-sets/9d4db3d651244ad0bf159575034953dc => generated 329 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:19.790528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4d81444d-3381-4a0d-81ba-7a3eca991453 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "DELETE /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 204 len: 0 microversion: 2.1 time: 0.256247 Aug 30 04:22:19.792468 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1484/3037] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:22:19 2022] DELETE /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:22:19.804025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:19.804886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:19.812749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.813822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.125"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:19.816517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:19.817239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.817925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.822375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.823095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.823897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.831860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.832947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.836550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.837940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:19.838596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:19.839196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:19.863728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:19.895544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:22:19.895967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquired lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:22:20.243601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.260678 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8d019c5e-7e9a-4632-a009-8db6816afbac tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.461262 Aug 30 04:22:20.261445 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1554/3038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:19 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:20.275132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:20.275868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:20.293815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.294442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.294749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.295472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.295930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.296529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.448887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.470742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.473572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.475547 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c910de7-91fb-426c-a7d8-000e41b20c8c tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1370 microversion: 2.47 time: 0.212799 Aug 30 04:22:20.476204 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1555/3039] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:20 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:20.481722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:20.483038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:20.490813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.491657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.492373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.493302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:20.494300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:20.494988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:20.836188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:20.847222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-472ea55a-7a45-4b5b-8066-52be207205e3 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.369784 Aug 30 04:22:20.848431 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1556/3040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:20 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:21.286155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:21.288399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:21.313395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:21.316883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:21.317366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:21.318675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:21.323369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:21.324029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:21.635582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Building network info cache for instance {{(pid=122402) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:22:21.640709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:21.711658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:21.724665 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00d26a07-bbcf-4b7b-8cb9-7579cbd35d8f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.445031 Aug 30 04:22:21.746582 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1557/3041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:21 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:21.753289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:21.754295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:21.762297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:21.763131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:21.763830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:21.764764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:21.765483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:21.766175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:21.922010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:21.935094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:21.939542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:21.946345 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ce05bcb-a599-4515-ad74-bd72dd9e5d02 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1355 microversion: 2.47 time: 0.198144 Aug 30 04:22:21.949259 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1558/3042] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:21 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1355 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:21.961409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bdaa1715-f221-45d4-80e5-9ddf4f7ed11c req-4b307012-2a94-4efb-8c0f-ac46a4cf503c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11757b96-666e-431b-9972-3e32ad1a70a0", "tag": "e275b53d-94fa-4a3f-a680-b496c0d7b4a8"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:21.986815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bdaa1715-f221-45d4-80e5-9ddf4f7ed11c req-4b307012-2a94-4efb-8c0f-ac46a4cf503c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:21.988125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bdaa1715-f221-45d4-80e5-9ddf4f7ed11c req-4b307012-2a94-4efb-8c0f-ac46a4cf503c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:21.990242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bdaa1715-f221-45d4-80e5-9ddf4f7ed11c req-4b307012-2a94-4efb-8c0f-ac46a4cf503c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.017358 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bdaa1715-f221-45d4-80e5-9ddf4f7ed11c req-4b307012-2a94-4efb-8c0f-ac46a4cf503c service nova] Creating event network-changed:e275b53d-94fa-4a3f-a680-b496c0d7b4a8 for instance 11757b96-666e-431b-9972-3e32ad1a70a0 on n-h1-854925-5 Aug 30 04:22:22.031720 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bdaa1715-f221-45d4-80e5-9ddf4f7ed11c req-4b307012-2a94-4efb-8c0f-ac46a4cf503c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080962 Aug 30 04:22:22.033314 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1559/3043] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:22.039327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:22.045776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:22.060361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.061118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.063601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.064576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.067209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.070606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.451994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.469158 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8577b34e-df30-491b-8b16-0469229b9008 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.432002 Aug 30 04:22:22.470912 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1560/3044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:22 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:22.491094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:22.497436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.498327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Searching by: {'deleted': False, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:22:22.506475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:UPDATE=14 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:22.508668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.509400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.510074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.512164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.513004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.513742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.672768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:22:22.789904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Updating instance_info_cache with network_info: [{"id": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a", "address": "fa:16:3e:f4:81:bc", "network": {"id": "f1e14a65-aaa1-4738-b8ee-8982958c9b28", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1647061102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6c7facb64d7a41a0974d2b5aa58c66ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a0f694a-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:22:22.816954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Releasing lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122402) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:22:22.818902 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-badb7575-a6a6-4b73-94c3-3690343b5f41 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action" status: 202 len: 0 microversion: 2.1 time: 3.018680 Aug 30 04:22:22.824850 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1485/3045] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:19 2022] POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action => generated 0 bytes in 3025 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 30 04:22:22.844072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1a82adb6-c6e3-4f19-8ca4-97f432cb4573 req-49063593-4a42-4cfb-a7d2-45cefabbec01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb63a2f-23a4-478f-9377-b3c21e4a59d0", "name": "network-vif-plugged", "status": "completed", "tag": "78eafa8d-f968-4acc-a70d-bf67e4cdcc39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:22.858435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1a82adb6-c6e3-4f19-8ca4-97f432cb4573 req-49063593-4a42-4cfb-a7d2-45cefabbec01 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.859028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1a82adb6-c6e3-4f19-8ca4-97f432cb4573 req-49063593-4a42-4cfb-a7d2-45cefabbec01 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.861128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1a82adb6-c6e3-4f19-8ca4-97f432cb4573 req-49063593-4a42-4cfb-a7d2-45cefabbec01 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.875386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.878812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1a82adb6-c6e3-4f19-8ca4-97f432cb4573 req-49063593-4a42-4cfb-a7d2-45cefabbec01 service nova] Creating event network-vif-plugged:78eafa8d-f968-4acc-a70d-bf67e4cdcc39 for instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 on n-h1-854925-5 Aug 30 04:22:22.887690 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1a82adb6-c6e3-4f19-8ca4-97f432cb4573 req-49063593-4a42-4cfb-a7d2-45cefabbec01 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060091 Aug 30 04:22:22.888497 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1486/3046] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:22.892056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.892742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.893398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.895268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:22.896569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:22.912130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.913719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:22.923155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.923571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.924500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.925472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:22.926236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:22.926845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:22.973972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d345c94-cb27-4742-8961-449d718db7c7 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.501825 Aug 30 04:22:22.974846 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1561/3047] 10.222.0.27 () {60 vars in 1187 bytes} [Tue Aug 30 04:22:22 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:22.979792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a937b4af-1895-4381-a243-bfe5a6a1959c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '.version_select at 0x7fe96e439b80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:23.301303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:23.311355 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3dcb210c-c234-491d-907d-867ad5740c56 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.420805 Aug 30 04:22:23.312685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1487/3048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:22 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:23.319564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:23.320279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:23.328380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.329581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.330626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:23.331600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.332443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.333154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:23.383016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:22:23.464595 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a937b4af-1895-4381-a243-bfe5a6a1959c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/os-floating-ips/8bc349f2-76f8-463e-8a12-5587d5a2375f" status: 200 len: 185 microversion: 2.1 time: 0.488432 Aug 30 04:22:23.465205 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1562/3049] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:22:22 2022] GET /compute/v2.1/os-floating-ips/8bc349f2-76f8-463e-8a12-5587d5a2375f => generated 185 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:23.477205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.125"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:23.563007 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-038c959f-5324-4197-a83f-d2470c544cea tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 204 len: 0 microversion: 2.47 time: 0.247828 Aug 30 04:22:23.564573 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1488/3050] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:22:23 2022] DELETE /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:22:23.579527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:23.580288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:23.588152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.589375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.590180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:23.591292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:23.591973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:23.592565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.056424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:24.064247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.064753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.065165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.071757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.071942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.072394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.093954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.115065 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e2d4699-7255-41f1-bd91-da7718469a72 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.548014 Aug 30 04:22:24.117359 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1489/3051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:23 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:24.136578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:24.137838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:24.147795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.149166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.149981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.150917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.152120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.153657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.683086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.692418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.706943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:24.708295 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf93878e-a8d8-4459-8a6f-5183ec949aaf tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1361 microversion: 2.47 time: 0.589862 Aug 30 04:22:24.708995 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1490/3052] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:24 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1361 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:24.714032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9168ef69-42f5-4b72-9513-4710ccf409b0 req-5f8a6fa9-be5a-4b3f-bef0-758b207467c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "187938a1-c38b-4179-85fd-5d7af72f5344", "name": "network-vif-deleted", "tag": "f4c874fd-abee-42f2-8868-c964c2487dda"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:24.729434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9168ef69-42f5-4b72-9513-4710ccf409b0 req-5f8a6fa9-be5a-4b3f-bef0-758b207467c1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.742097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9168ef69-42f5-4b72-9513-4710ccf409b0 req-5f8a6fa9-be5a-4b3f-bef0-758b207467c1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.742825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9168ef69-42f5-4b72-9513-4710ccf409b0 req-5f8a6fa9-be5a-4b3f-bef0-758b207467c1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.756886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9168ef69-42f5-4b72-9513-4710ccf409b0 req-5f8a6fa9-be5a-4b3f-bef0-758b207467c1 service nova] Creating event network-vif-deleted:f4c874fd-abee-42f2-8868-c964c2487dda for instance 187938a1-c38b-4179-85fd-5d7af72f5344 on n-h2-854925-5 Aug 30 04:22:24.770352 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9168ef69-42f5-4b72-9513-4710ccf409b0 req-5f8a6fa9-be5a-4b3f-bef0-758b207467c1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059873 Aug 30 04:22:24.781723 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1491/3053] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:24.787746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c115190e-437a-454c-a250-475b6bef2c78 req-91ea9ce8-579c-48f5-8195-354034daaff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e35e-b6af-4419-b964-4f7a1b665945", "tag": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:24.807837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c115190e-437a-454c-a250-475b6bef2c78 req-91ea9ce8-579c-48f5-8195-354034daaff5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.808672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c115190e-437a-454c-a250-475b6bef2c78 req-91ea9ce8-579c-48f5-8195-354034daaff5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.808764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c115190e-437a-454c-a250-475b6bef2c78 req-91ea9ce8-579c-48f5-8195-354034daaff5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.830732 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c115190e-437a-454c-a250-475b6bef2c78 req-91ea9ce8-579c-48f5-8195-354034daaff5 service nova] Creating event network-changed:3a0f694a-1f77-44c2-8170-8b4cb5f4985a for instance 89b5e35e-b6af-4419-b964-4f7a1b665945 on n-h1-854925-5 Aug 30 04:22:24.837843 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c115190e-437a-454c-a250-475b6bef2c78 req-91ea9ce8-579c-48f5-8195-354034daaff5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054370 Aug 30 04:22:24.839099 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1492/3054] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:24.845053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:24.845988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:24.855465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.856129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.856751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:24.857626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:24.858231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:24.858803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.094584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 04:22:25.095098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquired lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 04:22:25.109482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:25.139196 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b1307bb-d889-4682-acc0-9f54ee6cd3e2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1308 microversion: 2.1 time: 0.296042 Aug 30 04:22:25.141821 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1493/3055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:24 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:25.160712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:25.161383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:25.185399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:25.188355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:25.188991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.190134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:25.191577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:25.197281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:25.883248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:25.893593 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12c83493-7d2a-4161-b663-cd89c0b17c33 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.750253 Aug 30 04:22:25.896869 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1494/3056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:25 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:26.195501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Action: 'update', calling method: .version_select at 0x7fe96949c9d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:26.296022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.296825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.297363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.298504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.299050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.300124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.378851 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8319e1f2-0d28-4584-8fe8-5c47034bbd60 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585" status: 200 len: 240 microversion: 2.36 time: 0.466105 Aug 30 04:22:26.379754 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1495/3057] 10.222.0.27 () {62 vars in 1303 bytes} [Tue Aug 30 04:22:25 2022] PUT /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585 => generated 240 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:26.389723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:26.390635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:26.403850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.404549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.405318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.417889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.420451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.420929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.505654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.511646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.512121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.512598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lazy-loading 'fault' on Instance uuid ef6d64f2-023b-4439-a38e-dc68aaa181fb {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:22:26.520020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Building network info cache for instance {{(pid=122403) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Aug 30 04:22:26.696858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:26.713527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:26.726388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:26.731799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8e48bc85-7c67-46f9-aae5-2e2a0e98e55b tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 200 len: 1366 microversion: 2.47 time: 0.348831 Aug 30 04:22:26.734202 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1496/3058] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:26 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:26.763765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:26.764795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:26.778316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.779078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.780792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:26.783020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:26.783713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:26.786882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.159803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:27.169720 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ab931ad-fa95-47a5-8769-66cda3b2368e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1489 microversion: 2.1 time: 0.422472 Aug 30 04:22:27.174607 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1497/3059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:26 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1489 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:27.201214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Calling method '.version_select at 0x7fe96a03ab80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:27.309207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.311470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.313818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.318921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.319965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.322881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.367821 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca749944-a673-446e-b7ac-f3ca835394df tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585/detail" status: 200 len: 672 microversion: 2.36 time: 0.176054 Aug 30 04:22:27.369381 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1498/3060] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Aug 30 04:22:27 2022] GET /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585/detail => generated 672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:27.374776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:27.376220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:27.401695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.403034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.404037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.405394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.406977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.408060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.769996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Updating instance_info_cache with network_info: [{"id": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a", "address": "fa:16:3e:f4:81:bc", "network": {"id": "f1e14a65-aaa1-4738-b8ee-8982958c9b28", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1647061102-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6c7facb64d7a41a0974d2b5aa58c66ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3a0f694a-1f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:22:27.787540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:27.804582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5659b625-8708-4c3d-a6c5-dd73e88a4e89 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.432860 Aug 30 04:22:27.805219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Releasing lock "refresh_cache-89b5e35e-b6af-4419-b964-4f7a1b665945" {{(pid=122403) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 04:22:27.807219 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1499/3061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:27 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:27.808525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-748cb112-6cc4-48a1-a97e-c7a4eb5bae49 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action" status: 202 len: 0 microversion: 2.1 time: 4.333977 Aug 30 04:22:27.815139 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1563/3062] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:23 2022] POST /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945/action => generated 0 bytes in 4342 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Aug 30 04:22:27.821609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4172f612-54ff-438f-9b02-59392db60f7d req-82a77bcf-b0b5-44e8-9819-12125d8593fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b5e35e-b6af-4419-b964-4f7a1b665945", "tag": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:27.827672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:27.830884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:27.843595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.844249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.845775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4172f612-54ff-438f-9b02-59392db60f7d req-82a77bcf-b0b5-44e8-9819-12125d8593fa service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.846369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.847247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:27.847858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4172f612-54ff-438f-9b02-59392db60f7d req-82a77bcf-b0b5-44e8-9819-12125d8593fa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.848429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:27.849764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.850180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4172f612-54ff-438f-9b02-59392db60f7d req-82a77bcf-b0b5-44e8-9819-12125d8593fa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:27.878077 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4172f612-54ff-438f-9b02-59392db60f7d req-82a77bcf-b0b5-44e8-9819-12125d8593fa service nova] Creating event network-changed:3a0f694a-1f77-44c2-8170-8b4cb5f4985a for instance 89b5e35e-b6af-4419-b964-4f7a1b665945 on n-h1-854925-5 Aug 30 04:22:27.886664 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4172f612-54ff-438f-9b02-59392db60f7d req-82a77bcf-b0b5-44e8-9819-12125d8593fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077811 Aug 30 04:22:27.893302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lazy-loading 'flavor' on Instance uuid 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:22:27.894225 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1500/3063] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:27.900300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Action: 'update', calling method: .version_select at 0x7fe9693c5940>, body: {"quota_set": {"ram": "2048"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:28.025492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.026203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.027067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.035267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.036101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.037871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.042253 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-077ef223-cf40-4a32-a339-67806d10531e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0/action" status: 202 len: 0 microversion: 2.1 time: 0.221050 Aug 30 04:22:28.042253 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1564/3064] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:27 2022] POST /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:22:28.053506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.055395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: ef6d64f2-023b-4439-a38e-dc68aaa181fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:28.066133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.066687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.067712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.070757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.071992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.072613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.095155 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] HTTP exception thrown: Instance ef6d64f2-023b-4439-a38e-dc68aaa181fb could not be found. Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Request method failure captured: Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb HTTP/1.1 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZBNZRmV3Ii-pFZSF0jUcHn8WQnXkzdvpSXcmHZ7RD17UGV-vOiA1UnOnR5jPp3gUwuBMCVWRNREEJ-AMsaoQrSf7uUDTHUftToCr6ALxqT_vUAsC694QjYdYuv81r09UjFeUC5tAW-r1ps7FOnjmdy9DO1IRdG0tmJ_0EWcTetK-qg Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: f3262ed2851b411d8a9e6273292a80fe Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerShowV247Test-1552276562 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3262ed2851b411d8a9e6273292a80fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3262ed2851b411d8a9e6273292a80fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3262ed2851b411d8a9e6273292a80fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3262ed2851b411d8a9e6273292a80fe"}]}] Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerShowV247Test-1552276562 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: f3262ed2851b411d8a9e6273292a80fe Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerShowV247Test-1552276562 Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerShowV247Test-1552276562-project Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 424b82c5691b4b1fbbeb624fcfb80dee Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerShowV247Test-1552276562-project Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance ef6d64f2-023b-4439-a38e-dc68aaa181fb could not be found. Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'ef6d64f2-023b-4439-a38e-dc68aaa181fb'} Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef6d64f2-023b-4439-a38e-dc68aaa181fb could not be found. Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef6d64f2-023b-4439-a38e-dc68aaa181fb could not be found. Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.098083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.103960 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.103960 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.103960 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.103960 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:28.103960 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:28.103960 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef6d64f2-023b-4439-a38e-dc68aaa181fb could not be found. Aug 30 04:22:28.103960 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.107042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Returning 404 to user: Instance ef6d64f2-023b-4439-a38e-dc68aaa181fb could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:28.108652 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-05360c05-3fd7-4ac9-898f-5fecd88f1d17 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb" status: 404 len: 111 microversion: 2.47 time: 0.061963 Aug 30 04:22:28.113192 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1565/3065] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/servers/ef6d64f2-023b-4439-a38e-dc68aaa181fb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:22:28.121800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.122726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:28.131860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.132581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.133635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.134372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.134905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.135352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.148364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.148868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.149316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.150084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.150548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.150983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.160972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] HTTP exception thrown: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Request method failure captured: Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 HTTP/1.1 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZAvY7IeA9hqDYydtkhy7MHqYs7PL1PLivEeUPaql7uS5vaNZeUSsvhGBbtXctBDQOlJgdr5nKLaIvIUTIFAaYf1-kRp4yJYlf7mRk22Tzh7KJ8wG9rE3o7xCqlohCF9Xje55wUt61FI2xsWDPbVs-agCAI2kRUJIZeP14IfBmSrAGE Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c7facb64d7a41a0974d2b5aa58c66ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}] Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 34f73ac855ca447286ee1788fd2520f2 Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '187938a1-c38b-4179-85fd-5d7af72f5344'} Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:28.164073 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.169616 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.175210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Returning 404 to user: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:28.176091 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cafa6e5-84b7-4605-865f-ebe2e5ef9e15 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "DELETE /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 404 len: 111 microversion: 2.1 time: 0.061674 Aug 30 04:22:28.177203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1566/3066] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:22:28 2022] DELETE /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:22:28.183678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.184481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:28.194559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.195643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.196284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.197469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.198095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.198690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.244150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:28.246133 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e7e3d2b-d888-49c6-94f9-4a21ce2323ba tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585?user_id=694e130bb525497296cae63ad41fe271" status: 200 len: 240 microversion: 2.36 time: 0.350474 Aug 30 04:22:28.247225 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1501/3067] 10.222.0.27 () {62 vars in 1384 bytes} [Tue Aug 30 04:22:27 2022] PUT /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585?user_id=694e130bb525497296cae63ad41fe271 => generated 240 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:28.254302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.256582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:28.265720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.266572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.267700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.269215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.269879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.270990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.305525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:22:28.352533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:28.439625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-532b6d42-a66a-4925-921c-d6e4a4f2fcfb tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e" status: 204 len: 0 microversion: 2.47 time: 0.189685 Aug 30 04:22:28.440464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1502/3068] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:22:28 2022] DELETE /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:22:28.446891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.448357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 187938a1-c38b-4179-85fd-5d7af72f5344] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:28.455862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.456363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.456814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.457977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.457977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.458449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.482089 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] HTTP exception thrown: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.482335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Request method failure captured: Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 HTTP/1.1 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZAvY7IeA9hqDYydtkhy7MHqYs7PL1PLivEeUPaql7uS5vaNZeUSsvhGBbtXctBDQOlJgdr5nKLaIvIUTIFAaYf1-kRp4yJYlf7mRk22Tzh7KJ8wG9rE3o7xCqlohCF9Xje55wUt61FI2xsWDPbVs-agCAI2kRUJIZeP14IfBmSrAGE Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c7facb64d7a41a0974d2b5aa58c66ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}] Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 34f73ac855ca447286ee1788fd2520f2 Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '187938a1-c38b-4179-85fd-5d7af72f5344'} Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.483832 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Returning 404 to user: Instance 187938a1-c38b-4179-85fd-5d7af72f5344 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:28.488497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c6e0e02-6376-40b7-809d-7e4c463e444f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344" status: 404 len: 111 microversion: 2.1 time: 0.043669 Aug 30 04:22:28.490180 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1503/3069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/servers/187938a1-c38b-4179-85fd-5d7af72f5344 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:22:28.494613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c265b68b-cf93-41a9-ad78-68bad12341d9 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] Calling method '.version_select at 0x7fe9694d0430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.497696 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-388aaec2-66d3-4e07-aa17-76fe2008aa91 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1497 microversion: 2.1 time: 0.319173 Aug 30 04:22:28.510778 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1567/3070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1497 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:28.518366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.519120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:28.530918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.531737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.532296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.533381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.534351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.534984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.588745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c265b68b-cf93-41a9-ad78-68bad12341d9 tempest-QuotasAdminTestV236-862998751 tempest-QuotasAdminTestV236-862998751-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585?user_id=694e130bb525497296cae63ad41fe271" status: 200 len: 282 microversion: 2.36 time: 0.097818 Aug 30 04:22:28.590059 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1504/3071] 10.222.0.27 () {60 vars in 1364 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/os-quota-sets/7b1cfb30839c4a9b885de3392ed8d585?user_id=694e130bb525497296cae63ad41fe271 => generated 282 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:28.595398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb4dec82-8915-445c-8e91-b81c162586fa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '.version_select at 0x7fe969f78e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.621227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:28.631331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:28.634398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:28.635996 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1687a1cc-8da0-42d0-995b-f168f89a3c2d tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e" status: 200 len: 1363 microversion: 2.47 time: 0.124048 Aug 30 04:22:28.653179 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1568/3072] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:28.830270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:28.831369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:28.839832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.840744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.841613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:28.843194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:28.844037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:28.844923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:29.709425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:29.726067 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4017c1b5-7826-4eca-9bd8-9ae2fce8cd61 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.901657 Aug 30 04:22:29.726667 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1569/3073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:28 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:29.744688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0f23d44f-8297-40a4-aacd-742c53cb95f2 req-8e788a91-b5a9-4af5-8715-26f1a12e8905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11757b96-666e-431b-9972-3e32ad1a70a0", "name": "network-vif-plugged", "status": "completed", "tag": "e275b53d-94fa-4a3f-a680-b496c0d7b4a8"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:29.769353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f23d44f-8297-40a4-aacd-742c53cb95f2 req-8e788a91-b5a9-4af5-8715-26f1a12e8905 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:29.769842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f23d44f-8297-40a4-aacd-742c53cb95f2 req-8e788a91-b5a9-4af5-8715-26f1a12e8905 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:29.770486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f23d44f-8297-40a4-aacd-742c53cb95f2 req-8e788a91-b5a9-4af5-8715-26f1a12e8905 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:29.794461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0f23d44f-8297-40a4-aacd-742c53cb95f2 req-8e788a91-b5a9-4af5-8715-26f1a12e8905 service nova] Creating event network-vif-plugged:e275b53d-94fa-4a3f-a680-b496c0d7b4a8 for instance 11757b96-666e-431b-9972-3e32ad1a70a0 on n-h1-854925-5 Aug 30 04:22:29.806258 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0f23d44f-8297-40a4-aacd-742c53cb95f2 req-8e788a91-b5a9-4af5-8715-26f1a12e8905 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065064 Aug 30 04:22:29.807182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1570/3074] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:29.812574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:29.814105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:29.839846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:29.840761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:29.840761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:29.841489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:29.842140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:29.842908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.178049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:30.189887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:30.208301 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd1154b7-95a7-4bd5-a790-8abe75b1f24b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 200 len: 1480 microversion: 2.1 time: 0.399848 Aug 30 04:22:30.216009 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1571/3075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:29 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 1480 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:30.223141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.225000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:30.256840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.257743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.259381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.260651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.261251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.261894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.389880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:30.400941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:30.403666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:30.405952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-022af46c-e5a6-448e-a015-7e0d68a52909 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e" status: 200 len: 1363 microversion: 2.47 time: 0.188423 Aug 30 04:22:30.407144 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1572/3076] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:30.421919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1250411223"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:30.427652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:30.434400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.434994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.435763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.436540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.437092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.437628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.549538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb4dec82-8915-445c-8e91-b81c162586fa tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "DELETE /compute/v2.1/os-floating-ips/8bc349f2-76f8-463e-8a12-5587d5a2375f" status: 202 len: 0 microversion: 2.1 time: 1.958074 Aug 30 04:22:30.551405 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1505/3077] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:22:28 2022] DELETE /compute/v2.1/os-floating-ips/8bc349f2-76f8-463e-8a12-5587d5a2375f => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:22:30.572647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.577122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:30.623556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.627796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.629420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.645094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.647075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.651702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.716428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:22:30.717914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c11c696a-4647-47af-b823-a435fb08cbd5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0/action" status: 202 len: 0 microversion: 2.1 time: 0.308412 Aug 30 04:22:30.721440 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1573/3078] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:22:30 2022] POST /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:22:30.732003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eea5db3e-13ea-492e-ae23-069b1127954f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969a5dee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.805952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eea5db3e-13ea-492e-ae23-069b1127954f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.077975 Aug 30 04:22:30.807805 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1574/3079] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:30.814528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.818498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:30.833965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.834752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.835406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.836462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.837402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.838229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.885446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c7e75a6-8839-4969-b0c5-487ce22780b7 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "DELETE /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 204 len: 0 microversion: 2.1 time: 0.328619 Aug 30 04:22:30.889909 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1506/3080] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:22:30 2022] DELETE /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:22:30.914412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:30.915197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:30.921850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.922551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.923403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:30.924358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:30.925044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:30.925839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:31.275406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.307406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20289658-63df-412f-987e-9678f58e9a9c tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.482130 Aug 30 04:22:31.310763 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1575/3081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:31.348135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.377163 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64a5288b-e684-4426-a00a-bd4b7c4a143c tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1526 microversion: 2.1 time: 0.482477 Aug 30 04:22:31.395153 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1507/3082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:30 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1526 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:31.433539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:31.434825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:31.448458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:31.449285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:31.450142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:31.451278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:31.452341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:31.452976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:31.582345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:31.582784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:31.583504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:31.583965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lazy-loading 'fault' on Instance uuid cd2d48d0-6e7a-414c-8b71-838629aa392e {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:22:31.637103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.646450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.647916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '424b82c5691b4b1fbbeb624fcfb80dee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3262ed2851b411d8a9e6273292a80fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:31.651751 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a44a4f1-595b-44b9-b657-b69030cf8399 tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e" status: 200 len: 1368 microversion: 2.47 time: 0.222690 Aug 30 04:22:31.654146 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1576/3083] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:31 2022] GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:22:31.822574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1fd20aaf-0e1d-461f-883a-0ef4c03d3bc5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969a0d160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:31.900975 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1fd20aaf-0e1d-461f-883a-0ef4c03d3bc5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.082439 Aug 30 04:22:31.902175 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1508/3084] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:31 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:32.330348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.330902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:32.338383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.350075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.350832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.351754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.352380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.352991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.403572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.404200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:32.412256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.412757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.413210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.413955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.414421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.414855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.560634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:32.708423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:32.713654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:32.718532 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c22b5e69-9a32-401f-9e95-dd0fc0ef972f tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1526 microversion: 2.1 time: 0.319475 Aug 30 04:22:32.719135 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1509/3085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:32.727014 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d6ef1452-3bd3-4538-be20-ecec5dce3ab6 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1328 microversion: 2.1 time: 0.400441 Aug 30 04:22:32.728249 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1577/3086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1328 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:32.751204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.751858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] [instance: cd2d48d0-6e7a-414c-8b71-838629aa392e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:32.758139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.758703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.759139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.759850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:32.760315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:32.760749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:32.776099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] HTTP exception thrown: Instance cd2d48d0-6e7a-414c-8b71-838629aa392e could not be found. Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Request method failure captured: Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e HTTP/1.1 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZBNZRmV3Ii-pFZSF0jUcHn8WQnXkzdvpSXcmHZ7RD17UGV-vOiA1UnOnR5jPp3gUwuBMCVWRNREEJ-AMsaoQrSf7uUDTHUftToCr6ALxqT_vUAsC694QjYdYuv81r09UjFeUC5tAW-r1ps7FOnjmdy9DO1IRdG0tmJ_0EWcTetK-qg Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.47 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: f3262ed2851b411d8a9e6273292a80fe Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerShowV247Test-1552276562 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_f3262ed2851b411d8a9e6273292a80fe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/f3262ed2851b411d8a9e6273292a80fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3262ed2851b411d8a9e6273292a80fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/f3262ed2851b411d8a9e6273292a80fe"}]}] Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerShowV247Test-1552276562 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: f3262ed2851b411d8a9e6273292a80fe Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerShowV247Test-1552276562 Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerShowV247Test-1552276562-project Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 424b82c5691b4b1fbbeb624fcfb80dee Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerShowV247Test-1552276562-project Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance cd2d48d0-6e7a-414c-8b71-838629aa392e could not be found. Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'cd2d48d0-6e7a-414c-8b71-838629aa392e'} Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd2d48d0-6e7a-414c-8b71-838629aa392e could not be found. Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd2d48d0-6e7a-414c-8b71-838629aa392e could not be found. Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:32.778017 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd2d48d0-6e7a-414c-8b71-838629aa392e could not be found. Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] Returning 404 to user: Instance cd2d48d0-6e7a-414c-8b71-838629aa392e could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c7a516c-f151-47c8-9f1d-7d2d3df2593a tempest-ServerShowV247Test-1552276562 tempest-ServerShowV247Test-1552276562-project] 10.222.0.27 "GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e" status: 404 len: 111 microversion: 2.47 time: 0.050158 Aug 30 04:22:32.782918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1510/3087] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/servers/cd2d48d0-6e7a-414c-8b71-838629aa392e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:22:32.917510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f28f1bda-85e6-40df-86de-8ecced5731b7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969989700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:32.924943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=68 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:32.987810 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f28f1bda-85e6-40df-86de-8ecced5731b7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.074853 Aug 30 04:22:32.989128 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1578/3088] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:32 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:33.623499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Action: 'update', calling method: .version_select at 0x7fe969a0d160>, body: {"quota_set": {"ram": "5120"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:33.686048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.686538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.686980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.687745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.688232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.688691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.740510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a743150a-4283-4a91-a14e-f6d4952e7df5 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220" status: 200 len: 148 microversion: 2.57 time: 0.314457 Aug 30 04:22:33.741510 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1511/3089] 10.222.0.27 () {62 vars in 1303 bytes} [Tue Aug 30 04:22:33 2022] PUT /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220 => generated 148 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:33.751721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Calling method '.version_select at 0x7fe96a333040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:33.760936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:33.763001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:33.771879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.772330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.773116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.774229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.775206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.775945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.873248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.873763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.877067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.878064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.878739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.879340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.902743 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ba1c2231-5d14-47eb-9c2a-4d7fe773497d tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220/detail" status: 200 len: 463 microversion: 2.57 time: 0.154675 Aug 30 04:22:33.914546 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1579/3090] 10.222.0.27 () {60 vars in 1304 bytes} [Tue Aug 30 04:22:33 2022] GET /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220/detail => generated 463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:33.919670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:33.920540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:33.931903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.932823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.933638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:33.934711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:33.935453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:33.936211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.137698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34f73ac855ca447286ee1788fd2520f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7facb64d7a41a0974d2b5aa58c66ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:34.148740 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbb5686f-d76c-4bd7-a25c-ee82a04d83a1 tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 200 len: 1484 microversion: 2.1 time: 0.232739 Aug 30 04:22:34.149790 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1580/3091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:33 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 1484 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:34.150512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:34.155770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46c7e0c7-2063-4f1e-9298-5fcf0b1e85a9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969995040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:34.158977 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b4439f4-85d9-48ca-bcfd-82371e6f502e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1527 microversion: 2.1 time: 0.403897 Aug 30 04:22:34.159572 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1512/3092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:33 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1527 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:34.173638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-442ed8d5-3e45-4a66-98a8-38ec1eedc78a req-57fa4123-994c-4b6b-9700-86621c9ae174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b5e35e-b6af-4419-b964-4f7a1b665945", "name": "network-vif-deleted", "tag": "3a0f694a-1f77-44c2-8170-8b4cb5f4985a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:34.186917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-442ed8d5-3e45-4a66-98a8-38ec1eedc78a req-57fa4123-994c-4b6b-9700-86621c9ae174 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.187419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-442ed8d5-3e45-4a66-98a8-38ec1eedc78a req-57fa4123-994c-4b6b-9700-86621c9ae174 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.187861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-442ed8d5-3e45-4a66-98a8-38ec1eedc78a req-57fa4123-994c-4b6b-9700-86621c9ae174 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.212371 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-442ed8d5-3e45-4a66-98a8-38ec1eedc78a req-57fa4123-994c-4b6b-9700-86621c9ae174 service nova] Creating event network-vif-deleted:3a0f694a-1f77-44c2-8170-8b4cb5f4985a for instance 89b5e35e-b6af-4419-b964-4f7a1b665945 on n-h1-854925-5 Aug 30 04:22:34.219524 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-442ed8d5-3e45-4a66-98a8-38ec1eedc78a req-57fa4123-994c-4b6b-9700-86621c9ae174 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058758 Aug 30 04:22:34.220616 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1513/3093] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:34.225922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Action: 'update', calling method: .version_select at 0x7fe96a078d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:34.253471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46c7e0c7-2063-4f1e-9298-5fcf0b1e85a9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.099219 Aug 30 04:22:34.256715 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1581/3094] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:34 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:34.290726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:34.291378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:34.313653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.315908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.317871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.319251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.320209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.322110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.362728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.363230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.363862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.365209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.365657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.369875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.440471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.441223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.441860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.443352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.443984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.444616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.523358 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de7a0634-781a-4890-b360-884075811d60 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220?user_id=b9cab72d5f4741e98ba83153a9cfdad0" status: 200 len: 148 microversion: 2.57 time: 0.301793 Aug 30 04:22:34.524121 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1514/3095] 10.222.0.27 () {62 vars in 1384 bytes} [Tue Aug 30 04:22:34 2022] PUT /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220?user_id=b9cab72d5f4741e98ba83153a9cfdad0 => generated 148 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:34.537808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a6d22e79-d5a8-4e34-a8de-ffefc379b113 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] Calling method '.version_select at 0x7fe96a2fc0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:34.687904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:34.698871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ea2e274-6ff6-4265-9a36-145b9efb86de tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1527 microversion: 2.1 time: 0.438767 Aug 30 04:22:34.701158 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1582/3096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:34 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1527 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:34.892224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:34.928118 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a6d22e79-d5a8-4e34-a8de-ffefc379b113 tempest-QuotasAdminTestV257-1884003531 tempest-QuotasAdminTestV257-1884003531-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220?user_id=b9cab72d5f4741e98ba83153a9cfdad0" status: 200 len: 190 microversion: 2.57 time: 0.396635 Aug 30 04:22:34.928751 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1515/3097] 10.222.0.27 () {60 vars in 1364 bytes} [Tue Aug 30 04:22:34 2022] GET /compute/v2.1/os-quota-sets/37dfbc0030144d5e9210e2d1a5002220?user_id=b9cab72d5f4741e98ba83153a9cfdad0 => generated 190 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:22:34.965139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:34.966569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:34.977527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.978153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.979092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.979872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:34.980520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:34.980956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:34.998839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] HTTP exception thrown: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Request method failure captured: Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 HTTP/1.1 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZBur86DFVP1iqOdwBpo3QN0Y2VNYoKQUotCYNh7SZIQnw8n9dvd2ohyS4DOTEyvIFyt7pfuculNWZSw888-wQT2jiteFW1DzLB0EJg2OLT3yY6fi94mDpZGMh2bIuQMA9kXrMO8Pj-D-0pfACruvG4TdUk9PqHgFD30ua3R3sMkn-0 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 61c700ce791a454ba87806db0fe7bebd Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1105102982 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61c700ce791a454ba87806db0fe7bebd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61c700ce791a454ba87806db0fe7bebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61c700ce791a454ba87806db0fe7bebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61c700ce791a454ba87806db0fe7bebd"}]}] Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1105102982 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 61c700ce791a454ba87806db0fe7bebd Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1105102982 Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1105102982-project Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: a595b72a57a74ff0a37a28291ffd397d Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1105102982-project Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '11757b96-666e-431b-9972-3e32ad1a70a0'} Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:35.002415 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Returning 404 to user: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e826367d-9b1a-4fd6-8d30-35d286f84de7 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 404 len: 111 microversion: 2.1 time: 0.286016 Aug 30 04:22:35.008071 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1583/3098] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:22:34 2022] DELETE /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 111 bytes in 287 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:22:35.014094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.014854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:35.032334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.032877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.033374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.035301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.035862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.036863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.172439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.173227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] [instance: 89b5e35e-b6af-4419-b964-4f7a1b665945] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:35.183300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.184900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.187322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.189025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.190900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.191547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.226076 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] HTTP exception thrown: Instance 89b5e35e-b6af-4419-b964-4f7a1b665945 could not be found. Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Request method failure captured: Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 HTTP/1.1 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZAvY7IeA9hqDYydtkhy7MHqYs7PL1PLivEeUPaql7uS5vaNZeUSsvhGBbtXctBDQOlJgdr5nKLaIvIUTIFAaYf1-kRp4yJYlf7mRk22Tzh7KJ8wG9rE3o7xCqlohCF9Xje55wUt61FI2xsWDPbVs-agCAI2kRUJIZeP14IfBmSrAGE Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6c7facb64d7a41a0974d2b5aa58c66ab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6c7facb64d7a41a0974d2b5aa58c66ab"}]}] Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 6c7facb64d7a41a0974d2b5aa58c66ab Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-805945813 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 34f73ac855ca447286ee1788fd2520f2 Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-805945813-project Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 89b5e35e-b6af-4419-b964-4f7a1b665945 could not be found. Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '89b5e35e-b6af-4419-b964-4f7a1b665945'} Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b5e35e-b6af-4419-b964-4f7a1b665945 could not be found. Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b5e35e-b6af-4419-b964-4f7a1b665945 could not be found. Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.232550 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b5e35e-b6af-4419-b964-4f7a1b665945 could not be found. Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] Returning 404 to user: Instance 89b5e35e-b6af-4419-b964-4f7a1b665945 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:35.236720 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c085523-2547-4c4f-b7d3-250fd2b4c3ed tempest-FloatingIPsAssociationTestJSON-805945813 tempest-FloatingIPsAssociationTestJSON-805945813-project] 10.222.0.27 "GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945" status: 404 len: 111 microversion: 2.1 time: 0.068140 Aug 30 04:22:35.241497 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1584/3099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:35 2022] GET /compute/v2.1/servers/89b5e35e-b6af-4419-b964-4f7a1b665945 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:22:35.245658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:35.258871 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1017fcf2-2b74-4959-9443-95c72a11f6af tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1527 microversion: 2.1 time: 0.248604 Aug 30 04:22:35.260458 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1516/3100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:35 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1527 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:35.270209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7dabc217-6ca7-4474-8b39-1302ed9cc3b8 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9695ae160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.282977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Action: 'update', calling method: >, body: {"server": {"name": "11757b96-666e-431b-9972-3e32ad1a70a0_new"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:35.285924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:35.293001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.294727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.295371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.296821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.297586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.298208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.315302 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] HTTP exception thrown: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Request method failure captured: Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 HTTP/1.1 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 64 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZBur86DFVP1iqOdwBpo3QN0Y2VNYoKQUotCYNh7SZIQnw8n9dvd2ohyS4DOTEyvIFyt7pfuculNWZSw888-wQT2jiteFW1DzLB0EJg2OLT3yY6fi94mDpZGMh2bIuQMA9kXrMO8Pj-D-0pfACruvG4TdUk9PqHgFD30ua3R3sMkn-0 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 61c700ce791a454ba87806db0fe7bebd Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1105102982 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61c700ce791a454ba87806db0fe7bebd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61c700ce791a454ba87806db0fe7bebd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61c700ce791a454ba87806db0fe7bebd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61c700ce791a454ba87806db0fe7bebd"}]}] Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1105102982 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 61c700ce791a454ba87806db0fe7bebd Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1105102982 Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1105102982-project Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: a595b72a57a74ff0a37a28291ffd397d Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1105102982-project Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "11757b96-666e-431b-9972-3e32ad1a70a0_new"}} Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '11757b96-666e-431b-9972-3e32ad1a70a0', 'body': {'server': {'name': '11757b96-666e-431b-9972-3e32ad1a70a0_new'}}} Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:22:35.318305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:35.323720 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:35.326048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] Returning 404 to user: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:35.327108 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01969582-3506-474e-998e-6ea56c145a35 tempest-ServersNegativeTestMultiTenantJSON-1105102982 tempest-ServersNegativeTestMultiTenantJSON-1105102982-project] 10.222.0.27 "PUT /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 404 len: 111 microversion: 2.1 time: 0.049076 Aug 30 04:22:35.331994 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1517/3101] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:22:35 2022] PUT /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:22:35.339224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.339224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:35.346003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.346526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.347185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.347795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.348269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.348735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.354243 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7dabc217-6ca7-4474-8b39-1302ed9cc3b8 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.087227 Aug 30 04:22:35.361424 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1585/3102] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:35 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:35.401939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:22:35.533377 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f4452061-1b36-4316-af8c-036384411608 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "DELETE /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 204 len: 0 microversion: 2.1 time: 0.199829 Aug 30 04:22:35.537697 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1518/3103] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:22:35 2022] DELETE /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:22:35.545017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:35.545904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:35.555295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.556086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.556752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.557985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:35.558599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:35.559466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:35.756978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:35.775092 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4174e6b8-8719-4d5f-a02e-2784105641c2 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1533 microversion: 2.1 time: 0.235233 Aug 30 04:22:35.781807 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1586/3104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:35 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1533 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:36.204096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bb0bd1f4-84ec-4371-90b2-603cdefc1825 tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] Calling method '.version_select at 0x7fe96a3720d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:36.302246 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bb0bd1f4-84ec-4371-90b2-603cdefc1825 tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.365693 Aug 30 04:22:36.304504 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1519/3105] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:22:35 2022] GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4/defaults => generated 371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:36.317722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a704030c-d3c5-4077-a063-3a662ac1ac4f tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] Calling method '.version_select at 0x7fe9695ae280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:36.370661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08a3f324-c615-4965-9af9-1f2c13e2bfb3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96aa864c0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:36.420528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a704030c-d3c5-4077-a063-3a662ac1ac4f tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4" status: 200 len: 371 microversion: 2.1 time: 0.107221 Aug 30 04:22:36.429909 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1587/3106] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:22:36 2022] GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4 => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:36.436519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c2ba4f25-2e60-4d42-a234-ab3feb830358 tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] Calling method '.version_select at 0x7fe96958aaf0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:36.456265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08a3f324-c615-4965-9af9-1f2c13e2bfb3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.091352 Aug 30 04:22:36.456845 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1520/3107] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:36 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:36.500074 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c2ba4f25-2e60-4d42-a234-ab3feb830358 tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.068722 Aug 30 04:22:36.501007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1588/3108] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:22:36 2022] GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4/defaults => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:36.519370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9f165f3-b0e6-424e-b237-1dafd84690cc tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] Calling method '.version_select at 0x7fe96a078b80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:36.604414 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9f165f3-b0e6-424e-b237-1dafd84690cc tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4" status: 200 len: 371 microversion: 2.1 time: 0.091254 Aug 30 04:22:36.605354 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1521/3109] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 04:22:36 2022] GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4 => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:22:36.617048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f141b417-66dd-457a-84a4-7794f72336bb tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] Calling method '.version_select at 0x7fe96958a670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:36.701496 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f141b417-66dd-457a-84a4-7794f72336bb tempest-QuotasTestJSON-1476299078 tempest-QuotasTestJSON-1476299078-project] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4?user_id=ef6160114876430fa6c99bdbcf5c11a7" status: 200 len: 371 microversion: 2.1 time: 0.087890 Aug 30 04:22:36.702402 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1589/3110] 10.222.0.27 () {58 vars in 1323 bytes} [Tue Aug 30 04:22:36 2022] GET /compute/v2.1/os-quota-sets/c723415110b94dcc8ab4d342d6cad9e4?user_id=ef6160114876430fa6c99bdbcf5c11a7 => generated 371 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:36.801623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:36.802512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:36.813866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:36.814745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:36.815906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:36.816886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:36.818344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:36.819883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:37.115933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:37.126945 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9e44099-8296-44be-9043-41458d81c41e tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1533 microversion: 2.1 time: 0.330895 Aug 30 04:22:37.128185 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1522/3111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:36 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1533 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:37.472051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fdee0fbe-bcd1-4d9e-9dae-a922edfd0b5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969585430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:37.531709 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fdee0fbe-bcd1-4d9e-9dae-a922edfd0b5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.063760 Aug 30 04:22:37.533081 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1590/3112] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:37 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:38.150358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:38.150996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:38.161919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:38.167617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:38.168108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:38.168477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:38.170054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:38.170975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:38.171572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:38.359127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:38.371204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3197b68e-4780-4576-8666-c7ca1c840222 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1533 microversion: 2.1 time: 0.225496 Aug 30 04:22:38.372606 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1523/3113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:38 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1533 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:38.547743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-129baba6-0a63-4612-9cdf-693d96662cc7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96958aca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:38.560055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e8248101-4d42-4d8b-82fc-bea04d3709a2 req-cbcd66f9-0f90-42b4-82a4-1b1797ce7f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb63a2f-23a4-478f-9377-b3c21e4a59d0", "name": "network-vif-plugged", "status": "completed", "tag": "78eafa8d-f968-4acc-a70d-bf67e4cdcc39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:38.602062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e8248101-4d42-4d8b-82fc-bea04d3709a2 req-cbcd66f9-0f90-42b4-82a4-1b1797ce7f93 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:38.602673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e8248101-4d42-4d8b-82fc-bea04d3709a2 req-cbcd66f9-0f90-42b4-82a4-1b1797ce7f93 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:38.603128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e8248101-4d42-4d8b-82fc-bea04d3709a2 req-cbcd66f9-0f90-42b4-82a4-1b1797ce7f93 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:38.652035 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-129baba6-0a63-4612-9cdf-693d96662cc7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.106017 Aug 30 04:22:38.654984 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e8248101-4d42-4d8b-82fc-bea04d3709a2 req-cbcd66f9-0f90-42b4-82a4-1b1797ce7f93 service nova] Creating event network-vif-plugged:78eafa8d-f968-4acc-a70d-bf67e4cdcc39 for instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 on n-h1-854925-5 Aug 30 04:22:38.655779 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1591/3114] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:38 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:38.664818 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e8248101-4d42-4d8b-82fc-bea04d3709a2 req-cbcd66f9-0f90-42b4-82a4-1b1797ce7f93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109855 Aug 30 04:22:38.665791 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1524/3115] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:39.394327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:39.396099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:39.404880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:39.408522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:39.410881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:39.414575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:39.416409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:39.418429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:39.678097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc5709fe-3796-40ea-8a37-1abed64fe0d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a2fc0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:39.724696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:39.742871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4bfc4ed6-542a-4b8a-a0a4-0036cee23958 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1491 microversion: 2.1 time: 0.353425 Aug 30 04:22:39.748504 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1592/3116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:39 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1491 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:39.803015 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc5709fe-3796-40ea-8a37-1abed64fe0d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.136581 Aug 30 04:22:39.806472 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1525/3117] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:39 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:39.981784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cc18e224-7f3f-445e-bf76-6358173806b4 req-b8205479-e603-47bc-acb7-607bd0e6f06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11757b96-666e-431b-9972-3e32ad1a70a0", "name": "network-vif-deleted", "tag": "e275b53d-94fa-4a3f-a680-b496c0d7b4a8"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:40.007691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cc18e224-7f3f-445e-bf76-6358173806b4 req-b8205479-e603-47bc-acb7-607bd0e6f06c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.015902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cc18e224-7f3f-445e-bf76-6358173806b4 req-b8205479-e603-47bc-acb7-607bd0e6f06c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.016852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cc18e224-7f3f-445e-bf76-6358173806b4 req-b8205479-e603-47bc-acb7-607bd0e6f06c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.057133 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cc18e224-7f3f-445e-bf76-6358173806b4 req-b8205479-e603-47bc-acb7-607bd0e6f06c service nova] Creating event network-vif-deleted:e275b53d-94fa-4a3f-a680-b496c0d7b4a8 for instance 11757b96-666e-431b-9972-3e32ad1a70a0 on n-h1-854925-5 Aug 30 04:22:40.076729 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cc18e224-7f3f-445e-bf76-6358173806b4 req-b8205479-e603-47bc-acb7-607bd0e6f06c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099251 Aug 30 04:22:40.083068 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1593/3118] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:40.681221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fa03b7cc-7ee3-42a5-af17-dbbef909e8ae req-0312f8c9-1988-46b3-821c-e3ee7f967e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11757b96-666e-431b-9972-3e32ad1a70a0", "name": "network-vif-unplugged", "status": "completed", "tag": "e275b53d-94fa-4a3f-a680-b496c0d7b4a8"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:40.711939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa03b7cc-7ee3-42a5-af17-dbbef909e8ae req-0312f8c9-1988-46b3-821c-e3ee7f967e99 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.716871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa03b7cc-7ee3-42a5-af17-dbbef909e8ae req-0312f8c9-1988-46b3-821c-e3ee7f967e99 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.723810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa03b7cc-7ee3-42a5-af17-dbbef909e8ae req-0312f8c9-1988-46b3-821c-e3ee7f967e99 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.774204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:40.775937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:40.779141 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fa03b7cc-7ee3-42a5-af17-dbbef909e8ae req-0312f8c9-1988-46b3-821c-e3ee7f967e99 service nova] Creating event network-vif-unplugged:e275b53d-94fa-4a3f-a680-b496c0d7b4a8 for instance 11757b96-666e-431b-9972-3e32ad1a70a0 on n-h1-854925-5 Aug 30 04:22:40.798862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.802628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.804668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.808340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.809374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.811128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.813860 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fa03b7cc-7ee3-42a5-af17-dbbef909e8ae req-0312f8c9-1988-46b3-821c-e3ee7f967e99 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130564 Aug 30 04:22:40.817599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1526/3119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:40.832976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5359ab8-2ab2-4251-8c98-fca137f8b859 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a0249d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:40.947252 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b5359ab8-2ab2-4251-8c98-fca137f8b859 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.127376 Aug 30 04:22:40.948206 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1527/3120] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:40 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:40.954585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:40.956089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:40.957173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:40.959144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lazy-loading 'fault' on Instance uuid 11757b96-666e-431b-9972-3e32ad1a70a0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:22:41.365134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-788151762", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:41.463673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:22:41.571079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2088cb87e3e45f2b3a6c674442d2792', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e714811d9ad4d69a1d78fae3deadeab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:41.585775 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c98b38b-8e01-491e-bac5-e6a67a83d66f tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 200 len: 1318 microversion: 2.1 time: 0.818100 Aug 30 04:22:41.595309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1594/3121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:40 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:41.963826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f09d4539-d927-4272-8f2f-0feec380ec93 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a7fc040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:42.043035 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f09d4539-d927-4272-8f2f-0feec380ec93 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.084602 Aug 30 04:22:42.044846 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1595/3122] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:41 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:42.272435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:22:42.274150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:22:42.274444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:22:42.274864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:22:42.275295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:22:42.301701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.302204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.310439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:42.311463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.312112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.327435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:42.359989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=26 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:42.395975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:22:42.412505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:22:42.428749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:22:42.431268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:22:42.492304 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c943e368-c58c-4532-a66d-f39fa55890d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384691 Aug 30 04:22:42.501759 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1528/3123] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:22:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1395 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:22:42.506435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b7274da-8e7b-482b-8fcf-effa968726ba tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:42.507102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5b7274da-8e7b-482b-8fcf-effa968726ba tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:42.629201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:42.630616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] [instance: 11757b96-666e-431b-9972-3e32ad1a70a0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:42.644263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.644780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.645246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:42.646012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:42.646558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:42.646971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:42.708527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5b7274da-8e7b-482b-8fcf-effa968726ba tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:42.725498 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] HTTP exception thrown: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Request method failure captured: Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 HTTP/1.1 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZBbvwOpDQ0ipci1jNC-fR1L-eu7v_V2aM5NPoFbJeNOo3V5y2AjnYM_7VnRpbsvkZ9-MxplruE23WM85cbB87jYLtHDR6KZGxuXmxgaELxBdv6EJnRX8wPiE1K6jxFk-yLUYN2yANOpISx-O0d_Elgm90EwAw4PK-hpdeyqjHmYr-4 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 8e714811d9ad4d69a1d78fae3deadeab Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1038468686 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8e714811d9ad4d69a1d78fae3deadeab", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8e714811d9ad4d69a1d78fae3deadeab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e714811d9ad4d69a1d78fae3deadeab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8e714811d9ad4d69a1d78fae3deadeab"}]}] Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1038468686 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 8e714811d9ad4d69a1d78fae3deadeab Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1038468686 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1038468686-project Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: e2088cb87e3e45f2b3a6c674442d2792 Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1038468686-project Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '11757b96-666e-431b-9972-3e32ad1a70a0'} Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:42.728262 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. Aug 30 04:22:42.733143 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:22:42.737768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] Returning 404 to user: Instance 11757b96-666e-431b-9972-3e32ad1a70a0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:22:42.739294 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b7274da-8e7b-482b-8fcf-effa968726ba tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1216 microversion: 2.1 time: 0.235696 Aug 30 04:22:42.740455 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-451f166a-9fef-4e40-94a1-7ab32a6b3be9 tempest-ServersNegativeTestMultiTenantJSON-1038468686 tempest-ServersNegativeTestMultiTenantJSON-1038468686-project] 10.222.0.27 "GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0" status: 404 len: 111 microversion: 2.1 time: 0.121646 Aug 30 04:22:42.745999 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1529/3124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:42 2022] GET /compute/v2.1/servers/11757b96-666e-431b-9972-3e32ad1a70a0 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:22:42.746493 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1596/3125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:42 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1216 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:43.061922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6232b55e-f399-41ad-b479-53a5346799da tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a063820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:43.184112 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6232b55e-f399-41ad-b479-53a5346799da tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.126642 Aug 30 04:22:43.188062 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1530/3126] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:43 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:43.773601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:43.776053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:43.792668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:43.794711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:43.796515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:43.799218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:43.799833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:43.800877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:43.887711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:43.922917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:43.938159 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-493c18a4-db29-4990-852b-2be154d9635c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1212 microversion: 2.1 time: 0.168671 Aug 30 04:22:43.961883 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1597/3127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:43 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1212 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:44.203239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5d7febb-a896-4710-a414-dd9f73bed9b1 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a162700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:44.319558 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5d7febb-a896-4710-a414-dd9f73bed9b1 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.121697 Aug 30 04:22:44.320161 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1531/3128] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:44 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:44.960447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:44.962078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:44.980214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:44.982558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:44.983180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:44.984675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:44.995869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:44.998773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:45.174905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:45.192465 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8698359f-72f1-48c8-8b59-c1cec4c28df4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1274 microversion: 2.1 time: 0.237554 Aug 30 04:22:45.195039 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1598/3129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:44 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1274 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:45.344167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c707220-d75d-4178-92cf-053b2daa7814 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a20f3a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:45.424912 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c707220-d75d-4178-92cf-053b2daa7814 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.087537 Aug 30 04:22:45.425951 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1532/3130] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:45 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:46.217569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:46.218998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:46.231585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:46.236854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:46.237581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:46.240625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:46.244186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:46.249374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:46.447197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-90f46ebe-24b5-4370-840b-1040bd786ce2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a0633a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:46.561859 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-90f46ebe-24b5-4370-840b-1040bd786ce2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.123890 Aug 30 04:22:46.562663 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1533/3131] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:46 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:46.646157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:46.654839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c1e596ca-9b52-496b-8e23-e391085645e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1274 microversion: 2.1 time: 0.441773 Aug 30 04:22:46.655435 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1599/3132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:46 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1274 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:47.577372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48aa57ec-a917-48c5-bd34-748c05ea2ade tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a1f71f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:47.642868 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-48aa57ec-a917-48c5-bd34-748c05ea2ade tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.069555 Aug 30 04:22:47.647887 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1534/3133] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:47 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:47.676804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:47.678656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:47.686647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:47.687447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:47.688054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:47.689586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:47.690252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:47.690848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:47.698454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:47.814362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:47.827890 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e88ae047-c32f-4474-a223-4981972c5b7a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1274 microversion: 2.1 time: 0.154459 Aug 30 04:22:47.843419 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1600/3134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:47 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1274 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:48.660087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16477716-6db3-40a9-ba5c-37092be1064f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a0783a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:48.737041 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-16477716-6db3-40a9-ba5c-37092be1064f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.082263 Aug 30 04:22:48.745161 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1535/3135] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:48 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:48.856130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:48.856855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:48.867404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:48.868383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:48.869048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:48.870039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:48.870842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:48.871647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:49.251503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:49.267330 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ba628934-feac-4d58-8aa7-34eabe835dd1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.415400 Aug 30 04:22:49.291044 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1601/3136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:48 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:49.752931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28a33b56-7cf0-4f3e-916f-36452a842ead tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a20f3a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:49.837346 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28a33b56-7cf0-4f3e-916f-36452a842ead tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.089185 Aug 30 04:22:49.838842 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1536/3137] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:49 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:49.848721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5bf14fa5-43da-48c8-948a-7e545239d022"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:49.852523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:49.865748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:49.874156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:49.874976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:49.878766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:49.880048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:49.883214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:50.298694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:50.299713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:50.315176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:50.316084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:50.317289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:50.318409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:50.319233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:50.319909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:50.410695 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d816730f-b29c-4673-9abe-b0ecbecf6456 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.566827 Aug 30 04:22:50.411979 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1602/3138] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:22:49 2022] POST /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:50.799110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:50.806009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:50.815355 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9a85d7e-7249-42ab-ad30-22a1eb438e11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.520534 Aug 30 04:22:50.821943 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1537/3139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:50 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:50.854034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f1ed233-7d31-42eb-9c3c-871b761cbb79 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96958a940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:51.534350 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f1ed233-7d31-42eb-9c3c-871b761cbb79 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.685224 Aug 30 04:22:51.537909 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1603/3140] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:50 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:51.844719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:51.845563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:51.867483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.869579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.870476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:51.872663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:51.874440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:51.875095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:52.369191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:52.423090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=10 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:52.431859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:52.453635 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7fc3b13f-cb91-4c80-a406-8cf3338ff213 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.601134 Aug 30 04:22:52.456057 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1538/3141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:51 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:52.543200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d6644403-c5ee-48d0-9ab5-a478f25b4417 req-b3e79565-aacd-4824-bc19-1d41fe441016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f9d33f1-b907-43a7-95d7-52827d7877c1", "tag": "6b85a47d-1965-4b93-8908-76dd95f23901"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:52.552496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ca53f56-fab1-4e87-ae20-e55f12f52a4a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a1dce50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:52.557193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d6644403-c5ee-48d0-9ab5-a478f25b4417 req-b3e79565-aacd-4824-bc19-1d41fe441016 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:52.557941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d6644403-c5ee-48d0-9ab5-a478f25b4417 req-b3e79565-aacd-4824-bc19-1d41fe441016 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:52.558543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d6644403-c5ee-48d0-9ab5-a478f25b4417 req-b3e79565-aacd-4824-bc19-1d41fe441016 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:52.573311 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d6644403-c5ee-48d0-9ab5-a478f25b4417 req-b3e79565-aacd-4824-bc19-1d41fe441016 service nova] Creating event network-changed:6b85a47d-1965-4b93-8908-76dd95f23901 for instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 on n-h2-854925-5 Aug 30 04:22:52.581392 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d6644403-c5ee-48d0-9ab5-a478f25b4417 req-b3e79565-aacd-4824-bc19-1d41fe441016 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041975 Aug 30 04:22:52.586927 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1604/3142] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:53.382931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c25e0b5d-477b-4ba4-9329-6d6de260e2db tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969585d30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:53.403235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:53.544542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ca53f56-fab1-4e87-ae20-e55f12f52a4a tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.995785 Aug 30 04:22:53.549883 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1539/3143] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:52 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:53.563717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c25e0b5d-477b-4ba4-9329-6d6de260e2db tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/c594686e-5338-4a93-81eb-3b921c5e5788" status: 200 len: 661 microversion: 2.1 time: 0.185138 Aug 30 04:22:53.574475 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1605/3144] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:53 2022] GET /compute/v2.1/images/c594686e-5338-4a93-81eb-3b921c5e5788 => generated 661 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:53.577067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:53.578765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:53.591207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4af04504-bb20-4bd3-b4b6-e5a186982237 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a2f25e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:53.615525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.618725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.627094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.629739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:53.630469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:53.632839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:53.682547 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4af04504-bb20-4bd3-b4b6-e5a186982237 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/c594686e-5338-4a93-81eb-3b921c5e5788" status: 200 len: 661 microversion: 2.1 time: 0.105920 Aug 30 04:22:53.683178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1606/3145] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:53 2022] GET /compute/v2.1/images/c594686e-5338-4a93-81eb-3b921c5e5788 => generated 661 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:54.181009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:54.194287 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88510f3b-2c01-4d16-9673-c1c4c8bb3670 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.641343 Aug 30 04:22:54.195348 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1540/3146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:53 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:54.565553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9fa3d3e4-b83c-4685-b426-2a48613ad6aa tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969a9c700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:54.645863 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9fa3d3e4-b83c-4685-b426-2a48613ad6aa tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.085378 Aug 30 04:22:54.646464 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1607/3147] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:54 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:55.220750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:55.223248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:55.241374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:55.242151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:55.245025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:55.246085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:55.246565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:55.247002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:55.545662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:55.560717 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4e23d2ef-ef68-4ec1-9f02-023427a85d45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.344510 Aug 30 04:22:55.582498 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1541/3148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:55 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:55.661195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db006ad0-bbbe-418a-bc7f-63c30581d94d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a1dc3a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:55.663707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-923bb47d-ed1c-442f-ae74-520263ce6b09 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693edca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:55.802148 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-db006ad0-bbbe-418a-bc7f-63c30581d94d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.145730 Aug 30 04:22:55.802874 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1542/3149] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:55 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:55.821167 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-923bb47d-ed1c-442f-ae74-520263ce6b09 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/3bb278d4-04be-41c1-9651-14825b93b39a" status: 200 len: 662 microversion: 2.1 time: 0.171176 Aug 30 04:22:55.821949 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1608/3150] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:55 2022] GET /compute/v2.1/images/3bb278d4-04be-41c1-9651-14825b93b39a => generated 662 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:55.841704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3b90274-4a15-4bf1-8b9e-2f5dd9156207 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a078790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:55.896370 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3b90274-4a15-4bf1-8b9e-2f5dd9156207 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/3bb278d4-04be-41c1-9651-14825b93b39a" status: 200 len: 662 microversion: 2.1 time: 0.059380 Aug 30 04:22:55.905686 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1543/3151] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:55 2022] GET /compute/v2.1/images/3bb278d4-04be-41c1-9651-14825b93b39a => generated 662 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:56.601126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:56.601923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:56.613650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=87 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:22:56.615783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:56.616264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:56.616701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:56.623517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:56.624165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:56.624616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:56.815858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91d48137-e7da-486d-aa96-ae52a70fcc24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969f78790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:57.007539 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-91d48137-e7da-486d-aa96-ae52a70fcc24 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.195462 Aug 30 04:22:57.015180 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1544/3152] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:56 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:22:57.036779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:57.049890 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31909666-770b-4391-b944-8ab601dddef3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.453505 Aug 30 04:22:57.065506 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1609/3153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:56 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:57.758523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9915f3e9-5a6c-464f-9a79-e0d8dc37c0a7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a162dc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:57.833910 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9915f3e9-5a6c-464f-9a79-e0d8dc37c0a7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/55f6ef74-1fde-481a-a6e3-96553c1dce3c" status: 200 len: 662 microversion: 2.1 time: 0.080827 Aug 30 04:22:57.836851 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1545/3154] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:57 2022] GET /compute/v2.1/images/55f6ef74-1fde-481a-a6e3-96553c1dce3c => generated 662 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:57.850580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-63e7b5b9-a48e-44c0-9718-b3790e807dd4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693f1310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:57.926805 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-63e7b5b9-a48e-44c0-9718-b3790e807dd4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/55f6ef74-1fde-481a-a6e3-96553c1dce3c" status: 200 len: 662 microversion: 2.1 time: 0.081982 Aug 30 04:22:57.928315 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1610/3155] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:57 2022] GET /compute/v2.1/images/55f6ef74-1fde-481a-a6e3-96553c1dce3c => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:22:58.031219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df7d9595-e597-45b3-8f69-9035c226cb3c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a20fb80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:58.072882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:58.074257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:58.083523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:58.087105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:58.087729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:58.088775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:58.091318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:58.091990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:58.139497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df7d9595-e597-45b3-8f69-9035c226cb3c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.120890 Aug 30 04:22:58.140893 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1546/3156] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:58 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:58.181172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1689786436", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:58.309734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:22:58.871653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:22:58.882857 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4a02256e-e844-448c-889c-617d432654ad tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.813828 Aug 30 04:22:58.883820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1611/3157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:58 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:59.082327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:22:59.082894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:22:59.083216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:22:59.083633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:22:59.084051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:22:59.102502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.103111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.103560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:59.104319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.104781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.112929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:59.156018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-96048d5a-e0d8-4f2d-a833-2b470bac41b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96958a040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:59.166910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Getting quotas for project 7510a67478644f898bebcd31652de940. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:22:59.180185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Getting quotas for user 1ddf0680774f4ea6b7751706667bd896 and project 7510a67478644f898bebcd31652de940. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:22:59.206223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:22:59.209899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:22:59.260465 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-96048d5a-e0d8-4f2d-a833-2b470bac41b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.108406 Aug 30 04:22:59.261399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1612/3158] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:22:59 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:22:59.298390 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e9f73642-c173-47d5-b3da-f8d01f50feaa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121427 Aug 30 04:22:59.299702 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1547/3159] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:22:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:22:59.441358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1832905909", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:59.613373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:22:59.668701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eeec8382-0237-430d-98f8-5db10c7ac8d0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'create', calling method: .version_select at 0x7fe969585b80>, body: {"keypair": {"name": "tempest-keypair-84072091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmTOP97NEHEhT17uQKyxN09RE/0hQybotSndjfKHfdVEYL/9Y0QHOtlApZ66yLVgvk2SXLvBn6HeZYEkibObpPVQZ75iLVZg2/P6SbzgH/JaMmFyz/UfQO284j8UOvpHw=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:22:59.738431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-eeec8382-0237-430d-98f8-5db10c7ac8d0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for project 8441920631f94e39a79e27e6ce5e0250. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:22:59.774684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-eeec8382-0237-430d-98f8-5db10c7ac8d0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for user 32771c45ac9f4c43a23b413c9cbf4437 and project 8441920631f94e39a79e27e6ce5e0250. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:22:59.859567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eeec8382-0237-430d-98f8-5db10c7ac8d0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.595422 Aug 30 04:22:59.860454 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1613/3160] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:22:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 599 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:22:59.920229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:22:59.921049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:22:59.936816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.942383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.944280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:22:59.946737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:22:59.947224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:22:59.947675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:01.132627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:01.143366 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8886bbbe-9038-4964-aa21-9be316c34d0c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 1.232912 Aug 30 04:23:01.147375 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1614/3161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:22:59 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:01.160514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1170c8b-2337-43c1-a912-777f37bf1d2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96958a4c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:01.266942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:01.268021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:01.269425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:01.270499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:01.271259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:01.277917 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1170c8b-2337-43c1-a912-777f37bf1d2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.129417 Aug 30 04:23:01.278941 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1615/3162] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:01 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:01.290779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:01.299424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:01.301299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:01.302528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:01.304354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:01.306290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:01.373734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Getting quotas for project 7510a67478644f898bebcd31652de940. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:01.390586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Getting quotas for user 1ddf0680774f4ea6b7751706667bd896 and project 7510a67478644f898bebcd31652de940. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:01.476014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:01.485025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:01.629236 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa2557b9-d19e-4429-a0bd-0a8600b88ff5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.192414 Aug 30 04:23:01.634406 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1548/3163] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:22:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:23:01.641629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71204c69-fdca-42c9-bfc3-a6e61b14f545 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:01.642574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71204c69-fdca-42c9-bfc3-a6e61b14f545 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:02.168115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:02.168712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:02.177436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:02.187756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:02.189944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:02.192095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:02.194956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:02.195937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:02.744371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71204c69-fdca-42c9-bfc3-a6e61b14f545 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:02.752407 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71204c69-fdca-42c9-bfc3-a6e61b14f545 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1218 microversion: 2.1 time: 1.114726 Aug 30 04:23:02.757880 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1616/3164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:01 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1218 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:02.776248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8df67d59-66a6-455a-a6c3-4d90535e3b31 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96e5fcb80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:02.860999 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8df67d59-66a6-455a-a6c3-4d90535e3b31 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.101052 Aug 30 04:23:02.862510 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1617/3165] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:02 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:03.780580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:03.781921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:03.805226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:03.806020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:03.810518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:03.811515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:03.812151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:03.813706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:04.506354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:04.529703 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30b30b6a-611f-44e3-97d4-3f4a4e4266c2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 2.363620 Aug 30 04:23:04.530930 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1549/3166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:02 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 2367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:04.553885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:04.558733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f18ace9-5c2f-457a-ae7c-2eb03f744213 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a8c9ee0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:04.576993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e1b051a7-0d8b-47f6-ab5c-bc46e615fef8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1270 microversion: 2.1 time: 0.808310 Aug 30 04:23:04.593552 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1618/3167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:03 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1270 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:04.719217 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3f18ace9-5c2f-457a-ae7c-2eb03f744213 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.182813 Aug 30 04:23:04.730139 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1550/3168] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:04 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:05.554188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:05.555172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:05.579264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:05.580252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:05.580711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:05.584179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:05.584675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:05.585122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:05.603808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:05.604442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:05.620366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:05.621086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:05.622475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:05.625272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:05.626841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:05.627491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:05.972844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:05.981581 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31f71055-302e-404e-be9b-038126698fb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1276 microversion: 2.1 time: 0.381513 Aug 30 04:23:05.982501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1551/3169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:05 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1276 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:05.987130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4ff980f-fceb-44db-b149-28a781c0b54d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a2fcca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:06.101534 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4ff980f-fceb-44db-b149-28a781c0b54d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.117825 Aug 30 04:23:06.103859 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1552/3170] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:05 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:06.236976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:06.252314 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2371b17e-09df-4209-8660-b682b1f46da4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.704147 Aug 30 04:23:06.271614 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1619/3171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:05 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:06.281855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-305549364", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c60b633-d776-4897-a4be-2817eeb3438c"}], "security_groups": [{"name": "tempest-securitygroup--1391351842"}], "key_name": "tempest-keypair-84072091", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:06.558425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] validate_networks() for [('2c60b633-d776-4897-a4be-2817eeb3438c', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:23:07.003885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:07.004498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:07.019769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.020506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.021131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.022049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.022671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.023278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.129717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:07.150077 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21eac754-d0ae-43a3-8dd3-5752a6b197fa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1276 microversion: 2.1 time: 0.138607 Aug 30 04:23:07.151313 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1620/3172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:06 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:07.165425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92432c6d-4500-42b3-bbc2-d2cb4ab0c045 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9694f2160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:07.229254 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-92432c6d-4500-42b3-bbc2-d2cb4ab0c045 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1438 microversion: 2.1 time: 0.076635 Aug 30 04:23:07.234208 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1621/3173] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:07 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:07.286736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:07.287361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:07.296748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.302140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.303147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:07.304111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:07.304772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:07.306512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.223275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:08.223978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:08.224236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:08.224852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:08.225539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:08.231005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=9 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:08.253963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.255145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.256104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.257037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.258314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.259088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.326488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for project 8441920631f94e39a79e27e6ce5e0250. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:08.352706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for user 32771c45ac9f4c43a23b413c9cbf4437 and project 8441920631f94e39a79e27e6ce5e0250. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:08.378874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:08.380275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:08.382534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:08.403769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5322144-88f4-453d-80ff-9da3d9291525 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 1.121338 Aug 30 04:23:08.404392 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1622/3174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:07 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:08.445220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2c63f6c8-41ec-4919-8781-43588160f305 req-15b0b96d-68a9-4208-ad0d-c9ad1a27abda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9d33f1-b907-43a7-95d7-52827d7877c1", "name": "network-vif-plugged", "status": "completed", "tag": "6b85a47d-1965-4b93-8908-76dd95f23901"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:08.502630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2c63f6c8-41ec-4919-8781-43588160f305 req-15b0b96d-68a9-4208-ad0d-c9ad1a27abda service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.503003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2c63f6c8-41ec-4919-8781-43588160f305 req-15b0b96d-68a9-4208-ad0d-c9ad1a27abda service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.505387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2c63f6c8-41ec-4919-8781-43588160f305 req-15b0b96d-68a9-4208-ad0d-c9ad1a27abda service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.528209 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-238cadce-bd11-49df-8ac1-7cb27171567b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.251374 Aug 30 04:23:08.530780 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1553/3175] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:23:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:23:08.539649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:08.540809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:08.554998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.556269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.556594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2c63f6c8-41ec-4919-8781-43588160f305 req-15b0b96d-68a9-4208-ad0d-c9ad1a27abda service nova] Creating event network-vif-plugged:6b85a47d-1965-4b93-8908-76dd95f23901 for instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 on n-h2-854925-5 Aug 30 04:23:08.562640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.563705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:08.567084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:08.567915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:08.568906 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2c63f6c8-41ec-4919-8781-43588160f305 req-15b0b96d-68a9-4208-ad0d-c9ad1a27abda service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163235 Aug 30 04:23:08.574074 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1623/3176] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:08.592494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-087f7b35-2539-4579-8cd7-fb3215dff1df tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96947cdc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:08.716671 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-087f7b35-2539-4579-8cd7-fb3215dff1df tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1447 microversion: 2.1 time: 0.139091 Aug 30 04:23:08.717956 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1624/3177] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:08 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1447 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:08.723629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-edcfb906-333d-4129-892d-f74568fe7b15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:08.730348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-edcfb906-333d-4129-892d-f74568fe7b15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:08.792336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:08.806982 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb395e40-0c91-4dee-a909-2143a9b133ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1276 microversion: 2.1 time: 0.274773 Aug 30 04:23:08.807719 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1554/3178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:08 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:08.835223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18cb9eca-f840-458f-aa74-ede725627f2d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a8c9550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:08.917990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-edcfb906-333d-4129-892d-f74568fe7b15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:08.935303 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18cb9eca-f840-458f-aa74-ede725627f2d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 200 len: 1447 microversion: 2.1 time: 0.119646 Aug 30 04:23:08.936218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-edcfb906-333d-4129-892d-f74568fe7b15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:08.937521 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1555/3179] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:08 2022] GET /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 1447 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:08.946250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-edcfb906-333d-4129-892d-f74568fe7b15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:08.955609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f972561-76b0-486e-9b85-c9b8bb9d061d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969f78a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:08.962969 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-edcfb906-333d-4129-892d-f74568fe7b15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1279 microversion: 2.20 time: 0.243613 Aug 30 04:23:08.982797 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1625/3180] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:08 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1279 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:09.074000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:09.076517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:09.116746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.122240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.123221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:09.124163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.124906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.126213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:09.207896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lazy-loading 'flavor' on Instance uuid 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:23:09.603495 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81204b0e-f7d7-45c3-b37b-d474202bc028 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/action" status: 200 len: 32 microversion: 2.1 time: 0.535060 Aug 30 04:23:09.624738 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1626/3181] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:09 2022] POST /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/action => generated 32 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:23:09.639896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:09.646139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:09.656360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.656874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.661443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:09.663240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:09.664052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:09.665642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:09.980770 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f972561-76b0-486e-9b85-c9b8bb9d061d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 204 len: 0 microversion: 2.1 time: 1.033702 Aug 30 04:23:09.981563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1556/3182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:08 2022] DELETE /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:09.986900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:09.988574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:10.003764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:10.004452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:10.005071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:10.006066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:10.014240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:10.015001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:10.495180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:10.518150 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31ffeb99-6975-4ed8-ad53-7bb0219322ff tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1316 microversion: 2.1 time: 0.878836 Aug 30 04:23:10.519507 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1627/3183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:09 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1316 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:10.525962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:10.526905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:10.539636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:10.540360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:10.541026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:10.541980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:10.542638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:10.543264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:10.785565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:10.801924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c5d22c8-ed8a-4517-8c8c-af5b4a0308fc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.819013 Aug 30 04:23:10.802541 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1557/3184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:09 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:10.807194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:10.807802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:10.824775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:10.828773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:10.829299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:10.830092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:10.830563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:10.831028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.130874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:11.144047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:11.145531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:11.162810 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b9e13490-439e-4bee-8142-395fc4224f7f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1331 microversion: 2.20 time: 0.359134 Aug 30 04:23:11.166070 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1558/3185] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:10 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1331 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:11.172579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:11.181743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:11.198021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.198518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.198958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.199662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.200245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.200616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.263572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:11.473204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-967aecc6-a090-4e1c-949c-a7780958edf7 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 204 len: 0 microversion: 2.1 time: 0.304610 Aug 30 04:23:11.473844 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1559/3186] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:11 2022] DELETE /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:11.485532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-23a5c8a4-4e60-46ff-bee4-2e5740d79444 req-c0511755-2dcc-4d27-832d-db1774939052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb63a2f-23a4-478f-9377-b3c21e4a59d0", "name": "network-vif-unplugged", "status": "completed", "tag": "78eafa8d-f968-4acc-a70d-bf67e4cdcc39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:11.540257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-23a5c8a4-4e60-46ff-bee4-2e5740d79444 req-c0511755-2dcc-4d27-832d-db1774939052 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.540768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-23a5c8a4-4e60-46ff-bee4-2e5740d79444 req-c0511755-2dcc-4d27-832d-db1774939052 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.541222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-23a5c8a4-4e60-46ff-bee4-2e5740d79444 req-c0511755-2dcc-4d27-832d-db1774939052 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.591430 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-23a5c8a4-4e60-46ff-bee4-2e5740d79444 req-c0511755-2dcc-4d27-832d-db1774939052 service nova] Creating event network-vif-unplugged:78eafa8d-f968-4acc-a70d-bf67e4cdcc39 for instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 on n-h1-854925-5 Aug 30 04:23:11.603346 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-23a5c8a4-4e60-46ff-bee4-2e5740d79444 req-c0511755-2dcc-4d27-832d-db1774939052 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128084 Aug 30 04:23:11.604918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1560/3187] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:11.617636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:11.621651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:11.641791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.644982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.645650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.647775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.658785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.660139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.765777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:11.778815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:11.798684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-310f44b3-7f7f-4270-b3cf-dc3e7f343ad5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 1.277672 Aug 30 04:23:11.800491 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1628/3188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:10 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:11.807454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e1247b64-9d7b-43f1-b2c6-fce3a3515864 req-ee477128-62bf-4db1-a757-ac104e3adc59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a02175-d9f3-4f57-9db1-618596566c85", "tag": "78448671-cdb4-443f-ae74-c0c03dd6955b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:11.823153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e1247b64-9d7b-43f1-b2c6-fce3a3515864 req-ee477128-62bf-4db1-a757-ac104e3adc59 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:11.823996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e1247b64-9d7b-43f1-b2c6-fce3a3515864 req-ee477128-62bf-4db1-a757-ac104e3adc59 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:11.824593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e1247b64-9d7b-43f1-b2c6-fce3a3515864 req-ee477128-62bf-4db1-a757-ac104e3adc59 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:11.850227 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e1247b64-9d7b-43f1-b2c6-fce3a3515864 req-ee477128-62bf-4db1-a757-ac104e3adc59 service nova] Creating event network-changed:78448671-cdb4-443f-ae74-c0c03dd6955b for instance 76a02175-d9f3-4f57-9db1-618596566c85 on n-h1-854925-5 Aug 30 04:23:11.857966 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e1247b64-9d7b-43f1-b2c6-fce3a3515864 req-ee477128-62bf-4db1-a757-ac104e3adc59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055775 Aug 30 04:23:11.859212 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1629/3189] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:11.867958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-274534114", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "45f92f08-9d57-42f1-af99-23717f5e800c"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:11.994637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] validate_networks() for [('45f92f08-9d57-42f1-af99-23717f5e800c', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:23:12.245794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:12.259388 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c4f6e3b-d7bc-49a3-aa4b-5e53cfc44ae4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1465 microversion: 2.1 time: 0.652140 Aug 30 04:23:12.269564 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1561/3190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:11 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1465 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:12.269564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:12.269564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:12.276149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:12.276776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:12.277432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:12.278151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:12.278600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:12.279213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:12.560533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:12.570748 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b163dc55-70d7-4543-aa0e-40260f724611 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.309570 Aug 30 04:23:12.571653 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1562/3191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:12 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:12.576702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:12.577523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:12.585151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:12.586041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:12.586579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:12.587375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:12.587924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:12.588594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.080106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:13.093990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:13.095460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:13.097173 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-43480520-b3a1-47d5-b367-9dc67158dadf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1337 microversion: 2.20 time: 0.523763 Aug 30 04:23:13.097780 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1563/3192] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:12 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1337 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:13.165548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:13.167082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:13.168063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:13.168929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:13.170271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:13.191249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.192688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.193305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.194743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.195372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.196153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.219358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:13.226814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Getting quotas for user 689cafef29c449fd8dd8eae3ae2ab9c5 and project 4d549299f8d04da29bcc0bf2fc5b265c. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:13.242151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:13.244894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:13.337404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b8158d09-25f9-47c8-ba9f-1da8e08c1cee tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473409 Aug 30 04:23:13.345058 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1630/3193] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:23:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:23:13.352896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:13.356495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:13.366076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.367049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.367936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.368928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.369621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.370282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.453319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:13.453975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:13.466711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.467215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.467663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:13.468393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:13.468857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:13.469292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.033894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:14.043379 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a8e60b8b-54f9-4ab4-9034-04db9b7e704c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 0.702689 Aug 30 04:23:14.044936 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1631/3194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:13 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:14.052057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:14.052737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:14.062776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.063279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.063726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.064653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.066195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.066643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.210521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:14.220389 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ca0dbb9-eb63-44df-ac86-75f318596576 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1616 microversion: 2.1 time: 1.120117 Aug 30 04:23:14.226260 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b8f5620-ee75-4f98-899b-764dc2e9a472 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1211 microversion: 2.1 time: 0.179935 Aug 30 04:23:14.226956 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1632/3195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:14 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1211 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:14.234191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1564/3196] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:13 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1616 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:14.238680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:14.241516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:14.252178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b0f42d51-c8d5-4fb0-b021-450935451a99 req-cf71ad92-427d-45b4-bf04-a97feba57ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0", "tag": "063977e0-19b2-4875-a3fd-2f8c5b5b8529"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:14.254861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.255476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.256015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.256740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.257202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.259514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.276822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b0f42d51-c8d5-4fb0-b021-450935451a99 req-cf71ad92-427d-45b4-bf04-a97feba57ba0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.277320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b0f42d51-c8d5-4fb0-b021-450935451a99 req-cf71ad92-427d-45b4-bf04-a97feba57ba0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.277783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b0f42d51-c8d5-4fb0-b021-450935451a99 req-cf71ad92-427d-45b4-bf04-a97feba57ba0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.298256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b0f42d51-c8d5-4fb0-b021-450935451a99 req-cf71ad92-427d-45b4-bf04-a97feba57ba0 service nova] Creating event network-changed:063977e0-19b2-4875-a3fd-2f8c5b5b8529 for instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 on n-h2-854925-5 Aug 30 04:23:14.304374 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b0f42d51-c8d5-4fb0-b021-450935451a99 req-cf71ad92-427d-45b4-bf04-a97feba57ba0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068250 Aug 30 04:23:14.305821 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1565/3197] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:14.311198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:14.312145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:14.320519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.321409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.322107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.323233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:14.323749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:14.324350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:14.330551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:14.457283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:14.477100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:14.478563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:14.479682 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4fea5ffb-3be6-4d4c-972b-9bb0699350d3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1337 microversion: 2.20 time: 0.172615 Aug 30 04:23:14.480247 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1566/3198] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:14 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1337 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:14.498421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11462ef8-3684-4a95-89f8-05b27bf581c1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: .version_select at 0x7fe96a259670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-877536135", "policies": ["affinity"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:14.525590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-11462ef8-3684-4a95-89f8-05b27bf581c1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:14.533134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-11462ef8-3684-4a95-89f8-05b27bf581c1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:14.564426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:14.576008 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0dca6e07-7623-41bf-9c6a-a1429c8a2a9b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.347936 Aug 30 04:23:14.576905 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1633/3199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:14 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:14.617058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-11462ef8-3684-4a95-89f8-05b27bf581c1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:14.623035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-11462ef8-3684-4a95-89f8-05b27bf581c1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:14.639843 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11462ef8-3684-4a95-89f8-05b27bf581c1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.148713 Aug 30 04:23:14.640462 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1567/3200] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Aug 30 04:23:14 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:14.767023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1995417233", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "74dc91ba-1f36-4aed-ab77-a48f354c78dc"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:14.837305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:23:15.064392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:15.065787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:15.072908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.073663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.074305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.075192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.075819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.076416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.535199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:15.542350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:15.542985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:15.543173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:15.546537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:15.547220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:15.559283 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-17c2b459-a876-464e-a3c8-7b080646f3b5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 0.498928 Aug 30 04:23:15.560592 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1568/3201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:15 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:15.566103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:15.566883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:15.573481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.574279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.575096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.576159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.577895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.578639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.588678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.589175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.589646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.591422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.591887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.592315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.652727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:15.665363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:15.700999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Going to run 2 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:15.703376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:15.703626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:15.718594 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c893bbf-abea-4582-9e48-d8fa25077ed2 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1265 microversion: 2.1 time: 0.155960 Aug 30 04:23:15.732285 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1569/3202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:15 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:15.732285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:15.732285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:15.749488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.755844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.756631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.757604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:15.758266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:15.761174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:15.790463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122403) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 04:23:15.840291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:15.847333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:15.920281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:15.951558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:15.958509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:15.981722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:16.055055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:16.061107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:16.119019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:16.134251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:16.146111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.160409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.162175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.163762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed6acd0f-5765-4135-8d84-ab8435dea505 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.439265 Aug 30 04:23:16.164938 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1570/3203] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:15 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:16.191403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:16.192462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:16.200661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.202029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.202717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.204220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.204913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.205588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.221039 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c0c0c34-7031-41ab-8296-eaad64dc9704 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.457673 Aug 30 04:23:16.221956 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1634/3204] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:23:14 2022] POST /compute/v2.1/servers => generated 32 bytes in 1460 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:23:16.232205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:16.247368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.250107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Searching by: {'deleted': False, 'project_id': '697646bb2dfd47598fee27be7a58eeeb'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:23:16.277599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.278832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.279532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.280473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.281063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.281908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.333283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:23:16.406800 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3a1d4cb0-d7b1-4848-9716-cbbb9360f6d8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.180643 Aug 30 04:23:16.407718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1635/3205] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:23:16 2022] GET /compute/v2.1/servers => generated 1003 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:16.416125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-611878d4-d900-42ed-a1e9-d9d0a755438a req-25ea9354-974b-4aa5-814a-2fc7837b8bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:16.428193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-611878d4-d900-42ed-a1e9-d9d0a755438a req-25ea9354-974b-4aa5-814a-2fc7837b8bb6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.428669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-611878d4-d900-42ed-a1e9-d9d0a755438a req-25ea9354-974b-4aa5-814a-2fc7837b8bb6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.429092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-611878d4-d900-42ed-a1e9-d9d0a755438a req-25ea9354-974b-4aa5-814a-2fc7837b8bb6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.445470 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-611878d4-d900-42ed-a1e9-d9d0a755438a req-25ea9354-974b-4aa5-814a-2fc7837b8bb6 service nova] Creating event network-changed:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h1-854925-5 Aug 30 04:23:16.452630 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-611878d4-d900-42ed-a1e9-d9d0a755438a req-25ea9354-974b-4aa5-814a-2fc7837b8bb6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041810 Aug 30 04:23:16.453569 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1636/3206] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:16.544329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.558621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-497be1aa-416f-498f-8754-e204a7150b92 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.375957 Aug 30 04:23:16.560427 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1571/3207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:16 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:16.578779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-680a4e05-777a-4869-8a2c-d76c65d8e9b1 req-285dbec1-281f-46a7-9ce3-f9c63b860f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb63a2f-23a4-478f-9377-b3c21e4a59d0", "name": "network-vif-deleted", "tag": "78eafa8d-f968-4acc-a70d-bf67e4cdcc39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:16.597586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-680a4e05-777a-4869-8a2c-d76c65d8e9b1 req-285dbec1-281f-46a7-9ce3-f9c63b860f17 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.609815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-680a4e05-777a-4869-8a2c-d76c65d8e9b1 req-285dbec1-281f-46a7-9ce3-f9c63b860f17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.610333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-680a4e05-777a-4869-8a2c-d76c65d8e9b1 req-285dbec1-281f-46a7-9ce3-f9c63b860f17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.628077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a45441a5-26dd-4b4c-9192-f3c41dce925f tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Action: 'create', calling method: .version_select at 0x7fe96e439dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-298595367", "metadata": {"Type": "work"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a45441a5-26dd-4b4c-9192-f3c41dce925f tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Request method failure captured: Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 121 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZC0nCy7tpRqWoklpgePxzD1DIBidCMIjSsfnSvT5fE0IgwM8hRbS6LFI6CW1FW-FvfpJXkzzyjeueI80aw_Rr0KRRIuLfG22yqdMGxFiMqA75r0QuCvWVVHk-VRvjSABYvkvE36cCJyV1yxyxN_J6T2xbtbYH-iOGuvO6q0pIUaqyg Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aef0fbdc67614a96adf48c8defbb7a32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}] Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3af402089cbf49f89fbad4d93af5c6e1 Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-298595367", "metadata": {"Type": "work"}}} Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-298595367', 'metadata': {'Type': 'work'}}}} Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:23:16.633865 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a45441a5-26dd-4b4c-9192-f3c41dce925f tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a45441a5-26dd-4b4c-9192-f3c41dce925f tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.181020 Aug 30 04:23:16.639614 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1637/3208] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 04:23:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:23:16.641883 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-680a4e05-777a-4869-8a2c-d76c65d8e9b1 req-285dbec1-281f-46a7-9ce3-f9c63b860f17 service nova] Creating event network-vif-deleted:78eafa8d-f968-4acc-a70d-bf67e4cdcc39 for instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 on n-h1-854925-5 Aug 30 04:23:16.648671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31ac27c9-b6cd-4a3f-9ebe-931f944e84c0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:16.649548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31ac27c9-b6cd-4a3f-9ebe-931f944e84c0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:16.650057 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-680a4e05-777a-4869-8a2c-d76c65d8e9b1 req-285dbec1-281f-46a7-9ce3-f9c63b860f17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087609 Aug 30 04:23:16.653441 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1572/3209] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:16.664005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:16.665668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:16.679471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.681856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.682467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.683446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.684162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.684610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.756151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31ac27c9-b6cd-4a3f-9ebe-931f944e84c0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.764945 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31ac27c9-b6cd-4a3f-9ebe-931f944e84c0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1219 microversion: 2.1 time: 0.121502 Aug 30 04:23:16.766149 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1638/3210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:16 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1219 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:16.771569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-372818a1-6f6d-4479-a6e2-869e642b7d10 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Action: 'create', calling method: .version_select at 0x7fe96bc58670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1582436138", "metadata": {"Type": "work"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-372818a1-6f6d-4479-a6e2-869e642b7d10 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Request method failure captured: Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 120 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZC0nCy7tpRqWoklpgePxzD1DIBidCMIjSsfnSvT5fE0IgwM8hRbS6LFI6CW1FW-FvfpJXkzzyjeueI80aw_Rr0KRRIuLfG22yqdMGxFiMqA75r0QuCvWVVHk-VRvjSABYvkvE36cCJyV1yxyxN_J6T2xbtbYH-iOGuvO6q0pIUaqyg Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aef0fbdc67614a96adf48c8defbb7a32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}] Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3af402089cbf49f89fbad4d93af5c6e1 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1582436138", "metadata": {"Type": "work"}}} Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1582436138', 'metadata': {'Type': 'work'}}}} Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi '0' Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:23:16.775389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 04:23:16.779746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.781653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-372818a1-6f6d-4479-a6e2-869e642b7d10 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:16.782688 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-372818a1-6f6d-4479-a6e2-869e642b7d10 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015385 Aug 30 04:23:16.783738 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1639/3211] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 04:23:16 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:23:16.789039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:16.789947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:16.800919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.801880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.802568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.803970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:16.805688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:16.806380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:16.960427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:16.972980 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-550bef42-966d-4104-ac09-5f458dbca720 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1265 microversion: 2.1 time: 0.187873 Aug 30 04:23:16.973971 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1640/3212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:16 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:16.978913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61c41bc7-62be-4955-b2d6-11d3afc3cc81 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Action: 'create', calling method: .version_select at 0x7fe96bc58670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-335488827", "metadata": {"Type": "work"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61c41bc7-62be-4955-b2d6-11d3afc3cc81 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Request method failure captured: Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 118 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZC0nCy7tpRqWoklpgePxzD1DIBidCMIjSsfnSvT5fE0IgwM8hRbS6LFI6CW1FW-FvfpJXkzzyjeueI80aw_Rr0KRRIuLfG22yqdMGxFiMqA75r0QuCvWVVHk-VRvjSABYvkvE36cCJyV1yxyxN_J6T2xbtbYH-iOGuvO6q0pIUaqyg Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aef0fbdc67614a96adf48c8defbb7a32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}] Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3af402089cbf49f89fbad4d93af5c6e1 Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-335488827", "metadata": {"Type": "work"}}} Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-335488827', 'metadata': {'Type': 'work'}}}} Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi '' Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:23:16.983089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61c41bc7-62be-4955-b2d6-11d3afc3cc81 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61c41bc7-62be-4955-b2d6-11d3afc3cc81 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009420 Aug 30 04:23:16.990111 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1641/3213] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 04:23:16 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:23:16.999702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f7ef5cd-8694-415c-bd4d-c2a191d554c4 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Calling method '.version_select at 0x7fe9694f2790>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.026420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:17.044431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0f7ef5cd-8694-415c-bd4d-c2a191d554c4 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] HTTP exception thrown: Volume tempest-invalid-829427865 could not be found. Aug 30 04:23:17.045297 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34456e3c-949a-4903-a6e9-4a0d6226f21f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 0.389410 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f7ef5cd-8694-415c-bd4d-c2a191d554c4 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Request method failure captured: Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-829427865 HTTP/1.1 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZC0nCy7tpRqWoklpgePxzD1DIBidCMIjSsfnSvT5fE0IgwM8hRbS6LFI6CW1FW-FvfpJXkzzyjeueI80aw_Rr0KRRIuLfG22yqdMGxFiMqA75r0QuCvWVVHk-VRvjSABYvkvE36cCJyV1yxyxN_J6T2xbtbYH-iOGuvO6q0pIUaqyg Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aef0fbdc67614a96adf48c8defbb7a32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}] Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3af402089cbf49f89fbad4d93af5c6e1 Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: exception: Volume tempest-invalid-829427865 could not be found. Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'tempest-invalid-829427865'} Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-829427865 could not be found. (HTTP 404) (Request-ID: req-8def7554-a73b-4e4f-9f18-c91de08d04cc) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:23:17.047414 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-829427865 could not be found. Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-829427865 could not be found. Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-829427865 could not be found. Aug 30 04:23:17.052108 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.054646 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1573/3214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:16 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:17.067407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f7ef5cd-8694-415c-bd4d-c2a191d554c4 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Returning 404 to user: Volume tempest-invalid-829427865 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:17.069175 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f7ef5cd-8694-415c-bd4d-c2a191d554c4 tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-829427865" status: 404 len: 98 microversion: 2.1 time: 0.076014 Aug 30 04:23:17.074047 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1642/3215] 10.222.0.27 () {58 vars in 1215 bytes} [Tue Aug 30 04:23:16 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-829427865 => generated 98 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:23:17.079277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-601ab0d6-e542-4f7d-baeb-0d92a597d14c tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003864 Aug 30 04:23:17.079800 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1574/3216] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 30 04:23:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:23:17.090561 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-746ca7d7-58f0-49ed-ade2-f39960bbd92f tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004532 Aug 30 04:23:17.095595 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1643/3217] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:23:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:23:17.102852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-596acc4e-ad50-4ea8-afe1-b03b0621d6af tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Calling method '.version_select at 0x7fe96a1dcdc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.137992 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-596acc4e-ad50-4ea8-afe1-b03b0621d6af tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] HTTP exception thrown: Volume 041ac2ca-22b8-4836-98be-21d145299d8b could not be found. Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-596acc4e-ad50-4ea8-afe1-b03b0621d6af tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Request method failure captured: Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-volumes/041ac2ca-22b8-4836-98be-21d145299d8b HTTP/1.1 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZC0nCy7tpRqWoklpgePxzD1DIBidCMIjSsfnSvT5fE0IgwM8hRbS6LFI6CW1FW-FvfpJXkzzyjeueI80aw_Rr0KRRIuLfG22yqdMGxFiMqA75r0QuCvWVVHk-VRvjSABYvkvE36cCJyV1yxyxN_J6T2xbtbYH-iOGuvO6q0pIUaqyg Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aef0fbdc67614a96adf48c8defbb7a32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}] Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 3af402089cbf49f89fbad4d93af5c6e1 Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: exception: Volume 041ac2ca-22b8-4836-98be-21d145299d8b could not be found. Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '041ac2ca-22b8-4836-98be-21d145299d8b'} Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 041ac2ca-22b8-4836-98be-21d145299d8b could not be found. (HTTP 404) (Request-ID: req-271e2958-6901-4011-8984-cf29c3c1e2ce) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:23:17.140584 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 041ac2ca-22b8-4836-98be-21d145299d8b could not be found. Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 041ac2ca-22b8-4836-98be-21d145299d8b could not be found. Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 041ac2ca-22b8-4836-98be-21d145299d8b could not be found. Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-596acc4e-ad50-4ea8-afe1-b03b0621d6af tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Returning 404 to user: Volume 041ac2ca-22b8-4836-98be-21d145299d8b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-596acc4e-ad50-4ea8-afe1-b03b0621d6af tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/041ac2ca-22b8-4836-98be-21d145299d8b" status: 404 len: 109 microversion: 2.1 time: 0.044688 Aug 30 04:23:17.145667 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1575/3218] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:23:17 2022] DELETE /compute/v2.1/os-volumes/041ac2ca-22b8-4836-98be-21d145299d8b => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:17.158324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b31c64d-cd63-461a-9f93-c6b88b93390c tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Calling method '.version_select at 0x7fe96958a820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.194315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.195060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:17.204149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7b31c64d-cd63-461a-9f93-c6b88b93390c tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] HTTP exception thrown: Volume 774ab1ed-8a98-4b02-951b-e23240a4037f could not be found. Aug 30 04:23:17.205221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.205889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.206743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.208097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b31c64d-cd63-461a-9f93-c6b88b93390c tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Request method failure captured: Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-volumes/774ab1ed-8a98-4b02-951b-e23240a4037f HTTP/1.1 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZC0nCy7tpRqWoklpgePxzD1DIBidCMIjSsfnSvT5fE0IgwM8hRbS6LFI6CW1FW-FvfpJXkzzyjeueI80aw_Rr0KRRIuLfG22yqdMGxFiMqA75r0QuCvWVVHk-VRvjSABYvkvE36cCJyV1yxyxN_J6T2xbtbYH-iOGuvO6q0pIUaqyg Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_aef0fbdc67614a96adf48c8defbb7a32", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/aef0fbdc67614a96adf48c8defbb7a32"}]}] Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: aef0fbdc67614a96adf48c8defbb7a32 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesNegativeTest-505809322 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3af402089cbf49f89fbad4d93af5c6e1 Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesNegativeTest-505809322-project Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: exception: Volume 774ab1ed-8a98-4b02-951b-e23240a4037f could not be found. Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '774ab1ed-8a98-4b02-951b-e23240a4037f'} Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 774ab1ed-8a98-4b02-951b-e23240a4037f could not be found. (HTTP 404) (Request-ID: req-8d903467-0b63-4a1b-9160-66cc4b6b4f8f) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:23:17.208672 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 774ab1ed-8a98-4b02-951b-e23240a4037f could not be found. Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 774ab1ed-8a98-4b02-951b-e23240a4037f could not be found. Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 774ab1ed-8a98-4b02-951b-e23240a4037f could not be found. Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b31c64d-cd63-461a-9f93-c6b88b93390c tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] Returning 404 to user: Volume 774ab1ed-8a98-4b02-951b-e23240a4037f could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b31c64d-cd63-461a-9f93-c6b88b93390c tempest-VolumesNegativeTest-505809322 tempest-VolumesNegativeTest-505809322-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/774ab1ed-8a98-4b02-951b-e23240a4037f" status: 404 len: 109 microversion: 2.1 time: 0.059673 Aug 30 04:23:17.220048 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1644/3219] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:23:17 2022] GET /compute/v2.1/os-volumes/774ab1ed-8a98-4b02-951b-e23240a4037f => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:17.229530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.229530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.562326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:17.577163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:17.579590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:17.581955 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5e3883c3-244a-44e7-9052-3344cbbde7f2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.392680 Aug 30 04:23:17.582096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.582693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:17.583178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1576/3220] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:17 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:17.594151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.594655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.595100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.595813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.596332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.597274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.789010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:17.789730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:17.799364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.800651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.803132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.804485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:17.806086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:17.807290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:17.984522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:17.994667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:18.005305 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-caa96d29-2f97-462f-a41c-519b71bca7a5 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.428997 Aug 30 04:23:18.009841 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1645/3221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:17 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:18.019325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:18.019940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:18.027352 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19f6a9fe-bf4d-4bf5-bae3-b49e5ec3f8e1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1223 microversion: 2.1 time: 0.221734 Aug 30 04:23:18.031272 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1577/3222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:17 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1223 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:18.040934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.041435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.042081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.042961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.043591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.045440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.102256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:18.105372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:18.130164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.131200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.132716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.135674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.138865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.148949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.304475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:18.575387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:18.588642 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95314226-2e46-46d7-8e72-6f5e1d52831d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.577622 Aug 30 04:23:18.601647 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1646/3223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:18 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:18.620431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:18.621551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:18.636768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.637618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.638286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.639355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:18.640005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:18.640625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:18.760438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:18.770505 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7fd8d75e-b9d4-4e7b-9519-0ea4fa83c032 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 0.701694 Aug 30 04:23:18.774301 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1578/3224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:18 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:19.038157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:19.041709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:19.061011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.063474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.064566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.067173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.070542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.072468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.581302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.598225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.600278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.601919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc3288e8-88f4-417a-a2a5-38301d5a9ebb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.985264 Aug 30 04:23:19.622270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1647/3225] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:18 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:23:19.631980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:19.632594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:19.651682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.652185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.653242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.653986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.654607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.654869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.860128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:19.879725 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd20a0ae-5680-4b5b-926d-ccbb8dac2d84 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.852658 Aug 30 04:23:19.882282 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1579/3226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:19 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:19.898153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:19.901422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:19.914210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.920616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.921680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.927284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:19.928272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:19.929055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:19.991430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:20.003028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5a78037-05cd-4a14-8816-f3a5761d2c16 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1271 microversion: 2.1 time: 0.379275 Aug 30 04:23:20.003641 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1648/3227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:19 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1271 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:20.030313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:20.031770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:20.060433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:20.063906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:20.064492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:20.068685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:20.069225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:20.069709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:20.982652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:20.996619 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c47a42bd-a825-48a0-9703-5edbd12ce2ab tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 1.112048 Aug 30 04:23:20.997211 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1580/3228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:19 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:21.024113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:21.035092 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00f4c065-97fc-4e4e-9c63-7cc0a78609ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 1.030380 Aug 30 04:23:21.037142 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1649/3229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:20 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:21.041977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:21.042583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:21.062754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.063247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.063683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.064382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.065396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.065827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.575260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:21.575681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:21.587314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.588287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.589619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.590500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.591225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.592238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.683670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:21.886536 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-122ddf57-b418-4917-8f86-f22359d4bff9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 204 len: 0 microversion: 2.42 time: 0.887999 Aug 30 04:23:21.889741 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1581/3230] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:23:20 2022] DELETE /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 0 bytes in 892 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:23:21.897164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:21.897316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e32ba44b-7e6f-4b10-9868-c32cbe7f6882 req-d481e3ef-fbe8-4c5d-9baa-061dfdcbd532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0", "name": "network-vif-plugged", "status": "completed", "tag": "063977e0-19b2-4875-a3fd-2f8c5b5b8529"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:21.913923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:21.936170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:21.941597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e32ba44b-7e6f-4b10-9868-c32cbe7f6882 req-d481e3ef-fbe8-4c5d-9baa-061dfdcbd532 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.943646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e32ba44b-7e6f-4b10-9868-c32cbe7f6882 req-d481e3ef-fbe8-4c5d-9baa-061dfdcbd532 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.943992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:21.944147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e32ba44b-7e6f-4b10-9868-c32cbe7f6882 req-d481e3ef-fbe8-4c5d-9baa-061dfdcbd532 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.945533 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52cecd28-d6a0-4f36-a776-5ed50ae62c69 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.907191 Aug 30 04:23:21.949121 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1650/3231] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:21 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:21.967082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:21.968186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:21.980307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.981106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.983328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.986490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:21.987289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:21.988510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:21.999435 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e32ba44b-7e6f-4b10-9868-c32cbe7f6882 req-d481e3ef-fbe8-4c5d-9baa-061dfdcbd532 service nova] Creating event network-vif-plugged:063977e0-19b2-4875-a3fd-2f8c5b5b8529 for instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 on n-h2-854925-5 Aug 30 04:23:22.005483 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e32ba44b-7e6f-4b10-9868-c32cbe7f6882 req-d481e3ef-fbe8-4c5d-9baa-061dfdcbd532 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114042 Aug 30 04:23:22.018847 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1582/3232] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:22.036733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:22.037703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:22.055770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.059165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.059665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.060402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.060870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.061299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.203948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:22.213009 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4e9c60df-7e51-4141-9706-a9412893208f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1277 microversion: 2.1 time: 0.190436 Aug 30 04:23:22.222095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1583/3233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:22 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:22.233402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ef1c8172-a0ab-4677-85e4-35b335408795 req-f83c4190-5af7-4f0d-b9e5-15a0e153e81a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff18a6ba-0f63-44cd-9ff3-1128b364118a", "tag": "92e22735-08bb-4ef4-90cd-5dbc81f3bc59"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:22.245052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef1c8172-a0ab-4677-85e4-35b335408795 req-f83c4190-5af7-4f0d-b9e5-15a0e153e81a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.250259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef1c8172-a0ab-4677-85e4-35b335408795 req-f83c4190-5af7-4f0d-b9e5-15a0e153e81a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.250998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef1c8172-a0ab-4677-85e4-35b335408795 req-f83c4190-5af7-4f0d-b9e5-15a0e153e81a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.282779 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ef1c8172-a0ab-4677-85e4-35b335408795 req-f83c4190-5af7-4f0d-b9e5-15a0e153e81a service nova] Creating event network-changed:92e22735-08bb-4ef4-90cd-5dbc81f3bc59 for instance ff18a6ba-0f63-44cd-9ff3-1128b364118a on n-h2-854925-5 Aug 30 04:23:22.295667 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ef1c8172-a0ab-4677-85e4-35b335408795 req-f83c4190-5af7-4f0d-b9e5-15a0e153e81a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071998 Aug 30 04:23:22.297162 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1584/3234] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:22.303146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:22.306603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:22.318915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.330135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.331471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.332416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.333051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.333705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.728599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:22.743049 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f3be76e4-0efc-49dc-b9e9-9ac0ac1664a8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.789560 Aug 30 04:23:22.763860 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1651/3235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:21 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:22.769654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:22.770614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:22.786554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.787046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.793148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.795120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.795771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.796377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.840858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:22.859593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:22.861320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:22.863607 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4534b90-bb01-4253-a79b-a15bbd908c1f tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2958 microversion: 2.42 time: 0.565177 Aug 30 04:23:22.879783 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1585/3236] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:22 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2958 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:22.904055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:22.904678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:22.928354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.935840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.936395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.937147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:22.941540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:22.942246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:22.997253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:23.336762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:23.356095 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adf7fd22-0f99-4d48-855c-5c17114e3015 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 0.474767 Aug 30 04:23:23.370822 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1586/3237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:22 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:23.370822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:23.371683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:23.381398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.381897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.382341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.383049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.383505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.383935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.453105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:23.466220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-05e10ebb-413f-4909-ae25-a402c8446429 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.701023 Aug 30 04:23:23.466829 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1652/3238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:22 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:23.484901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:23.485580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:23.492028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.492888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.493754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.494938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.495639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.496295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.634780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:23.648193 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c2a2094-4ae1-4868-baee-c367c181ab20 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1277 microversion: 2.1 time: 0.167207 Aug 30 04:23:23.649510 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1653/3239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:23 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:23.701743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:23.711446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:23.713374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:23.714845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36ff8038-812f-4691-8112-e0cb8ef58458 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.354813 Aug 30 04:23:23.716082 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1587/3240] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:23 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:23.766743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:23.767524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:23.778291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.778846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.780061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.781660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.782169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.782610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.894653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:23.895163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:23.907093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.909044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.909526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:23.910248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:23.910903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:23.913926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.059551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.065651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:24.074785 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-877b0f4b-947e-43fe-a520-5f03aab987ed tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.310660 Aug 30 04:23:24.090628 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1654/3241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:23 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:24.098253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cbdb230c-c10d-49d9-9133-d4fe5f7774a5 req-40aa5694-d5e3-4bb1-bdd3-95b6b21ae17c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a02175-d9f3-4f57-9db1-618596566c85", "name": "network-vif-plugged", "status": "completed", "tag": "78448671-cdb4-443f-ae74-c0c03dd6955b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:24.115862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cbdb230c-c10d-49d9-9133-d4fe5f7774a5 req-40aa5694-d5e3-4bb1-bdd3-95b6b21ae17c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.116583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cbdb230c-c10d-49d9-9133-d4fe5f7774a5 req-40aa5694-d5e3-4bb1-bdd3-95b6b21ae17c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.117721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cbdb230c-c10d-49d9-9133-d4fe5f7774a5 req-40aa5694-d5e3-4bb1-bdd3-95b6b21ae17c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.133809 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cbdb230c-c10d-49d9-9133-d4fe5f7774a5 req-40aa5694-d5e3-4bb1-bdd3-95b6b21ae17c service nova] Creating event network-vif-plugged:78448671-cdb4-443f-ae74-c0c03dd6955b for instance 76a02175-d9f3-4f57-9db1-618596566c85 on n-h1-854925-5 Aug 30 04:23:24.149445 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cbdb230c-c10d-49d9-9133-d4fe5f7774a5 req-40aa5694-d5e3-4bb1-bdd3-95b6b21ae17c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055506 Aug 30 04:23:24.150288 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1655/3242] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:24.381481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:24.383642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:24.405227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.406041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.406725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.408175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.410340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.411103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.632120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=26 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:24.691516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.707487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.713906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.716992 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0e183dba-6411-402b-b3cb-c3f00edcd638 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2958 microversion: 2.42 time: 0.826306 Aug 30 04:23:24.731397 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1588/3243] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:23 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2958 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:23:24.754207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:24.755738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:24.763284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.764581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.765259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.766172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.766784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.767364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.838401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:24.849474 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b3eca45-0f68-4b88-a8c4-65a076efa111 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 0.474093 Aug 30 04:23:24.850071 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1656/3244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:24 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:24.854560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:24.855172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:24.868051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.868755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.869403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:24.870402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:24.871026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:24.871701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.271535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.283002 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-74e7e1aa-621c-4d77-8ab9-100dab30a0dc tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.430376 Aug 30 04:23:25.283654 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1657/3245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:24 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:25.293951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:25.297954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:25.313628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.314310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.317898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.320385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.321036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.327319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.569422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.589482 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-272ec13e-78e8-4114-bc2e-2c6df1d2b003 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.852854 Aug 30 04:23:25.602818 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1589/3246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:24 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:25.619795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:25.621420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:25.631934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.632536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.633190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.634742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.635457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.635617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.635898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.644831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.646270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:25.647403 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a651f1c5-0209-40dd-a200-5d1130b9678d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.360890 Aug 30 04:23:25.653482 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1658/3247] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:25 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:25.658174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5103504a-8166-4ddd-9a69-e56c994e6237 req-657b8a89-3268-410b-a73f-e6699eaece7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385", "tag": "42d6b307-ca25-4d6f-b9ef-e3622bbc796d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:25.685808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5103504a-8166-4ddd-9a69-e56c994e6237 req-657b8a89-3268-410b-a73f-e6699eaece7c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.686689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5103504a-8166-4ddd-9a69-e56c994e6237 req-657b8a89-3268-410b-a73f-e6699eaece7c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.687383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5103504a-8166-4ddd-9a69-e56c994e6237 req-657b8a89-3268-410b-a73f-e6699eaece7c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.706727 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5103504a-8166-4ddd-9a69-e56c994e6237 req-657b8a89-3268-410b-a73f-e6699eaece7c service nova] Creating event network-changed:42d6b307-ca25-4d6f-b9ef-e3622bbc796d for instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 on n-h1-854925-5 Aug 30 04:23:25.714569 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5103504a-8166-4ddd-9a69-e56c994e6237 req-657b8a89-3268-410b-a73f-e6699eaece7c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059809 Aug 30 04:23:25.716585 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1659/3248] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:25.755668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:25.759923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:25.775240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.778508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.779321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:25.780559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:25.786903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:25.789693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.053022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:26.061772 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a3e1f7c-d6de-436a-bae7-0589a261167c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.451152 Aug 30 04:23:26.070614 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1590/3249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:25 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:26.079262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:26.083372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:26.101371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.102439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.104526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.109197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.109765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.110211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.219524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:26.232024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:26.233729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:26.242151 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce407f82-9207-4ee3-ba39-674ba53ba9ed tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2958 microversion: 2.42 time: 0.491443 Aug 30 04:23:26.243003 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1660/3250] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:25 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2958 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:23:26.255739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a357690c-622d-4f35-937a-94a713c8e0e8 req-136e1eb0-2aab-4558-9f44-87fedb64306f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152", "tag": "72f2911a-10e3-473d-a172-f8ac8b9e6d12"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:26.283135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a357690c-622d-4f35-937a-94a713c8e0e8 req-136e1eb0-2aab-4558-9f44-87fedb64306f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.285275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a357690c-622d-4f35-937a-94a713c8e0e8 req-136e1eb0-2aab-4558-9f44-87fedb64306f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.286081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a357690c-622d-4f35-937a-94a713c8e0e8 req-136e1eb0-2aab-4558-9f44-87fedb64306f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.305446 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a357690c-622d-4f35-937a-94a713c8e0e8 req-136e1eb0-2aab-4558-9f44-87fedb64306f service nova] Creating event network-changed:72f2911a-10e3-473d-a172-f8ac8b9e6d12 for instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 on n-h1-854925-5 Aug 30 04:23:26.308868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:26.313417 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a357690c-622d-4f35-937a-94a713c8e0e8 req-136e1eb0-2aab-4558-9f44-87fedb64306f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064069 Aug 30 04:23:26.317664 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1661/3251] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:26.323417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:26.324141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:26.331908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.332546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.332978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.333731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.334186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.334615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.559225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:26.577768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8fb2bd8d-5a59-4790-a4ce-8e4ac2d77c5c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1318 microversion: 2.1 time: 0.509790 Aug 30 04:23:26.597022 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1591/3252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:26 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:26.622427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:26.623313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:26.628135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:26.634652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.636041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.636835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.638117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.638801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.639805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.659863 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5b86802-1ca3-4dec-94ae-61526b3dd161 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.340131 Aug 30 04:23:26.660480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1662/3253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:26 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:26.673598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:26.674687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:26.683983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.684582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.685213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.686001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:26.686528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:26.686965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:26.762169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=38 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:27.225763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:27.233829 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dced710e-3a0b-4439-a92f-7c3430201a9d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.620787 Aug 30 04:23:27.237672 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1592/3254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:26 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:27.242721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:27.252847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:27.260744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:27.262869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:27.265022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:27.269808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a28c9f8b-0ed7-4214-851e-3cb3803e91a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.595325 Aug 30 04:23:27.282203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1663/3255] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:26 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:27.294623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:27.297059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:27.298293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.300965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.301619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:27.302541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.304732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.307200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:27.313505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.314216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.314896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:27.315774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:27.326101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:27.326844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.342880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.351050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.384311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.386193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8bf4f6da-dce6-41de-a406-141582f3b383 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 1.143341 Aug 30 04:23:28.387919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.388866 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1593/3256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:27 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:28.391291 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a9c309a-4ab6-42ca-8b4b-ca5996b314c1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2958 microversion: 2.42 time: 1.107855 Aug 30 04:23:28.397483 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1664/3257] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:27 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2958 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:28.400854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2fe3436e-a5df-4f98-b993-2a98e75c419b req-e5e43c04-c439-41ec-89b6-e79e89adf7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "name": "network-vif-plugged", "status": "completed", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:28.412906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:28.417952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:28.431682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2fe3436e-a5df-4f98-b993-2a98e75c419b req-e5e43c04-c439-41ec-89b6-e79e89adf7ee service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.433625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2fe3436e-a5df-4f98-b993-2a98e75c419b req-e5e43c04-c439-41ec-89b6-e79e89adf7ee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.435017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2fe3436e-a5df-4f98-b993-2a98e75c419b req-e5e43c04-c439-41ec-89b6-e79e89adf7ee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.437056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.438625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.440555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.443093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.443652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.445316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.462624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2fe3436e-a5df-4f98-b993-2a98e75c419b req-e5e43c04-c439-41ec-89b6-e79e89adf7ee service nova] Creating event network-vif-plugged:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h1-854925-5 Aug 30 04:23:28.471902 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2fe3436e-a5df-4f98-b993-2a98e75c419b req-e5e43c04-c439-41ec-89b6-e79e89adf7ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081421 Aug 30 04:23:28.476142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1594/3258] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:28.486213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:28.488559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:28.505029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.507156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.507860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.510665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.511397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.513050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.928651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:28.938454 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5467ebe7-09f4-4f53-a76e-3b458e5aa889 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1467 microversion: 2.1 time: 0.539668 Aug 30 04:23:28.941932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1665/3259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:28 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1467 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:28.956073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:28.957806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:28.964561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.965286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.965941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:28.967042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:28.968416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:28.969038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.040533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.050137 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb54e120-490b-4115-a5bc-247be895d5fb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.572434 Aug 30 04:23:29.051069 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1595/3260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:28 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:29.057951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:29.058889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:29.067189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.068412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.069501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.070476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.071165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.071844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.407841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.425898 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0a001ffe-42cf-4ef3-9f29-a749ab0217cd tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.481866 Aug 30 04:23:29.441252 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1666/3261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:28 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:29.442305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.450254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:29.451446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:29.456998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.459947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.463207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.463820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12786f4a-811e-4c19-9fbf-32e6db6b28c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.411104 Aug 30 04:23:29.463949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.477674 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1596/3262] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:29 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:29.478385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.478385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.478385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.478385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.487524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:29.488155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:29.510157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.510662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.511104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.512051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.512708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.513347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.909498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.918271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fdfd7613-3dc9-401f-a32b-5364bac6a9ba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1468 microversion: 2.1 time: 0.473168 Aug 30 04:23:29.918427 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1667/3263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:29 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1468 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:29.923244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:29.924090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:29.930765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.931536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.934859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:29.944809 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd1cb924-14c2-48ea-855d-7494b80ad51d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.479179 Aug 30 04:23:29.945378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.946377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.947253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.947789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.951797 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1597/3264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:29 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:29.961643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-869927849"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:29.969887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:29.983533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.984102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.985190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:29.986053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:29.987346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:29.987735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.431334 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-daf1d757-883b-4d50-a912-c3c2907d5ae5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "POST /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85/action" status: 202 len: 0 microversion: 2.1 time: 0.477659 Aug 30 04:23:30.432677 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1598/3265] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:29 2022] POST /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:23:30.441453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:30.442654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:30.454610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.455335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.455935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.456808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.457463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.458077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.545749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.557590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.567359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:30.568973 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40c6c55e-bf4d-44a4-84c6-8a637eadddbb tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2937 microversion: 2.42 time: 0.649356 Aug 30 04:23:30.569778 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1668/3266] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:29 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2937 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:30.575384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e82d4a86-0437-4cd1-a2c0-1b5330925c86 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693f1040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:30.637603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e82d4a86-0437-4cd1-a2c0-1b5330925c86 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.066384 Aug 30 04:23:30.639164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1669/3267] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:30 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:30.645048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:30.646195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:30.652866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.653640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.654090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:30.654835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:30.655465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:30.655919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.079223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.088881 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a361041a-ea45-48f8-82ca-4666b412cbd2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.653462 Aug 30 04:23:31.089894 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1599/3268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:30 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:31.097151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:31.098821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:31.109803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.110470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.110987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.111799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.112370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.112871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.196748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.201894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7d41b88-24f3-48c8-99ed-8034f9b1f794 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.560547 Aug 30 04:23:31.202490 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1670/3269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:30 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:31.209117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-unplugged", "status": "completed", "tag": "78e02f42-39d7-40d5-90cf-ba73041ae462"}, {"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-unplugged", "status": "completed", "tag": "7aabe1a2-bce3-41a4-adf6-b7b685b254d8"}, {"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-unplugged", "status": "completed", "tag": "1e12d725-0a04-4649-8cbe-5b9d9b18db68"}, {"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-unplugged", "status": "completed", "tag": "c60ef681-2421-4c79-99dc-cb517437fdc6"}, {"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-unplugged", "status": "completed", "tag": "d58eca3a-311c-4ff2-aa27-f5391e5e4bad"}, {"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-unplugged", "status": "completed", "tag": "42bcc2a6-99c0-41c1-8d7e-96b497240ef7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:31.221082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.221582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.222204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.235009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Creating event network-vif-unplugged:78e02f42-39d7-40d5-90cf-ba73041ae462 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:31.235527 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Creating event network-vif-unplugged:7aabe1a2-bce3-41a4-adf6-b7b685b254d8 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:31.236033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Creating event network-vif-unplugged:1e12d725-0a04-4649-8cbe-5b9d9b18db68 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:31.236528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Creating event network-vif-unplugged:c60ef681-2421-4c79-99dc-cb517437fdc6 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:31.237023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Creating event network-vif-unplugged:d58eca3a-311c-4ff2-aa27-f5391e5e4bad for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:31.237587 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] Creating event network-vif-unplugged:42bcc2a6-99c0-41c1-8d7e-96b497240ef7 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:31.246896 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-82242cb3-c175-43da-96fe-7b21b66faf42 req-0f6f9f99-28b0-4ea9-8a8a-96899adfa0d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.042964 Aug 30 04:23:31.247684 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1671/3270] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:31.258263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:31.259228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:31.267310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:31.272059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.272900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.286869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.287883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.288520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.289599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.682142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.696726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.700117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.705409 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22c06461-1c47-46ae-81c6-d5f68d4e1426 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.613633 Aug 30 04:23:31.707518 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1600/3271] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:31 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:31.712824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:31.713758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:31.721344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.722105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.722707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.723754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:31.724443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:31.725418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:31.828808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:31.845058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb9cdb33-3e59-48c8-9008-a7c4b1a6dc37 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.596327 Aug 30 04:23:31.846507 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1672/3272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:31 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:31.854636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b31bf5a-98ce-431f-a759-e4b921279c03 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9697040d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:31.917454 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b31bf5a-98ce-431f-a759-e4b921279c03 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.069880 Aug 30 04:23:31.918482 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1673/3273] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:31 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:32.115281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.116153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.120972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:32.125158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.125701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.126134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.127373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.128037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.128704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.149689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:32.152070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:32.154834 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-053a48d7-b725-454c-9b83-48025a170fce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2916 microversion: 2.42 time: 0.446014 Aug 30 04:23:32.167414 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1601/3274] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:31 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2916 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:32.225219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.226022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.237943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.238441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.238879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.243828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.244333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.244796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.255528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:32.486260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:32.494166 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cde735e1-7a41-4618-93bf-463cbec636c7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.384154 Aug 30 04:23:32.494987 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1674/3275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:32 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:32.588255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:32.621537 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3bd07afd-98b1-4ecd-a3c6-05880ee00503 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.399181 Aug 30 04:23:32.626251 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1602/3276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:32 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:32.735942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.736750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.744740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.745495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.746184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.747101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.747802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.748437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.761487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-eecdeccc-bb3b-40a1-afc5-ded4be2f72df req-23ef24de-66ac-4b2a-8f22-b555dc8f7675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-deleted", "tag": "d58eca3a-311c-4ff2-aa27-f5391e5e4bad"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:32.789784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eecdeccc-bb3b-40a1-afc5-ded4be2f72df req-23ef24de-66ac-4b2a-8f22-b555dc8f7675 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.790265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eecdeccc-bb3b-40a1-afc5-ded4be2f72df req-23ef24de-66ac-4b2a-8f22-b555dc8f7675 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.790692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-eecdeccc-bb3b-40a1-afc5-ded4be2f72df req-23ef24de-66ac-4b2a-8f22-b555dc8f7675 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.833034 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-eecdeccc-bb3b-40a1-afc5-ded4be2f72df req-23ef24de-66ac-4b2a-8f22-b555dc8f7675 service nova] Creating event network-vif-deleted:d58eca3a-311c-4ff2-aa27-f5391e5e4bad for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:32.839540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-eecdeccc-bb3b-40a1-afc5-ded4be2f72df req-23ef24de-66ac-4b2a-8f22-b555dc8f7675 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085102 Aug 30 04:23:32.840459 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1603/3277] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 04:23:32.871955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:32.874437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:32.910461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.911831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.913989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:32.916062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:32.916902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:32.919068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.602010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.614160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.616426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.618376 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c283a94-09f3-4034-ba4e-3b707b12002d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.887584 Aug 30 04:23:33.629248 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1675/3278] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:32 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:33.640257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f681ce0-4537-4b0d-bdd0-3d8e757f43f7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693b1dc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:33.662390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:33.684691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-935062e2-269d-4681-939a-afddd1e0677d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.817129 Aug 30 04:23:33.685849 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1604/3279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:32 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:33.691050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:33.694190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:33.703239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.703759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.704435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.705379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.706626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.707263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.719920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f681ce0-4537-4b0d-bdd0-3d8e757f43f7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.091086 Aug 30 04:23:33.723175 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1676/3280] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:33 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:33.732316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d54fd404-6426-4206-ba46-78d70053289a req-0a5dab4c-382b-4fee-be12-92bd26434453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff18a6ba-0f63-44cd-9ff3-1128b364118a", "name": "network-vif-plugged", "status": "completed", "tag": "92e22735-08bb-4ef4-90cd-5dbc81f3bc59"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:33.745223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d54fd404-6426-4206-ba46-78d70053289a req-0a5dab4c-382b-4fee-be12-92bd26434453 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.746649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d54fd404-6426-4206-ba46-78d70053289a req-0a5dab4c-382b-4fee-be12-92bd26434453 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.747093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d54fd404-6426-4206-ba46-78d70053289a req-0a5dab4c-382b-4fee-be12-92bd26434453 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.751834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:33.779536 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d54fd404-6426-4206-ba46-78d70053289a req-0a5dab4c-382b-4fee-be12-92bd26434453 service nova] Creating event network-vif-plugged:92e22735-08bb-4ef4-90cd-5dbc81f3bc59 for instance ff18a6ba-0f63-44cd-9ff3-1128b364118a on n-h2-854925-5 Aug 30 04:23:33.792992 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d54fd404-6426-4206-ba46-78d70053289a req-0a5dab4c-382b-4fee-be12-92bd26434453 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068756 Aug 30 04:23:33.794235 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1677/3281] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:33.804344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:33.806565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:33.821664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.822595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.823209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:33.826687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:33.828845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:33.829606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.201208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.216489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.218085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.219604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9936558e-ba5c-43fe-86f3-790b5f3f32a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2755 microversion: 2.42 time: 0.532565 Aug 30 04:23:34.220773 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1605/3282] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:33 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2755 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:34.225623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:34.226526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:34.234942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.236241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.237028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.237988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.238715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.239464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.305663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.317500 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc9595b0-8c98-450a-bb8b-33b06f6963b3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.521727 Aug 30 04:23:34.318658 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1678/3283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:33 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:34.425103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:34.437450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-97f8e026-7609-4541-8a39-5064f2b532b5 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.215240 Aug 30 04:23:34.452839 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1606/3284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:34 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:34.644630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:34.645432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:34.655508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.660087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.661021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.662810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.664727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.665729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.711710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:34.711970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:34.722786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.723281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.726726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:34.730580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:34.731957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:34.732298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.021241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.028887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.037978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.040869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.041929 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9a2dfb68-ea30-4209-b587-f889a2fb0da2 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.337364 Aug 30 04:23:35.042577 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-49190e5e-2e1a-4654-ae83-22f80781b693 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1405 microversion: 2.20 time: 0.404856 Aug 30 04:23:35.057955 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1679/3285] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:34 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:35.058161 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1607/3286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:34 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:35.058260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-353e956f-a8d3-4ff9-a319-a73d2a343fe5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693da4c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:35.064307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d316e542-d7bf-43fc-959c-6619a9732256 req-8d06bebb-416b-427c-82b3-0801d196249d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-deleted", "tag": "7aabe1a2-bce3-41a4-adf6-b7b685b254d8"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:35.079409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d316e542-d7bf-43fc-959c-6619a9732256 req-8d06bebb-416b-427c-82b3-0801d196249d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.079926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d316e542-d7bf-43fc-959c-6619a9732256 req-8d06bebb-416b-427c-82b3-0801d196249d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.080357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d316e542-d7bf-43fc-959c-6619a9732256 req-8d06bebb-416b-427c-82b3-0801d196249d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.093721 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d316e542-d7bf-43fc-959c-6619a9732256 req-8d06bebb-416b-427c-82b3-0801d196249d service nova] Creating event network-vif-deleted:7aabe1a2-bce3-41a4-adf6-b7b685b254d8 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:35.100487 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d316e542-d7bf-43fc-959c-6619a9732256 req-8d06bebb-416b-427c-82b3-0801d196249d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041346 Aug 30 04:23:35.101292 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1608/3287] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:35.128081 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-353e956f-a8d3-4ff9-a319-a73d2a343fe5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.075632 Aug 30 04:23:35.128900 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1680/3288] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:35 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:35.246684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:35.247382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:35.255216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.255778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.256507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.257564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.258295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.258807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.341999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:35.343377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:35.350735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.351745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.352369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.353626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.354078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.354883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.529585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.539966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.549512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.560119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28f74539-82c7-4a05-8616-6d7a7edb6fc2 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2661 microversion: 2.42 time: 0.317465 Aug 30 04:23:35.564371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1609/3289] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:35 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2661 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:35.570733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:35.579525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:35.593729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.594298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.594892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.597258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.599293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.599984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.622605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.635809 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-715ff75b-83f7-4d79-a508-1580bfaa4f89 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.299759 Aug 30 04:23:35.637462 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1681/3290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:35 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:35.854147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:35.869666 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44caf0e0-3e7b-4552-8a5f-da955a30c509 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1307 microversion: 2.1 time: 0.302640 Aug 30 04:23:35.876248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-99f913b1-fa59-4baa-94ab-9719aadb17c1 req-e62f2eaf-ddf2-432f-83aa-1033f0010484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152", "name": "network-vif-plugged", "status": "completed", "tag": "72f2911a-10e3-473d-a172-f8ac8b9e6d12"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:35.883285 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1610/3291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:35 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:35.891634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-99f913b1-fa59-4baa-94ab-9719aadb17c1 req-e62f2eaf-ddf2-432f-83aa-1033f0010484 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:35.892419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-99f913b1-fa59-4baa-94ab-9719aadb17c1 req-e62f2eaf-ddf2-432f-83aa-1033f0010484 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:35.894063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-99f913b1-fa59-4baa-94ab-9719aadb17c1 req-e62f2eaf-ddf2-432f-83aa-1033f0010484 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:35.919990 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-99f913b1-fa59-4baa-94ab-9719aadb17c1 req-e62f2eaf-ddf2-432f-83aa-1033f0010484 service nova] Creating event network-vif-plugged:72f2911a-10e3-473d-a172-f8ac8b9e6d12 for instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 on n-h1-854925-5 Aug 30 04:23:35.928502 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-99f913b1-fa59-4baa-94ab-9719aadb17c1 req-e62f2eaf-ddf2-432f-83aa-1033f0010484 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056276 Aug 30 04:23:35.936176 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1682/3292] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:36.069973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.070855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:36.071952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.073693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:36.085673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.086990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.087683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.088378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.089219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.089478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.089719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.090453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.090583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.090919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.091329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.091460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.574335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.585785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7327d30c-0f97-4d11-86c1-269a5955489c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.522263 Aug 30 04:23:36.601899 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1611/3293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:36.607474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20f14493-8107-40ce-a834-6cf5a35ea68c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96ae51040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.662118 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20f14493-8107-40ce-a834-6cf5a35ea68c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.057667 Aug 30 04:23:36.663714 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1612/3294] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:36.669123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.670330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:36.679221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.680143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.680753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.681671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.682353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.682948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.735939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.748183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.753410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:36.755087 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f559c98f-7799-4229-9219-d47d47011a93 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1597 microversion: 2.20 time: 0.690467 Aug 30 04:23:36.769418 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1683/3295] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1597 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:36.784663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:36.786123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:36.793947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.794815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.795633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:36.796575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:36.797827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:36.799057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.164428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.182640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.184896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.188675 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4e17f8f-8104-4323-86fb-5ec28a92015c tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2548 microversion: 2.42 time: 0.522043 Aug 30 04:23:37.194092 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1613/3296] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2548 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:37.207131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.207131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:37.221589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.222617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.223468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.224284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.224962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.225520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.245229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.253009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-385be571-0e9c-4c9d-adfe-0e10248f726e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.487258 Aug 30 04:23:37.264118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1684/3297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:36 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:37.280960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.281633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:37.288385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.301397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.302318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.303251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.303720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.304144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.465120 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-243b4bd8-0763-43f5-a7c5-662c17556afd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.268354 Aug 30 04:23:37.465801 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1614/3298] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 04:23:37 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-interface => generated 284 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:23:37.472079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-49ed4153-6bf1-45c5-a42f-5db9a92af201 req-3f501249-08cb-4813-90dc-1b365b8d1477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-deleted", "tag": "78e02f42-39d7-40d5-90cf-ba73041ae462"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:37.494332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-49ed4153-6bf1-45c5-a42f-5db9a92af201 req-3f501249-08cb-4813-90dc-1b365b8d1477 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.494747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-49ed4153-6bf1-45c5-a42f-5db9a92af201 req-3f501249-08cb-4813-90dc-1b365b8d1477 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.495183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-49ed4153-6bf1-45c5-a42f-5db9a92af201 req-3f501249-08cb-4813-90dc-1b365b8d1477 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.521182 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-49ed4153-6bf1-45c5-a42f-5db9a92af201 req-3f501249-08cb-4813-90dc-1b365b8d1477 service nova] Creating event network-vif-deleted:78e02f42-39d7-40d5-90cf-ba73041ae462 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:37.541585 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-49ed4153-6bf1-45c5-a42f-5db9a92af201 req-3f501249-08cb-4813-90dc-1b365b8d1477 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074448 Aug 30 04:23:37.542206 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1615/3299] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:37.609138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.610948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:37.619627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.620677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.621396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.622329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.623025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.623700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.764131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.778914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8e8cd5cb-6e43-4d84-af99-549046e450ef tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1488 microversion: 2.1 time: 0.513672 Aug 30 04:23:37.793570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1685/3300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:37 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1488 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:37.798413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76bd34b0-fe11-4b1b-b0f1-02cc7f0cdbb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96978eca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:37.862276 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76bd34b0-fe11-4b1b-b0f1-02cc7f0cdbb3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.080942 Aug 30 04:23:37.862974 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1686/3301] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:37 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:37.868192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1956077421"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:37.870871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:37.878775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.879610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.880121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.880895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:37.881599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:37.882289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:37.927847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:37.945902 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f581604e-33a1-459b-91d5-72af829b5d58 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1734 microversion: 2.1 time: 0.340374 Aug 30 04:23:37.948074 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1616/3302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:37 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1734 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:38.099082 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-54c54fee-48c9-4db3-874e-833fd4dead5e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "POST /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a/action" status: 202 len: 0 microversion: 2.1 time: 0.234593 Aug 30 04:23:38.105846 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1687/3303] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:37 2022] POST /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:23:38.110068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a7dfc6fe-be1a-4668-926a-7b095e6557a9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a568670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:38.187147 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a7dfc6fe-be1a-4668-926a-7b095e6557a9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8" status: 200 len: 1412 microversion: 2.1 time: 0.080948 Aug 30 04:23:38.188052 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1617/3304] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:38 2022] GET /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:38.208963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83295786-475b-415d-abf1-7a9cdfa9b12b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9695855e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:38.215545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:38.216158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:38.230830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:38.231558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:38.232161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:38.233034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:38.233806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:38.234404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:38.281538 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83295786-475b-415d-abf1-7a9cdfa9b12b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8" status: 200 len: 1412 microversion: 2.1 time: 0.083315 Aug 30 04:23:38.291868 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1688/3305] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:38 2022] GET /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:38.300396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:38.306908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:38.322051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:38.323006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:38.323892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:38.324921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:38.325629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:38.326305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:38.815812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:38.836456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:38.838185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:38.858503 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3419d333-f9d8-424d-a2dc-f87e77445922 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2388 microversion: 2.42 time: 0.642421 Aug 30 04:23:38.859365 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1618/3306] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:38 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2388 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:38.882423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b46196d-ee14-4c45-8f6d-7b4b935f3a74 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a71a1f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.156845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6b46196d-ee14-4c45-8f6d-7b4b935f3a74 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8" status: 204 len: 0 microversion: 2.1 time: 0.295967 Aug 30 04:23:39.157529 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1619/3307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:38 2022] DELETE /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:39.164037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75e67e9b-6e59-490b-b7a5-3736dd8ea69c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a2fc940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.180579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:39.243610 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77286fcb-711f-4aa3-a914-3e33611599c9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1319 microversion: 2.1 time: 0.928079 Aug 30 04:23:39.257788 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-75e67e9b-6e59-490b-b7a5-3736dd8ea69c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.098052 Aug 30 04:23:39.263885 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1689/3308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:38 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1319 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:39.265687 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1620/3309] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:39.280200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68a1999f-fd63-4f16-952a-c9d448a45f9b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a406790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.289945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.295686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:39.320312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.321686 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-68a1999f-fd63-4f16-952a-c9d448a45f9b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Image not found. Aug 30 04:23:39.323974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68a1999f-fd63-4f16-952a-c9d448a45f9b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 HTTP/1.1 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8'} Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:23:39.324669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 could not be found. Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68a1999f-fd63-4f16-952a-c9d448a45f9b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68a1999f-fd63-4f16-952a-c9d448a45f9b tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8" status: 404 len: 62 microversion: 2.1 time: 0.059545 Aug 30 04:23:39.329891 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1621/3310] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:23:39.335610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.337386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.337386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:39.337682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.337682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.337682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.352482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.355954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.357861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.358794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.359780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.361853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.754284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:39.772818 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38a3f2db-f892-4a9a-a79e-1c166c7a9501 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1714 microversion: 2.1 time: 0.503808 Aug 30 04:23:39.773534 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1690/3311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1714 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:39.796410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5d796727-5c66-462b-addd-a2afcbbcf2f5 req-29dae128-ef48-479c-bbbb-60c26b180e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-deleted", "tag": "c60ef681-2421-4c79-99dc-cb517437fdc6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:39.822581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d796727-5c66-462b-addd-a2afcbbcf2f5 req-29dae128-ef48-479c-bbbb-60c26b180e43 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.827484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d796727-5c66-462b-addd-a2afcbbcf2f5 req-29dae128-ef48-479c-bbbb-60c26b180e43 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.829007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d796727-5c66-462b-addd-a2afcbbcf2f5 req-29dae128-ef48-479c-bbbb-60c26b180e43 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.875009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5d796727-5c66-462b-addd-a2afcbbcf2f5 req-29dae128-ef48-479c-bbbb-60c26b180e43 service nova] Creating event network-vif-deleted:c60ef681-2421-4c79-99dc-cb517437fdc6 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:39.897095 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5d796727-5c66-462b-addd-a2afcbbcf2f5 req-29dae128-ef48-479c-bbbb-60c26b180e43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122243 Aug 30 04:23:39.897776 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1691/3312] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:39.923168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:39.946865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:39.979179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.979682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.990256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:39.991124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:39.991619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:39.992060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.072248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:40.080909 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-55b2a42a-ba85-4c14-9c18-29862deb8d0e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1500 microversion: 2.1 time: 0.749109 Aug 30 04:23:40.088800 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1622/3313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1500 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:40.094260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.100576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:40.115191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.115957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.116597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.118120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.119974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.120609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.258028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:40.283265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:40.284686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:40.296232 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4dc90fd-e7a0-409b-9fb0-fff620f49cd5 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 2029 microversion: 2.42 time: 0.380093 Aug 30 04:23:40.315290 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1692/3314] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:39 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 2029 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:40.331845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0db3f3fa-e75d-4a4b-999d-d608ffdeb7ef req-23482156-9032-40fb-b1c5-e1809898b40c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:40.357606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0db3f3fa-e75d-4a4b-999d-d608ffdeb7ef req-23482156-9032-40fb-b1c5-e1809898b40c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.358302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0db3f3fa-e75d-4a4b-999d-d608ffdeb7ef req-23482156-9032-40fb-b1c5-e1809898b40c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.360394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0db3f3fa-e75d-4a4b-999d-d608ffdeb7ef req-23482156-9032-40fb-b1c5-e1809898b40c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.394500 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0db3f3fa-e75d-4a4b-999d-d608ffdeb7ef req-23482156-9032-40fb-b1c5-e1809898b40c service nova] Creating event network-changed:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h1-854925-5 Aug 30 04:23:40.410648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0db3f3fa-e75d-4a4b-999d-d608ffdeb7ef req-23482156-9032-40fb-b1c5-e1809898b40c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090462 Aug 30 04:23:40.411481 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1693/3315] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:40.422225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.425190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:40.444129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.446317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.447319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.449503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.452126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.452749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.455794 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Cannot 'detach_volume' instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 while it is in vm_state rescued Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments/5bf14fa5-43da-48c8-948a-7e545239d022 HTTP/1.1 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: exception: Cannot 'detach_volume' instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 while it is in vm_state rescued Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46', 'id': '5bf14fa5-43da-48c8-948a-7e545239d022'} Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 while it is in vm_state rescued Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:40.465755 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 while it is in vm_state rescued Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 409 to user: Cannot 'detach_volume' instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 while it is in vm_state rescued {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd78d497-23c1-4434-bdaf-2cac318a4980 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments/5bf14fa5-43da-48c8-948a-7e545239d022" status: 409 len: 152 microversion: 2.1 time: 0.377130 Aug 30 04:23:40.470943 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1623/3316] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:23:40 2022] DELETE /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments/5bf14fa5-43da-48c8-948a-7e545239d022 => generated 152 bytes in 378 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:23:40.515602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c143bf6c-ce7f-4673-bacf-59019c8e8563 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a2fc0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.646705 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c143bf6c-ce7f-4673-bacf-59019c8e8563 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.177789 Aug 30 04:23:40.647305 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1624/3317] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:40 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:40.678154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:40.678704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:40.725570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.726179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.726831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.727343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.727806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.728943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.764385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:40.781876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b6b2da1-d6eb-437a-a34d-958dfd08e2ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1469 microversion: 2.1 time: 0.368956 Aug 30 04:23:40.794124 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1694/3318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:40 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1469 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:40.819624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.820541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:40.835104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.837741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.838361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.839278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:40.841557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:40.842170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:40.966709 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f8b201f9-9d85-49c8-a5e6-6af9a0676f43 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/action" status: 202 len: 0 microversion: 2.1 time: 0.318060 Aug 30 04:23:40.967984 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1625/3319] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:23:40 2022] POST /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:23:40.979733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:40.993155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:41.015535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.019368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.020456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.025453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.029366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.034229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.050362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:41.610514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:41.620140 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-003e3546-6e2e-4354-9d2c-f55728cee4f2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1319 microversion: 2.1 time: 0.805001 Aug 30 04:23:41.628383 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1695/3320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:40 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1319 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:41.641031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:41.644959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:41.671142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.674478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.676648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.679556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.685232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.686557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.757300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:41.785722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08f03609-5822-4446-80bd-c79742108542 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1722 microversion: 2.1 time: 0.805087 Aug 30 04:23:41.789319 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1626/3321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:40 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1722 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:41.800648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:41.801264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:41.840262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.840756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.841192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:41.841919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:41.842372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:41.842796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.182934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:42.193798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:42.202203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:42.214516 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-254ac541-5cf1-4788-be4d-e2817b56aec1 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.424088 Aug 30 04:23:42.217152 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1627/3322] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:41 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:42.230013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-23e80ec8-f081-4207-8b73-924ab508c7ac req-71538fa5-d5fe-4968-a404-428b36940bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385", "name": "network-vif-plugged", "status": "completed", "tag": "42d6b307-ca25-4d6f-b9ef-e3622bbc796d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:42.260108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-23e80ec8-f081-4207-8b73-924ab508c7ac req-71538fa5-d5fe-4968-a404-428b36940bbb service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.263466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-23e80ec8-f081-4207-8b73-924ab508c7ac req-71538fa5-d5fe-4968-a404-428b36940bbb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.267357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-23e80ec8-f081-4207-8b73-924ab508c7ac req-71538fa5-d5fe-4968-a404-428b36940bbb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.319635 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-23e80ec8-f081-4207-8b73-924ab508c7ac req-71538fa5-d5fe-4968-a404-428b36940bbb service nova] Creating event network-vif-plugged:42d6b307-ca25-4d6f-b9ef-e3622bbc796d for instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 on n-h1-854925-5 Aug 30 04:23:42.339023 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-23e80ec8-f081-4207-8b73-924ab508c7ac req-71538fa5-d5fe-4968-a404-428b36940bbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107051 Aug 30 04:23:42.342048 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1628/3323] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:42.353361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e111dbd-5336-4156-a8fc-a24f293265ad tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a2534c0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:42.512386 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e111dbd-5336-4156-a8fc-a24f293265ad tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.162938 Aug 30 04:23:42.513687 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1629/3324] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:42 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:42.528354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f8317a0c-5480-4685-a175-4b9b98a88155 req-4c7c8bbe-0a85-41b8-8a5a-dbc07bb5fac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98710227-9190-41c0-83ab-36b2eb2693c7", "name": "network-vif-deleted", "tag": "1e12d725-0a04-4649-8cbe-5b9d9b18db68"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:42.558455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f8317a0c-5480-4685-a175-4b9b98a88155 req-4c7c8bbe-0a85-41b8-8a5a-dbc07bb5fac0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.559232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f8317a0c-5480-4685-a175-4b9b98a88155 req-4c7c8bbe-0a85-41b8-8a5a-dbc07bb5fac0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.560150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f8317a0c-5480-4685-a175-4b9b98a88155 req-4c7c8bbe-0a85-41b8-8a5a-dbc07bb5fac0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.617820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f8317a0c-5480-4685-a175-4b9b98a88155 req-4c7c8bbe-0a85-41b8-8a5a-dbc07bb5fac0 service nova] Creating event network-vif-deleted:1e12d725-0a04-4649-8cbe-5b9d9b18db68 for instance 98710227-9190-41c0-83ab-36b2eb2693c7 on n-h2-854925-5 Aug 30 04:23:42.631398 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f8317a0c-5480-4685-a175-4b9b98a88155 req-4c7c8bbe-0a85-41b8-8a5a-dbc07bb5fac0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115498 Aug 30 04:23:42.633022 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1630/3325] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:42.649504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:42.653764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:42.671018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.671994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.673270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.674340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.675045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.675704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.770358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:42.786533 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a5ff5b6-e585-4971-ac2d-24bff0a864b9 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1506 microversion: 2.1 time: 1.153852 Aug 30 04:23:42.787956 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1696/3326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:41 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1506 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:42.815215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:42.816104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:42.830940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.831616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.837359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:42.839764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:42.847198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:42.847729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.563033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:43.580236 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-865eedc9-8f57-4904-bb8a-30e8691d8696 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1722 microversion: 2.1 time: 0.769830 Aug 30 04:23:43.580397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:43.597762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08322017-7646-46d8-9d8f-6e9c036fa6e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1319 microversion: 2.1 time: 0.952779 Aug 30 04:23:43.598828 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1631/3328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:42 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1319 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:43.600996 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1697/3328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:42 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1722 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:43.606571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.607654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:43.615911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.616805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.617532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.618408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.618544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-058e4307-a38c-41af-aea6-24e08c8bf55c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96958af70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.619151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.619748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.741760 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-058e4307-a38c-41af-aea6-24e08c8bf55c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.139075 Aug 30 04:23:43.742352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1698/3329] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:43.814288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:43.815626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:43.819783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:43.827168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.829170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.836107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:43.837086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.837550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:43.838318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:43.838786 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a02f6be0-c238-41fa-9e6e-a4cc3ccaf8ce tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.238698 Aug 30 04:23:43.838939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:43.839199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:43.839616 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1632/3330] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:43.882466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:44.413059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-103e45ea-1e57-4a51-aee7-337d6da0fb76 req-468678b1-b8c9-4cd4-b80a-9c47e4c9bb45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a02175-d9f3-4f57-9db1-618596566c85", "name": "network-vif-plugged", "status": "completed", "tag": "78448671-cdb4-443f-ae74-c0c03dd6955b"}, {"server_uuid": "ff18a6ba-0f63-44cd-9ff3-1128b364118a", "name": "network-vif-plugged", "status": "completed", "tag": "92e22735-08bb-4ef4-90cd-5dbc81f3bc59"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:44.444303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-103e45ea-1e57-4a51-aee7-337d6da0fb76 req-468678b1-b8c9-4cd4-b80a-9c47e4c9bb45 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.445116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-103e45ea-1e57-4a51-aee7-337d6da0fb76 req-468678b1-b8c9-4cd4-b80a-9c47e4c9bb45 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.445908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-103e45ea-1e57-4a51-aee7-337d6da0fb76 req-468678b1-b8c9-4cd4-b80a-9c47e4c9bb45 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.481712 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-103e45ea-1e57-4a51-aee7-337d6da0fb76 req-468678b1-b8c9-4cd4-b80a-9c47e4c9bb45 service nova] Creating event network-vif-plugged:78448671-cdb4-443f-ae74-c0c03dd6955b for instance 76a02175-d9f3-4f57-9db1-618596566c85 on n-h1-854925-5 Aug 30 04:23:44.483471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-103e45ea-1e57-4a51-aee7-337d6da0fb76 req-468678b1-b8c9-4cd4-b80a-9c47e4c9bb45 service nova] Creating event network-vif-plugged:92e22735-08bb-4ef4-90cd-5dbc81f3bc59 for instance ff18a6ba-0f63-44cd-9ff3-1128b364118a on n-h2-854925-5 Aug 30 04:23:44.502614 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-103e45ea-1e57-4a51-aee7-337d6da0fb76 req-468678b1-b8c9-4cd4-b80a-9c47e4c9bb45 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093789 Aug 30 04:23:44.510138 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1633/3331] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:44.612552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.613289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:44.639730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.640610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.641073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.644379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.644882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.645354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.760057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:44.770839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3eb1fa1f-a3f8-4b8c-81a4-62e381ba64b3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1488 microversion: 2.1 time: 0.960272 Aug 30 04:23:44.771436 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1699/3332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:43 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1488 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:44.778132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:44.779524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:44.801006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.802086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.802750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.805815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:44.809305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:44.810029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:44.944144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:44.962119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c698e100-44d7-44f3-bc35-281acf26afbc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1722 microversion: 2.1 time: 0.353863 Aug 30 04:23:44.963085 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1634/3333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:44.975186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ba266e8-eec3-4335-b750-3b7d7742de1f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96ae51040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.062585 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ba266e8-eec3-4335-b750-3b7d7742de1f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.094812 Aug 30 04:23:45.068714 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1635/3334] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:45.093257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.096127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.117934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.119642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.120878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.123935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.126031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.128184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.193123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:45.201965 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d834d3df-45ff-4f4e-aa68-07f6d4cde19d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1319 microversion: 2.1 time: 0.427558 Aug 30 04:23:45.207349 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1700/3335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:44 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1319 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:45.216060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:45.220494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.221912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.236838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.240107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.240776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.241752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.243948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.245751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.382988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-331798ab-e8a9-4fdf-9f86-aaebbbcea5a4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 204 len: 0 microversion: 2.1 time: 0.311540 Aug 30 04:23:45.393566 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1636/3336] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:45 2022] DELETE /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:23:45.400381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1a74358-1bcb-4f68-8c64-15c41782e334 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96e45b0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.401150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:45.413883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:45.415325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:45.416527 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7260fc4-8711-4391-8658-b7e612d4cb7e tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.207986 Aug 30 04:23:45.439531 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1701/3337] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:45 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:45.449285 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e1a74358-1bcb-4f68-8c64-15c41782e334 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Image not found. Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1a74358-1bcb-4f68-8c64-15c41782e334 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 HTTP/1.1 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8'} Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 to delete Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 could not be found. Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:45.461802 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1a74358-1bcb-4f68-8c64-15c41782e334 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:45.468751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1a74358-1bcb-4f68-8c64-15c41782e334 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8" status: 404 len: 62 microversion: 2.1 time: 0.072078 Aug 30 04:23:45.475375 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1637/3338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:45 2022] DELETE /compute/v2.1/images/bc72dc6c-9b8a-4ebb-84f3-0043d56c61f8 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:23:45.476494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.477011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.487592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.489282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.489767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.490490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.492607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.493183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.558859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:23:45.678034 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.compute.api [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Instance is already in deleting state, ignoring this request Aug 30 04:23:45.678984 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77661d88-350d-433a-b898-e0595e8e9d81 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 204 len: 0 microversion: 2.1 time: 0.206431 Aug 30 04:23:45.685470 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1702/3339] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:45 2022] DELETE /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:23:45.708561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.712547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:45.726392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:45.730838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.731689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.732340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.733970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:45.735390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:45.737631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:45.984500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:45.985123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:46.002112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.002663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.003124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.003978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.004826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.004974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.051513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.061767 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-60b409cf-87e6-40d7-a0ec-c2f3c9ab1982 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1494 microversion: 2.1 time: 0.371700 Aug 30 04:23:46.077789 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1638/3340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:45 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1494 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:46.083485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7bea8d6-5780-4112-ac21-3b1a76987896 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a4ea0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:46.198554 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7bea8d6-5780-4112-ac21-3b1a76987896 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.119317 Aug 30 04:23:46.199733 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1639/3341] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:46 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:46.228466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:46.231968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:46.242438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.246532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.249804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.251703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.252456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.256864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.345902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.361407 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f4ee6f2-fec2-4363-aaa3-fdb312a5b66d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1722 microversion: 2.1 time: 0.381107 Aug 30 04:23:46.369005 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1703/3342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:45 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:46.446962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:46.447907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:46.457365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.458245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.458846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.459777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.460815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.462956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.559698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.578576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.580377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.581870 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-03cdbc34-d1a4-41a2-b59d-1caf8a6080f3 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.141880 Aug 30 04:23:46.597174 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1704/3343] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:46 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:23:46.660781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0ba0d04a-3bfb-40f8-aef3-b75cd55d932e req-db60208a-5443-4699-ab43-fb0e4a8f2a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff18a6ba-0f63-44cd-9ff3-1128b364118a", "name": "network-vif-unplugged", "status": "completed", "tag": "92e22735-08bb-4ef4-90cd-5dbc81f3bc59"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:46.677808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0ba0d04a-3bfb-40f8-aef3-b75cd55d932e req-db60208a-5443-4699-ab43-fb0e4a8f2a6b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.678291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0ba0d04a-3bfb-40f8-aef3-b75cd55d932e req-db60208a-5443-4699-ab43-fb0e4a8f2a6b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.678716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0ba0d04a-3bfb-40f8-aef3-b75cd55d932e req-db60208a-5443-4699-ab43-fb0e4a8f2a6b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.701107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.710960 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eaefd5f6-7dec-4a74-8301-4584ac129210 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1469 microversion: 2.1 time: 0.486597 Aug 30 04:23:46.721592 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1640/3344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:46 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1469 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:46.747168 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0ba0d04a-3bfb-40f8-aef3-b75cd55d932e req-db60208a-5443-4699-ab43-fb0e4a8f2a6b service nova] Creating event network-vif-unplugged:92e22735-08bb-4ef4-90cd-5dbc81f3bc59 for instance ff18a6ba-0f63-44cd-9ff3-1128b364118a on n-h2-854925-5 Aug 30 04:23:46.749594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:46.757238 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0ba0d04a-3bfb-40f8-aef3-b75cd55d932e req-db60208a-5443-4699-ab43-fb0e4a8f2a6b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100370 Aug 30 04:23:46.761343 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1705/3345] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:46.763312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:46.768603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Searching by: {'reservation_id': 'r-1htdyj8b', 'deleted': False, 'project_id': '697646bb2dfd47598fee27be7a58eeeb'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:23:46.782708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.783700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.784895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.786020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:46.787316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:46.788102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:46.925690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:23:47.019785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:47.034600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.035417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.035861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.086521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.087260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:47.125604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.130301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.131151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.133019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.135891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.136983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.180341 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1290a0bd-2a6f-4fc8-9eb9-77279bf7a857 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-1htdyj8b" status: 200 len: 2931 microversion: 2.1 time: 0.437767 Aug 30 04:23:47.180959 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1641/3346] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Aug 30 04:23:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-1htdyj8b => generated 2931 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:47.205600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e83ed7c2-aa7a-47ef-8653-65f6ee4ff5b0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.253212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.server_groups [None req-e83ed7c2-aa7a-47ef-8653-65f6ee4ff5b0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Querying cell ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) for 2 instances {{(pid=122402) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 04:23:47.254344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e83ed7c2-aa7a-47ef-8653-65f6ee4ff5b0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.255860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e83ed7c2-aa7a-47ef-8653-65f6ee4ff5b0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.256519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e83ed7c2-aa7a-47ef-8653-65f6ee4ff5b0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.345283 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e83ed7c2-aa7a-47ef-8653-65f6ee4ff5b0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/74dc91ba-1f36-4aed-ab77-a48f354c78dc" status: 200 len: 265 microversion: 2.1 time: 0.143833 Aug 30 04:23:47.346860 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1642/3347] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/os-server-groups/74dc91ba-1f36-4aed-ab77-a48f354c78dc => generated 265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:47.368438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e390929f-c2c9-418e-9cb9-76c7ed75eefb tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e47f1f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.459491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:47.470525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b512e15-1d47-43d1-875c-8b890e729393 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1494 microversion: 2.1 time: 0.389975 Aug 30 04:23:47.480478 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e390929f-c2c9-418e-9cb9-76c7ed75eefb tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.123813 Aug 30 04:23:47.482028 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1643/3348] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:47.488226 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1706/3349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1494 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:47.496419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.497200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:47.504029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:47.504739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:47.517168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.518002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.518635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.520011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.521079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.522153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.546292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.546800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.547246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:47.549304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:47.551887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:47.552344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.197358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:48.208343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d5ea2a7-d3da-4977-aded-738eb0e2270f tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1722 microversion: 2.1 time: 0.718686 Aug 30 04:23:48.223020 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1707/3350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1722 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:48.231564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:48.233128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:48.243343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.245002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.245792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.246829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.247477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.248140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.324879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae6553cf-48b2-4346-a52e-b2d94f3a5d9c tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 200 len: 1620 microversion: 2.1 time: 0.835156 Aug 30 04:23:48.331421 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1644/3351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:47 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 1620 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:48.352519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:48.353385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:48.362137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.370350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.371437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.372896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.373785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.374423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.427869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:48.443168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:48.448351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:48.451930 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4186c34b-7ff9-49aa-aae3-8a2c24110763 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.227187 Aug 30 04:23:48.455399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1708/3352] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:48 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:48.498909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5dcec2f3-797f-440d-845e-1dca12cbf5f3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693718b0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:48.645437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5dcec2f3-797f-440d-845e-1dca12cbf5f3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.152794 Aug 30 04:23:48.646033 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1709/3353] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:48 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:48.656789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:48.658395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:48.667941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.668614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.669493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.669964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:48.670467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:48.704844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:48.828930 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0426052d-a23f-4ff6-bee6-98717b73abf8 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1620 microversion: 2.1 time: 0.480292 Aug 30 04:23:48.834016 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1645/3354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:48 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1620 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:48.861526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66bb5b34-f9c4-4ffa-a2f0-a6f18ddd8a46 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: .version_select at 0x7fe96a3720d0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1224341348", "policies": ["anti-affinity"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:48.912627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-66bb5b34-f9c4-4ffa-a2f0-a6f18ddd8a46 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:48.929998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-66bb5b34-f9c4-4ffa-a2f0-a6f18ddd8a46 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:49.015856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-66bb5b34-f9c4-4ffa-a2f0-a6f18ddd8a46 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:49.040935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-66bb5b34-f9c4-4ffa-a2f0-a6f18ddd8a46 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:49.067719 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66bb5b34-f9c4-4ffa-a2f0-a6f18ddd8a46 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.210642 Aug 30 04:23:49.070662 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1646/3355] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Aug 30 04:23:48 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:23:49.234085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:49.234712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:49.241843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.242684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.243448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.244544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.245273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.245960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.325295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:49.339360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c2fd682-b806-4c97-a253-7ef66aa831d3 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1494 microversion: 2.1 time: 0.692256 Aug 30 04:23:49.342062 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1710/3356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:48 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1494 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:49.431901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-667262481", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a4f8d81d-2b9f-418b-a4b0-49f85931e70d"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:49.546102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:23:49.741617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:49.757910 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-98fcd80a-1611-4eec-9c44-9b28ed587f47 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1728 microversion: 2.1 time: 0.527819 Aug 30 04:23:49.758668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1647/3357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:49 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1728 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:49.771723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:49.771723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:49.777878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.777878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.777878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:49.785547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:49.786180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:49.786634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.023273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:50.029374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:50.048760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:50.050647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:50.052452 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f390efa-38b8-44c0-95e0-a3b23988344b tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.292833 Aug 30 04:23:50.053249 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1648/3358] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:49 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:50.059535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b1eca0f-43af-4eed-bffb-cd907fa3f23c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e40bc10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:50.121520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:23:50.122276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:23:50.123522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:23:50.124159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:23:50.125068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:23:50.158020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.160750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.163285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.164205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.168858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.169776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.186366 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b1eca0f-43af-4eed-bffb-cd907fa3f23c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.130796 Aug 30 04:23:50.187268 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1649/3359] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:50 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:50.219656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:50.220214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:50.233481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:50.253168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:50.257906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.264287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.267389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.269018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.270098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.274580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.300304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Going to run 2 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:23:50.303368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:50.387872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:50.395906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:50.448569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:50.454138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:50.455260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:50.481134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=cb375c92-a532-4c37-a8b0-fa947e77db24,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:23:50.559710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:50.564333 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d9aaf4a-289f-413e-acf3-86c28430c7ef tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.373784 Aug 30 04:23:50.572291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:50.578866 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1650/3360] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:23:50 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-interface => generated 284 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:50.588630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:50.592283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:50.616976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.628479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.629516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.631408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.633690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.639155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.644903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:23:50.663286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'server_group_members'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:23:50.804038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-07912ecd-df44-41b6-94f5-eebfd18fe17f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.376498 Aug 30 04:23:50.816298 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1711/3361] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:23:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 1390 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:23:50.836723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8bbd75c9-9a27-470d-ac48-cff482f71886 req-178ae769-f603-4281-872a-c198dde7606e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff18a6ba-0f63-44cd-9ff3-1128b364118a", "name": "network-vif-deleted", "tag": "92e22735-08bb-4ef4-90cd-5dbc81f3bc59"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:50.867623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8bbd75c9-9a27-470d-ac48-cff482f71886 req-178ae769-f603-4281-872a-c198dde7606e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.868116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8bbd75c9-9a27-470d-ac48-cff482f71886 req-178ae769-f603-4281-872a-c198dde7606e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.874867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8bbd75c9-9a27-470d-ac48-cff482f71886 req-178ae769-f603-4281-872a-c198dde7606e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.898085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:50.922702 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8bbd75c9-9a27-470d-ac48-cff482f71886 req-178ae769-f603-4281-872a-c198dde7606e service nova] Creating event network-vif-deleted:92e22735-08bb-4ef4-90cd-5dbc81f3bc59 for instance ff18a6ba-0f63-44cd-9ff3-1128b364118a on n-h2-854925-5 Aug 30 04:23:50.928918 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-427aab4c-22c7-4e0d-a7e1-e2c3c5bb7266 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1452 microversion: 2.1 time: 0.348119 Aug 30 04:23:50.929624 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1651/3362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:50 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1452 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:50.937656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:50.943495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:50.944325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Searching by: {'deleted': False, 'project_id': '697646bb2dfd47598fee27be7a58eeeb'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:23:50.949142 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8bbd75c9-9a27-470d-ac48-cff482f71886 req-178ae769-f603-4281-872a-c198dde7606e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131590 Aug 30 04:23:50.950512 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1712/3363] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:50.967691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.968186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.968628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:50.969399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:50.970053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:50.970479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.057745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:23:51.080296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:51.081841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:51.101426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.101944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.105486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.106301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.106773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.107209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.302551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-759a8586-81d2-45af-985f-3f53c2b1161a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.371404 Aug 30 04:23:51.312871 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1652/3364] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:23:50 2022] GET /compute/v2.1/servers => generated 1663 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:51.346646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0cc4b70-c4a8-4373-8b73-63c286f70c70 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a99e8b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:51.449282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:51.503335 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0cc4b70-c4a8-4373-8b73-63c286f70c70 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.184814 Aug 30 04:23:51.504210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:51.505686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:51.506891 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6eb8a110-705f-4917-a2d7-c9858eb78114 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.431241 Aug 30 04:23:51.507632 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1713/3365] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:51 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:23:51.508471 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1653/3366] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:51 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:51.523042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df675ba3-df56-497c-9734-24ca7e95e6ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:51.525934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df675ba3-df56-497c-9734-24ca7e95e6ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:51.693773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df675ba3-df56-497c-9734-24ca7e95e6ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:51.703096 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df675ba3-df56-497c-9734-24ca7e95e6ab tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1218 microversion: 2.1 time: 0.194463 Aug 30 04:23:51.705178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1714/3367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:51 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:51.958722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:51.959800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:51.983303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:51.995752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:51.996817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:51.998284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.000597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.002793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.184810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.187969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.191193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.191915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lazy-loading 'fault' on Instance uuid ff18a6ba-0f63-44cd-9ff3-1128b364118a {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:23:52.299665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '689cafef29c449fd8dd8eae3ae2ab9c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d549299f8d04da29bcc0bf2fc5b265c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:52.308846 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3fc24e9f-10bb-44bd-9967-a7170958949d tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 200 len: 1297 microversion: 2.1 time: 0.357002 Aug 30 04:23:52.309352 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1654/3368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:51 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 1297 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:52.531616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b8148e3-35cf-41e8-a08e-1f627583f146 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969348670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.542858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.544051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:52.575782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.578712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.582815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.587571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:52.588109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:52.588564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:52.674963 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b8148e3-35cf-41e8-a08e-1f627583f146 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.151742 Aug 30 04:23:52.682574 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1715/3369] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:52 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:52.723892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b07c32f4-f7f2-4284-8566-995ef0599000 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:52.724712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b07c32f4-f7f2-4284-8566-995ef0599000 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:52.801980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:52.834287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:52.845251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:52.856565 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4d1f11f8-eedd-41e5-be1e-454ace3c5ec9 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.314904 Aug 30 04:23:52.857780 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1655/3370] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:52 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:52.958761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b07c32f4-f7f2-4284-8566-995ef0599000 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:52.967537 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b07c32f4-f7f2-4284-8566-995ef0599000 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1218 microversion: 2.1 time: 0.247351 Aug 30 04:23:52.973051 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1716/3371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:52 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:53.333318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.334346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: ff18a6ba-0f63-44cd-9ff3-1128b364118a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:53.347399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.350653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.352377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.354371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.355975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.359812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.396839 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Instance ff18a6ba-0f63-44cd-9ff3-1128b364118a could not be found. Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a HTTP/1.1 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance ff18a6ba-0f63-44cd-9ff3-1128b364118a could not be found. Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'ff18a6ba-0f63-44cd-9ff3-1128b364118a'} Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff18a6ba-0f63-44cd-9ff3-1128b364118a could not be found. Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff18a6ba-0f63-44cd-9ff3-1128b364118a could not be found. Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.401023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.406090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.406090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.406090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:53.406090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:53.406090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff18a6ba-0f63-44cd-9ff3-1128b364118a could not be found. Aug 30 04:23:53.406090 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.409018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Instance ff18a6ba-0f63-44cd-9ff3-1128b364118a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:53.413133 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3dbe3499-f9ee-404e-a577-ba7d92681107 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a" status: 404 len: 111 microversion: 2.1 time: 0.086367 Aug 30 04:23:53.427727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c1ed19d-82c0-415e-add4-ae6afc7365e4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe969348ee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.435890 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1656/3372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:53 2022] GET /compute/v2.1/servers/ff18a6ba-0f63-44cd-9ff3-1128b364118a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:53.472698 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7c1ed19d-82c0-415e-add4-ae6afc7365e4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Image not found. Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c1ed19d-82c0-415e-add4-ae6afc7365e4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 HTTP/1.1 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'fc9146d6-fb40-4ecb-b715-15ded2beb026'} Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fc9146d6-fb40-4ecb-b715-15ded2beb026 to delete Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc9146d6-fb40-4ecb-b715-15ded2beb026 could not be found. Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.475585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.480981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c1ed19d-82c0-415e-add4-ae6afc7365e4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:53.484589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c1ed19d-82c0-415e-add4-ae6afc7365e4 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026" status: 404 len: 62 microversion: 2.1 time: 0.060666 Aug 30 04:23:53.488214 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1717/3373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:53 2022] DELETE /compute/v2.1/images/fc9146d6-fb40-4ecb-b715-15ded2beb026 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:23:53.497141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.497681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:53.510440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.510948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.511408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.519288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.519823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.520278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.560489 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 HTTP/1.1 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '5bb63a2f-23a4-478f-9377-b3c21e4a59d0'} Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:53.562134 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c519e40d-fa89-4ac5-9693-4f1dba2e7924 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 404 len: 111 microversion: 2.1 time: 0.075671 Aug 30 04:23:53.567439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1657/3374] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:53 2022] DELETE /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:53.579461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.580007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 5bb63a2f-23a4-478f-9377-b3c21e4a59d0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:53.588854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.589718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.590365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.591497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.592414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.593294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.681576 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 HTTP/1.1 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5bb63a2f-23a4-478f-9377-b3c21e4a59d0'} Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.683603 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.692611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.692611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.692611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:53.692611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:53.692611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. Aug 30 04:23:53.692611 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.700553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a760a062-0541-40ef-bf12-528f98ce9c7b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9698e7310>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.710239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Instance 5bb63a2f-23a4-478f-9377-b3c21e4a59d0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:53.716453 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6eb875c9-3621-4526-95c3-86a588139925 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0" status: 404 len: 111 microversion: 2.1 time: 0.142362 Aug 30 04:23:53.721033 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1718/3375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:53 2022] GET /compute/v2.1/servers/5bb63a2f-23a4-478f-9377-b3c21e4a59d0 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:53.733664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3015205e-c494-44f3-9eb0-ce8433240886 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe9695ae670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.824609 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3015205e-c494-44f3-9eb0-ce8433240886 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Image not found. Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3015205e-c494-44f3-9eb0-ce8433240886 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 HTTP/1.1 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128'} Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 to delete Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 could not be found. Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.827174 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3015205e-c494-44f3-9eb0-ce8433240886 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:53.833988 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3015205e-c494-44f3-9eb0-ce8433240886 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128" status: 404 len: 62 microversion: 2.1 time: 0.110083 Aug 30 04:23:53.839255 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1719/3376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:53 2022] DELETE /compute/v2.1/images/8961c8ac-9d6d-4b61-8fe8-3ff46d6b4128 => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:23:53.849811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:53.859106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a760a062-0541-40ef-bf12-528f98ce9c7b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.163026 Aug 30 04:23:53.859774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1658/3377] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:53 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:53.873664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:53.903717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.910057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.912021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.913312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:53.922768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:53.925040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:53.981347 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 HTTP/1.1 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '8ded16a4-47e1-44cc-8113-aa7538c0c786'} Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:53.983030 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:53.989106 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:53.997913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:53.999331 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec054fac-1374-4c05-9f01-07c8c592b279 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 404 len: 111 microversion: 2.1 time: 0.159431 Aug 30 04:23:54.000153 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1720/3378] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:53 2022] DELETE /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:54.017697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.018907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.039901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.046501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.047335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.050444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.052424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.056796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.206982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:54.225745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:54.227903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:54.233305 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-258aab86-ccc8-4983-9ed0-a7d6c9ad7da4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.228244 Aug 30 04:23:54.250481 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1721/3379] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:54.261722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.262825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.269536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.271158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.272092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.273107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.273958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.274623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.361648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9de115ac-1c37-4fb0-bec9-5fd476904e03 req-35baa449-2398-4ebf-a8c3-f8ff79146924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46", "tag": "308b9057-99c9-4500-b785-230fa19d288b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:54.394318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:54.396146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9de115ac-1c37-4fb0-bec9-5fd476904e03 req-35baa449-2398-4ebf-a8c3-f8ff79146924 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.396636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9de115ac-1c37-4fb0-bec9-5fd476904e03 req-35baa449-2398-4ebf-a8c3-f8ff79146924 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.399685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9de115ac-1c37-4fb0-bec9-5fd476904e03 req-35baa449-2398-4ebf-a8c3-f8ff79146924 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.411254 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b37854ca-3840-4d0d-89b3-50d8df39e4b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1270 microversion: 2.1 time: 0.158476 Aug 30 04:23:54.414786 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1722/3380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:54.427886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.430755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 8ded16a4-47e1-44cc-8113-aa7538c0c786] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.449268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9de115ac-1c37-4fb0-bec9-5fd476904e03 req-35baa449-2398-4ebf-a8c3-f8ff79146924 service nova] Creating event network-changed:308b9057-99c9-4500-b785-230fa19d288b for instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 on n-h2-854925-5 Aug 30 04:23:54.456854 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9de115ac-1c37-4fb0-bec9-5fd476904e03 req-35baa449-2398-4ebf-a8c3-f8ff79146924 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.588050 Aug 30 04:23:54.457796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.459916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.461462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.461943 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1659/3381] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:54.466266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.467848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.470232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.526834 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 HTTP/1.1 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '8ded16a4-47e1-44cc-8113-aa7538c0c786'} Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.534035 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.540009 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.540009 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.540009 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:54.540009 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:54.540009 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. Aug 30 04:23:54.540009 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.548774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Instance 8ded16a4-47e1-44cc-8113-aa7538c0c786 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:54.550304 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a15609a-f9e9-4c4a-9cff-301bd9201744 tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786" status: 404 len: 111 microversion: 2.1 time: 0.134148 Aug 30 04:23:54.555338 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1723/3382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/servers/8ded16a4-47e1-44cc-8113-aa7538c0c786 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:54.564841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2e0fa01-05cc-4de3-91a9-ff71be49470e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '.version_select at 0x7fe96a99e8b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.608674 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e2e0fa01-05cc-4de3-91a9-ff71be49470e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Image not found. Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2e0fa01-05cc-4de3-91a9-ff71be49470e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 HTTP/1.1 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'aad95eb7-cb05-43d4-93a0-53bb22ba7010'} Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aad95eb7-cb05-43d4-93a0-53bb22ba7010 to delete Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aad95eb7-cb05-43d4-93a0-53bb22ba7010 could not be found. Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.614238 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:23:54.618910 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.624177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2e0fa01-05cc-4de3-91a9-ff71be49470e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:54.633193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2e0fa01-05cc-4de3-91a9-ff71be49470e tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010" status: 404 len: 62 microversion: 2.1 time: 0.073211 Aug 30 04:23:54.635821 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1660/3383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:54 2022] DELETE /compute/v2.1/images/aad95eb7-cb05-43d4-93a0-53bb22ba7010 => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:23:54.644383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.644889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.665160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.665683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.666121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.666829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.667276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.667698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.730204 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d HTTP/1.1 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7b808ff1-027c-46e7-bc13-a1ee270c686d'} Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:54.731790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.738048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.756608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:54.762155 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2764d49a-1b8d-443d-ba8c-4da5201c015c tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 404 len: 111 microversion: 2.1 time: 0.122054 Aug 30 04:23:54.762756 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1724/3384] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:23:54 2022] DELETE /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:54.772304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.773044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] [instance: 7b808ff1-027c-46e7-bc13-a1ee270c686d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:54.795186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.806505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.810057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.813959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:54.815197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:54.815657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:54.875116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da6df593-020a-4e29-9491-03f5247d5576 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a2f25e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:54.875847 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] HTTP exception thrown: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Request method failure captured: Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d HTTP/1.1 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_K34-ci1VmqROn4oIScLvR13B7ipAP9wLj74q7meDE7wboKy3lUxPXGh4IoU7DXGH-HyVEBdGuheDhvP1jndjs3Kn-2fylEXXoOeqDZsrX4TC4BCU4JfdgfHLvg6MpHDauHningGgYO3B7Vqlle5KK3BIjnsvopqifQ2fTuYqtWeM Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4d549299f8d04da29bcc0bf2fc5b265c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4d549299f8d04da29bcc0bf2fc5b265c"}]}] Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4d549299f8d04da29bcc0bf2fc5b265c Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesTestJSON-498586031 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 689cafef29c449fd8dd8eae3ae2ab9c5 Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesTestJSON-498586031-project Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '7b808ff1-027c-46e7-bc13-a1ee270c686d'} Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.881817 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:23:54.887477 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:23:54.887477 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:23:54.887477 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:23:54.887477 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:23:54.887477 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. Aug 30 04:23:54.887477 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:23:54.892878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] Returning 404 to user: Instance 7b808ff1-027c-46e7-bc13-a1ee270c686d could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:23:54.894220 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77c574b3-ef0c-444b-a810-d86bb345ae2f tempest-ImagesTestJSON-498586031 tempest-ImagesTestJSON-498586031-project] 10.222.0.27 "GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d" status: 404 len: 111 microversion: 2.1 time: 0.126559 Aug 30 04:23:54.896713 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1661/3385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/servers/7b808ff1-027c-46e7-bc13-a1ee270c686d => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:23:54.975857 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da6df593-020a-4e29-9491-03f5247d5576 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.105009 Aug 30 04:23:54.976441 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1725/3386] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:54 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:55.266533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:55.267972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:55.293987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.295701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.296167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.296904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.312370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.314529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.436780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:55.437485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:55.460377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.465158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.469037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.480443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:55.480961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:55.481446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:55.486461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:55.809090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:55.830245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:55.830889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:55.837420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:55.843489 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f86db23f-918d-4eee-8409-67f93486e75d tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.580475 Aug 30 04:23:55.848724 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1662/3387] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:55 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:55.857483 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7eee77a-6f24-4d76-b061-75b9464281e8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1288 microversion: 2.1 time: 0.413029 Aug 30 04:23:55.858210 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1726/3388] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:55 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1288 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:23:55.991149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-29a7370f-a493-4172-a7f3-ed1cff589271 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969f78280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:56.120213 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-29a7370f-a493-4172-a7f3-ed1cff589271 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.132870 Aug 30 04:23:56.121425 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1663/3389] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:55 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:56.489193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3cd4066d-729e-4886-8ec8-2c34f8d8a764 req-77a3a3fd-b3b8-4895-bbb7-4fc00cdaf4c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46", "tag": "308b9057-99c9-4500-b785-230fa19d288b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:23:56.505699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3cd4066d-729e-4886-8ec8-2c34f8d8a764 req-77a3a3fd-b3b8-4895-bbb7-4fc00cdaf4c0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.520159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3cd4066d-729e-4886-8ec8-2c34f8d8a764 req-77a3a3fd-b3b8-4895-bbb7-4fc00cdaf4c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.521003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3cd4066d-729e-4886-8ec8-2c34f8d8a764 req-77a3a3fd-b3b8-4895-bbb7-4fc00cdaf4c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.552504 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3cd4066d-729e-4886-8ec8-2c34f8d8a764 req-77a3a3fd-b3b8-4895-bbb7-4fc00cdaf4c0 service nova] Creating event network-changed:308b9057-99c9-4500-b785-230fa19d288b for instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 on n-h2-854925-5 Aug 30 04:23:56.566899 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3cd4066d-729e-4886-8ec8-2c34f8d8a764 req-77a3a3fd-b3b8-4895-bbb7-4fc00cdaf4c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074165 Aug 30 04:23:56.571968 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1727/3390] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:23:56.873265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:56.874673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:56.879468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:56.880180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:56.889703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.890576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.891390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.895217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.895915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.898067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.919457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.919965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.920411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:56.921130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:56.921616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:56.922049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:57.147127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:57.157953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da6e6f92-626b-4d2a-98c0-b5c6295b3950 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1276 microversion: 2.1 time: 0.282012 Aug 30 04:23:57.165921 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1728/3391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:56 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:57.177256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:57.184798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5800671f-77b2-4b75-a1b7-f10523f21aba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693c7670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:57.199549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:57.221035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:57.226968 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1cbf58c-6638-4566-975f-4ede139d1f90 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.357590 Aug 30 04:23:57.247547 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1664/3392] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:56 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:57.302406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5800671f-77b2-4b75-a1b7-f10523f21aba tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.135239 Aug 30 04:23:57.303488 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1729/3393] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:57 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:58.179421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:58.180054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:58.192348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:58.192839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:58.193279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:58.206378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:58.206879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:58.212922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:58.262904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:58.264392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:58.283472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:58.295143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:58.295808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:58.296769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:58.297503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:58.298212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:58.411451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:58.421691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49823b32-8b93-4a1a-8cfa-057b46984e54 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1276 microversion: 2.1 time: 0.246420 Aug 30 04:23:58.431317 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1665/3394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:58 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1276 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:58.450133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1deda347-8e93-41f6-9a08-869dc33dfd00 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a6f3af0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:58.549015 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1deda347-8e93-41f6-9a08-869dc33dfd00 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.116091 Aug 30 04:23:58.549657 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1666/3395] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:58 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:58.722274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:58.737311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:58.743460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:58.747365 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41b37de4-0ad0-4380-976b-7a428256b498 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.488715 Aug 30 04:23:58.751084 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1730/3396] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:58 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:23:59.454468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:59.455844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:59.458838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=10 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:23:59.476997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.482200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.483011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:59.483926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.492360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.493618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:59.564645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72b845f7-b473-4bd9-8212-a52f1001a4b9 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693c7ca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:59.639924 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-72b845f7-b473-4bd9-8212-a52f1001a4b9 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.079963 Aug 30 04:23:59.641135 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1731/3397] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:23:59 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:59.762678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:23:59.773548 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b36dfb0-72d2-44c5-a01f-a043b2ee15c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1276 microversion: 2.1 time: 0.325258 Aug 30 04:23:59.775103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:23:59.776088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:23:59.789239 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1667/3398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:23:59 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1276 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:23:59.792292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.792792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.801654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:23:59.802697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:23:59.805186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:23:59.805847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:00.124726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:00.147579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:00.152581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:00.154131 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f0e1cc2-a32f-416d-a2d4-38e5ac616382 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.382871 Aug 30 04:24:00.157077 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1732/3399] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:23:59 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:00.657068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-478884e1-7d6c-444a-aa25-ff5c07e06efa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a063820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:00.738175 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-478884e1-7d6c-444a-aa25-ff5c07e06efa tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.086259 Aug 30 04:24:00.738767 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1668/3400] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:00 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:00.796048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:00.798280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:00.808455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:00.835654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:00.836220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:00.836835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:00.846803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:00.847444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:00.849227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.180385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:01.185378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:01.185750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:01.216468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:01.219725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:01.222993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.225723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:01.226408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:01.229245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:01.614602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:01.632740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:01.635767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:01.640430 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a6ce146b-3b32-4b3a-86dc-624d3feb3801 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.457429 Aug 30 04:24:01.641210 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1669/3401] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:01 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:01.656713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:01.668423 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-add1a2eb-151f-48b7-a778-fc1104e0603d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1318 microversion: 2.1 time: 0.877119 Aug 30 04:24:01.669024 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1733/3402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:00 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1318 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:01.755498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0a951702-4af9-4b33-9b5c-62a0d64de48f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96994b3a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:01.860410 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0a951702-4af9-4b33-9b5c-62a0d64de48f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.111646 Aug 30 04:24:01.869006 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1670/3403] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:01 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:02.034446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-70694e26-40eb-4a32-b469-6daba76d49d9 req-2d35e724-3158-431a-93a1-2609ed22ee74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb375c92-a532-4c37-a8b0-fa947e77db24", "tag": "b2e910fa-5768-4639-bb01-583ea3a0b61f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:02.078042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-70694e26-40eb-4a32-b469-6daba76d49d9 req-2d35e724-3158-431a-93a1-2609ed22ee74 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.082622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-70694e26-40eb-4a32-b469-6daba76d49d9 req-2d35e724-3158-431a-93a1-2609ed22ee74 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.093823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-70694e26-40eb-4a32-b469-6daba76d49d9 req-2d35e724-3158-431a-93a1-2609ed22ee74 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.152718 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-70694e26-40eb-4a32-b469-6daba76d49d9 req-2d35e724-3158-431a-93a1-2609ed22ee74 service nova] Creating event network-changed:b2e910fa-5768-4639-bb01-583ea3a0b61f for instance cb375c92-a532-4c37-a8b0-fa947e77db24 on n-h1-854925-5 Aug 30 04:24:02.197368 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-70694e26-40eb-4a32-b469-6daba76d49d9 req-2d35e724-3158-431a-93a1-2609ed22ee74 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162614 Aug 30 04:24:02.207688 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1734/3404] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:02.473525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6548f105-2d8c-4cfd-9ab6-4120fc85c4a6 req-9062e2ee-e8fa-4b54-8e1b-63ae899fef14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f107c254-cbdf-4265-9715-e9bbb13e8c32", "tag": "c58c9b91-e362-45a6-926d-9df70b39963d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:02.495755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6548f105-2d8c-4cfd-9ab6-4120fc85c4a6 req-9062e2ee-e8fa-4b54-8e1b-63ae899fef14 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.496549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6548f105-2d8c-4cfd-9ab6-4120fc85c4a6 req-9062e2ee-e8fa-4b54-8e1b-63ae899fef14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.497162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6548f105-2d8c-4cfd-9ab6-4120fc85c4a6 req-9062e2ee-e8fa-4b54-8e1b-63ae899fef14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.516807 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6548f105-2d8c-4cfd-9ab6-4120fc85c4a6 req-9062e2ee-e8fa-4b54-8e1b-63ae899fef14 service nova] Creating event network-changed:c58c9b91-e362-45a6-926d-9df70b39963d for instance f107c254-cbdf-4265-9715-e9bbb13e8c32 on n-h2-854925-5 Aug 30 04:24:02.525284 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6548f105-2d8c-4cfd-9ab6-4120fc85c4a6 req-9062e2ee-e8fa-4b54-8e1b-63ae899fef14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055446 Aug 30 04:24:02.526551 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1671/3405] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:02.675318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:02.678835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:02.695773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:02.696844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:02.709113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.722395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.723282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.724098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.730300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.731044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.731603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.732102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.732906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:02.733443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.736120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:02.738286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:02.967284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=26 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:03.083441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:03.098740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:03.100211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:03.102739 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-de773216-262b-4e49-a48f-fcec59dd37fd tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.435344 Aug 30 04:24:03.117684 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1735/3406] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:02 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:03.124711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78585756-b493-4c46-b85b-6e3ffea0a05a tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969383f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:03.198938 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78585756-b493-4c46-b85b-6e3ffea0a05a tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.079609 Aug 30 04:24:03.206127 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1736/3407] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:03 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:03.238585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:03.251304 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-50ba8c23-110d-4e63-8fb2-3d5ff14b29d1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1318 microversion: 2.1 time: 0.559441 Aug 30 04:24:03.257405 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1672/3408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:02 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:04.135401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:04.137134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:04.149622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:04.150536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:04.151313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:04.152460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:04.153921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:04.154599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:04.214704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3e9ca0cf-788e-4f88-817e-6e85f36fbb5b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e401c10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:04.284250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:04.298804 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3e9ca0cf-788e-4f88-817e-6e85f36fbb5b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.088578 Aug 30 04:24:04.299722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1673/3409] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:04 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:04.303437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:04.310214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:04.311120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:04.314177 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-24ca6aec-97a3-4903-8f6b-69dfd6f82cd0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.186253 Aug 30 04:24:04.315204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:04.315371 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1737/3410] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:04 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:04.334120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:04.335685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:04.336143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:04.336881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:04.337374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:04.338264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:05.090934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:05.103259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99c47112-81e9-401f-935d-2f09ebabfc35 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1318 microversion: 2.1 time: 0.799931 Aug 30 04:24:05.104215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1674/3411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:04 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1318 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:05.314069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5cfdbac6-c2e2-4434-82bf-d48c846743f8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969359e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:05.341725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:05.343182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:05.354708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:05.355209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:05.368760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:05.369561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:05.370358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:05.370471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:05.406278 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5cfdbac6-c2e2-4434-82bf-d48c846743f8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.096672 Aug 30 04:24:05.407279 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1738/3412] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:05 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:05.565175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:05.576223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:05.582380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:05.588729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c55830cf-2d24-4e7e-85c3-3afcdb4fcaf0 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.251155 Aug 30 04:24:05.595887 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1675/3413] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:05 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:06.126613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:06.127512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:06.150260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:06.151297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:06.152954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:06.164233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:06.167117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:06.176775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:06.423115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-786e7d90-3e36-41c8-8b6a-c37fc5a124d8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e45b9d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:06.517270 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-786e7d90-3e36-41c8-8b6a-c37fc5a124d8 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.100006 Aug 30 04:24:06.520630 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1676/3414] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:06 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:06.621301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:06.622238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:06.635874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:06.636091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:06.637227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:06.639803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:06.643244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:06.643944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:07.144034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:07.154402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:07.155845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:07.170653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd92b1d4-79ad-41e4-8d3b-dd3573effe81 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.541404 Aug 30 04:24:07.179165 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1677/3415] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:06 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:24:07.235426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:07.245031 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ba3e029-b185-4a74-bfc4-cd36c8ce91d9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1318 microversion: 2.1 time: 1.124635 Aug 30 04:24:07.265789 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1739/3416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:06 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1318 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:07.540316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66e0152c-7ddf-42bd-a24c-90b8741bd72e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e439f70>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:07.645469 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66e0152c-7ddf-42bd-a24c-90b8741bd72e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.111708 Aug 30 04:24:07.647890 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1678/3417] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:07 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:08.194897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:08.195520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:08.213310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:08.215697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:08.216146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:08.216880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:08.217357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:08.228760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:08.272317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:08.275036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:08.291115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:08.292106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:08.292784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:08.295694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:08.296608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:08.302115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:08.363998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:08.436686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:08.457075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:08.465578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:08.479921 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-289ec856-5a1f-4f36-bb4e-0f5c2f2215df tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.275878 Aug 30 04:24:08.480653 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1740/3418] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:08 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:08.660772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-93bb20b0-bcaa-4a6d-83c7-b17234755e9d tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969359430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:08.758129 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-93bb20b0-bcaa-4a6d-83c7-b17234755e9d tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.100886 Aug 30 04:24:08.769046 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1741/3419] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:08 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:09.008983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:09.022141 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de61dd24-6d50-4ccb-882a-5ea9a19d37e0 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1318 microversion: 2.1 time: 0.756462 Aug 30 04:24:09.031243 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1679/3420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:08 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:09.548416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:09.555371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:09.600809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:09.601832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:09.604226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:09.605101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:09.605865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:09.608506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:09.683171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0c5c74a4-74c8-486b-9082-8edba3ce229c req-6f93030f-e6d7-4af6-815b-6a8bbbb5f7ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f107c254-cbdf-4265-9715-e9bbb13e8c32", "name": "network-vif-plugged", "status": "completed", "tag": "c58c9b91-e362-45a6-926d-9df70b39963d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:09.705649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c5c74a4-74c8-486b-9082-8edba3ce229c req-6f93030f-e6d7-4af6-815b-6a8bbbb5f7ff service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:09.709296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c5c74a4-74c8-486b-9082-8edba3ce229c req-6f93030f-e6d7-4af6-815b-6a8bbbb5f7ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:09.710103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c5c74a4-74c8-486b-9082-8edba3ce229c req-6f93030f-e6d7-4af6-815b-6a8bbbb5f7ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:09.742062 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0c5c74a4-74c8-486b-9082-8edba3ce229c req-6f93030f-e6d7-4af6-815b-6a8bbbb5f7ff service nova] Creating event network-vif-plugged:c58c9b91-e362-45a6-926d-9df70b39963d for instance f107c254-cbdf-4265-9715-e9bbb13e8c32 on n-h2-854925-5 Aug 30 04:24:09.755763 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0c5c74a4-74c8-486b-9082-8edba3ce229c req-6f93030f-e6d7-4af6-815b-6a8bbbb5f7ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573933 Aug 30 04:24:09.759951 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1742/3421] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:09.775333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:09.778037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-760dfddc-f3e8-4784-a30f-a153367f065b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969348310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:09.808449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:09.818009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:09.830915 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0e0c71c-87d8-4f51-bde6-202192f256a7 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1603 microversion: 2.42 time: 0.291271 Aug 30 04:24:09.846623 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1680/3422] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:09 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1603 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:09.866144 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-760dfddc-f3e8-4784-a30f-a153367f065b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1452 microversion: 2.1 time: 0.093745 Aug 30 04:24:09.866856 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1743/3423] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:09 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:10.055240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:10.056468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:10.071631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:10.073601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:10.077956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:10.079290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:10.080995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:10.082356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:10.388802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:10.400811 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5740ad81-a483-40e0-83fc-255a5fb8848d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1318 microversion: 2.1 time: 0.351434 Aug 30 04:24:10.402362 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1681/3424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:10 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:10.866913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:10.868574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:10.886690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-669b5da6-9662-4de6-aade-15775a981e91 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9698fbdc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:10.899307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:10.902370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:10.903335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:10.925750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:10.927552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:10.928315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:10.993916 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-669b5da6-9662-4de6-aade-15775a981e91 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1461 microversion: 2.1 time: 0.112573 Aug 30 04:24:10.994504 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1682/3425] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:10 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1461 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:11.008612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8126714-8c21-40f2-884a-da4c46c09ce6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a8043a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:11.019768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.020359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.022921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.024111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lazy-loading 'fault' on Instance uuid 98710227-9190-41c0-83ab-36b2eb2693c7 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:24:11.076198 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8126714-8c21-40f2-884a-da4c46c09ce6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 200 len: 1461 microversion: 2.1 time: 0.071008 Aug 30 04:24:11.087745 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1683/3426] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:11 2022] GET /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:11.098544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:11.099241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:11.101510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:11.113548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.114062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.114503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.115221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.116792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:11.117134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.117621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.119754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3d11c8cca77843b4a3fab73e81cb6978', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4475ca7f6b8743ae924217827522984f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:11.121552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51482955-57ed-4d3d-829d-e359e1f9bd42 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 200 len: 1608 microversion: 2.42 time: 0.265396 Aug 30 04:24:11.122997 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1744/3427] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:10 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 1608 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:24:11.428538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:11.429274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:11.436205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.446975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.448028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.449060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.450049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.451758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.492831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:11.509564 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-65f1781d-7520-431a-847b-706d4199e745 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1481 microversion: 2.1 time: 0.420587 Aug 30 04:24:11.510951 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1684/3428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:11 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1481 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:11.724333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:11.738665 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e89bed7-e9e0-404b-9184-966e20e6d600 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1468 microversion: 2.1 time: 0.317030 Aug 30 04:24:11.739662 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1745/3429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:11 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1468 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:11.761261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:11.761932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:11.779427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-60f2e651-d7ba-4148-aad0-22eda1dc8e2e req-6e8d73f9-6601-4353-89dd-6a0ef1a256df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb375c92-a532-4c37-a8b0-fa947e77db24", "name": "network-vif-plugged", "status": "completed", "tag": "b2e910fa-5768-4639-bb01-583ea3a0b61f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:11.798045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.798578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.799024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.799763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.800199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.809996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-60f2e651-d7ba-4148-aad0-22eda1dc8e2e req-6e8d73f9-6601-4353-89dd-6a0ef1a256df service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:11.810857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.818562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-60f2e651-d7ba-4148-aad0-22eda1dc8e2e req-6e8d73f9-6601-4353-89dd-6a0ef1a256df service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:11.819150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-60f2e651-d7ba-4148-aad0-22eda1dc8e2e req-6e8d73f9-6601-4353-89dd-6a0ef1a256df service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:11.841787 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-60f2e651-d7ba-4148-aad0-22eda1dc8e2e req-6e8d73f9-6601-4353-89dd-6a0ef1a256df service nova] Creating event network-vif-plugged:b2e910fa-5768-4639-bb01-583ea3a0b61f for instance cb375c92-a532-4c37-a8b0-fa947e77db24 on n-h1-854925-5 Aug 30 04:24:11.855480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-60f2e651-d7ba-4148-aad0-22eda1dc8e2e req-6e8d73f9-6601-4353-89dd-6a0ef1a256df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079633 Aug 30 04:24:11.870099 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1746/3430] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:12.153854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:12.155303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:12.171067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:12.171678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:12.172238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:12.173099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:12.173765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:12.174348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:12.194614 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] HTTP exception thrown: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Request method failure captured: Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 HTTP/1.1 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY816rzejF_LxaAHJVgKjoMk8D1UplK2IVULu9ZuNKcmvsDtzIDQdgiRZdQfk8hHUm2K90I3zxKxmprTkcDrLLLoOICqzQ_TmXHN0ZjGnOLbn72RdovZSI0JMWR0DVn7YPBL9c2mERhtEZAGc5xz-G1QojhhgZSbLwaL23b2Lq7Fk7s Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4475ca7f6b8743ae924217827522984f Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4475ca7f6b8743ae924217827522984f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4475ca7f6b8743ae924217827522984f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4475ca7f6b8743ae924217827522984f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4475ca7f6b8743ae924217827522984f"}]}] Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4475ca7f6b8743ae924217827522984f Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TaggedBootDevicesTest_v242-537263177-project Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3d11c8cca77843b4a3fab73e81cb6978 Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TaggedBootDevicesTest_v242-537263177-project Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '98710227-9190-41c0-83ab-36b2eb2693c7'} Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:12.195858 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:12.201042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Returning 404 to user: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:12.202091 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e2529a5a-3f27-494d-b98e-f22d84223511 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 404 len: 111 microversion: 2.42 time: 0.056937 Aug 30 04:24:12.203895 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1747/3431] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:12 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:24:12.214139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea06e9be-e7d2-4cec-a532-3443b801d697 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '.version_select at 0x7fe969359550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:12.237974 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea06e9be-e7d2-4cec-a532-3443b801d697 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63939338" status: 204 len: 0 microversion: 2.42 time: 0.029321 Aug 30 04:24:12.238892 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1748/3432] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:24:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63939338 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:24:12.328938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:12.341354 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-719dcf90-432e-41fb-b7f2-c850c6de2727 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 200 len: 1318 microversion: 2.1 time: 0.584898 Aug 30 04:24:12.344354 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1685/3433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:11 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:12.532878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:12.533549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:12.544575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:12.544909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:12.546101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:12.546880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:12.548388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:12.549519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:12.753534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:12.768661 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c5dafbf-df70-4baa-9a24-45f77a83446b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1468 microversion: 2.1 time: 0.241059 Aug 30 04:24:12.769379 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1749/3434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:12 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1468 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:12.793920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-409028967"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:12.796436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:12.808628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:12.809125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:12.809590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:12.810295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:12.819088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:12.819575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:13.088932 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-10a16eaa-f643-448f-9daa-b3dee96d1a28 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "POST /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0/action" status: 202 len: 0 microversion: 2.1 time: 0.299584 Aug 30 04:24:13.089911 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1686/3435] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:24:12 2022] POST /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:24:13.100397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19e4d2ae-d962-45a8-a1e1-e7e7501f330e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969938040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:13.156876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19e4d2ae-d962-45a8-a1e1-e7e7501f330e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.059754 Aug 30 04:24:13.158028 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1750/3436] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:13 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:13.388771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:13.389727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:13.405264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:13.407382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:13.407922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:13.409532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:13.415301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:13.415799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:13.658973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:13.668161 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49a35dab-c796-4927-9579-48c07a9f4e69 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 200 len: 1318 microversion: 2.1 time: 0.306575 Aug 30 04:24:13.682655 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1687/3437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:13 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:14.173996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2c8a8fa-6e98-4ffc-9393-463f4cddc91e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693719d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:14.254440 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2c8a8fa-6e98-4ffc-9393-463f4cddc91e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.086801 Aug 30 04:24:14.255588 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1751/3438] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:14 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:14.694896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:14.696366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:14.707358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:14.711529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:14.712591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:14.714546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:14.716900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:14.717909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:14.719920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.004903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:15.016644 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc97a1b3-e9d7-4ba9-ac5b-d5898cf849a1 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 200 len: 1468 microversion: 2.1 time: 0.328580 Aug 30 04:24:15.017254 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1688/3439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:14 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 1468 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:15.039833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:15.045847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:15.047648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Searching by: {'reservation_id': 'r-x25000ej', 'deleted': False, 'project_id': '697646bb2dfd47598fee27be7a58eeeb'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:24:15.063712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.064755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.065268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.066483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.067184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.067858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.269565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef5768e7-5065-4e64-ad98-f937b1aa9255 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a59c0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:15.296037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:24:15.357542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef5768e7-5065-4e64-ad98-f937b1aa9255 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.092135 Aug 30 04:24:15.359663 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1689/3440] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:15 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:15.475904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fa317a21-aa18-44e8-9287-649a481f0b3e req-75a373f4-6ef3-4425-8fec-0dcd0c7e0c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a02175-d9f3-4f57-9db1-618596566c85", "name": "network-vif-unplugged", "status": "completed", "tag": "78448671-cdb4-443f-ae74-c0c03dd6955b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:15.483033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:15.490871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:15.495743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.496608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.497382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.513975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa317a21-aa18-44e8-9287-649a481f0b3e req-75a373f4-6ef3-4425-8fec-0dcd0c7e0c06 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.516804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa317a21-aa18-44e8-9287-649a481f0b3e req-75a373f4-6ef3-4425-8fec-0dcd0c7e0c06 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.518876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa317a21-aa18-44e8-9287-649a481f0b3e req-75a373f4-6ef3-4425-8fec-0dcd0c7e0c06 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.571317 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fa317a21-aa18-44e8-9287-649a481f0b3e req-75a373f4-6ef3-4425-8fec-0dcd0c7e0c06 service nova] Creating event network-vif-unplugged:78448671-cdb4-443f-ae74-c0c03dd6955b for instance 76a02175-d9f3-4f57-9db1-618596566c85 on n-h1-854925-5 Aug 30 04:24:15.587551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fa317a21-aa18-44e8-9287-649a481f0b3e req-75a373f4-6ef3-4425-8fec-0dcd0c7e0c06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115432 Aug 30 04:24:15.592432 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1690/3441] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:15.730446 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-69a8b5a2-75b0-42f5-8899-10ac6f311bcf tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/detail?reservation_id=r-x25000ej" status: 200 len: 2929 microversion: 2.1 time: 0.695415 Aug 30 04:24:15.731632 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1752/3442] 10.222.0.27 () {58 vars in 1197 bytes} [Tue Aug 30 04:24:15 2022] GET /compute/v2.1/servers/detail?reservation_id=r-x25000ej => generated 2929 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:15.756882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-536fedf9-9192-4b21-a027-c66d84e6d580 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:15.774118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.server_groups [None req-536fedf9-9192-4b21-a027-c66d84e6d580 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Querying cell ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) for 2 instances {{(pid=122402) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 04:24:15.774914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-536fedf9-9192-4b21-a027-c66d84e6d580 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.775398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-536fedf9-9192-4b21-a027-c66d84e6d580 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.776105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-536fedf9-9192-4b21-a027-c66d84e6d580 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.802452 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-536fedf9-9192-4b21-a027-c66d84e6d580 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/a4f8d81d-2b9f-418b-a4b0-49f85931e70d" status: 200 len: 271 microversion: 2.1 time: 0.050509 Aug 30 04:24:15.803848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1691/3443] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:24:15 2022] GET /compute/v2.1/os-server-groups/a4f8d81d-2b9f-418b-a4b0-49f85931e70d => generated 271 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:15.814483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:15.815118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:15.822634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.823337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.823903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:15.824757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:15.825043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:15.825616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:16.082037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c988a5ee-68f3-429c-b4f0-1443b4d76926 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 200 len: 1619 microversion: 2.1 time: 0.270267 Aug 30 04:24:16.083399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1753/3444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:15 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 1619 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:16.106548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:16.108092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:16.126547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:16.131038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:16.131589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:16.134172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:16.135799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:16.136550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:16.372813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-090482d9-8b87-49b2-944b-f636f106f232 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969374f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:16.426539 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-090482d9-8b87-49b2-944b-f636f106f232 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.057735 Aug 30 04:24:16.434771 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1754/3445] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:16 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:16.490554 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c2c98f0c-f390-45b6-8902-d2c260dc18f0 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 200 len: 1619 microversion: 2.1 time: 0.389475 Aug 30 04:24:16.491971 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1692/3446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:16 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 1619 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:16.689854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1852241099", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "3f9d33f1-b907-43a7-95d7-52827d7877c1"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:16.810697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:24:17.445593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c83e4072-fec0-4bda-9f6b-0ddd3927f395 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e45b670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:17.585853 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c83e4072-fec0-4bda-9f6b-0ddd3927f395 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.148024 Aug 30 04:24:17.587058 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1693/3447] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:17 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:17.809596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:24:17.810172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:24:17.810636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:24:17.811245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:24:17.811873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:24:17.831576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:17.832349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:17.832992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:17.835795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:17.836515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:17.837148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:17.861369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:17.885600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:24:17.896131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:24:17.914590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:24:17.918120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:24:17.988009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8cce8428-4a4a-4336-bebd-0c4166bee144 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302864 Aug 30 04:24:17.989919 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1755/3448] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:24:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:24:18.003519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c30d1f2-7021-4955-9ee1-f3add2cdd09d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:18.003519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c30d1f2-7021-4955-9ee1-f3add2cdd09d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:18.084341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c30d1f2-7021-4955-9ee1-f3add2cdd09d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:18.092732 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c30d1f2-7021-4955-9ee1-f3add2cdd09d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1217 microversion: 2.1 time: 0.096557 Aug 30 04:24:18.106155 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1694/3449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:17 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:18.600988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-49139295-4be2-4a70-81a9-82f4ec195743 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969989d30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:18.697038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-49139295-4be2-4a70-81a9-82f4ec195743 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.100572 Aug 30 04:24:18.701673 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1756/3450] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:18 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:19.117724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d22494bd-97c3-495d-b2e3-41ead56e238c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:19.118423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d22494bd-97c3-495d-b2e3-41ead56e238c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:19.295630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d22494bd-97c3-495d-b2e3-41ead56e238c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:19.309079 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d22494bd-97c3-495d-b2e3-41ead56e238c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1217 microversion: 2.1 time: 0.196685 Aug 30 04:24:19.315358 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1695/3451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:19 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:19.717878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5fc1f19d-5715-405d-8032-497aaf7396a5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969374dc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:19.850566 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5fc1f19d-5715-405d-8032-497aaf7396a5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.137506 Aug 30 04:24:19.854609 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1757/3452] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:19 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:20.338891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:20.340274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:20.351589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.353484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.360200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:20.361276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.362634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.364691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:20.527240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:20.543550 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84cb8fba-7dfb-465b-acc9-505d4dd62120 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1269 microversion: 2.1 time: 0.211970 Aug 30 04:24:20.550065 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1696/3453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:20 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1269 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:20.716549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:20.717055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:20.730401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.731434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.731434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:20.732077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.732610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.733048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:20.770847 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] HTTP exception thrown: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Request method failure captured: Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 HTTP/1.1 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY816rzejF_LxaAHJVgKjoMk8D1UplK2IVULu9ZuNKcmvsDtzIDQdgiRZdQfk8hHUm2K90I3zxKxmprTkcDrLLLoOICqzQ_TmXHN0ZjGnOLbn72RdovZSI0JMWR0DVn7YPBL9c2mERhtEZAGc5xz-G1QojhhgZSbLwaL23b2Lq7Fk7s Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4475ca7f6b8743ae924217827522984f Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4475ca7f6b8743ae924217827522984f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4475ca7f6b8743ae924217827522984f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4475ca7f6b8743ae924217827522984f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4475ca7f6b8743ae924217827522984f"}]}] Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4475ca7f6b8743ae924217827522984f Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TaggedBootDevicesTest_v242-537263177-project Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3d11c8cca77843b4a3fab73e81cb6978 Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TaggedBootDevicesTest_v242-537263177-project Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '98710227-9190-41c0-83ab-36b2eb2693c7'} Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:20.772654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Returning 404 to user: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3857ad85-7965-4273-91d0-39a85b3ebdf4 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "DELETE /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 404 len: 111 microversion: 2.42 time: 0.064149 Aug 30 04:24:20.780509 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1758/3454] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:24:20 2022] DELETE /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:24:20.785134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:20.785790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] [instance: 98710227-9190-41c0-83ab-36b2eb2693c7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:20.798406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.801004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.810677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:20.813398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:20.814267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:20.816827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:20.862722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] HTTP exception thrown: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Request method failure captured: Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 HTTP/1.1 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY816rzejF_LxaAHJVgKjoMk8D1UplK2IVULu9ZuNKcmvsDtzIDQdgiRZdQfk8hHUm2K90I3zxKxmprTkcDrLLLoOICqzQ_TmXHN0ZjGnOLbn72RdovZSI0JMWR0DVn7YPBL9c2mERhtEZAGc5xz-G1QojhhgZSbLwaL23b2Lq7Fk7s Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.42 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4475ca7f6b8743ae924217827522984f Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4475ca7f6b8743ae924217827522984f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4475ca7f6b8743ae924217827522984f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4475ca7f6b8743ae924217827522984f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4475ca7f6b8743ae924217827522984f"}]}] Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4475ca7f6b8743ae924217827522984f Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-537263177 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TaggedBootDevicesTest_v242-537263177-project Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 3d11c8cca77843b4a3fab73e81cb6978 Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TaggedBootDevicesTest_v242-537263177-project Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '98710227-9190-41c0-83ab-36b2eb2693c7'} Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.865908 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. Aug 30 04:24:20.870577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:20.871167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb8b743d-78ce-4e8e-99a9-148ddfa6e2ab tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969348e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:20.875478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] Returning 404 to user: Instance 98710227-9190-41c0-83ab-36b2eb2693c7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:20.876830 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03fc085d-368c-408e-bb86-b26871fcda05 tempest-TaggedBootDevicesTest_v242-537263177 tempest-TaggedBootDevicesTest_v242-537263177-project] 10.222.0.27 "GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7" status: 404 len: 111 microversion: 2.42 time: 0.096197 Aug 30 04:24:20.881378 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1697/3455] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:24:20 2022] GET /compute/v2.1/servers/98710227-9190-41c0-83ab-36b2eb2693c7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:24:21.022808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb8b743d-78ce-4e8e-99a9-148ddfa6e2ab tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.158121 Aug 30 04:24:21.026162 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1759/3456] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:20 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:21.588973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:21.591028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:21.618260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:21.618768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:21.619219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:21.626511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:21.628832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:21.630771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:21.651399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-45ff0f86-82b6-4501-abec-7791c0efb263 req-41b62a22-1997-476f-b9cf-c2dc01c30950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0", "name": "network-vif-plugged", "status": "completed", "tag": "063977e0-19b2-4875-a3fd-2f8c5b5b8529"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:21.688854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45ff0f86-82b6-4501-abec-7791c0efb263 req-41b62a22-1997-476f-b9cf-c2dc01c30950 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:21.689194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45ff0f86-82b6-4501-abec-7791c0efb263 req-41b62a22-1997-476f-b9cf-c2dc01c30950 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:21.689651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45ff0f86-82b6-4501-abec-7791c0efb263 req-41b62a22-1997-476f-b9cf-c2dc01c30950 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:21.743457 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-45ff0f86-82b6-4501-abec-7791c0efb263 req-41b62a22-1997-476f-b9cf-c2dc01c30950 service nova] Creating event network-vif-plugged:063977e0-19b2-4875-a3fd-2f8c5b5b8529 for instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 on n-h2-854925-5 Aug 30 04:24:21.756453 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-45ff0f86-82b6-4501-abec-7791c0efb263 req-41b62a22-1997-476f-b9cf-c2dc01c30950 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116133 Aug 30 04:24:21.757650 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1760/3457] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:22.039125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18c08c90-2cf5-42fd-9b02-f2e04d24ee09 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692d6430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:22.072727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:22.091350 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e427640c-2fda-4187-bf3e-16b723507a5c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1275 microversion: 2.1 time: 0.515347 Aug 30 04:24:22.093367 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1698/3458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:21 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1275 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:22.116544 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18c08c90-2cf5-42fd-9b02-f2e04d24ee09 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.081568 Aug 30 04:24:22.117466 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1761/3459] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:22 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:23.113998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:23.115350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:23.126148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:23.131751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:23.132544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0e476a4-fdaa-4c3f-91bf-c2975ad9a903 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692660d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:23.134205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:23.136724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:23.137890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:23.141385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:23.242031 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a0e476a4-fdaa-4c3f-91bf-c2975ad9a903 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.114408 Aug 30 04:24:23.245193 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1762/3460] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:23 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:23.803580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:23.813251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8a7053da-c6de-4fdc-b629-825f1686f752 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.703240 Aug 30 04:24:23.828870 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1699/3461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:23 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:23.940895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8146cb00-e2e2-4f67-bbc2-9a2d2b9b983e tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Calling method '.version_select at 0x7fe9692d6940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:23.983517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-8146cb00-e2e2-4f67-bbc2-9a2d2b9b983e tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:24:23.984512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-8146cb00-e2e2-4f67-bbc2-9a2d2b9b983e tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Neutron security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:24:23.985387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8146cb00-e2e2-4f67-bbc2-9a2d2b9b983e tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] HTTP exception thrown: Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist Aug 30 04:24:23.985387 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-d0876658-06a4-4727-b500-028e3027a18d'] Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8146cb00-e2e2-4f67-bbc2-9a2d2b9b983e tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Request method failure captured: Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-security-groups/6ca1c82a-35f2-4ca5-8827-2bc6947b84cb HTTP/1.1 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZD2DCZGuxazg22_Tc3yqyZ026tEb1NGLpBUTxeox7wOXQKfKiXfRK8TBU-iQ7Yz0OJcIZK3EJsgHXkcekZPvdZ4O8i9nxQdL1nr5VmeN2YXhsJwx6_DvZbEEXmhBV_ziqsB0WLy65TDqDUbtbwJTPMOazxoDtDTvrLCvQL1jpnOJWI Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4392de6d4db84e4e805bc595b308c4bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}] Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 56074d42a5154c288c031c8bcdacd359 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-d0876658-06a4-4727-b500-028e3027a18d'] Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '6ca1c82a-35f2-4ca5-8827-2bc6947b84cb'} Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:24:23.989110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0876658-06a4-4727-b500-028e3027a18d'] Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0876658-06a4-4727-b500-028e3027a18d'] Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0876658-06a4-4727-b500-028e3027a18d'] Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d0876658-06a4-4727-b500-028e3027a18d'] Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8146cb00-e2e2-4f67-bbc2-9a2d2b9b983e tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Returning 404 to user: Security group 6ca1c82a-35f2-4ca5-8827-2bc6947b84cb does not exist Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-d0876658-06a4-4727-b500-028e3027a18d'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8146cb00-e2e2-4f67-bbc2-9a2d2b9b983e tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/6ca1c82a-35f2-4ca5-8827-2bc6947b84cb" status: 404 len: 194 microversion: 2.1 time: 0.743952 Aug 30 04:24:23.995096 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1763/3462] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:24:23 2022] DELETE /compute/v2.1/os-security-groups/6ca1c82a-35f2-4ca5-8827-2bc6947b84cb => generated 194 bytes in 745 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:24.005728 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb21f83b-56de-4c43-9bbb-25dbe07e5add tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005188 Aug 30 04:24:24.006791 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1700/3463] 10.222.0.27 () {58 vars in 1164 bytes} [Tue Aug 30 04:24:23 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 04:24:24.035463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df563940-083b-47bc-b020-02e9d40a1d4b tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Calling method '.version_select at 0x7fe969a5dd30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:24.261014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b87378c9-f217-46c4-beb0-a73b184a198b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e40b1f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:24.347133 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b87378c9-f217-46c4-beb0-a73b184a198b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.091988 Aug 30 04:24:24.350735 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1701/3464] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:24 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:24.487237 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df563940-083b-47bc-b020-02e9d40a1d4b tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.469809 Aug 30 04:24:24.487868 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1764/3465] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:24:24 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:24.502941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-626c439a-8762-46a7-bd6d-87074dbd5a73 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Calling method '.version_select at 0x7fe9699f2790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:24.852148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:24.853033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:24.871480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:24.875328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:24.879111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:24.885086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:24.888536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:24.895358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:25.994342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-626c439a-8762-46a7-bd6d-87074dbd5a73 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:24:25.995941 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-626c439a-8762-46a7-bd6d-87074dbd5a73 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 30 04:24:25.995941 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-c7fbd8c4-638b-4d60-a447-51fc405a26b9'] Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-626c439a-8762-46a7-bd6d-87074dbd5a73 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Request method failure captured: Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/os-security-groups/9a6b320e-14be-45b1-83a6-d6dee86faf40 HTTP/1.1 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZD2DCZGuxazg22_Tc3yqyZ026tEb1NGLpBUTxeox7wOXQKfKiXfRK8TBU-iQ7Yz0OJcIZK3EJsgHXkcekZPvdZ4O8i9nxQdL1nr5VmeN2YXhsJwx6_DvZbEEXmhBV_ziqsB0WLy65TDqDUbtbwJTPMOazxoDtDTvrLCvQL1jpnOJWI Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4392de6d4db84e4e805bc595b308c4bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}] Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 56074d42a5154c288c031c8bcdacd359 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: exception: Insufficient rights for removing default security group. Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-c7fbd8c4-638b-4d60-a447-51fc405a26b9'] Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9a6b320e-14be-45b1-83a6-d6dee86faf40'} Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:24:26.001247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fbd8c4-638b-4d60-a447-51fc405a26b9'] Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fbd8c4-638b-4d60-a447-51fc405a26b9'] Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fbd8c4-638b-4d60-a447-51fc405a26b9'] Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c7fbd8c4-638b-4d60-a447-51fc405a26b9'] Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-626c439a-8762-46a7-bd6d-87074dbd5a73 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-c7fbd8c4-638b-4d60-a447-51fc405a26b9'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-626c439a-8762-46a7-bd6d-87074dbd5a73 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] 10.222.0.27 "DELETE /compute/v2.1/os-security-groups/9a6b320e-14be-45b1-83a6-d6dee86faf40" status: 400 len: 182 microversion: 2.1 time: 1.504157 Aug 30 04:24:26.006222 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1702/3466] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 04:24:24 2022] DELETE /compute/v2.1/os-security-groups/9a6b320e-14be-45b1-83a6-d6dee86faf40 => generated 182 bytes in 1506 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:24:26.017420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb3d52e4-c935-4148-98c3-8286c2d491d3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9698e7b80>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:26.099774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:26.108577 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aa1caba3-f77a-4ad8-ae07-3d7f05a794cd tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 1.260291 Aug 30 04:24:26.117042 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1765/3467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:24 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:26.141774 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb3d52e4-c935-4148-98c3-8286c2d491d3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.134594 Aug 30 04:24:26.143152 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1703/3468] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:26 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:26.169092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a18ae1a-424b-42f2-b883-aa1c2dbf8a46 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Calling method '.version_select at 0x7fe9692d6820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:26.235732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG neutronclient.v2_0.client [None req-9a18ae1a-424b-42f2-b883-aa1c2dbf8a46 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist", "detail": ""}} {{(pid=122403) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:24:26.236352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-9a18ae1a-424b-42f2-b883-aa1c2dbf8a46 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Neutron security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 not found {{(pid=122403) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:24:26.236890 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-9a18ae1a-424b-42f2-b883-aa1c2dbf8a46 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] HTTP exception thrown: Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist Aug 30 04:24:26.236890 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-6d32ded5-60e4-4404-a97f-14d9ce15740d'] Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a18ae1a-424b-42f2-b883-aa1c2dbf8a46 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Request method failure captured: Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-security-groups/450fa44e-2f03-4dda-af94-5ef9b6ad1a51 HTTP/1.1 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZD2DCZGuxazg22_Tc3yqyZ026tEb1NGLpBUTxeox7wOXQKfKiXfRK8TBU-iQ7Yz0OJcIZK3EJsgHXkcekZPvdZ4O8i9nxQdL1nr5VmeN2YXhsJwx6_DvZbEEXmhBV_ziqsB0WLy65TDqDUbtbwJTPMOazxoDtDTvrLCvQL1jpnOJWI Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4392de6d4db84e4e805bc595b308c4bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}] Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 56074d42a5154c288c031c8bcdacd359 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: exception: Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-6d32ded5-60e4-4404-a97f-14d9ce15740d'] Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '450fa44e-2f03-4dda-af94-5ef9b6ad1a51'} Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:24:26.238965 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d32ded5-60e4-4404-a97f-14d9ce15740d'] Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d32ded5-60e4-4404-a97f-14d9ce15740d'] Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d32ded5-60e4-4404-a97f-14d9ce15740d'] Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6d32ded5-60e4-4404-a97f-14d9ce15740d'] Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a18ae1a-424b-42f2-b883-aa1c2dbf8a46 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Returning 404 to user: Security group 450fa44e-2f03-4dda-af94-5ef9b6ad1a51 does not exist Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: Neutron server returns request_ids: ['req-6d32ded5-60e4-4404-a97f-14d9ce15740d'] {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:26.244389 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a18ae1a-424b-42f2-b883-aa1c2dbf8a46 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] 10.222.0.27 "GET /compute/v2.1/os-security-groups/450fa44e-2f03-4dda-af94-5ef9b6ad1a51" status: 404 len: 194 microversion: 2.1 time: 0.122369 Aug 30 04:24:26.248230 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1766/3469] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:24:26 2022] GET /compute/v2.1/os-security-groups/450fa44e-2f03-4dda-af94-5ef9b6ad1a51 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:26.255591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18cad31a-bdf7-477c-81e7-f8a4c1521517 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Action: 'update', calling method: .version_select at 0x7fe96e40bc10>, body: {"security_group": {"name": "tempest-sg-1915685771", "description": "tempest-description-1431199732"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:26.429255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG neutronclient.v2_0.client [None req-18cad31a-bdf7-477c-81e7-f8a4c1521517 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist", "detail": ""}} {{(pid=122402) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 30 04:24:26.430311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.security_group_api [None req-18cad31a-bdf7-477c-81e7-f8a4c1521517 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Neutron security group 3423269f-f933-48fa-9911-67a9ee96cce5 not found {{(pid=122402) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 30 04:24:26.431096 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-18cad31a-bdf7-477c-81e7-f8a4c1521517 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] HTTP exception thrown: Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist Aug 30 04:24:26.431096 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-81c4d58a-4ff7-4b7b-9f78-26142b5b918d'] Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18cad31a-bdf7-477c-81e7-f8a4c1521517 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Request method failure captured: Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/os-security-groups/3423269f-f933-48fa-9911-67a9ee96cce5 HTTP/1.1 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 102 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZD2DCZGuxazg22_Tc3yqyZ026tEb1NGLpBUTxeox7wOXQKfKiXfRK8TBU-iQ7Yz0OJcIZK3EJsgHXkcekZPvdZ4O8i9nxQdL1nr5VmeN2YXhsJwx6_DvZbEEXmhBV_ziqsB0WLy65TDqDUbtbwJTPMOazxoDtDTvrLCvQL1jpnOJWI Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4392de6d4db84e4e805bc595b308c4bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4392de6d4db84e4e805bc595b308c4bd"}]}] Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4392de6d4db84e4e805bc595b308c4bd Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-925905727 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 56074d42a5154c288c031c8bcdacd359 Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-925905727-project Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: {"security_group": {"name": "tempest-sg-1915685771", "description": "tempest-description-1431199732"}} Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: exception: Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-81c4d58a-4ff7-4b7b-9f78-26142b5b918d'] Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '3423269f-f933-48fa-9911-67a9ee96cce5', 'body': {'security_group': {'name': 'tempest-sg-1915685771', 'description': 'tempest-description-1431199732'}}} Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 30 04:24:26.434168 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81c4d58a-4ff7-4b7b-9f78-26142b5b918d'] Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81c4d58a-4ff7-4b7b-9f78-26142b5b918d'] Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81c4d58a-4ff7-4b7b-9f78-26142b5b918d'] Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81c4d58a-4ff7-4b7b-9f78-26142b5b918d'] Aug 30 04:24:26.439852 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:26.444759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18cad31a-bdf7-477c-81e7-f8a4c1521517 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] Returning 404 to user: Security group 3423269f-f933-48fa-9911-67a9ee96cce5 does not exist Aug 30 04:24:26.444759 n-d-854925-5 devstack@n-api.service[122402]: Neutron server returns request_ids: ['req-81c4d58a-4ff7-4b7b-9f78-26142b5b918d'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:26.446729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18cad31a-bdf7-477c-81e7-f8a4c1521517 tempest-SecurityGroupsNegativeTestJSON-925905727 tempest-SecurityGroupsNegativeTestJSON-925905727-project] 10.222.0.27 "PUT /compute/v2.1/os-security-groups/3423269f-f933-48fa-9911-67a9ee96cce5" status: 404 len: 194 microversion: 2.1 time: 0.195581 Aug 30 04:24:26.448399 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1704/3470] 10.222.0.27 () {60 vars in 1290 bytes} [Tue Aug 30 04:24:26 2022] PUT /compute/v2.1/os-security-groups/3423269f-f933-48fa-9911-67a9ee96cce5 => generated 194 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:26.877009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:26.877879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:26.888609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:26.890159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:26.891134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:26.892209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:26.894955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:26.895654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.178879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lazy-loading 'services' on Instance uuid 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:24:27.338845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-09fc5247-6363-4c1b-ad16-1d2425f995e1 req-8cdbd53a-b5c2-4da7-8df3-131bfda07dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a015b05-13a4-42a8-87cc-1df881303bdf", "tag": "1ac49fa9-9d12-4671-9dde-dbc033d7b69d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:27.396015 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-772ca396-becc-48a2-a008-cb8503040d99 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments/5bf14fa5-43da-48c8-948a-7e545239d022" status: 202 len: 0 microversion: 2.1 time: 0.525266 Aug 30 04:24:27.397704 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1767/3471] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:24:26 2022] DELETE /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments/5bf14fa5-43da-48c8-948a-7e545239d022 => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:24:27.406729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-09fc5247-6363-4c1b-ad16-1d2425f995e1 req-8cdbd53a-b5c2-4da7-8df3-131bfda07dad service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.415387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-09fc5247-6363-4c1b-ad16-1d2425f995e1 req-8cdbd53a-b5c2-4da7-8df3-131bfda07dad service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.418263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-09fc5247-6363-4c1b-ad16-1d2425f995e1 req-8cdbd53a-b5c2-4da7-8df3-131bfda07dad service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.421144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:27.439509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:27.475249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-09fc5247-6363-4c1b-ad16-1d2425f995e1 req-8cdbd53a-b5c2-4da7-8df3-131bfda07dad service nova] Creating event network-changed:1ac49fa9-9d12-4671-9dde-dbc033d7b69d for instance 6a015b05-13a4-42a8-87cc-1df881303bdf on n-h1-854925-5 Aug 30 04:24:27.480996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.496035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.496560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.505479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:27.506152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:27.506601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:27.520817 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-09fc5247-6363-4c1b-ad16-1d2425f995e1 req-8cdbd53a-b5c2-4da7-8df3-131bfda07dad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.558999 Aug 30 04:24:27.532056 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1705/3472] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:27.566541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5e9bafe7-81bb-40f2-98af-feb60aba4372 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96994b430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:27.857463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:27.908618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:28.450247 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5e9bafe7-81bb-40f2-98af-feb60aba4372 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.916543 Aug 30 04:24:28.453174 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1706/3473] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:27 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:28.463797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:28.474225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:28.493019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.493698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.494246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.495666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:28.498040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:28.498768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:28.588497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-020c13df-f91f-49bc-97e4-025e065c485d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133805 Aug 30 04:24:28.595239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:28.610858 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-145c27c1-c11e-40ae-beed-dba4428ffb0a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 1.207159 Aug 30 04:24:28.614244 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1707/3474] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:28 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:28.626642 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1768/3475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:27 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:29.473773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-42b8136b-b9f9-49ee-bbb2-6053d436438b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a3f0160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:29.517625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:29.629392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:29.636273 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-42b8136b-b9f9-49ee-bbb2-6053d436438b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.169344 Aug 30 04:24:29.638857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:29.639270 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1708/3476] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:29 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:29.644847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:29.663238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:29.664965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:29.677535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:29.680495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:29.685503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:29.687512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:29.692270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:29.693613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:29.694437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:29.697483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:29.704570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:29.708675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:29.710037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:29.814992 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8f66bcef-fabb-472b-84ec-94a63361b991 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192503 Aug 30 04:24:29.818835 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1769/3477] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:29 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:30.100491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:30.111581 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25f761c9-b32e-42b3-a6ab-e57f82f6cf1e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.470964 Aug 30 04:24:30.116036 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1709/3478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:29 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:30.652311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7c9b3bf-b26f-447e-9e90-43be1e753323 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693718b0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:30.736556 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7c9b3bf-b26f-447e-9e90-43be1e753323 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.088119 Aug 30 04:24:30.737151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1770/3479] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:30 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:30.832053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:30.845240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:30.868894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:30.869433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:30.869870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:30.870584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:30.871042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:30.871466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:30.884038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:30.983173 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6870a73-4395-46c5-bf45-e855ae401dd6 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156045 Aug 30 04:24:30.986091 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1710/3480] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:30 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:31.137192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:31.138236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:31.152578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.155658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.156520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.159373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:31.161298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:31.162402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:31.566159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:31.581449 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e3e6ecf6-038f-4bf5-9c81-a506357b73e7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.443760 Aug 30 04:24:31.584678 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1771/3481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:31 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:31.754793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7bb4122f-d2f6-42e8-8cbd-9c60cc8317a1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a3f0d30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:31.880820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7bb4122f-d2f6-42e8-8cbd-9c60cc8317a1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.132424 Aug 30 04:24:31.883364 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1711/3482] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:31 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:31.999631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:32.003681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:32.034342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.035988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.036305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.037013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.037833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.042077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.118288 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29a9fde6-4de7-405f-b245-10efa46d2503 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125471 Aug 30 04:24:32.122044 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1772/3483] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:31 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:32.606209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:32.607189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:32.622751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.626136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.628361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.632745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:32.633638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:32.635035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:32.898090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-edc9a796-989b-4a64-b527-ead776b5d6d4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969938040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:32.982075 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-edc9a796-989b-4a64-b527-ead776b5d6d4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.089637 Aug 30 04:24:32.982668 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1773/3484] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:32 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:33.135580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:33.144179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:33.175396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.175669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.182052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.185022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:33.186486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:33.188539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:33.315557 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc033c7b-750b-4ebd-9b97-73a94b1bcd56 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188384 Aug 30 04:24:33.317608 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1774/3485] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:33 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:33.532930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:33.546950 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b557043b-f1b6-48d6-9763-3544f20ed6c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.947825 Aug 30 04:24:33.548251 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1712/3486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:32 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:33.998049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10d792d6-cee4-4935-ab25-e87aac5b4a50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693483a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:34.105939 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10d792d6-cee4-4935-ab25-e87aac5b4a50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.106986 Aug 30 04:24:34.108852 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1775/3487] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:33 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:34.329061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:34.331730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:34.371493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.372857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.373313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.374819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.379510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.379985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.522355 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5bc4ce8d-099c-41b6-80e8-dc5d26b3c9bf tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197755 Aug 30 04:24:34.523519 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1713/3488] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:34 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:34.576530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:34.577502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:34.592219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.593275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.594793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:34.599008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:34.601675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:34.603396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:35.129908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63607a44-ce47-4280-9b2e-1c22490bfad3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692bf940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:35.212481 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63607a44-ce47-4280-9b2e-1c22490bfad3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.091293 Aug 30 04:24:35.213649 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1714/3489] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:35 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:35.419163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:35.432624 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-696d8094-fd9e-4068-8479-8618b3f01204 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.861024 Aug 30 04:24:35.433783 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1776/3490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:34 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:35.538901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:35.542577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:35.562080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:35.562986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:35.563841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:35.566711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:35.568823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:35.569544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:35.698800 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a877723-359d-4051-9cfc-90af1cf5c92e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165012 Aug 30 04:24:35.707501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1715/3491] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:35 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:36.231717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b8ef4348-b6cd-4298-a1f1-7dca96fad16a tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969293160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:36.339406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b8ef4348-b6cd-4298-a1f1-7dca96fad16a tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.112370 Aug 30 04:24:36.341734 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1777/3492] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:36 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:36.470761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:36.472272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:36.479392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:36.480622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:36.481590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:36.482819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:36.483652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:36.484306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:36.714796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:36.718119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:36.744972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:36.749729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:36.751544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:36.752538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:36.753316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:36.754037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:36.808226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:36.821485 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d2a9899-0cdc-4db3-b525-002e49e97062 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.356868 Aug 30 04:24:36.822865 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1716/3493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:36 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:36.848172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-092c25cc-4fb1-4096-bda4-05d8f4d82474 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137564 Aug 30 04:24:36.850639 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1778/3494] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:36 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:37.361835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af215388-461c-4f4d-ae0f-4a42082f1542 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96925f940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:37.733119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7fdaa9b7-c854-419b-9496-1ced145ad6bd req-708752e6-dc3a-484e-8ec5-918a28d34fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a015b05-13a4-42a8-87cc-1df881303bdf", "name": "network-vif-plugged", "status": "completed", "tag": "1ac49fa9-9d12-4671-9dde-dbc033d7b69d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:37.759435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7fdaa9b7-c854-419b-9496-1ced145ad6bd req-708752e6-dc3a-484e-8ec5-918a28d34fb3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:37.759950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7fdaa9b7-c854-419b-9496-1ced145ad6bd req-708752e6-dc3a-484e-8ec5-918a28d34fb3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:37.760390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7fdaa9b7-c854-419b-9496-1ced145ad6bd req-708752e6-dc3a-484e-8ec5-918a28d34fb3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:37.797433 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7fdaa9b7-c854-419b-9496-1ced145ad6bd req-708752e6-dc3a-484e-8ec5-918a28d34fb3 service nova] Creating event network-vif-plugged:1ac49fa9-9d12-4671-9dde-dbc033d7b69d for instance 6a015b05-13a4-42a8-87cc-1df881303bdf on n-h1-854925-5 Aug 30 04:24:37.849102 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7fdaa9b7-c854-419b-9496-1ced145ad6bd req-708752e6-dc3a-484e-8ec5-918a28d34fb3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119761 Aug 30 04:24:37.850318 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1779/3495] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:37.856886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:37.858075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:37.879308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:37.879908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:37.880429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:37.881217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:37.881705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:37.882142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:38.144060 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af215388-461c-4f4d-ae0f-4a42082f1542 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.792101 Aug 30 04:24:38.144986 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1717/3496] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:37 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:38.158377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:38.179690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:38.233854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:38.247381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:38.247645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:38.248409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:38.248915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:38.249372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:38.379538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-605c8f8d-fd76-4a98-9be8-06b638e8b452 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232720 Aug 30 04:24:38.380154 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1718/3497] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:38 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:38.400170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:38.412007 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf89d5dc-c825-4506-b38f-6a6be28609d2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.559364 Aug 30 04:24:38.413673 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1780/3498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:37 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:39.162213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89ab6dca-e88b-45d8-b25e-fbf644ca3a97 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96931b550>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:39.406929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:39.413876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:39.448430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.455190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.460874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.463029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.467172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.468378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.570524 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89ab6dca-e88b-45d8-b25e-fbf644ca3a97 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.414362 Aug 30 04:24:39.571120 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1719/3499] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:39 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:39.598654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:39.599292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:39.606171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fe69a8a6-e45a-460d-930f-473e496aa131 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.216538 Aug 30 04:24:39.614855 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1781/3500] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:24:39 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46/os-volume_attachments => generated 25 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:24:39.665356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.668011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.669660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.671444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.674739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.675209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.768242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:39.772047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:39.805066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.809867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.810572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.812356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.813998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.816768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.906602 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Cannot 'reboot' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action HTTP/1.1 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 28 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: {"reboot": {"type": "HARD"}} Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'reboot' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'bed32086-1deb-4867-ba21-ecef253f35df', 'body': {'reboot': {'type': 'HARD'}}} Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bed32086-1deb-4867-ba21-ecef253f35df in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:24:39.910204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:39.915025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:39.929191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 409 to user: Cannot 'reboot' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:39.930162 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f05522a5-0a32-4ed4-afa4-950705a441ac tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action" status: 409 len: 145 microversion: 2.1 time: 0.166464 Aug 30 04:24:39.931183 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1782/3501] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:24:39 2022] POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action => generated 145 bytes in 168 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:24:39.946008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:39.967582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:39.977467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.987343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.990002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:39.991857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:39.993169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:39.993930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.058101 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Cannot 'rebuild' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action HTTP/1.1 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 65 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'rebuild' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'bed32086-1deb-4867-ba21-ecef253f35df', 'body': {'rebuild': {'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2'}}} Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bed32086-1deb-4867-ba21-ecef253f35df in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:24:40.067769 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 409 to user: Cannot 'rebuild' instance bed32086-1deb-4867-ba21-ecef253f35df while it is in vm_state rescued {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:40.074633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c65991e-4b54-4581-b84c-f87d5799d11b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action" status: 409 len: 146 microversion: 2.1 time: 0.135017 Aug 30 04:24:40.080478 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1783/3502] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:24:39 2022] POST /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df/action => generated 146 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:24:40.086980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:40.088528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:40.102785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.103519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.103757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.104490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.104960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.105736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.147353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:24:40.222520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:40.234248 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-734ec3e0-5ef1-447a-a83b-d7d1a4c5c510 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1317 microversion: 2.1 time: 0.652932 Aug 30 04:24:40.241519 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1720/3503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:39 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1317 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:40.589722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-101c3324-1be6-40d7-a338-6bf62a4a5aef tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a8040d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:40.774668 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-101c3324-1be6-40d7-a338-6bf62a4a5aef tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.190191 Aug 30 04:24:40.775703 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1721/3504] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:40 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:40.845501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:40.932420 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d696b37b-39dd-4413-ad92-1a5078fed4a0 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 204 len: 0 microversion: 2.1 time: 0.849251 Aug 30 04:24:40.933009 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1784/3505] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:24:40 2022] DELETE /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:24:40.942758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:40.943405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:40.971626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.973161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.976725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:40.980911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:40.981584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:40.982133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.266606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:41.267628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:41.280298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:41.282968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:41.285092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.288100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:41.288828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:41.289734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.343884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:41.355970 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d4f91d0f-1369-414c-a236-9ba539b65e38 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1688 microversion: 2.1 time: 0.415924 Aug 30 04:24:41.359477 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1722/3506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:40 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1688 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:41.700037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:41.711579 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0775d06-bc30-43e5-9a0f-7164ffc8cf1a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1466 microversion: 2.1 time: 0.450569 Aug 30 04:24:41.713193 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1785/3507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:41 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1466 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:41.741965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:41.743223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:41.756313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:41.757143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:41.757798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.758843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:41.759474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:41.760648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:41.789864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4270877-b027-42dc-94b6-859cef061dbc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969383310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:41.932519 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4270877-b027-42dc-94b6-859cef061dbc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.145949 Aug 30 04:24:41.935182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1786/3508] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:41 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:42.080606 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c013586-d206-4107-80e2-b815b8945564 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1617 microversion: 2.1 time: 0.351167 Aug 30 04:24:42.081648 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1723/3509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:41 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1617 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:42.380723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:42.381772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:42.395240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:42.398065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:42.398786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:42.400060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:42.403447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:42.404170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:42.492201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1708902312", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["3f9d33f1-b907-43a7-95d7-52827d7877c1"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:42.622414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:24:42.830869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:42.843488 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1440d4b4-94e6-4a97-8639-9b6caedea287 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1688 microversion: 2.1 time: 0.467003 Aug 30 04:24:42.848507 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1787/3510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:42 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1688 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:42.949639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-645f923f-9494-430e-9f5c-9a75b7173e88 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969385700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:43.052254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:24:43.052896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:24:43.053423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:24:43.053840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:24:43.054255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:24:43.056928 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-645f923f-9494-430e-9f5c-9a75b7173e88 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.111183 Aug 30 04:24:43.059498 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1788/3511] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:42 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:43.067298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.067792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.068496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:43.069773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.070252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.070751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:43.095289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:24:43.101433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:24:43.120485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:24:43.124839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:24:43.241252 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e274c66-cf80-4e18-9c73-c3430d43bdeb tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754622 Aug 30 04:24:43.242196 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1724/3512] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:24:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:24:43.253487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a01a674d-17d4-465b-8638-880808ac09f9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:43.254295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a01a674d-17d4-465b-8638-880808ac09f9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:43.579491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a01a674d-17d4-465b-8638-880808ac09f9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:43.590101 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a01a674d-17d4-465b-8638-880808ac09f9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1217 microversion: 2.1 time: 0.340793 Aug 30 04:24:43.602241 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1789/3513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:43 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1217 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:43.869155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:43.870422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:43.943969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.944489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.947800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:43.949627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:43.951692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:43.954250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:44.083241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-caae559a-a8ee-451b-88af-3684efc4e563 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969367ee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:44.189354 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-caae559a-a8ee-451b-88af-3684efc4e563 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.116177 Aug 30 04:24:44.191940 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1790/3514] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:44 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:44.303865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.316837 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f31d71e-842f-4369-a9dc-369d5d97617b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1688 microversion: 2.1 time: 0.451948 Aug 30 04:24:44.318231 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1725/3515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:43 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1688 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:44.633913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cfefc387-8372-49df-9481-1cc5331763b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:44.635380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cfefc387-8372-49df-9481-1cc5331763b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:44.850928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cfefc387-8372-49df-9481-1cc5331763b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:44.859030 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cfefc387-8372-49df-9481-1cc5331763b2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1217 microversion: 2.1 time: 0.239546 Aug 30 04:24:44.867367 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1791/3516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:44 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1217 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:45.205482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89a0a413-40ad-403e-8ccf-d5e98471caf5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96931b8b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:45.294319 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89a0a413-40ad-403e-8ccf-d5e98471caf5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.093811 Aug 30 04:24:45.295459 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1726/3517] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:45 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:45.339432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:45.340367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:45.362542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.363052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.374718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.378923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.379784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.380458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.883439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:45.884582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:45.886981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:45.925368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.933168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.933903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:45.934687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:45.935170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:45.940456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:46.047264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:46.055626 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc51d866-6494-44b0-81cd-a068ff6ffb26 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1688 microversion: 2.1 time: 0.721161 Aug 30 04:24:46.066759 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1792/3518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:45 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1688 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:46.314363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ab79dfb-63e8-4ac3-b208-203c64adcb7b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969374430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:46.321713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:46.334925 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-48e2b8bd-9d7d-4aa7-9c17-d8381361a4e2 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1269 microversion: 2.1 time: 0.455407 Aug 30 04:24:46.368931 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1727/3519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:45 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1269 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:46.422839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ab79dfb-63e8-4ac3-b208-203c64adcb7b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.112404 Aug 30 04:24:46.435561 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1793/3520] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:46 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:47.094967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:47.095603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:47.120359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:47.120858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:47.121309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.125186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:47.125955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:47.126564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.400080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:47.400989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:47.403501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:47.426435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:47.430014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:47.430932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.435424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:47.436558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:47.437007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:47.726645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:47.753771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51653d8e-175a-4909-8608-921cb9ef8e01 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1287 microversion: 2.1 time: 0.387429 Aug 30 04:24:47.779016 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1794/3521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:47 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1287 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:47.801408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-441e33da-895b-426d-841d-3f257639f099 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96933fd30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:47.822795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:47.850325 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-43480058-9888-45ed-976f-9aad6ac6551d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1688 microversion: 2.1 time: 0.762814 Aug 30 04:24:47.855364 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1728/3522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:47 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1688 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:47.897045 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-441e33da-895b-426d-841d-3f257639f099 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.112321 Aug 30 04:24:47.902905 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1795/3523] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:47 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:48.776748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:48.777726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:48.796663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.797455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.814056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.824023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.824640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.825276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.875815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:48.876494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:48.912114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.919456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.921222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:48.930477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:48.933620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:48.937508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.147681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:49.164347 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-04ba0aa2-4b20-4325-b9fd-ab687a46c3a9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1275 microversion: 2.1 time: 0.391414 Aug 30 04:24:49.185521 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1729/3524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:48 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1275 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:49.198774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a18a32e4-cbaa-4619-8870-11c5ac0a06df tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96925fdc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:49.231074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:49.254667 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ab919e1-a38b-4516-b7c0-646f2bd4b036 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1621 microversion: 2.1 time: 0.379371 Aug 30 04:24:49.257944 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1796/3525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:48 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1621 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:49.339868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e05e5b2c-2350-4895-8100-2385bfb18d21 req-302e4a4e-ac27-48fa-b912-d5c460400d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46", "name": "network-vif-deleted", "tag": "308b9057-99c9-4500-b785-230fa19d288b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:49.346845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a18a32e4-cbaa-4619-8870-11c5ac0a06df tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1452 microversion: 2.1 time: 0.159847 Aug 30 04:24:49.351151 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1730/3526] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:49 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:49.372135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e05e5b2c-2350-4895-8100-2385bfb18d21 req-302e4a4e-ac27-48fa-b912-d5c460400d60 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:49.372548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e05e5b2c-2350-4895-8100-2385bfb18d21 req-302e4a4e-ac27-48fa-b912-d5c460400d60 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:49.372989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e05e5b2c-2350-4895-8100-2385bfb18d21 req-302e4a4e-ac27-48fa-b912-d5c460400d60 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:49.456466 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e05e5b2c-2350-4895-8100-2385bfb18d21 req-302e4a4e-ac27-48fa-b912-d5c460400d60 service nova] Creating event network-vif-deleted:308b9057-99c9-4500-b785-230fa19d288b for instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 on n-h2-854925-5 Aug 30 04:24:49.489007 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e05e5b2c-2350-4895-8100-2385bfb18d21 req-302e4a4e-ac27-48fa-b912-d5c460400d60 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153194 Aug 30 04:24:49.495722 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1797/3527] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:50.188326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.189411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.210744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.222064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.222679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.226890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.227519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.228225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.280986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.282658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:50.299898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.322112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.324727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.325780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.333820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.334913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.430105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:50.435591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:50.442147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:50.442860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lazy-loading 'fault' on Instance uuid 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:24:50.737112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:50.749017 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18a9b9ec-9652-49b4-a50a-cbaade03184b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 200 len: 1335 microversion: 2.1 time: 0.470333 Aug 30 04:24:50.749919 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1798/3528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 1335 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:50.762230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a020ab72-9227-4c46-92d1-af2c135c97dd tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96933f550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.857156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a020ab72-9227-4c46-92d1-af2c135c97dd tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1461 microversion: 2.1 time: 0.103169 Aug 30 04:24:50.866194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1799/3529] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1461 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:50.880236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3d32d04-8e64-428c-96fb-d819fad207ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969383670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:50.974696 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c3d32d04-8e64-428c-96fb-d819fad207ca tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 200 len: 1461 microversion: 2.1 time: 0.098468 Aug 30 04:24:50.975293 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1800/3530] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 1461 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:51.002759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:51.008290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:51.024366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.026480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.031207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.032178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.036133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.036844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.239232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:51.248949 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0abb35c5-1cd6-4ea9-a70d-e96b60e041ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 1.064754 Aug 30 04:24:51.252494 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1731/3531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:51.612520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:51.629645 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-994fa491-bec6-4bd2-a1aa-12a64e4e2ee2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1480 microversion: 2.1 time: 0.637124 Aug 30 04:24:51.635158 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1801/3532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:50 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1480 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:51.773023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:51.773802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:51.783297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.783789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.784226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.784935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:51.785528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:51.785960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:51.852265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 could not be found. Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 HTTP/1.1 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 could not be found. Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46'} Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 could not be found. Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 could not be found. Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:51.860325 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 could not be found. Aug 30 04:24:51.866003 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:24:51.869374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 404 to user: Instance 2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:24:51.875228 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-81dbd476-e87a-4d45-a358-b5c3c906c43e tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46" status: 404 len: 111 microversion: 2.1 time: 0.105986 Aug 30 04:24:51.882107 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1732/3533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:51 2022] GET /compute/v2.1/servers/2fdcdfd3-865b-4d2b-8bcb-9f41aad71c46 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:24:51.890503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0aaadc1-b5cf-47c0-984e-9b91c8b8c620 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '.version_select at 0x7fe9692d6a60>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:51.940643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a0aaadc1-b5cf-47c0-984e-9b91c8b8c620 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-375704477" status: 202 len: 0 microversion: 2.1 time: 0.053604 Aug 30 04:24:51.945304 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1802/3534] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:24:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-375704477 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:24:52.272755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:52.274163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:52.284210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.287526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.290524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.291930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.293989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.294683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.653815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:52.655223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:52.675190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.675954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.677009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:52.678086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:52.678779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:52.679331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.080979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:53.109466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:53.412595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:53.431153 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f21d788-660f-42df-b060-22b65b2617c1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1467 microversion: 2.1 time: 0.781477 Aug 30 04:24:53.452791 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1803/3535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:52 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1467 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:24:53.454155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:53.466648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-417066779"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:53.469821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:53.488790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.489317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.489792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.490524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:53.490694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-80055193-3f2a-4837-b73c-30379d0e35ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 1.213065 Aug 30 04:24:53.490983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:53.491410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:53.505431 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1733/3536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:52 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:53.974851 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6316c103-1de6-41d7-8468-3701f1907888 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "POST /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85/action" status: 202 len: 0 microversion: 2.1 time: 0.511730 Aug 30 04:24:53.976981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1804/3537] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:24:53 2022] POST /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:24:53.987803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e35ef4e-3517-4226-ac2b-8e11608647f6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692cd1f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:54.083852 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e35ef4e-3517-4226-ac2b-8e11608647f6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.101063 Aug 30 04:24:54.085981 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1734/3538] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:53 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:54.518374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:54.519480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:54.544498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.545771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.546085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.567393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:54.567994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:54.568452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:54.859346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:54.992410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0c89c849-5b8f-4bcf-a0be-c547c9ddd70f req-1d636cf2-b806-4c2a-b124-2f2cef5af92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0", "name": "network-vif-unplugged", "status": "completed", "tag": "063977e0-19b2-4875-a3fd-2f8c5b5b8529"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:55.018317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0c89c849-5b8f-4bcf-a0be-c547c9ddd70f req-1d636cf2-b806-4c2a-b124-2f2cef5af92d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.021112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0c89c849-5b8f-4bcf-a0be-c547c9ddd70f req-1d636cf2-b806-4c2a-b124-2f2cef5af92d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.024683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0c89c849-5b8f-4bcf-a0be-c547c9ddd70f req-1d636cf2-b806-4c2a-b124-2f2cef5af92d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.066557 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0c89c849-5b8f-4bcf-a0be-c547c9ddd70f req-1d636cf2-b806-4c2a-b124-2f2cef5af92d service nova] Creating event network-vif-unplugged:063977e0-19b2-4875-a3fd-2f8c5b5b8529 for instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 on n-h2-854925-5 Aug 30 04:24:55.091455 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0c89c849-5b8f-4bcf-a0be-c547c9ddd70f req-1d636cf2-b806-4c2a-b124-2f2cef5af92d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103415 Aug 30 04:24:55.101673 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1735/3539] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:55.120084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-442a21b5-b3a1-4e01-acbe-dd88eea9a527 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692cda60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:55.201638 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-442a21b5-b3a1-4e01-acbe-dd88eea9a527 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.097245 Aug 30 04:24:55.204893 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1736/3540] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:55 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:55.384023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d9b3ccf6-d25b-41c7-aad1-d8c37000713e req-c5a2e739-67c1-44fd-a780-1c4bfdb4415b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1892b8-c352-4d48-8593-dd46d7347909", "tag": "deb8e28e-beed-4d0f-98a8-bc395104d445"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:55.404043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9b3ccf6-d25b-41c7-aad1-d8c37000713e req-c5a2e739-67c1-44fd-a780-1c4bfdb4415b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:55.405352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:55.405925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9b3ccf6-d25b-41c7-aad1-d8c37000713e req-c5a2e739-67c1-44fd-a780-1c4bfdb4415b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:55.406589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9b3ccf6-d25b-41c7-aad1-d8c37000713e req-c5a2e739-67c1-44fd-a780-1c4bfdb4415b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:55.421151 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e271960-4226-44dd-8a4b-7b1cb2608544 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 0.907948 Aug 30 04:24:55.429282 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1805/3541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:54 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:55.435866 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d9b3ccf6-d25b-41c7-aad1-d8c37000713e req-c5a2e739-67c1-44fd-a780-1c4bfdb4415b service nova] Creating event network-changed:deb8e28e-beed-4d0f-98a8-bc395104d445 for instance ab1892b8-c352-4d48-8593-dd46d7347909 on n-h1-854925-5 Aug 30 04:24:55.446243 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d9b3ccf6-d25b-41c7-aad1-d8c37000713e req-c5a2e739-67c1-44fd-a780-1c4bfdb4415b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066494 Aug 30 04:24:55.449190 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1737/3542] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:24:56.220022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3298ce39-2b4f-4b2f-9e82-36a010195610 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693830d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:56.283464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3298ce39-2b4f-4b2f-9e82-36a010195610 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.068540 Aug 30 04:24:56.284621 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1806/3543] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:56 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:56.455668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:56.457101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:56.466701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.467466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.468143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.469102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:56.470650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:56.471403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:56.502995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:24:57.105774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:57.118180 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89046136-254c-4237-8180-15640ee2e759 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 0.668518 Aug 30 04:24:57.120404 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1738/3544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:56 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:57.299603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dbc1e3f6-581f-4736-aa20-035a5ccf92e4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693b1ca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:57.385600 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dbc1e3f6-581f-4736-aa20-035a5ccf92e4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.080786 Aug 30 04:24:57.386333 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1807/3545] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:57 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:58.146672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:58.148061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:24:58.164803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.166474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.167938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.169704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:24:58.171904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:24:58.172713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:24:58.542521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a973e6f-b136-4057-a4dd-2c666b9cfa38 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Action: 'create', calling method: .version_select at 0x7fe96933ff70>, body: {"keypair": {"name": "tempest-keypair-731287238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM0I4fRj9YvKKvfaKYSy+jjEar2FtbvYadmWgJ7DRlVrZ5Qb6OCq+zTtPnd6aRVQ5Ehrk5Rr5Z/KsWToJeySFXH2+fJYmVkGV7COvITX9mNB6PC/WJ7A4f3BJ/+DQQIQw=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:24:58.617303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5a973e6f-b136-4057-a4dd-2c666b9cfa38 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Getting quotas for project 9f54901782b046dd88fffca8ea054109. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:24:58.631640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5a973e6f-b136-4057-a4dd-2c666b9cfa38 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Getting quotas for user b773ad51ff6048f898ce7db8eba855e6 and project 9f54901782b046dd88fffca8ea054109. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:24:58.682335 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a973e6f-b136-4057-a4dd-2c666b9cfa38 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.381101 Aug 30 04:24:58.684205 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1808/3546] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:24:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:24:58.694323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e7438d74-257b-4560-b208-ce4c02791f17 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693b15e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:58.793568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e7438d74-257b-4560-b208-ce4c02791f17 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.106087 Aug 30 04:24:58.805981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1809/3547] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:58 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:59.039397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:24:59.065454 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f27f142d-f7cb-445b-b95d-7221f3065095 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 0.924441 Aug 30 04:24:59.066146 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1739/3548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:24:58 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:24:59.813918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-efa7be1c-805c-4379-851e-66fe33908ad2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969383040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:24:59.878347 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-efa7be1c-805c-4379-851e-66fe33908ad2 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.067764 Aug 30 04:24:59.880204 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1810/3549] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:24:59 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:00.086925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:00.087656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:00.104217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.104716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.112079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.113148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:00.116220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:00.116678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:00.894816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5088895f-554a-461b-9ed9-b01568eddae3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969385d30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:01.030844 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5088895f-554a-461b-9ed9-b01568eddae3 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.140972 Aug 30 04:25:01.047586 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1811/3550] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:00 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:01.264218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:01.276870 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30978e4c-e6b5-41f4-b3a9-5a3c758387aa tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 1.194138 Aug 30 04:25:01.278832 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1740/3551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:00 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:02.048951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36adfbb3-37f0-4b71-b3fa-f3d3b959f30f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692d6940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:02.155099 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36adfbb3-37f0-4b71-b3fa-f3d3b959f30f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.111796 Aug 30 04:25:02.177888 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1812/3552] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:02 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:02.299954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:02.300799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:02.319405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:02.319911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:02.320571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:02.322122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:02.323906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:02.332125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:03.174481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c31ceb0-fc7a-4fe0-805b-e3b1b1fb7a91 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9694f2700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:03.277186 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c31ceb0-fc7a-4fe0-805b-e3b1b1fb7a91 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.108621 Aug 30 04:25:03.293412 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1813/3553] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:03 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:03.522028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:03.537970 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8ffb040c-1fb9-4baf-ba77-7db903609850 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 1.240101 Aug 30 04:25:03.539486 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1741/3554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:02 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:04.301978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-774a2e15-e164-4106-ba1a-8bedfa44b9c5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96933ff70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:04.337609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "391096cb-5be9-4328-a858-d01b85d52ce6"}], "security_groups": [{"name": "tempest-securitygroup--2122881351"}], "key_name": "tempest-keypair-731287238", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:04.406381 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-774a2e15-e164-4106-ba1a-8bedfa44b9c5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.109925 Aug 30 04:25:04.411035 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1814/3555] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:04 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:04.437008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:04.438049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:04.471406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.471908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.472344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.473047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.505716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.507341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.598164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:04.626825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] validate_networks() for [('391096cb-5be9-4328-a858-d01b85d52ce6', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:25:04.843076 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd028566-19db-4c1d-86d8-c3beb3eaccf7 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 204 len: 0 microversion: 2.1 time: 0.429032 Aug 30 04:25:04.845471 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1815/3556] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:04 2022] DELETE /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:04.868160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:04.871261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:04.920834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.921645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.923315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:04.924706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:04.925697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:04.926332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.265608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:05.281424 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0a9a84f1-58b3-41cd-aba2-9f6c0987162d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 0.427602 Aug 30 04:25:05.284388 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1816/3557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:04 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:05.292804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-084c1ff5-d624-4db4-8d00-da69d8bf664f req-2383cb35-fef4-4817-83f0-736f07bbfc9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a02175-d9f3-4f57-9db1-618596566c85", "name": "network-vif-plugged", "status": "completed", "tag": "78448671-cdb4-443f-ae74-c0c03dd6955b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:05.303764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-084c1ff5-d624-4db4-8d00-da69d8bf664f req-2383cb35-fef4-4817-83f0-736f07bbfc9f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.304383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-084c1ff5-d624-4db4-8d00-da69d8bf664f req-2383cb35-fef4-4817-83f0-736f07bbfc9f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.304662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-084c1ff5-d624-4db4-8d00-da69d8bf664f req-2383cb35-fef4-4817-83f0-736f07bbfc9f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.318222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-084c1ff5-d624-4db4-8d00-da69d8bf664f req-2383cb35-fef4-4817-83f0-736f07bbfc9f service nova] Creating event network-vif-plugged:78448671-cdb4-443f-ae74-c0c03dd6955b for instance 76a02175-d9f3-4f57-9db1-618596566c85 on n-h1-854925-5 Aug 30 04:25:05.323808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-084c1ff5-d624-4db4-8d00-da69d8bf664f req-2383cb35-fef4-4817-83f0-736f07bbfc9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038131 Aug 30 04:25:05.324411 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1817/3558] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:05.335395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:05.336357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:05.344409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.345160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.345803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.346677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.347300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.347898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.381921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:05.653630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:25:05.654178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:25:05.654569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:25:05.654985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:25:05.655401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:25:05.674996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.675494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.675935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.676667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:05.677129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:05.677577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:05.686592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:05.696608 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8e67535d-9db9-4c92-831d-d8c923975913 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1507 microversion: 2.1 time: 0.365648 Aug 30 04:25:05.702277 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1818/3559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:05 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1507 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:05.708472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0257c9bb-574a-4985-aedf-65ddfa12fe74 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9694f20d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:05.719212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Getting quotas for project 9f54901782b046dd88fffca8ea054109. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:25:05.732542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Getting quotas for user b773ad51ff6048f898ce7db8eba855e6 and project 9f54901782b046dd88fffca8ea054109. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:25:05.762525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:25:05.767922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:25:05.777571 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0257c9bb-574a-4985-aedf-65ddfa12fe74 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.072590 Aug 30 04:25:05.778499 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1819/3560] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:05 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:05.844678 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b10ae399-007d-4c75-a1dd-592fe11e8fdf tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.513283 Aug 30 04:25:05.858475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5464af9-410b-47b4-bb0a-82a0328ad5af tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:05.859483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5464af9-410b-47b4-bb0a-82a0328ad5af tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:05.862529 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1742/3561] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:25:04 2022] POST /compute/v2.1/servers => generated 409 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:25:06.012951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b5464af9-410b-47b4-bb0a-82a0328ad5af tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:06.026797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5464af9-410b-47b4-bb0a-82a0328ad5af tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1225 microversion: 2.1 time: 0.168676 Aug 30 04:25:06.033038 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1820/3562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:05 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1225 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:06.307071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:06.307723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:06.323536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:06.324566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:06.325306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.326897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:06.327567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:06.328185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.686077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:06.700686 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0451aa7-b090-417c-8b0e-0de755a30811 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 0.398343 Aug 30 04:25:06.715622 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1743/3563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:06 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:06.723293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:06.724544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:06.734383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:06.742117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:06.742584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.743347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:06.743816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:06.744252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:06.793951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-711b3a3d-d5e0-46c8-8d20-d71a471fb95d tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96b13d0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:06.883356 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-711b3a3d-d5e0-46c8-8d20-d71a471fb95d tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.093794 Aug 30 04:25:06.893153 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1744/3564] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:06 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:07.056542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:07.057311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:07.070978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.071648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.072586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.075976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.077007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.078447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.185786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:07.198347 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bbdf2dfb-f210-44a2-8416-f687d9469246 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1507 microversion: 2.1 time: 0.478941 Aug 30 04:25:07.201661 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1821/3565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:06 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1507 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:07.207913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:07.230621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-150df30a-3b72-4f98-9581-3c5680110db0 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1221 microversion: 2.1 time: 0.167984 Aug 30 04:25:07.234213 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1745/3566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:07 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:07.774625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:07.782668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:07.803381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.803891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.804320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.805034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:07.805523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:07.809901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:07.899446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74503c9e-ec58-4251-ad34-557c71e34847 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692c84c0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:08.005210 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74503c9e-ec58-4251-ad34-557c71e34847 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.109586 Aug 30 04:25:08.006491 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1746/3567] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:07 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:08.072158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-715d546c-4efe-404b-9030-ea1eea32024e req-ed056195-9752-4797-9926-ea6fa6c5640c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1892b8-c352-4d48-8593-dd46d7347909", "name": "network-vif-plugged", "status": "completed", "tag": "deb8e28e-beed-4d0f-98a8-bc395104d445"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:08.096152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-715d546c-4efe-404b-9030-ea1eea32024e req-ed056195-9752-4797-9926-ea6fa6c5640c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.098957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-715d546c-4efe-404b-9030-ea1eea32024e req-ed056195-9752-4797-9926-ea6fa6c5640c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.100276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-715d546c-4efe-404b-9030-ea1eea32024e req-ed056195-9752-4797-9926-ea6fa6c5640c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.124703 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-715d546c-4efe-404b-9030-ea1eea32024e req-ed056195-9752-4797-9926-ea6fa6c5640c service nova] Creating event network-vif-plugged:deb8e28e-beed-4d0f-98a8-bc395104d445 for instance ab1892b8-c352-4d48-8593-dd46d7347909 on n-h1-854925-5 Aug 30 04:25:08.136744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-715d546c-4efe-404b-9030-ea1eea32024e req-ed056195-9752-4797-9926-ea6fa6c5640c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068270 Aug 30 04:25:08.147182 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1747/3568] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:25:08.221563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:08.222965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:08.234799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.241242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.241937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.242875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.243511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.244506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.503189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:08.514872 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-528bfb2c-b26b-4b47-8ac6-96eb922fd33b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 0.791715 Aug 30 04:25:08.515477 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1822/3569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:07 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:08.527293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:08.529300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:08.542111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.545358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.547526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.548734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:08.551269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:08.552874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:08.604323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:08.629006 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-535bbcf2-2faa-473a-8508-9e93b3714df4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1507 microversion: 2.1 time: 0.411766 Aug 30 04:25:08.641414 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1748/3570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:08 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1507 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:09.021239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b79bc28-8ca0-444f-9e39-5c0233cfd45e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a1d53a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:09.097966 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b79bc28-8ca0-444f-9e39-5c0233cfd45e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.081330 Aug 30 04:25:09.098576 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1749/3571] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:09 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:09.122028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:09.132576 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9d365cd-ffed-44e5-a348-caabd36b3365 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1283 microversion: 2.1 time: 0.613681 Aug 30 04:25:09.137783 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1823/3572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:08 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1283 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:09.544111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:09.545017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:09.566031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.568926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.570707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:09.571810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.573788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.577937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:09.667044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:09.668010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:09.689456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.692580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.693487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:09.697754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:09.698105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:09.698694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:10.015754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:10.029747 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5752584a-6e0c-467b-b8aa-048565deaba4 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1465 microversion: 2.1 time: 0.365435 Aug 30 04:25:10.031754 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1824/3573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:09 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1465 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:10.112053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9c5427d4-1466-42b5-8f47-f3404539700b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96947cb80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:10.155549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:10.166778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-838a0842-9c9a-4d47-889e-bbd9f7388d38 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1317 microversion: 2.1 time: 0.630199 Aug 30 04:25:10.167907 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1750/3574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:09 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:10.184704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:10.187027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:10.202552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9c5427d4-1466-42b5-8f47-f3404539700b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.093504 Aug 30 04:25:10.206203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1825/3575] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:10 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:10.217238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:10.219080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:10.219521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:10.221946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:10.223466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:10.224329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:10.275510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-44a0caed-3598-4af7-9161-6b325b53c97b req-5a22dd0d-bb0e-4038-9b32-4656211152e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bed32086-1deb-4867-ba21-ecef253f35df", "name": "network-vif-deleted", "tag": "f8e76d66-3c88-43bc-beb4-023271e1bab3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:10.306427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-44a0caed-3598-4af7-9161-6b325b53c97b req-5a22dd0d-bb0e-4038-9b32-4656211152e8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:10.307152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-44a0caed-3598-4af7-9161-6b325b53c97b req-5a22dd0d-bb0e-4038-9b32-4656211152e8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:10.307602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-44a0caed-3598-4af7-9161-6b325b53c97b req-5a22dd0d-bb0e-4038-9b32-4656211152e8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:10.343368 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-44a0caed-3598-4af7-9161-6b325b53c97b req-5a22dd0d-bb0e-4038-9b32-4656211152e8 service nova] Creating event network-vif-deleted:f8e76d66-3c88-43bc-beb4-023271e1bab3 for instance bed32086-1deb-4867-ba21-ecef253f35df on n-h1-854925-5 Aug 30 04:25:10.357959 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-44a0caed-3598-4af7-9161-6b325b53c97b req-5a22dd0d-bb0e-4038-9b32-4656211152e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084937 Aug 30 04:25:10.360274 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1826/3576] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:10.692895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:10.717124 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26fec1ec-f700-43c6-a2c1-c58176e311e1 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1283 microversion: 2.1 time: 0.545492 Aug 30 04:25:10.717848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1751/3577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:10 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1283 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:11.055655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:11.056515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:11.076317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.076886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.077356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.078458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.079099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.079655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.176594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.177086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.178950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.179940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lazy-loading 'fault' on Instance uuid bed32086-1deb-4867-ba21-ecef253f35df {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:25:11.196884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:11.215891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:11.241446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.242562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.243258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.244211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.244937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.245829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.249605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:11.262530 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-49b3cf70-1650-46a5-984e-831f4e66fccd tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 200 len: 1312 microversion: 2.1 time: 0.213896 Aug 30 04:25:11.265446 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1827/3578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:11 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 1312 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:11.301022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cadae68-d2c0-44c6-a715-c9a4e1966341 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969348040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:11.381403 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cadae68-d2c0-44c6-a715-c9a4e1966341 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.114657 Aug 30 04:25:11.384202 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1828/3579] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:11 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:11.603646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:11.613944 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-97473da3-8241-4225-bfec-47bad83ece8b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1467 microversion: 2.1 time: 0.421358 Aug 30 04:25:11.615702 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1752/3580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:11 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1467 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:11.642399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:11.643045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:11.658615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.659291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.660064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.661008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.661719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.662485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.742967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:11.743831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:11.754869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.755658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.756434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:11.757319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:11.762913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:11.763380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.007524 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cea7da2a-2a2f-46fb-89db-800b8f2c1729 tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1618 microversion: 2.1 time: 0.367815 Aug 30 04:25:12.008172 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1829/3581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:11 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1618 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:12.164151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:12.175731 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-908ab6ad-a10e-4411-a296-402848e17695 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1351 microversion: 2.1 time: 0.437089 Aug 30 04:25:12.178984 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1753/3582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:11 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1351 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:12.287407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:12.288781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: bed32086-1deb-4867-ba21-ecef253f35df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:12.299640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.306592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.307169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.308021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.308579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.309085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.328286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-811869345", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3f9d33f1-b907-43a7-95d7-52827d7877c1"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:12.349107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Instance bed32086-1deb-4867-ba21-ecef253f35df could not be found. Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df HTTP/1.1 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance bed32086-1deb-4867-ba21-ecef253f35df could not be found. Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'bed32086-1deb-4867-ba21-ecef253f35df'} Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bed32086-1deb-4867-ba21-ecef253f35df could not be found. Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bed32086-1deb-4867-ba21-ecef253f35df could not be found. Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:12.364957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bed32086-1deb-4867-ba21-ecef253f35df could not be found. Aug 30 04:25:12.370300 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:12.387432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 404 to user: Instance bed32086-1deb-4867-ba21-ecef253f35df could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:12.389035 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef1918fc-788b-4769-924f-d47e55ac2cd8 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df" status: 404 len: 111 microversion: 2.1 time: 0.106484 Aug 30 04:25:12.392255 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1830/3583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:12 2022] GET /compute/v2.1/servers/bed32086-1deb-4867-ba21-ecef253f35df => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:12.402455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b982df98-9ee4-4cf2-8602-bc3ab18593ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969348940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:12.505745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:25:12.547929 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b982df98-9ee4-4cf2-8602-bc3ab18593ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.154074 Aug 30 04:25:12.560200 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1831/3584] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:12 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:12.574942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:12.580284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:12.621886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.622929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.623521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.624104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.624557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.624983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.714446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:12.933163 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ede763b-1748-4d90-a103-a6ca7233988d tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 204 len: 0 microversion: 2.1 time: 0.371500 Aug 30 04:25:12.940903 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1832/3585] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:12 2022] DELETE /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:12.949823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:12.951047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:12.963808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.964315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.964763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:12.965511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:12.966076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:12.966502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.065589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:25:13.066100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:25:13.067422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:25:13.067985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:25:13.068702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:25:13.088115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.093177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.094032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.095818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.096283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.096712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.172993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:25:13.193888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Getting quotas for user 4e9f9b59a77a4e46b5ac74c179c38224 and project 697646bb2dfd47598fee27be7a58eeeb. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:25:13.228927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:25:13.231373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:25:13.347667 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8122b4e4-7c39-495e-bfaf-78b24f1b5762 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025783 Aug 30 04:25:13.361623 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1754/3586] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:25:13.371916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:13.373450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:13.393742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.395802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.397270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.398339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:13.399027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:13.404798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:13.601992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:13.619626 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e212e510-c6f2-4f5b-822c-b3d7d1c6f22b tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.674060 Aug 30 04:25:13.624729 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1833/3587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:12 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:13.655465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ee86631-1350-4702-91a3-e0e73d5d0f9b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:13.657602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ee86631-1350-4702-91a3-e0e73d5d0f9b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:13.879050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0ee86631-1350-4702-91a3-e0e73d5d0f9b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:13.892408 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ee86631-1350-4702-91a3-e0e73d5d0f9b tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1216 microversion: 2.1 time: 0.265976 Aug 30 04:25:13.925454 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1834/3588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:13 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1216 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:13.940850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d702758b-2e43-497f-97ad-bdfda7cbbc39 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9695aeaf0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:13.989932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:13.999533 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4c4d54c-5358-4336-a663-004be20a9a8f tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1351 microversion: 2.1 time: 0.636658 Aug 30 04:25:14.000135 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1755/3589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:13 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1351 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:14.109116 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d702758b-2e43-497f-97ad-bdfda7cbbc39 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.177932 Aug 30 04:25:14.120214 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1835/3590] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:13 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:14.123214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7670b45d-71bc-48dd-9874-cb1ee049dbcd req-d86ad3bf-f20f-497a-ac3b-02812e5af0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ca72e1-8b4d-48e3-bd8d-6ddc94691227", "tag": "ec53bdea-27ca-477d-b33c-085dea1871bb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:14.144976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7670b45d-71bc-48dd-9874-cb1ee049dbcd req-d86ad3bf-f20f-497a-ac3b-02812e5af0d7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.153159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7670b45d-71bc-48dd-9874-cb1ee049dbcd req-d86ad3bf-f20f-497a-ac3b-02812e5af0d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.155894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7670b45d-71bc-48dd-9874-cb1ee049dbcd req-d86ad3bf-f20f-497a-ac3b-02812e5af0d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:14.187532 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7670b45d-71bc-48dd-9874-cb1ee049dbcd req-d86ad3bf-f20f-497a-ac3b-02812e5af0d7 service nova] Creating event network-changed:ec53bdea-27ca-477d-b33c-085dea1871bb for instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 on n-h2-854925-5 Aug 30 04:25:14.197486 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7670b45d-71bc-48dd-9874-cb1ee049dbcd req-d86ad3bf-f20f-497a-ac3b-02812e5af0d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078545 Aug 30 04:25:14.205189 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1756/3591] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:25:14.646321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:14.647480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:14.668667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.671714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.672741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:14.679378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.682250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.682946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:14.949299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:14.954459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:14.963698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.966635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.967200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:14.968221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:14.969092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:14.969782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:15.084493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:15.094769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e877a2c-9c38-4f93-9e64-b94a85f1359c tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.453899 Aug 30 04:25:15.099494 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1836/3592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:14 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:15.109252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:15.109800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:15.114297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:15.134975 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-db1d1a03-8069-4d4b-aa74-3e0d4e595e34 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1268 microversion: 2.1 time: 0.193016 Aug 30 04:25:15.145384 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1757/3593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:14 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:15.158682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:15.160317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:15.160784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:15.164713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:15.165293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:15.165779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:15.171864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d0679861-34e4-44f8-bbaf-68274b21b198 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9698e78b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:15.298544 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d0679861-34e4-44f8-bbaf-68274b21b198 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.139935 Aug 30 04:25:15.311201 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1758/3594] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:15 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:15.560967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:15.574739 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83e7e74d-4c6f-41c9-8132-28e69c222abc tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1351 microversion: 2.1 time: 0.472925 Aug 30 04:25:15.585359 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1837/3595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:15 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1351 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:16.122763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:16.123387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:16.125460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:16.135169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.135671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.136121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.136827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.137286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.146928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.159093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:16.159724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:16.172299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.174228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.179357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.180361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.186033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.186703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.370809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:16.392160 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1bdceb12-87f7-4fc0-b999-51bb9cde5abe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1274 microversion: 2.1 time: 0.237002 Aug 30 04:25:16.394303 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1838/3596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:16 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1274 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:16.401535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61ddb619-e471-4fa4-9f3f-4edcaaad8918 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969348040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:16.558470 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61ddb619-e471-4fa4-9f3f-4edcaaad8918 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.162521 Aug 30 04:25:16.560553 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1839/3597] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:16 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:16.601759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:16.602522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:16.621889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.627157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.646181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.655276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:16.655796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:16.657613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:16.860165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:16.870799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c59e0b93-72a9-4432-a59a-056b1defad33 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1521 microversion: 2.1 time: 0.753324 Aug 30 04:25:16.872848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1759/3598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:16 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1521 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:17.236033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:17.244913 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71bdd251-c506-4c2d-a91d-7798ba140e92 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1351 microversion: 2.1 time: 0.648762 Aug 30 04:25:17.247888 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1840/3599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:16 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1351 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:17.416150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:17.416150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:17.430312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.431222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.431681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.434478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.435801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.436249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.574211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ca8aa067-c790-4f12-badb-431b03b2eff9 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96947c3a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:17.703777 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ca8aa067-c790-4f12-badb-431b03b2eff9 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.133283 Aug 30 04:25:17.704596 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1841/3600] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:17 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:17.756460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:17.767789 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d13b7f0f-8b17-4dd2-9db7-416c0ef9bf95 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1274 microversion: 2.1 time: 0.357068 Aug 30 04:25:17.771239 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1760/3601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:17 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1274 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:17.897899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:17.898692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:17.902785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:17.926349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.929694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.930253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:17.932736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:17.933480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:17.934189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.197867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84dd97e2c7fb48f0a9d8f93f1211dc91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ddddf2cb39446c6b3bf9ce1e163d60f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:18.210936 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6b5e6be7-3e66-4707-b7a1-f43a568a7d10 tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 200 len: 1479 microversion: 2.1 time: 0.319464 Aug 30 04:25:18.215095 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1842/3602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:17 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 1479 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:18.271638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:18.271638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:18.288611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.289229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.290079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.290835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.291377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.291814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.377216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0c217db2-426d-4ee9-bd4c-5716a9bee51a req-76116118-faba-4584-b597-330ec87d13bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8256913-3e91-4d10-9b49-5a5e5fff2ae0", "name": "network-vif-deleted", "tag": "02dbd89d-bfe8-4171-9039-44a821398026"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:18.399064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c217db2-426d-4ee9-bd4c-5716a9bee51a req-76116118-faba-4584-b597-330ec87d13bf service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.401155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c217db2-426d-4ee9-bd4c-5716a9bee51a req-76116118-faba-4584-b597-330ec87d13bf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.403886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c217db2-426d-4ee9-bd4c-5716a9bee51a req-76116118-faba-4584-b597-330ec87d13bf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.436723 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0c217db2-426d-4ee9-bd4c-5716a9bee51a req-76116118-faba-4584-b597-330ec87d13bf service nova] Creating event network-vif-deleted:02dbd89d-bfe8-4171-9039-44a821398026 for instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 on n-h1-854925-5 Aug 30 04:25:18.453224 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0c217db2-426d-4ee9-bd4c-5716a9bee51a req-76116118-faba-4584-b597-330ec87d13bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080631 Aug 30 04:25:18.454454 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1843/3603] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:25:18.720452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b6c0300-f1a9-4f23-b038-220a92ae2dde tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9693480d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:18.824860 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b6c0300-f1a9-4f23-b038-220a92ae2dde tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.109823 Aug 30 04:25:18.825508 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1844/3604] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:18 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:18.858459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:18.859479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:18.870560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.871064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.885534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.886984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:18.888287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:18.888980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:18.894469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:19.722885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:19.726729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:19.745106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-790e7e40-fe3d-4e0b-81b5-f30b56cdf81b tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1351 microversion: 2.1 time: 1.478198 Aug 30 04:25:19.759633 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1761/3605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:18 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1351 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:19.765883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:19.767009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] [instance: b8256913-3e91-4d10-9b49-5a5e5fff2ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:19.774112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.775768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.782549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.783325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:19.783805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:19.784228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:19.794282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:19.821832 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] HTTP exception thrown: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 could not be found. Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Request method failure captured: Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 HTTP/1.1 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDY_IQjU6XHk9_D-J-LH-ZEj_EKAwh6MgFu-bkJ_l6GGpDHg7pxe1QnUQEV2yvuA4iTltOB3xk6XuHXE7c10E7DlTLFhx3kJp68QfEVGpIg5VgycVl6kUbtjIEWSAz4ayUfUPKsJCe8FiOQwbgzKNxoIVBBz4lmPCNf0l34QLKVhpTe0 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4ddddf2cb39446c6b3bf9ce1e163d60f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4ddddf2cb39446c6b3bf9ce1e163d60f"}]}] Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 4ddddf2cb39446c6b3bf9ce1e163d60f Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-369827978 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 84dd97e2c7fb48f0a9d8f93f1211dc91 Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerRescueNegativeTestJSON-369827978-project Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 could not be found. Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b8256913-3e91-4d10-9b49-5a5e5fff2ae0'} Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 could not be found. Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 could not be found. Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:19.826331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 could not be found. Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] Returning 404 to user: Instance b8256913-3e91-4d10-9b49-5a5e5fff2ae0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:19.831193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0bfade2a-dddb-499f-9009-41074e2c89dc tempest-ServerRescueNegativeTestJSON-369827978 tempest-ServerRescueNegativeTestJSON-369827978-project] 10.222.0.27 "GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0" status: 404 len: 111 microversion: 2.1 time: 0.069927 Aug 30 04:25:19.834340 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1762/3606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:19 2022] GET /compute/v2.1/servers/b8256913-3e91-4d10-9b49-5a5e5fff2ae0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:19.843046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e0309e2-3c06-47d3-b384-2f589911973e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9699f2820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:19.919436 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-332783d5-02b1-4ce3-b7da-d311016cc739 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 1.086386 Aug 30 04:25:19.925024 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1845/3607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:18 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:20.005245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e0309e2-3c06-47d3-b384-2f589911973e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.166572 Aug 30 04:25:20.017280 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1763/3608] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:19 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:20.765763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:20.766396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:20.781737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.782149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.782591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:20.783309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.783766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.784243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:20.946906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:20.948348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:20.967558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.968382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.969005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:20.969973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:20.970606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:20.971208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:21.813557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:21.827450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8187092f-9010-49ad-b5bc-2539cd0af418 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 0.885134 Aug 30 04:25:21.834443 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1764/3609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:20 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:21.851951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:21.857831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-60c2c230-42dd-4aed-b9cb-add24bd01f04 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e45bc10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:21.871521 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81fb4ef3-8288-411b-b8b1-d18f045cd71c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1351 microversion: 2.1 time: 1.109684 Aug 30 04:25:21.892107 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1846/3610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:20 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1351 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:21.901047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1ea5f55d-2849-4d16-853e-f67a0eaa597a req-90542f33-2fb7-47cd-b31b-e1cd8ef68e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ca72e1-8b4d-48e3-bd8d-6ddc94691227", "name": "network-vif-plugged", "status": "completed", "tag": "ec53bdea-27ca-477d-b33c-085dea1871bb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:21.943600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1ea5f55d-2849-4d16-853e-f67a0eaa597a req-90542f33-2fb7-47cd-b31b-e1cd8ef68e93 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:21.951933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1ea5f55d-2849-4d16-853e-f67a0eaa597a req-90542f33-2fb7-47cd-b31b-e1cd8ef68e93 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:21.952461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1ea5f55d-2849-4d16-853e-f67a0eaa597a req-90542f33-2fb7-47cd-b31b-e1cd8ef68e93 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.008480 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-60c2c230-42dd-4aed-b9cb-add24bd01f04 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.167780 Aug 30 04:25:22.022415 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1765/3611] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:21 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:22.032425 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1ea5f55d-2849-4d16-853e-f67a0eaa597a req-90542f33-2fb7-47cd-b31b-e1cd8ef68e93 service nova] Creating event network-vif-plugged:ec53bdea-27ca-477d-b33c-085dea1871bb for instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 on n-h2-854925-5 Aug 30 04:25:22.054315 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1ea5f55d-2849-4d16-853e-f67a0eaa597a req-90542f33-2fb7-47cd-b31b-e1cd8ef68e93 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160734 Aug 30 04:25:22.054938 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1847/3612] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:22.104214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:22.105174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:22.133294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.136320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.137130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.138449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.140154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.142182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.222373 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac21b962-7dff-41ed-983e-c7d3172b52e3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/ips" status: 200 len: 151 microversion: 2.20 time: 0.125735 Aug 30 04:25:22.226563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1766/3613] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Aug 30 04:25:22 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/ips => generated 151 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:25:22.467501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ae800095-4aee-49fe-8734-1a2832d28bbc req-6ab92788-690c-4a79-99d3-5aa8b95ddfbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a3cba00-1ce3-4089-87e8-415b1296551a", "tag": "9df5b477-f374-4c01-ae0d-0ecc08aaa203"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:22.511032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ae800095-4aee-49fe-8734-1a2832d28bbc req-6ab92788-690c-4a79-99d3-5aa8b95ddfbc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.511650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ae800095-4aee-49fe-8734-1a2832d28bbc req-6ab92788-690c-4a79-99d3-5aa8b95ddfbc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.513890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ae800095-4aee-49fe-8734-1a2832d28bbc req-6ab92788-690c-4a79-99d3-5aa8b95ddfbc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.549240 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ae800095-4aee-49fe-8734-1a2832d28bbc req-6ab92788-690c-4a79-99d3-5aa8b95ddfbc service nova] Creating event network-changed:9df5b477-f374-4c01-ae0d-0ecc08aaa203 for instance 8a3cba00-1ce3-4089-87e8-415b1296551a on n-h2-854925-5 Aug 30 04:25:22.563436 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ae800095-4aee-49fe-8734-1a2832d28bbc req-6ab92788-690c-4a79-99d3-5aa8b95ddfbc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102481 Aug 30 04:25:22.566401 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1848/3614] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:25:22.861219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:22.862968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:22.895069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.895592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.897502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:22.898937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:22.922624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.923668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.924334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.933056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.934340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.934970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.935541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:22.939591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:22.945993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:22.954533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:23.117278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:23.211599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:23.350684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:23.363427 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1d2e3ff7-4838-4fc6-ae12-cde8e26919ce tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 0.507201 Aug 30 04:25:23.364345 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1767/3615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:22 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:23.386018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-261e7510-68b5-4d46-a440-490363d5e4b1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96e439a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:23.467269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:23.484889 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-261e7510-68b5-4d46-a440-490363d5e4b1 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.119448 Aug 30 04:25:23.488337 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-056c2ec0-3f3c-456d-b8dc-f1b7f113e846 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1351 microversion: 2.1 time: 0.596402 Aug 30 04:25:23.502989 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1849/3617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:22 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1351 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:23.503603 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1768/3617] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:23 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:24.394513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:24.398160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:24.409621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:24.413643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:24.416158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:24.418390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:24.422338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:24.423867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:24.427622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:24.503208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a7a8622c-3ce2-4397-9bbd-88967707ad40 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a59c4c0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:24.597769 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a7a8622c-3ce2-4397-9bbd-88967707ad40 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.101069 Aug 30 04:25:24.610605 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1769/3618] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:24 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:24.632529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:24.634721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:24.643472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:24.644236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:24.644843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:24.645993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:24.646872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:24.647977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:25.617704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:25.627480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd934af8-d6b4-4861-b4a8-5b83ba6fa607 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 1.238353 Aug 30 04:25:25.627764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:25.640377 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca97adcc-29bc-4e4a-b06a-f43f7bde4580 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1542 microversion: 2.1 time: 1.028342 Aug 30 04:25:25.641233 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1770/3619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:24 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1542 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:25.647546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac2d5037-e66e-4262-98e4-0144377cfbfc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a597c10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:25.658086 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1850/3620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:24 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:25.704768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:25.709014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:25.734351 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac2d5037-e66e-4262-98e4-0144377cfbfc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.090475 Aug 30 04:25:25.735840 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1771/3621] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:25 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:25.765703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:25.766212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:25.766664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:25.776329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:25.776858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:25.777311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:26.008769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d457382-ac99-414d-9947-b157cf904ad2 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.346028 Aug 30 04:25:26.010597 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1851/3622] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:25:25 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227/os-interface => generated 285 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:26.669533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:26.670997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:26.686569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:26.687355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:26.687968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:26.688118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1502546797", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:26.689497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:26.690138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:26.690937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:26.786131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:25:27.344237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:27.354918 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8095e8ff-54a2-4218-ba25-5aba56bf43ee tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 0.692480 Aug 30 04:25:27.369810 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1772/3623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:26 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:27.369810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dec79b2-da5c-449d-8f67-bc7d708f6da5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a59c0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:27.450797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:25:27.451520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:25:27.451661 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dec79b2-da5c-449d-8f67-bc7d708f6da5 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.089033 Aug 30 04:25:27.452301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:25:27.452924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:25:27.453552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:25:27.460204 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1773/3624] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:27 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:27.478583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:27.479091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:27.482794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:27.483626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:27.484942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:27.486549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:27.492681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:27.496851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:27.512748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:27.522438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:27.524590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:27.525518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:27.532051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:27.532850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:27.534087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Getting quotas for project 12fbaa93748b4d7784101fa1b5d63784. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:25:27.549021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Getting quotas for user c18b6cfa93004da9886b8358708dc306 and project 12fbaa93748b4d7784101fa1b5d63784. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:25:27.584205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:25:27.587640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:25:27.607225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lazy-loading 'flavor' on Instance uuid b9e5a44f-46b4-420a-a56d-4bcdaabc66ab {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:25:27.706406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5d05adb-063f-44b1-9222-caeaea3a9488 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023195 Aug 30 04:25:27.712642 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1852/3625] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:25:27.720555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f8f3dc5d-e1fa-43d2-afac-0bbdce900bfc tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:27.724059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f8f3dc5d-e1fa-43d2-afac-0bbdce900bfc tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:27.846851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f8f3dc5d-e1fa-43d2-afac-0bbdce900bfc tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:27.857986 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f8f3dc5d-e1fa-43d2-afac-0bbdce900bfc tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1214 microversion: 2.1 time: 0.139319 Aug 30 04:25:27.860237 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1853/3626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:27 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1214 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:28.172349 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0176f964-4637-457b-b63f-cfe217712856 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/action" status: 202 len: 0 microversion: 2.20 time: 0.695760 Aug 30 04:25:28.175064 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1774/3627] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:25:27 2022] POST /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:28.185235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:28.186380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:28.196401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.198233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.199601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:28.201844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.206155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.207050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:28.388741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:28.389926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:28.406413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.407221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.408483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:28.412352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.422818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.427701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:28.590159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:28.606397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:28.611344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:28.615976 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e13371f2-4caa-4b7c-9ea2-aaab14cb6275 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 0.433713 Aug 30 04:25:28.618397 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1854/3628] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:28 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:28.636611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98eb6dff-1fe1-4019-94ea-f69456736055 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969938af0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:28.732767 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98eb6dff-1fe1-4019-94ea-f69456736055 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.111971 Aug 30 04:25:28.733404 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1855/3629] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:28 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:28.886040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:28.887053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:28.896645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.897510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.898119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:28.899320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:28.899946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:28.900720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:29.246092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:29.259807 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af5efee2-631a-4611-9bb8-97158f13dfba tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1218 microversion: 2.1 time: 0.380398 Aug 30 04:25:29.272677 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1856/3630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:28 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1218 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:29.473191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:29.495672 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e498a0c-395e-49b0-8ab2-d8f7bf7401df tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 1.115533 Aug 30 04:25:29.502141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1775/3631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:28 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:29.645316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:29.646194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:29.656621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:29.657038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:29.657521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:29.658244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:29.667983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:29.668490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:29.747573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-959df7fc-79f4-49f8-a030-aa49eee3b625 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9698fb160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:29.862433 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-959df7fc-79f4-49f8-a030-aa49eee3b625 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.117811 Aug 30 04:25:29.873043 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1776/3632] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:29 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:30.283912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:30.284855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:30.301701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:30.302610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:30.303243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:30.304138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:30.304770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:30.305403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:30.591967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:30.605922 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4c55651-c24d-4873-bb73-27b5d92b3185 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1266 microversion: 2.1 time: 0.325771 Aug 30 04:25:30.610781 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1777/3633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:30 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1266 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:30.635855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:30.639430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:30.660569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:30.667195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:30.669870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:30.670869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:30.673473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:30.674350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:30.987716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:31.009800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:31.011255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:31.012497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5efce3ea-50f4-415b-a06a-d91976f073f9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 1.371755 Aug 30 04:25:31.013072 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1857/3634] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:29 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:31.049425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f36005be-aecc-4c8e-b5c8-fb98f799a4eb tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969704550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:31.144821 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f36005be-aecc-4c8e-b5c8-fb98f799a4eb tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.116129 Aug 30 04:25:31.145879 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1858/3635] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:31 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:31.180533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f168282a-4e47-4166-b6cd-fde07d1008cb req-5a659ae9-0f20-46ef-85d6-ab82390f881e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69ca72e1-8b4d-48e3-bd8d-6ddc94691227", "tag": "ec53bdea-27ca-477d-b33c-085dea1871bb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:31.204596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f168282a-4e47-4166-b6cd-fde07d1008cb req-5a659ae9-0f20-46ef-85d6-ab82390f881e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:31.212196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f168282a-4e47-4166-b6cd-fde07d1008cb req-5a659ae9-0f20-46ef-85d6-ab82390f881e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:31.212886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f168282a-4e47-4166-b6cd-fde07d1008cb req-5a659ae9-0f20-46ef-85d6-ab82390f881e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:31.246200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:31.247719 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f168282a-4e47-4166-b6cd-fde07d1008cb req-5a659ae9-0f20-46ef-85d6-ab82390f881e service nova] Creating event network-changed:ec53bdea-27ca-477d-b33c-085dea1871bb for instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 on n-h2-854925-5 Aug 30 04:25:31.260370 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f168282a-4e47-4166-b6cd-fde07d1008cb req-5a659ae9-0f20-46ef-85d6-ab82390f881e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104251 Aug 30 04:25:31.274585 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b40cc5f5-834a-4506-bc2f-1cb9dc1b3e4d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 0.662370 Aug 30 04:25:31.289351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1778/3636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:30 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:31.290457 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1859/3637] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:31.633177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:31.633915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:31.662853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:31.663348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:31.663788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:31.664503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:31.664958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:31.665407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.041517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:32.042165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:32.063648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.066463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.067154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.070704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.071986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.073401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.277270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:32.294585 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb9c6494-df9f-4702-ad72-3df6d1c11017 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1272 microversion: 2.1 time: 0.665120 Aug 30 04:25:32.299115 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1860/3638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:31 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1272 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:32.314637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-983c1ce0-74e6-48f3-9efb-16ffa683f95c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a7350d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:32.413067 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-983c1ce0-74e6-48f3-9efb-16ffa683f95c tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.112566 Aug 30 04:25:32.414990 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1861/3639] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:32 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:32.424228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:32.428078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:32.445955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.447371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.450392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:32.451918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:32.454636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:32.455827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:33.104691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:33.123929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:33.127638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:33.130518 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-711f7c79-1458-4e67-ac96-5e3127debd15 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 1.092735 Aug 30 04:25:33.130518 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1779/3640] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:32 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:25:33.145773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fd3f0250-bfa3-4267-9fb9-ac905f830a53 req-5b167405-192d-42d2-a98b-0ec183d889e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3cba00-1ce3-4089-87e8-415b1296551a", "name": "network-vif-plugged", "status": "completed", "tag": "9df5b477-f374-4c01-ae0d-0ecc08aaa203"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:33.167399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fd3f0250-bfa3-4267-9fb9-ac905f830a53 req-5b167405-192d-42d2-a98b-0ec183d889e5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:33.167883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fd3f0250-bfa3-4267-9fb9-ac905f830a53 req-5b167405-192d-42d2-a98b-0ec183d889e5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:33.168356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fd3f0250-bfa3-4267-9fb9-ac905f830a53 req-5b167405-192d-42d2-a98b-0ec183d889e5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:33.209916 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fd3f0250-bfa3-4267-9fb9-ac905f830a53 req-5b167405-192d-42d2-a98b-0ec183d889e5 service nova] Creating event network-vif-plugged:9df5b477-f374-4c01-ae0d-0ecc08aaa203 for instance 8a3cba00-1ce3-4089-87e8-415b1296551a on n-h2-854925-5 Aug 30 04:25:33.219014 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fd3f0250-bfa3-4267-9fb9-ac905f830a53 req-5b167405-192d-42d2-a98b-0ec183d889e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085242 Aug 30 04:25:33.221698 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1780/3641] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:33.319059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:33.329360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:33.330697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:33.353247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:33.353887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:33.354328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:33.354730 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-047578c8-cc21-4945-bb8d-c08897861b8e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 0.926615 Aug 30 04:25:33.359045 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1862/3642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:32 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:33.364549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:33.365526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:33.366147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:33.430715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e9371c4-7e8b-4e92-9ff7-b1981621f521 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96947cdc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:33.584408 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e9371c4-7e8b-4e92-9ff7-b1981621f521 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.093208 Aug 30 04:25:33.584408 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1863/3643] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:33 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:33.672314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:33.682029 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-762dca26-f962-4e03-93b9-7558e2f692d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1272 microversion: 2.1 time: 0.357976 Aug 30 04:25:33.682623 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1781/3644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:33 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1272 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:34.154583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:34.155406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:34.207993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.212009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.212699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.215456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.220012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.222968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.384701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:34.390488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:34.414807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.416176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.423413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:34.426584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:34.429044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:34.431889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:35.267600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:35.278296 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e444f3c-5e7d-4d25-a988-20095319521c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1316 microversion: 2.1 time: 0.902925 Aug 30 04:25:35.281675 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1782/3645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:34 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1316 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:35.289995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77590418-e358-4939-b811-fcbe49860f84 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692d09d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:35.335751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:35.350306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:35.351946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:35.353406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6082c5f6-5974-4e06-b64a-3d42ab6d1a81 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 1.204583 Aug 30 04:25:35.361783 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1864/3646] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:34 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:35.366625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:35.367253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:35.374700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:35.375399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:35.376484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:35.377393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:35.378006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:35.378572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:35.390741 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77590418-e358-4939-b811-fcbe49860f84 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.107555 Aug 30 04:25:35.391993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1783/3647] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:35 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:35.504275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:35.514080 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0004a8e0-faee-4571-9479-b296e67e73ca tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1272 microversion: 2.1 time: 0.151148 Aug 30 04:25:35.514683 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1865/3648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:35 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:35.699228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1074459782", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "7d1ec10f-fecb-460d-b298-5cd3cc7fd417"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:35.859536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] validate_networks() for [('7d1ec10f-fecb-460d-b298-5cd3cc7fd417', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:25:36.307175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:36.308051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:36.323606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.331358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.332693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:36.336515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:36.337911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:36.339620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.103308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:37.120283 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20deb638-c0ad-42ca-aa32-e88089bb8f84 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1466 microversion: 2.1 time: 0.819923 Aug 30 04:25:37.123081 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1866/3649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:36 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1466 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:37.136484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:37.139325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:37.191705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.192470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.193075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.194731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.196289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.197590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.513794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:37.538579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:25:37.541515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:25:37.542215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:25:37.542878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:25:37.544180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:25:37.604640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:37.625184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:37.627118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:37.627683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.631267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.633367 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6afe9ac-6dc3-4034-97a7-2b97a7e44821 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 0.508835 Aug 30 04:25:37.634087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.637897 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1867/3650] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:37 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:37.644726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.647007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.649669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99c93399-8c69-4269-b7fe-e22854176e56 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96958a940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:37.653214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.755664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Getting quotas for project 0dcdefb0eee8499e8896e1760e505e75. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:25:37.772391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Getting quotas for user 1ea053cf590a47ef8f1fc51b1d3be222 and project 0dcdefb0eee8499e8896e1760e505e75. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:25:37.792701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Going to run 3 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:25:37.796151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:25:37.810886 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99c93399-8c69-4269-b7fe-e22854176e56 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.169701 Aug 30 04:25:37.812007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1868/3651] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:37 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:37.832003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:37.834519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:37.859478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:37.866053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.867908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.870355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.873418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:37.873897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=d6e8a194-f7bd-4579-ad3a-7b85ab11eaae,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:25:37.876877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:37.877538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:37.922992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:25:38.087988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01f7f7bf-0c55-4762-90fa-2255c99af98a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.693853 Aug 30 04:25:38.089211 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1784/3652] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:25:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:25:38.094765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:38.095483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:38.101870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.102458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.103806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.104859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.105529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.106641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.367455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:38.390190 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9f00aa5-321e-425c-80cd-56faedd6c02f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.575927 Aug 30 04:25:38.391039 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1869/3653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:37 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:38.405208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:38.426152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:38.429989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:25:38.505991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.506906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.507511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.508583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.509390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.509674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.566949 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41650905-e80d-43ff-967d-cc14df6c1157 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.173298 Aug 30 04:25:38.574203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1870/3654] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:25:38 2022] GET /compute/v2.1/servers => generated 1018 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:38.591187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb7da492-5ea6-43ea-a995-4db5a13155d5 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:38.591997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eb7da492-5ea6-43ea-a995-4db5a13155d5 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:38.626676 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-62b2c160-0383-4467-8a9f-fcdc2d85acec tempest-ServersOnMultiNodesTest-1108358553 tempest-ServersOnMultiNodesTest-1108358553-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1617 microversion: 2.1 time: 0.535613 Aug 30 04:25:38.627276 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1785/3655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:38 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1617 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:38.664568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:38.665604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:38.690854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.691817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.692181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.698927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.701188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.703308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.805418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:38.818667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eb7da492-5ea6-43ea-a995-4db5a13155d5 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:38.828473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb7da492-5ea6-43ea-a995-4db5a13155d5 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1223 microversion: 2.1 time: 0.245978 Aug 30 04:25:38.835236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:38.835861 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1871/3656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:38 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1223 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:38.856093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:38.875787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:38.892305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.896132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.898076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:38.899553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:38.902010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:38.902677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.006260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:39.210884 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c07ecba2-72b7-4530-85f2-8e6fe921d1b9 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 204 len: 0 microversion: 2.1 time: 0.551146 Aug 30 04:25:39.214153 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1786/3657] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:38 2022] DELETE /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:25:39.233443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1e76c844-39fd-445c-83a8-ad8eada526c5 req-901b8951-23d1-472e-ba69-30af11c6703d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102d4935-336f-4a28-bbad-4adda3e5c7e3", "tag": "d23c3020-e156-4999-8b30-8706ae0a8a96"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:39.268926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1e76c844-39fd-445c-83a8-ad8eada526c5 req-901b8951-23d1-472e-ba69-30af11c6703d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.269527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1e76c844-39fd-445c-83a8-ad8eada526c5 req-901b8951-23d1-472e-ba69-30af11c6703d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.281982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1e76c844-39fd-445c-83a8-ad8eada526c5 req-901b8951-23d1-472e-ba69-30af11c6703d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.336889 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1e76c844-39fd-445c-83a8-ad8eada526c5 req-901b8951-23d1-472e-ba69-30af11c6703d service nova] Creating event network-changed:d23c3020-e156-4999-8b30-8706ae0a8a96 for instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 on n-h1-854925-5 Aug 30 04:25:39.344258 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1e76c844-39fd-445c-83a8-ad8eada526c5 req-901b8951-23d1-472e-ba69-30af11c6703d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124884 Aug 30 04:25:39.344890 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1787/3658] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:39.360151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ff104e4-e236-4c72-a096-88d46e5b0bdb tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96926e040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:39.482193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ff104e4-e236-4c72-a096-88d46e5b0bdb tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1452 microversion: 2.1 time: 0.127720 Aug 30 04:25:39.483162 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1788/3659] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:39 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:39.504016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:39.505361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:39.522811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.531371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.532581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:39.535151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:39.538180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:39.539137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.130898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.153641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.159736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.169993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-89dbdd3e-0de5-4875-ae04-3fbcd0d6a73e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 1.332424 Aug 30 04:25:40.189793 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1872/3660] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:38 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:40.225815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:40.226460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:40.253299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.253916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.254303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.256090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.256583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.257026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.522137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.550777 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9964b79b-0964-4202-a166-e761331ebd73 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1472 microversion: 2.1 time: 1.065227 Aug 30 04:25:40.568388 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1789/3661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:39 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1472 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:40.583831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:40.584469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:40.623016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.623866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.624540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.625669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:40.626143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:40.626587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:40.823846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.828274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:40.837627 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17f362b4-5fb6-491a-a335-2279574d32e3 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.637468 Aug 30 04:25:40.839920 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c466e259-2679-45b2-9dbc-f5f7a81deca2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1219 microversion: 2.1 time: 0.269251 Aug 30 04:25:40.840554 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1790/3662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:40 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1219 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:40.842686 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1873/3663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:40 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:40.864912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec537a9b-4c92-44c5-a31b-905795995619 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9692c85e0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:40.957658 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec537a9b-4c92-44c5-a31b-905795995619 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1461 microversion: 2.1 time: 0.099103 Aug 30 04:25:40.958267 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1791/3664] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:40 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1461 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:40.972338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-779f0554-3796-45bf-a7e6-de548acceeee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a7353a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:41.044361 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-779f0554-3796-45bf-a7e6-de548acceeee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 200 len: 1461 microversion: 2.1 time: 0.076738 Aug 30 04:25:41.050465 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1874/3665] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:40 2022] GET /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:41.064361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:41.065375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:41.079553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.080323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.081427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.082326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.087753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.088348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.197694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:41.198856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:41.210062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.211549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.213889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.216845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.217320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.219382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.454663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:41.489191 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cb8716dc-09e7-4940-993c-52b968056906 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1481 microversion: 2.1 time: 0.428798 Aug 30 04:25:41.491213 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1792/3666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:41 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1481 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:41.577770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:41.578423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:41.598430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.599451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.599451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.600363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.601068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.601781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.938633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:41.947534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:41.949053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:41.950533 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10ab3005-3922-4f28-882d-8e6f919141ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 0.758341 Aug 30 04:25:41.951095 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1875/3667] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:41 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:25:41.972975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:41.973961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:41.981505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.982394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.983000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:41.983908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:41.984545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:41.985205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.064763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:42.085266 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d9ff13e-e3c1-48fa-8c9b-e2b9f456832f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1472 microversion: 2.1 time: 0.511958 Aug 30 04:25:42.097617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1793/3668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:41 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1472 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:42.104073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:42.104699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:42.112758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.113255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.113794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.114684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.115138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.115567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.175799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:42.189579 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-de993c99-3d85-44f2-82d6-4dc7c3eb3c6f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1275 microversion: 2.1 time: 0.222786 Aug 30 04:25:42.191973 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1876/3669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:41 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1275 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:42.330141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-169c6759-0ebb-4289-9cca-3a9491663e3c req-b6d4d6c5-6beb-470e-aafe-0baa204a5f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a3cba00-1ce3-4089-87e8-415b1296551a", "name": "network-vif-deleted", "tag": "9df5b477-f374-4c01-ae0d-0ecc08aaa203"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:42.359732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-169c6759-0ebb-4289-9cca-3a9491663e3c req-b6d4d6c5-6beb-470e-aafe-0baa204a5f15 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.362441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-169c6759-0ebb-4289-9cca-3a9491663e3c req-b6d4d6c5-6beb-470e-aafe-0baa204a5f15 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.363135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-169c6759-0ebb-4289-9cca-3a9491663e3c req-b6d4d6c5-6beb-470e-aafe-0baa204a5f15 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.391781 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-169c6759-0ebb-4289-9cca-3a9491663e3c req-b6d4d6c5-6beb-470e-aafe-0baa204a5f15 service nova] Creating event network-vif-deleted:9df5b477-f374-4c01-ae0d-0ecc08aaa203 for instance 8a3cba00-1ce3-4089-87e8-415b1296551a on n-h2-854925-5 Aug 30 04:25:42.409030 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-169c6759-0ebb-4289-9cca-3a9491663e3c req-b6d4d6c5-6beb-470e-aafe-0baa204a5f15 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082976 Aug 30 04:25:42.409824 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1877/3670] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:25:42.536175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:42.537009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:42.561305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.562196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.565762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.571961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.575341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.575979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.644253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:42.651953 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e240b5b1-c5c7-4c73-9af1-20defb030e86 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.564463 Aug 30 04:25:42.656218 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1794/3671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:42 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:42.977965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:42.979334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:42.989750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.993797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:42.994952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:42.996372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:42.998579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.000728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.011013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:43.024079 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-746f8d18-1ee1-465e-b120-856431aeb2d7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1481 microversion: 2.1 time: 0.512421 Aug 30 04:25:43.029065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1878/3672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:42 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1481 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:43.110150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:43.111042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:43.125956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.128886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.129516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.131171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.134397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.135272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.223805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.224705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.225466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.226149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lazy-loading 'fault' on Instance uuid 8a3cba00-1ce3-4089-87e8-415b1296551a {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:25:43.616722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:43.625746 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94384fa9-8cf7-474a-9a2b-56f957d337c4 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 200 len: 1306 microversion: 2.1 time: 0.522233 Aug 30 04:25:43.626523 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1879/3673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:43 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 1306 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:43.641490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:43.644136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:43.662194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.662687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.663145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.663826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.664280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.664703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.812020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:43.824309 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b01747b-355f-4f65-bb3f-e60918023289 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1275 microversion: 2.1 time: 0.196872 Aug 30 04:25:43.834179 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1880/3674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:43 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:43.850178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:43.850999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:43.864038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.873985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.874774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.876032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:43.876703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:43.877355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:43.907815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:43.920374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:43.930393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:43.939443 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a706fcc6-8208-457f-b31b-667b76320b38 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 0.961247 Aug 30 04:25:43.949759 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1795/3675] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:42 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:25:44.052862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:44.053673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:44.064954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.065841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.067149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.069628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.070317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.071984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.282509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:44.291620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ab2577f-9059-4dee-9dc8-b0f46f8aadcf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.445301 Aug 30 04:25:44.304642 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1881/3676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:43 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:44.553749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:44.566578 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5618cfdc-d0a9-4070-a2d7-d11a020689e6 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1481 microversion: 2.1 time: 0.518360 Aug 30 04:25:44.567709 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1796/3677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:44 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1481 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:44.652703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:44.653453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 8a3cba00-1ce3-4089-87e8-415b1296551a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:44.681466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.693272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.694831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.696803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.697538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.698189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.738384 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance 8a3cba00-1ce3-4089-87e8-415b1296551a could not be found. Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a HTTP/1.1 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 8a3cba00-1ce3-4089-87e8-415b1296551a could not be found. Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '8a3cba00-1ce3-4089-87e8-415b1296551a'} Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a3cba00-1ce3-4089-87e8-415b1296551a could not be found. Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a3cba00-1ce3-4089-87e8-415b1296551a could not be found. Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:44.757447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:44.760698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:44.760698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:44.760698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:44.760698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:44.760698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:44.760698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a3cba00-1ce3-4089-87e8-415b1296551a could not be found. Aug 30 04:25:44.760698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:44.762565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance 8a3cba00-1ce3-4089-87e8-415b1296551a could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:44.764095 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c6d2b40-7a8c-4183-9054-ae4c87c01227 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a" status: 404 len: 111 microversion: 2.1 time: 0.116066 Aug 30 04:25:44.767885 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1882/3678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:44 2022] GET /compute/v2.1/servers/8a3cba00-1ce3-4089-87e8-415b1296551a => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:44.776170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:44.776979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:44.788773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.789868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.791082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.794155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.796239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.797417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.850514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:44.852009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:44.852646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:44.868718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.869218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.888932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:44.894188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:44.918565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:44.922136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.045504 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28973eb6-aec5-4c35-a8e4-e989463bb08c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 204 len: 0 microversion: 2.1 time: 0.271035 Aug 30 04:25:45.047123 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1797/3679] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:44 2022] DELETE /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:45.061309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:45.062531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:45.069885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.070589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.071232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.072756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.073379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.074646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.160532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:45.172965 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1562ed0-0b2a-4374-b5fb-39fca8d64a71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1275 microversion: 2.1 time: 0.324780 Aug 30 04:25:45.174329 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1883/3680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:44 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1275 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:45.179864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:45.180743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:45.188626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.189497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.190142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.191129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.191921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.192545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.738051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:45.752013 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a688051d-8cf5-4490-8667-866f84c72f67 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1473 microversion: 2.1 time: 0.576387 Aug 30 04:25:45.754991 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1884/3681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:45 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1473 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:45.771092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:45.771930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:45.790275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.791086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.792010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.795863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.796526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.798847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.883570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:45.894517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:45.902518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:45.903249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03026954-784b-40d2-8075-83ab4446d862 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 0.847642 Aug 30 04:25:45.926367 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1798/3682] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:45 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:45.935269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:45.942266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:45.954665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.961835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.964139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:45.965084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:45.971695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:45.972458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:46.218601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:46.231769 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5499dcf2-fda8-409d-85d6-82aa6311c566 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1468 microversion: 2.1 time: 0.301858 Aug 30 04:25:46.233568 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1799/3683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:45 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:46.246867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:46.250477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:46.257621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:46.283784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:46.284620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:46.287429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:46.288395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:46.296422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:46.297217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:46.432298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:46.449051 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28323073-42e4-470d-9bd6-1c7267a855f8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.689560 Aug 30 04:25:46.449950 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1885/3684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:45 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:46.471916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea0fe119-5add-4ce7-aa74-aa309d4a8575 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a36a820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:46.512537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:46.530168 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9cadffcc-8c76-4f8e-a716-91821de79c60 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1275 microversion: 2.1 time: 0.295497 Aug 30 04:25:46.546570 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1800/3685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:46 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1275 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:46.625410 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea0fe119-5add-4ce7-aa74-aa309d4a8575 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?changes-since=2022-08-30T04%3A22%3A56Z" status: 200 len: 1901 microversion: 2.1 time: 0.157854 Aug 30 04:25:46.626994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1886/3686] 10.222.0.27 () {58 vars in 1199 bytes} [Tue Aug 30 04:25:46 2022] GET /compute/v2.1/images?changes-since=2022-08-30T04%3A22%3A56Z => generated 1901 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:46.644569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a9ff1824-c72c-4392-a77a-5b9e0fbf6102 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969282820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:46.727289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-21f0d003-4481-42b7-baab-0894599c9d08 req-ec725a9f-4fcb-42de-ae98-a54180f54241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6e8a194-f7bd-4579-ad3a-7b85ab11eaae", "tag": "be1b5369-d6ce-4842-b558-7e1202b6e6ed"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:46.735445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a9ff1824-c72c-4392-a77a-5b9e0fbf6102 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-994203584" status: 200 len: 484 microversion: 2.1 time: 0.096058 Aug 30 04:25:46.746803 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1801/3687] 10.222.0.27 () {58 vars in 1229 bytes} [Tue Aug 30 04:25:46 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-994203584 => generated 484 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:46.752841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-21f0d003-4481-42b7-baab-0894599c9d08 req-ec725a9f-4fcb-42de-ae98-a54180f54241 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:46.753362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-21f0d003-4481-42b7-baab-0894599c9d08 req-ec725a9f-4fcb-42de-ae98-a54180f54241 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:46.753801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-21f0d003-4481-42b7-baab-0894599c9d08 req-ec725a9f-4fcb-42de-ae98-a54180f54241 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:46.754914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd995d2c-60fc-4f90-93b5-a3ef4defb5a7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96994b670>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:46.784576 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-21f0d003-4481-42b7-baab-0894599c9d08 req-ec725a9f-4fcb-42de-ae98-a54180f54241 service nova] Creating event network-changed:be1b5369-d6ce-4842-b558-7e1202b6e6ed for instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae on n-h2-854925-5 Aug 30 04:25:46.789859 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-21f0d003-4481-42b7-baab-0894599c9d08 req-ec725a9f-4fcb-42de-ae98-a54180f54241 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066975 Aug 30 04:25:46.791018 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1887/3688] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:46.797251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:46.798390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:46.814783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:46.815857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:46.816476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:46.817420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:46.818151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:46.818756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:46.885918 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd995d2c-60fc-4f90-93b5-a3ef4defb5a7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?server=76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 956 microversion: 2.1 time: 0.137345 Aug 30 04:25:46.886918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1802/3689] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Aug 30 04:25:46 2022] GET /compute/v2.1/images?server=76a02175-d9f3-4f57-9db1-618596566c85 => generated 956 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:46.908119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5c916576-116c-49d0-ba3d-8f66ecc4ea98 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969282c10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:46.966831 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5c916576-116c-49d0-ba3d-8f66ecc4ea98 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 484 microversion: 2.1 time: 0.069071 Aug 30 04:25:46.967723 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1803/3690] 10.222.0.27 () {58 vars in 1317 bytes} [Tue Aug 30 04:25:46 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 484 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:46.979756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:46.981196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:46.989521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:46.990296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:46.990872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:46.991754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:46.992204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:46.992732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:47.224330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:47.236937 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-07ee58ec-53e2-4387-8d15-6e649bd96d29 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1473 microversion: 2.1 time: 0.444486 Aug 30 04:25:47.238166 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1888/3691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:46 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1473 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:47.257601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bae2d774-a3c0-4fe2-9c93-f8833f660e60 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96958ab80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:47.342571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:47.353349 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bae2d774-a3c0-4fe2-9c93-f8833f660e60 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 484 microversion: 2.1 time: 0.106561 Aug 30 04:25:47.361451 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1889/3692] 10.222.0.27 () {58 vars in 1303 bytes} [Tue Aug 30 04:25:47 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 484 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:47.361634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:47.361634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:47.361634 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07e51480-1c37-4006-b06a-37fe2bd57c76 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1742 microversion: 2.20 time: 0.382427 Aug 30 04:25:47.361634 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1804/3693] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:46 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1742 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:47.369203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-efdad50c-21b3-484d-a621-68f390b92c1e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe9694f28b0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:47.476195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:47.477891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:47.496268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:47.496790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:47.499677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:47.500434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:47.500912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:47.505521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:47.516135 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-efdad50c-21b3-484d-a621-68f390b92c1e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.150725 Aug 30 04:25:47.529791 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1890/3694] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:25:47 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:47.536373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-07707d09-5b9a-4aff-a0b0-d8cac26e1e31 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96958af70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:47.685612 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-07707d09-5b9a-4aff-a0b0-d8cac26e1e31 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.154190 Aug 30 04:25:47.696834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1891/3695] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:25:47 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:47.702940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:47.703789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:47.711189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:47.711905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:47.712500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:47.713426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:47.714032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:47.714694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:47.720984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:47.782997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:48.016352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:48.034669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-de30c919-9094-49c2-9652-7a1f4d782530 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1293 microversion: 2.1 time: 0.336286 Aug 30 04:25:48.035435 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1892/3696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:47 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1293 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:48.051841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7bd46e26-d44b-4267-be1d-79830b25ae55 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969938310>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.136769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7bd46e26-d44b-4267-be1d-79830b25ae55 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.100114 Aug 30 04:25:48.137850 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1893/3697] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:48.151872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7325090f-c4df-49fa-92f7-dd804e582333 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96958a1f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.267711 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7325090f-c4df-49fa-92f7-dd804e582333 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/detail?changes-since=2022-08-30T04%3A22%3A51Z" status: 200 len: 6326 microversion: 2.1 time: 0.119605 Aug 30 04:25:48.277523 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1894/3698] 10.222.0.27 () {58 vars in 1220 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-30T04%3A22%3A51Z => generated 6326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:25:48.286721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.289343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.331639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:48.335857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.337916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.339357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.341405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.343628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.348116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.524893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:48.652486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:48.654761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:48.662584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3e7f3934-5b3d-4147-89ab-a9c86909633f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 1.190743 Aug 30 04:25:48.663176 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1805/3699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:47 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:48.681165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5bd4f6dd-3411-4b11-af5c-886064962cb4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969223940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.755378 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5bd4f6dd-3411-4b11-af5c-886064962cb4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-994203584" status: 200 len: 664 microversion: 2.1 time: 0.080712 Aug 30 04:25:48.756548 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1806/3700] 10.222.0.27 () {58 vars in 1250 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-994203584 => generated 664 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:48.763638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:48.764670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:48.773065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.773873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.774514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.775438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:48.776105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:48.776723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:48.823166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:49.626069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:49.638119 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a9d77ae7-68dc-4217-810b-2730f00d5ec8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 200 len: 1473 microversion: 2.1 time: 1.368261 Aug 30 04:25:49.655030 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1895/3701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 1473 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:49.668722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-76b5e1df-f42c-4d4d-b525-93daf8907896 req-4a222d87-f6fd-4805-abad-399ec51c61fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800", "tag": "8acd5cb6-4c52-4486-a973-d61788826f47"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:49.694975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-76b5e1df-f42c-4d4d-b525-93daf8907896 req-4a222d87-f6fd-4805-abad-399ec51c61fa service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:49.697938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-76b5e1df-f42c-4d4d-b525-93daf8907896 req-4a222d87-f6fd-4805-abad-399ec51c61fa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:49.698594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-76b5e1df-f42c-4d4d-b525-93daf8907896 req-4a222d87-f6fd-4805-abad-399ec51c61fa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:49.720790 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-76b5e1df-f42c-4d4d-b525-93daf8907896 req-4a222d87-f6fd-4805-abad-399ec51c61fa service nova] Creating event network-changed:8acd5cb6-4c52-4486-a973-d61788826f47 for instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 on n-h2-854925-5 Aug 30 04:25:49.721856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:49.727345 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-76b5e1df-f42c-4d4d-b525-93daf8907896 req-4a222d87-f6fd-4805-abad-399ec51c61fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070835 Aug 30 04:25:49.728588 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1896/3702] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:49.735383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37b2c0da-39a3-4275-b1af-806174bb81ff tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a3333a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:49.736035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:49.739029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:49.740468 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f8ee311-569e-47db-932a-323aa68ec22f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1742 microversion: 2.20 time: 0.982839 Aug 30 04:25:49.755851 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1807/3703] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:48 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1742 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:49.766282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:49.767133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:49.779825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:49.782141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:49.782945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:49.786713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:49.787720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:49.788319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:49.826461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37b2c0da-39a3-4275-b1af-806174bb81ff tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1464 microversion: 2.1 time: 0.096413 Aug 30 04:25:49.831319 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1897/3704] 10.222.0.27 () {58 vars in 1338 bytes} [Tue Aug 30 04:25:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fv2.1%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1464 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:49.847841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:49.849689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:49.858752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:49.859587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:49.860253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:49.861158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:49.861841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:49.862617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.387754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:50.396751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-40001222-28fa-4886-bc4a-39d63381e96b tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.639719 Aug 30 04:25:50.397585 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1808/3705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:49 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:50.403705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-42a1d607-d7ae-4a79-8ee1-da7c7de7b1b4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969221790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:50.468231 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-42a1d607-d7ae-4a79-8ee1-da7c7de7b1b4 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1464 microversion: 2.1 time: 0.069415 Aug 30 04:25:50.468840 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1809/3706] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Aug 30 04:25:50 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.27%2Fcompute%2Fservers%2Fa6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1464 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:50.481505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-37762cd8-e214-4ba4-a490-75115b74f85c req-eeb90d57-7362-4bf3-972f-f5301f07c5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a02175-d9f3-4f57-9db1-618596566c85", "name": "network-vif-unplugged", "status": "completed", "tag": "78448671-cdb4-443f-ae74-c0c03dd6955b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:50.504454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-37762cd8-e214-4ba4-a490-75115b74f85c req-eeb90d57-7362-4bf3-972f-f5301f07c5fd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:50.505170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-37762cd8-e214-4ba4-a490-75115b74f85c req-eeb90d57-7362-4bf3-972f-f5301f07c5fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:50.505777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-37762cd8-e214-4ba4-a490-75115b74f85c req-eeb90d57-7362-4bf3-972f-f5301f07c5fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.514325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:50.524935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da1a1ba9-067e-41b0-8d5b-174e596326b1 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.681624 Aug 30 04:25:50.525570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1898/3707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:49 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:50.525772 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-37762cd8-e214-4ba4-a490-75115b74f85c req-eeb90d57-7362-4bf3-972f-f5301f07c5fd service nova] Creating event network-vif-unplugged:78448671-cdb4-443f-ae74-c0c03dd6955b for instance 76a02175-d9f3-4f57-9db1-618596566c85 on n-h1-854925-5 Aug 30 04:25:50.534864 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-37762cd8-e214-4ba4-a490-75115b74f85c req-eeb90d57-7362-4bf3-972f-f5301f07c5fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064767 Aug 30 04:25:50.537261 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1810/3708] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:50.542179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f21d794c-28b2-4f36-b009-067fb11e0034 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96c29c820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:50.646045 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f21d794c-28b2-4f36-b009-067fb11e0034 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.119320 Aug 30 04:25:50.647559 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1899/3709] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 04:25:50 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:50.675383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:50.676105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ab1892b8-c352-4d48-8593-dd46d7347909] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:50.677987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-efd6139a-dbf5-4ed4-8ce8-ad33d6de1e2b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96958a790>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:50.683500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:50.683998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:50.684895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.685804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:50.686874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:50.687541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.721441 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance ab1892b8-c352-4d48-8593-dd46d7347909 could not be found. Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 HTTP/1.1 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance ab1892b8-c352-4d48-8593-dd46d7347909 could not be found. Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'ab1892b8-c352-4d48-8593-dd46d7347909'} Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1892b8-c352-4d48-8593-dd46d7347909 could not be found. Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1892b8-c352-4d48-8593-dd46d7347909 could not be found. Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:50.725600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1892b8-c352-4d48-8593-dd46d7347909 could not be found. Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:25:50.729727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance ab1892b8-c352-4d48-8593-dd46d7347909 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:50.730853 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b1841fd-1c3f-4ed7-bf79-3302a6aae26f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909" status: 404 len: 111 microversion: 2.1 time: 0.066369 Aug 30 04:25:50.736503 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1811/3710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:50 2022] GET /compute/v2.1/servers/ab1892b8-c352-4d48-8593-dd46d7347909 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:50.743507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:50.744358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:50.753545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:50.754191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:50.757967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.759075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:50.759703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:50.760282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.768066 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-efd6139a-dbf5-4ed4-8ce8-ad33d6de1e2b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.095008 Aug 30 04:25:50.768998 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1900/3711] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 04:25:50 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:50.775763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:50.776410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:50.787761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:50.789489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:50.790105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.790981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:50.791577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:50.793511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:50.806528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:50.814948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:50.936243 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb9c1567-dc56-42b1-ba9b-67c3f25f706d tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 204 len: 0 microversion: 2.1 time: 0.197959 Aug 30 04:25:50.940234 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1812/3712] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:50 2022] DELETE /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:50.945022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-162eafdf-cf58-4ba4-a888-9afffa4bb877 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969221d30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:50.997956 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-162eafdf-cf58-4ba4-a888-9afffa4bb877 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/b5ae2bcd-efca-4003-b452-ab36e7c230c2" status: 200 len: 784 microversion: 2.1 time: 0.059267 Aug 30 04:25:50.998938 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1813/3713] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:25:50 2022] GET /compute/v2.1/images/b5ae2bcd-efca-4003-b452-ab36e7c230c2 => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:51.012144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:51.012884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:51.019183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:51.019673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:51.020111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:51.020815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:51.021269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:51.022243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:51.550245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:51.561382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:51.563366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:51.564858 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ebc7aae5-cfb8-4ba0-8db1-804a9d4da332 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1742 microversion: 2.20 time: 0.794695 Aug 30 04:25:51.565520 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1901/3714] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:50 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1742 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:51.580435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:51.600291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e4c26e1-64f5-4f26-9abe-1c8590f929cf tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969a5d940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:51.633104 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-192dc915-4278-4838-ad07-7faffcbc6a99 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1472 microversion: 2.1 time: 0.632857 Aug 30 04:25:51.637845 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1814/3715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:50 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1472 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:51.650360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:51.651062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:51.670430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:51.671385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:51.672031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:51.684330 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e4c26e1-64f5-4f26-9abe-1c8590f929cf tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.103784 Aug 30 04:25:51.684990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:51.686599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:51.687079 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1902/3716] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:25:51 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:51.689127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:51.701569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:51.702885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:51.720550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:51.723887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:51.724798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:51.725774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:51.728151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:51.729560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:52.190245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:52.197712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:52.203744 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ba03bd3-1e74-497a-bae6-5da0ad6fd594 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.515152 Aug 30 04:25:52.206094 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1903/3717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:51 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:52.212330 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f20bc4e7-51a6-4c91-ab2f-342a4c9c9d30 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.573061 Aug 30 04:25:52.225250 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1815/3718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:51 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:52.226551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a889d951-520b-4916-ac29-407c5b3ab8d3 req-9ab4b832-2bd9-4f58-80d7-731b2fef0c37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1892b8-c352-4d48-8593-dd46d7347909", "name": "network-vif-deleted", "tag": "deb8e28e-beed-4d0f-98a8-bc395104d445"}, {"name": "network-changed", "server_uuid": "03491984-41d2-4ea8-a37c-0544b386693b", "tag": "d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:52.241632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c4c9880-0dd6-475f-bd71-a195dcfd810f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969a5dc10>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:52.251858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a889d951-520b-4916-ac29-407c5b3ab8d3 req-9ab4b832-2bd9-4f58-80d7-731b2fef0c37 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:52.252346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a889d951-520b-4916-ac29-407c5b3ab8d3 req-9ab4b832-2bd9-4f58-80d7-731b2fef0c37 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:52.252777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a889d951-520b-4916-ac29-407c5b3ab8d3 req-9ab4b832-2bd9-4f58-80d7-731b2fef0c37 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:52.284777 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a889d951-520b-4916-ac29-407c5b3ab8d3 req-9ab4b832-2bd9-4f58-80d7-731b2fef0c37 service nova] Creating event network-vif-deleted:deb8e28e-beed-4d0f-98a8-bc395104d445 for instance ab1892b8-c352-4d48-8593-dd46d7347909 on n-h1-854925-5 Aug 30 04:25:52.285499 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a889d951-520b-4916-ac29-407c5b3ab8d3 req-9ab4b832-2bd9-4f58-80d7-731b2fef0c37 service nova] Creating event network-changed:d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0 for instance 03491984-41d2-4ea8-a37c-0544b386693b on n-h1-854925-5 Aug 30 04:25:52.306572 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a889d951-520b-4916-ac29-407c5b3ab8d3 req-9ab4b832-2bd9-4f58-80d7-731b2fef0c37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.091208 Aug 30 04:25:52.308023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1816/3719] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:52.591644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:52.592942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:52.602573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:52.609301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:52.609920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:52.613824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:52.614545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:52.615055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:53.252055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c4c9880-0dd6-475f-bd71-a195dcfd810f tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c" status: 204 len: 0 microversion: 2.1 time: 1.041088 Aug 30 04:25:53.252742 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1904/3720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:52 2022] DELETE /compute/v2.1/images/526c3f56-4f37-43d3-848c-1d39c1d7f71c => generated 0 bytes in 1044 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:53.259163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:53.259808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:53.278870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:53.279842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:53.280347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:53.280793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:53.284660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:53.286138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:53.286611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:53.291454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:53.296527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:53.301458 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b8dd2bf-03f8-44c6-bf84-6b08b548ccbf tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1742 microversion: 2.20 time: 0.714525 Aug 30 04:25:53.310515 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1817/3721] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:52 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1742 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:25:53.315664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:53.316535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:53.332823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:53.333889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:53.337070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:53.338073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:53.338702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:53.341989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:53.779337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:53.794856 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98701d6f-c118-40d4-a82e-663849da085c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1472 microversion: 2.1 time: 0.540779 Aug 30 04:25:53.795463 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1905/3722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:53 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:53.817258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:53.817961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:53.836847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:53.845895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:53.846513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:53.847289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:53.847776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:53.848243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:54.040927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:54.052022 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eab2a79c-ecb8-4647-a992-d729619c5590 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.740078 Aug 30 04:25:54.052627 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1818/3723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:53 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:54.057964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c084fe2-6f22-4a79-a871-1bfa0bebe519 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96b13d0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:54.265484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:54.278591 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f3ed5c6-b6ac-4709-a4a6-a226f42525c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.474628 Aug 30 04:25:54.279200 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1906/3724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:53 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:54.339081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:54.340538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:54.355440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:54.355949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:54.356405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:54.357107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:54.357598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:54.358037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:55.004536 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c084fe2-6f22-4a79-a871-1bfa0bebe519 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11" status: 204 len: 0 microversion: 2.1 time: 0.950044 Aug 30 04:25:55.008996 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1819/3725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:54 2022] DELETE /compute/v2.1/images/0b4adccb-e32f-42cc-ba5d-b538d5d63f11 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:55.016665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:55.018027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:55.031898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:55.033767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:55.034403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:55.035318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:55.035996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:55.036590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:55.350751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:55.359219 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1430 microversion: 2.1 time: 0.346832 Aug 30 04:25:55.364532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:55.369694 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1820/3726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:55 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1430 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:55.371418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:55.372383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22864a99-a35e-49c9-8f59-3c142b37fef8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001822 Aug 30 04:25:55.372969 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1821/3727] 10.222.0.27 () {56 vars in 886 bytes} [Tue Aug 30 04:25:55 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 04:25:55.381442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:55.383832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-315b95e3-ebf1-4cef-8aa6-89e9f7f33c5c req-63cdfb6d-6a04-4223-8faa-e931831cfc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a015b05-13a4-42a8-87cc-1df881303bdf", "name": "network-vif-deleted", "tag": "1ac49fa9-9d12-4671-9dde-dbc033d7b69d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:55.384172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:55.387678 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a04bf734-c93f-491f-b90b-b027fad5e714 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 1.052687 Aug 30 04:25:55.388978 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1907/3728] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:54 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:25:55.395660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05db1142-f405-4025-961a-9e316b3348b9 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96a7a69d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:55.420367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-315b95e3-ebf1-4cef-8aa6-89e9f7f33c5c req-63cdfb6d-6a04-4223-8faa-e931831cfc03 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:55.423407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-315b95e3-ebf1-4cef-8aa6-89e9f7f33c5c req-63cdfb6d-6a04-4223-8faa-e931831cfc03 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:55.424078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-315b95e3-ebf1-4cef-8aa6-89e9f7f33c5c req-63cdfb6d-6a04-4223-8faa-e931831cfc03 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:55.460300 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-315b95e3-ebf1-4cef-8aa6-89e9f7f33c5c req-63cdfb6d-6a04-4223-8faa-e931831cfc03 service nova] Creating event network-vif-deleted:1ac49fa9-9d12-4671-9dde-dbc033d7b69d for instance 6a015b05-13a4-42a8-87cc-1df881303bdf on n-h1-854925-5 Aug 30 04:25:55.488566 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-315b95e3-ebf1-4cef-8aa6-89e9f7f33c5c req-63cdfb6d-6a04-4223-8faa-e931831cfc03 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114148 Aug 30 04:25:55.491489 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1822/3729] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:55.512233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:55.516320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:55.537145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:55.540487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:55.545514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:55.550452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:55.551090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:55.552134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:55.848011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:55.855820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4611935-313d-4a32-a87b-91472c3979ec tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.362860 Aug 30 04:25:55.869595 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1823/3730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:55 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:55.872054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:55.872917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:55.888004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:55.888733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:55.889233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:55.890427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:55.891080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:55.891702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.185119 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-05db1142-f405-4025-961a-9e316b3348b9 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5" status: 204 len: 0 microversion: 2.1 time: 0.794880 Aug 30 04:25:56.185788 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1908/3731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:55 2022] DELETE /compute/v2.1/images/f324439e-00a0-424b-8f3e-e9b952a8a9a5 => generated 0 bytes in 796 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:56.193689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:56.194456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:56.201753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.202250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.202676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.203368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.203821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.204245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.276727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:56.369080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:56.377265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-931f74a7-8564-4fe0-b2af-37b52a853a27 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.509645 Aug 30 04:25:56.381214 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1824/3732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:55 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:56.389291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:56.397781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:56.411268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.412092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.412817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.413825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.414458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.415086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.514493 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47ae51ed-3b5f-4998-8345-c18359321d1b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 204 len: 0 microversion: 2.1 time: 0.324343 Aug 30 04:25:56.516579 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1909/3733] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:56 2022] DELETE /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:25:56.531518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:56.532267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:56.551125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.551938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.553545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.557507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.561310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.562116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.689735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:56.702360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5c9c2508-67e6-42a4-87d6-0db0f5e28ace tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1430 microversion: 2.1 time: 0.319674 Aug 30 04:25:56.702962 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1825/3734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:56 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1430 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:56.760725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:56.766348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:56.780839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.783994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.784793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.785702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:56.788454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:56.790414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:56.954560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:56.964128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:56.969739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:56.971409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec9a4869-5569-4a4d-9980-8a54a918650f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.453587 Aug 30 04:25:56.978100 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1910/3735] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:56 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:56.983219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:56.991169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:57.001516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:57.002237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:57.002901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:57.003797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:57.005061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:57.015416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:57.099403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:57.109095 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20283d3e-9437-4d0d-9e35-e59c2a820e50 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1473 microversion: 2.1 time: 0.369616 Aug 30 04:25:57.118571 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1826/3736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:56 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1473 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:57.341979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:57.356550 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d411d385-1cfc-4b78-ac61-ff4e399f049a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.374395 Aug 30 04:25:57.358441 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1911/3737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:56 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:57.405118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:57.406960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:57.423543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:57.426284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:57.428992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:57.429848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:57.429848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:57.431026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:57.728844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:57.729843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:57.744411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:57.744924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:57.755542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:57.764183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:57.764680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:57.770691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:57.881318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:57.881867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:57.882317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:57.882787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lazy-loading 'fault' on Instance uuid 6a015b05-13a4-42a8-87cc-1df881303bdf {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:25:58.059579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:58.076891 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d49fa086-5a7f-498b-9bb6-01f39c07273a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 200 len: 1307 microversion: 2.1 time: 0.354107 Aug 30 04:25:58.077770 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1912/3738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:57 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 1307 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:58.115563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b19fe7f8-c610-4846-85e0-df4931fd5ab0 req-153ca436-cd3b-47a2-a07d-01539afb7bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "name": "network-vif-plugged", "status": "completed", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:25:58.129028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b19fe7f8-c610-4846-85e0-df4931fd5ab0 req-153ca436-cd3b-47a2-a07d-01539afb7bc5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:58.129940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b19fe7f8-c610-4846-85e0-df4931fd5ab0 req-153ca436-cd3b-47a2-a07d-01539afb7bc5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:58.130775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b19fe7f8-c610-4846-85e0-df4931fd5ab0 req-153ca436-cd3b-47a2-a07d-01539afb7bc5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:58.156243 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b19fe7f8-c610-4846-85e0-df4931fd5ab0 req-153ca436-cd3b-47a2-a07d-01539afb7bc5 service nova] Creating event network-vif-plugged:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h1-854925-5 Aug 30 04:25:58.162792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b19fe7f8-c610-4846-85e0-df4931fd5ab0 req-153ca436-cd3b-47a2-a07d-01539afb7bc5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061968 Aug 30 04:25:58.163410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:58.164120 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1913/3739] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:25:58.174067 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77c1f27f-f239-49d8-a24e-502309bafb45 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.773837 Aug 30 04:25:58.174265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:58.174982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:58.178819 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1827/3740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:57 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:58.184134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:58.184928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:58.197263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:58.197837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:58.198288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:58.200528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:58.201018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:58.203077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:58.203552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:58.203673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:58.203980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:58.210401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:58.217142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:58.218556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:58.286225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:25:58.858818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:58.878546 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-268d5e3b-e09f-4b01-b09a-af5bd38486b7 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1473 microversion: 2.1 time: 0.690713 Aug 30 04:25:58.886515 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1828/3741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:58 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1473 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:58.903164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:58.910799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:58.912092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:58.915170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:58.916623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:58.929612 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ed5c76a4-d903-401a-9150-d73318796a53 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.763480 Aug 30 04:25:58.930649 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1914/3742] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:25:58 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:25:58.933998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:58.935938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:58.950802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:58.952006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:58.952511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:58.952963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.099643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:59.100271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 6a015b05-13a4-42a8-87cc-1df881303bdf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:59.117562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.117562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.117562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.118124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.123564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.124128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.171364 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance 6a015b05-13a4-42a8-87cc-1df881303bdf could not be found. Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf HTTP/1.1 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 6a015b05-13a4-42a8-87cc-1df881303bdf could not be found. Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '6a015b05-13a4-42a8-87cc-1df881303bdf'} Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a015b05-13a4-42a8-87cc-1df881303bdf could not be found. Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a015b05-13a4-42a8-87cc-1df881303bdf could not be found. Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:25:59.173097 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:59.177186 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:25:59.177186 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:25:59.177186 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:25:59.177186 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:25:59.177186 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:25:59.177186 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a015b05-13a4-42a8-87cc-1df881303bdf could not be found. Aug 30 04:25:59.177186 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:25:59.181931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance 6a015b05-13a4-42a8-87cc-1df881303bdf could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:25:59.183058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7badc577-0ee8-4899-bfd1-5645b3fee170 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf" status: 404 len: 111 microversion: 2.1 time: 0.087583 Aug 30 04:25:59.186479 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1915/3743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:59 2022] GET /compute/v2.1/servers/6a015b05-13a4-42a8-87cc-1df881303bdf => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:25:59.197614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:59.198570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:59.212817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.213617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.217448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.218376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.218991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.219594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.292623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:25:59.436089 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cdc39ce5-7388-42fb-8f61-9df4bedf915c tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 204 len: 0 microversion: 2.1 time: 0.244344 Aug 30 04:25:59.437581 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1916/3744] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:59 2022] DELETE /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:25:59.443652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:59.444446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:59.451978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.452467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.452945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.453704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.454160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.454675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.736125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:25:59.750430 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-898d3d8d-246b-445e-b737-65b4cbeccaea tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.862276 Aug 30 04:25:59.751603 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1829/3745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:58 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:25:59.764419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:25:59.772176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:25:59.790563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.791257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.791602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.792924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:25:59.793418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:25:59.793822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:25:59.851913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:00.097640 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec3c13b3-110e-4462-82b5-965e224a2459 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 204 len: 0 microversion: 2.1 time: 0.341243 Aug 30 04:26:00.100679 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1830/3746] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:25:59 2022] DELETE /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:00.118517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:00.123320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:00.138546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.139673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.140484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.142217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.142898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.143704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.286965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:00.314561 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b4e9af1-cece-4880-a404-08fd57c20f98 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.875647 Aug 30 04:26:00.315520 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1917/3747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:25:59 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:00.320493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:00.321109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:00.328338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.328878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.330642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.331782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.332265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.333258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.592261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:00.610830 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5594ee3-c118-400a-94f6-2391e5af5fce tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1473 microversion: 2.1 time: 0.508114 Aug 30 04:26:00.612183 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1831/3748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:00 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1473 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:00.627007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:00.627716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:00.640554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.650076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.653260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.654132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.654672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.655653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:00.897223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:00.902764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:00.917714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:00.926767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:00.931211 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25619612-1fcf-4f55-86cb-10a93fc0e474 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.613519 Aug 30 04:26:00.933119 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1918/3749] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:00 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:00.946077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8f6f5cae-5d62-4580-b68b-84f23aab354c req-be914bad-f42a-46b1-b340-95e4ff40dc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e8a194-f7bd-4579-ad3a-7b85ab11eaae", "name": "network-vif-plugged", "status": "completed", "tag": "be1b5369-d6ce-4842-b558-7e1202b6e6ed"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:00.973546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8f6f5cae-5d62-4580-b68b-84f23aab354c req-be914bad-f42a-46b1-b340-95e4ff40dc3a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:00.975462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8f6f5cae-5d62-4580-b68b-84f23aab354c req-be914bad-f42a-46b1-b340-95e4ff40dc3a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:00.976136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8f6f5cae-5d62-4580-b68b-84f23aab354c req-be914bad-f42a-46b1-b340-95e4ff40dc3a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.042560 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8f6f5cae-5d62-4580-b68b-84f23aab354c req-be914bad-f42a-46b1-b340-95e4ff40dc3a service nova] Creating event network-vif-plugged:be1b5369-d6ce-4842-b558-7e1202b6e6ed for instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae on n-h2-854925-5 Aug 30 04:26:01.066633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8f6f5cae-5d62-4580-b68b-84f23aab354c req-be914bad-f42a-46b1-b340-95e4ff40dc3a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116139 Aug 30 04:26:01.068040 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1919/3750] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:01.074892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:01.081482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:01.089877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:01.101743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.102262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.102885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.103848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.105574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.107176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.109436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-130e7d1a-33cd-44f5-a153-6c038aeaa404 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 200 len: 1474 microversion: 2.1 time: 0.495862 Aug 30 04:26:01.115411 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1832/3751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:00 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 1474 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:01.129609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-609c3bf6-920d-4200-bc85-997a1c4fee90 req-4a4b79d1-f57f-4dca-a040-84a6228fea3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0", "name": "network-vif-deleted", "tag": "063977e0-19b2-4875-a3fd-2f8c5b5b8529"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:01.151727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-609c3bf6-920d-4200-bc85-997a1c4fee90 req-4a4b79d1-f57f-4dca-a040-84a6228fea3b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.152495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-609c3bf6-920d-4200-bc85-997a1c4fee90 req-4a4b79d1-f57f-4dca-a040-84a6228fea3b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.153594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-609c3bf6-920d-4200-bc85-997a1c4fee90 req-4a4b79d1-f57f-4dca-a040-84a6228fea3b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.168392 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-609c3bf6-920d-4200-bc85-997a1c4fee90 req-4a4b79d1-f57f-4dca-a040-84a6228fea3b service nova] Creating event network-vif-deleted:063977e0-19b2-4875-a3fd-2f8c5b5b8529 for instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 on n-h2-854925-5 Aug 30 04:26:01.174543 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-609c3bf6-920d-4200-bc85-997a1c4fee90 req-4a4b79d1-f57f-4dca-a040-84a6228fea3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048760 Aug 30 04:26:01.175696 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1833/3752] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:01.326294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:01.338779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:01.339535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:01.350554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.356098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.356478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.358093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.360035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.366311 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ef00752-74a1-4de2-9b21-503192c2facf tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.296480 Aug 30 04:26:01.370091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.388529 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1920/3753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:01 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:01.642242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:01.643061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:01.654770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.655190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.663162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.666827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.669565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.674204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.764475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.767989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.788047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.788996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lazy-loading 'fault' on Instance uuid a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:01.811220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:01.836942 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1260df4d-a7bf-4d25-bb98-66fba0486bf0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.504321 Aug 30 04:26:01.837588 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1834/3754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:01 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:01.963881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:01.965268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:01.984143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.984729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.987984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:01.992183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:01.995392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:01.998880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:02.397445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:02.414717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c676fe99-00f2-48fe-9c1f-9de084b3a583 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 200 len: 1308 microversion: 2.1 time: 0.784710 Aug 30 04:26:02.433362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1921/3755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:01 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 1308 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:02.444507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:02.447588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:02.462527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:02.465112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:02.465863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:02.466766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:02.469528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:02.470227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.082180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:03.117850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:03.119779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:03.127519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:03.132334 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63cb763d-0a2f-4b8a-98b4-d34197e2630d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 1.174172 Aug 30 04:26:03.141588 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4a1778ef-b12d-4778-bf2f-85f3a6025616 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 200 len: 1474 microversion: 2.1 time: 0.706714 Aug 30 04:26:03.144828 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1922/3756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:02 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 1474 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:03.146606 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1835/3757] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:01 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:03.157368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:03.159043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:03.163965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:03.178362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:03.178616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.180462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.181410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.194160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.197636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.198141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.200396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.215131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.217274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:03.223337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:03.224018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:03.226210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.100715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:04.109528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-228ff321-9d48-4cdd-be6e-52ad82db9c71 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.961474 Aug 30 04:26:04.114602 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1836/3758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:03 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:04.129441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3feb7afd-5471-48d7-946b-a63e98741142 req-9e96b46e-2660-4a34-8427-3811ce83cd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f107c254-cbdf-4265-9715-e9bbb13e8c32", "name": "network-vif-deleted", "tag": "c58c9b91-e362-45a6-926d-9df70b39963d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:04.144138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3feb7afd-5471-48d7-946b-a63e98741142 req-9e96b46e-2660-4a34-8427-3811ce83cd22 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.148287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3feb7afd-5471-48d7-946b-a63e98741142 req-9e96b46e-2660-4a34-8427-3811ce83cd22 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.149012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3feb7afd-5471-48d7-946b-a63e98741142 req-9e96b46e-2660-4a34-8427-3811ce83cd22 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.183116 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3feb7afd-5471-48d7-946b-a63e98741142 req-9e96b46e-2660-4a34-8427-3811ce83cd22 service nova] Creating event network-vif-deleted:c58c9b91-e362-45a6-926d-9df70b39963d for instance f107c254-cbdf-4265-9715-e9bbb13e8c32 on n-h2-854925-5 Aug 30 04:26:04.197064 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3feb7afd-5471-48d7-946b-a63e98741142 req-9e96b46e-2660-4a34-8427-3811ce83cd22 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080428 Aug 30 04:26:04.198392 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1837/3759] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:04.216777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:04.220299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:04.235449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.241088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.241854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.242838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.243502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.244146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.267348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:04.284532 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e3c5460c-b1b7-4742-a1ad-8529483a0f5f tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 1.135385 Aug 30 04:26:04.289897 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1923/3760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:03 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:04.293295 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] HTTP exception thrown: Instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 could not be found. Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Request method failure captured: Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 HTTP/1.1 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZCahC8Oikjw7ElKUzhBhOFfLWo-oZx_b53s7JfkJgM4ZpZzmSW1nira4Z-UqN6PSmRR-w6GQdEWdSCnWt3q0yUvO-KybP-VTxBNB5CYi0F6TOISRJbF1twA9maq0FSORSoK8X-srSMufXhh2o54ikUUokswCZEz6aBs5474bvwbHG8 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7510a67478644f898bebcd31652de940 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListImageFiltersTestJSON-490965513 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7510a67478644f898bebcd31652de940", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7510a67478644f898bebcd31652de940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7510a67478644f898bebcd31652de940"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7510a67478644f898bebcd31652de940"}]}] Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListImageFiltersTestJSON-490965513 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7510a67478644f898bebcd31652de940 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-490965513 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListImageFiltersTestJSON-490965513-project Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1ddf0680774f4ea6b7751706667bd896 Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListImageFiltersTestJSON-490965513-project Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 could not be found. Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0'} Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 could not be found. Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 could not be found. Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:04.295283 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:04.299241 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:04.299241 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:04.299241 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:04.299241 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:04.299241 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:04.299241 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 could not be found. Aug 30 04:26:04.299241 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:04.302008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a470bdcb-a585-4e0f-a0bc-29385329fa0d req-f571a0fd-da26-4c11-93ba-6527867bdf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102d4935-336f-4a28-bbad-4adda3e5c7e3", "name": "network-vif-plugged", "status": "completed", "tag": "d23c3020-e156-4999-8b30-8706ae0a8a96"}, {"server_uuid": "49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800", "name": "network-vif-plugged", "status": "completed", "tag": "8acd5cb6-4c52-4486-a973-d61788826f47"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:04.302779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Returning 404 to user: Instance a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:04.305117 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2947d6d-84af-4547-82dc-66f52b5ae579 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0" status: 404 len: 111 microversion: 2.1 time: 0.105081 Aug 30 04:26:04.309621 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1838/3761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:04 2022] GET /compute/v2.1/servers/a6c3b4ed-be3b-4db5-9d8f-acf2fb049ea0 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:04.334941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:04.335890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:04.355780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a470bdcb-a585-4e0f-a0bc-29385329fa0d req-f571a0fd-da26-4c11-93ba-6527867bdf5f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.356010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.356463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.356908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.357656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.357926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a470bdcb-a585-4e0f-a0bc-29385329fa0d req-f571a0fd-da26-4c11-93ba-6527867bdf5f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.359588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a470bdcb-a585-4e0f-a0bc-29385329fa0d req-f571a0fd-da26-4c11-93ba-6527867bdf5f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.361923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.362375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.407108 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a470bdcb-a585-4e0f-a0bc-29385329fa0d req-f571a0fd-da26-4c11-93ba-6527867bdf5f service nova] Creating event network-vif-plugged:d23c3020-e156-4999-8b30-8706ae0a8a96 for instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 on n-h1-854925-5 Aug 30 04:26:04.408748 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a470bdcb-a585-4e0f-a0bc-29385329fa0d req-f571a0fd-da26-4c11-93ba-6527867bdf5f service nova] Creating event network-vif-plugged:8acd5cb6-4c52-4486-a973-d61788826f47 for instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 on n-h2-854925-5 Aug 30 04:26:04.436092 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a470bdcb-a585-4e0f-a0bc-29385329fa0d req-f571a0fd-da26-4c11-93ba-6527867bdf5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.144306 Aug 30 04:26:04.436799 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1924/3762] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:04.446366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:04.448035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:04.459017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.461043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.461983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.463078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.463549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.464544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.565131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.565911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.566539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.567155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lazy-loading 'fault' on Instance uuid cb375c92-a532-4c37-a8b0-fa947e77db24 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:04.723172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:04.741090 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6bf9fd5e-181c-47e9-b879-4e86db44e0ec tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 200 len: 1308 microversion: 2.1 time: 0.302136 Aug 30 04:26:04.741937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1925/3763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:04 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:04.771416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:04.771935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:04.784450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.784969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.785434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.786155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:04.786614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:04.787047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:04.844255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:05.036304 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-853329a4-9863-4d00-8cee-d6486cedb582 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 204 len: 0 microversion: 2.1 time: 0.270540 Aug 30 04:26:05.037878 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1926/3764] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:04 2022] DELETE /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:05.058727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:05.060296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:05.074098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.075293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.085612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.086691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.088041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.088738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.089977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.092642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.109168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.110716 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c3c5f9b-0bb6-4515-a7a7-66d152b15a11 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.799758 Aug 30 04:26:05.121868 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1839/3765] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:04 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:05.136463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:05.137095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:05.149599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.150100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.150547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.151270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.152294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.152736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.602441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.628505 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-90801de3-2a47-4f86-9a76-c296313bf82e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1474 microversion: 2.1 time: 0.586045 Aug 30 04:26:05.629319 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1927/3766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:05 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1474 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:05.642409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:05.643047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:05.665115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.665707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.666323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.667862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.668478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.669082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.706947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:05.727055 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d0eaab5f-32c8-40da-b355-a03d19ac6ced tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.592593 Aug 30 04:26:05.750668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1840/3767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:05 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:05.766657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:05.770195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:05.795423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.805842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.808649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.810466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:05.814569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:05.815177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:05.897226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:06.141998 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3ad56eea-412d-45dd-a691-37f19a309c79 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "DELETE /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 204 len: 0 microversion: 2.1 time: 0.389162 Aug 30 04:26:06.143639 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1841/3768] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:05 2022] DELETE /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:06.145727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.156454 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a0f6804-e58e-41c7-92a1-0c29724cbc5d tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.517980 Aug 30 04:26:06.157046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.157801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: cb375c92-a532-4c37-a8b0-fa947e77db24] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.158007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1928/3769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:05 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:06.163210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.164024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.166963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.172236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.172754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.173548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.174477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.174477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.178249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.179362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.179973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.180880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.181572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.182146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.211204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance cb375c92-a532-4c37-a8b0-fa947e77db24 could not be found. Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 HTTP/1.1 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance cb375c92-a532-4c37-a8b0-fa947e77db24 could not be found. Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'cb375c92-a532-4c37-a8b0-fa947e77db24'} Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb375c92-a532-4c37-a8b0-fa947e77db24 could not be found. Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb375c92-a532-4c37-a8b0-fa947e77db24 could not be found. Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:06.215813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb375c92-a532-4c37-a8b0-fa947e77db24 could not be found. Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance cb375c92-a532-4c37-a8b0-fa947e77db24 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e16695f4-566d-4f2c-9c6a-538c3e00baa3 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24" status: 404 len: 111 microversion: 2.1 time: 0.072415 Aug 30 04:26:06.219157 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1842/3770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/cb375c92-a532-4c37-a8b0-fa947e77db24 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:06.231079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.231705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.244811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.245363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.245802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.246499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.246951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.247375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.472552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.484940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.492049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.495690 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a2c8a489-0971-481f-9d49-ed66c72187a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.334374 Aug 30 04:26:06.495690 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1929/3771] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:06.509413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.510561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: f107c254-cbdf-4265-9715-e9bbb13e8c32] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.527141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.530005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.530838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.531793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.534153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.534845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.580944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance f107c254-cbdf-4265-9715-e9bbb13e8c32 could not be found. Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 HTTP/1.1 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance f107c254-cbdf-4265-9715-e9bbb13e8c32 could not be found. Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'f107c254-cbdf-4265-9715-e9bbb13e8c32'} Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f107c254-cbdf-4265-9715-e9bbb13e8c32 could not be found. Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f107c254-cbdf-4265-9715-e9bbb13e8c32 could not be found. Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:06.583630 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.587010 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:06.587010 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:06.587010 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:06.587010 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:06.587010 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:06.587010 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f107c254-cbdf-4265-9715-e9bbb13e8c32 could not be found. Aug 30 04:26:06.587010 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:06.608006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance f107c254-cbdf-4265-9715-e9bbb13e8c32 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:06.614714 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5976538c-3b35-45f0-b513-5746075e158f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32" status: 404 len: 111 microversion: 2.1 time: 0.119271 Aug 30 04:26:06.615625 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1930/3772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/f107c254-cbdf-4265-9715-e9bbb13e8c32 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:06.630180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-163135ce-e53b-43a3-af3b-59837876bf23 req-59bef55f-cef2-49eb-86ad-9890968fa826 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb375c92-a532-4c37-a8b0-fa947e77db24", "name": "network-vif-deleted", "tag": "b2e910fa-5768-4639-bb01-583ea3a0b61f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:06.647034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:06.653010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-163135ce-e53b-43a3-af3b-59837876bf23 req-59bef55f-cef2-49eb-86ad-9890968fa826 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.653891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-163135ce-e53b-43a3-af3b-59837876bf23 req-59bef55f-cef2-49eb-86ad-9890968fa826 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.654481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-163135ce-e53b-43a3-af3b-59837876bf23 req-59bef55f-cef2-49eb-86ad-9890968fa826 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.659971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e861b3ed-31b0-48d7-a7ac-1acdfd59a154 tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1666 microversion: 2.1 time: 0.440866 Aug 30 04:26:06.672473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-163135ce-e53b-43a3-af3b-59837876bf23 req-59bef55f-cef2-49eb-86ad-9890968fa826 service nova] Creating event network-vif-deleted:b2e910fa-5768-4639-bb01-583ea3a0b61f for instance cb375c92-a532-4c37-a8b0-fa947e77db24 on n-h1-854925-5 Aug 30 04:26:06.678812 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-163135ce-e53b-43a3-af3b-59837876bf23 req-59bef55f-cef2-49eb-86ad-9890968fa826 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060066 Aug 30 04:26:06.679972 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1931/3773] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:06.682164 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1843/3774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1666 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:06.687649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.688261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.688794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71fe27ab-ee85-4626-9e0a-87a67c7f7b68 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.702636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.707667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.708747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.709663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.710257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.712025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.760250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71fe27ab-ee85-4626-9e0a-87a67c7f7b68 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/a4f8d81d-2b9f-418b-a4b0-49f85931e70d" status: 204 len: 0 microversion: 2.1 time: 0.078821 Aug 30 04:26:06.769380 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1932/3775] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:26:06 2022] DELETE /compute/v2.1/os-server-groups/a4f8d81d-2b9f-418b-a4b0-49f85931e70d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:06.777206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:06.785586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:06.786523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:06.824667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.833120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.836365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:06.840311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:06.842686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:06.844890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.405077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:07.433617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:07.454144 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd2db23c-8de2-45f2-bd93-e1621422f153 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1474 microversion: 2.1 time: 0.767587 Aug 30 04:26:07.457549 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1844/3776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1474 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:07.468669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:07.470030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:07.488837 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-12acdd43-95a1-4ff2-a37f-e968fab57470 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.714688 Aug 30 04:26:07.492266 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1933/3777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:06 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:07.499271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.499776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.500219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.500926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.501401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.501830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.508705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1725b3e6-de6a-4c10-b07f-493e1df4dd5a req-3ea167f1-3de3-4564-b19f-92d3e2f00a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03491984-41d2-4ea8-a37c-0544b386693b", "name": "network-vif-plugged", "status": "completed", "tag": "d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:07.573843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:07.594378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1725b3e6-de6a-4c10-b07f-493e1df4dd5a req-3ea167f1-3de3-4564-b19f-92d3e2f00a17 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.598996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1725b3e6-de6a-4c10-b07f-493e1df4dd5a req-3ea167f1-3de3-4564-b19f-92d3e2f00a17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.603341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1725b3e6-de6a-4c10-b07f-493e1df4dd5a req-3ea167f1-3de3-4564-b19f-92d3e2f00a17 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.641340 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1725b3e6-de6a-4c10-b07f-493e1df4dd5a req-3ea167f1-3de3-4564-b19f-92d3e2f00a17 service nova] Creating event network-vif-plugged:d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0 for instance 03491984-41d2-4ea8-a37c-0544b386693b on n-h1-854925-5 Aug 30 04:26:07.659287 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1725b3e6-de6a-4c10-b07f-493e1df4dd5a req-3ea167f1-3de3-4564-b19f-92d3e2f00a17 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165616 Aug 30 04:26:07.660518 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1934/3778] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:07.666042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:07.676986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:07.698936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.703558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.704165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.716854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.717553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.718175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.759877 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d339a5e5-4208-4964-bafb-0402178910ae tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 204 len: 0 microversion: 2.1 time: 0.300429 Aug 30 04:26:07.762405 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1845/3779] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:07 2022] DELETE /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:07.782125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:07.784395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:07.802733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:07.809091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.810956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.812918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:07.814881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:07.816127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:07.817647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.356342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.365725 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-806dabaf-2d4f-4740-9aec-fc7cd2736e6a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.703548 Aug 30 04:26:08.366851 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1935/3780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:07 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:08.389056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:08.391138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:08.402146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:08.407351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.408139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.408822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.409825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.411203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.411852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.524974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.534594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.547107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.548923 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c36a683-44c3-4895-bd31-291c1141a68e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.784980 Aug 30 04:26:08.550053 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1846/3781] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:07 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:08.566225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:08.567155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:08.580695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.593755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.596604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.597631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.598988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.601423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.681120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:08.897621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2e1822f-f055-4de3-a07e-e4fd9863ad45 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 204 len: 0 microversion: 2.1 time: 0.345937 Aug 30 04:26:08.899028 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1847/3782] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:08 2022] DELETE /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:08.905855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:08.907008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:08.917222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.917903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.918554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.919416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:08.920208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:08.920835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:08.966498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b773ad51ff6048f898ce7db8eba855e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f54901782b046dd88fffca8ea054109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:08.974882 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb719ffd-6ffe-49fe-a324-49a3efd85ffb tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 200 len: 1666 microversion: 2.1 time: 0.606822 Aug 30 04:26:08.987016 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1936/3783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:08 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 1666 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:09.012830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:09.013517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:09.023862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.024368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.024852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.025658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.026125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.026788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.054673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:09.327825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:09.336511 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1474 microversion: 2.1 time: 0.435900 Aug 30 04:26:09.360156 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1848/3784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:08 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1474 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:09.361648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:09.362743 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51f768de-f268-4397-af10-dac08e1d168b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001650 Aug 30 04:26:09.370802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1849/3785] 10.222.0.27 () {56 vars in 886 bytes} [Tue Aug 30 04:26:09 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 04:26:09.388069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:09.391510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:09.406680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.407266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.407734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.413397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.414149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.414615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.505756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:09.515805 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-119e5710-9ba2-4e42-bb07-002a1b5bacb8 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.517142 Aug 30 04:26:09.525876 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1937/3786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:08 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:09.542584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:09.551164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:09.577048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.584746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.585471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:09.589293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:09.592264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:09.594231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.262644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.274769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c50d4eca-d82e-4504-b947-aada224678cb tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1314 microversion: 2.1 time: 0.740519 Aug 30 04:26:10.284380 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1938/3787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:09 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:10.299927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.326561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ab24bcd-a4a4-4d37-b95b-64b509db70f8 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1475 microversion: 2.1 time: 0.953710 Aug 30 04:26:10.346398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1850/3788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:09 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1475 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:10.348582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0abdeee2-2766-41ba-b2d2-516a691911c3 req-dda6b3bc-9996-43bb-9c1a-4ad792e36775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69ca72e1-8b4d-48e3-bd8d-6ddc94691227", "name": "network-vif-deleted", "tag": "ec53bdea-27ca-477d-b33c-085dea1871bb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:10.363799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:10.380035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:10.410243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0abdeee2-2766-41ba-b2d2-516a691911c3 req-dda6b3bc-9996-43bb-9c1a-4ad792e36775 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.413288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0abdeee2-2766-41ba-b2d2-516a691911c3 req-dda6b3bc-9996-43bb-9c1a-4ad792e36775 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.416396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0abdeee2-2766-41ba-b2d2-516a691911c3 req-dda6b3bc-9996-43bb-9c1a-4ad792e36775 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.420333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.420333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.420765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.426021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.429891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.435321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.473632 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0abdeee2-2766-41ba-b2d2-516a691911c3 req-dda6b3bc-9996-43bb-9c1a-4ad792e36775 service nova] Creating event network-vif-deleted:ec53bdea-27ca-477d-b33c-085dea1871bb for instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 on n-h2-854925-5 Aug 30 04:26:10.488341 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0abdeee2-2766-41ba-b2d2-516a691911c3 req-dda6b3bc-9996-43bb-9c1a-4ad792e36775 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199023 Aug 30 04:26:10.490600 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1939/3789] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:10.503605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:10.506185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] [instance: 69ca72e1-8b4d-48e3-bd8d-6ddc94691227] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:10.525586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.528593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.530436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.532042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.533921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.538666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.589868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] HTTP exception thrown: Instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 could not be found. Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Request method failure captured: Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 HTTP/1.1 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZEaT25_KWQs1R5R1ywIgojESintjPRhu95EFkJXPQf3ZMQeis4-iQsgN9T5FWOYL3KqrYVxDLhE5sJnmMsr_H8X872DSGyzU2fpjdZFjWWDay9rwvMeAzaqkAu5hBhgrKacwVi6B3ts0GJZ6Xb_KX9ivfhHcN1L4n2Llc1wyrw9q-8 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 9f54901782b046dd88fffca8ea054109 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestFqdnHostnames-1784451236 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9f54901782b046dd88fffca8ea054109", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9f54901782b046dd88fffca8ea054109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f54901782b046dd88fffca8ea054109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9f54901782b046dd88fffca8ea054109"}]}] Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestFqdnHostnames-1784451236 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 9f54901782b046dd88fffca8ea054109 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1784451236 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestFqdnHostnames-1784451236-project Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b773ad51ff6048f898ce7db8eba855e6 Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestFqdnHostnames-1784451236-project Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 could not be found. Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '69ca72e1-8b4d-48e3-bd8d-6ddc94691227'} Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 could not be found. Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 could not be found. Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:10.609273 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:10.614057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:10.614057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:10.614057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:10.614057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:10.614057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:10.614057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 could not be found. Aug 30 04:26:10.614057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:10.616701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Returning 404 to user: Instance 69ca72e1-8b4d-48e3-bd8d-6ddc94691227 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:10.625237 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d7b22ed-fee1-4819-86df-8909eb03537c tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227" status: 404 len: 111 microversion: 2.1 time: 0.133047 Aug 30 04:26:10.626279 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1940/3790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:10 2022] GET /compute/v2.1/servers/69ca72e1-8b4d-48e3-bd8d-6ddc94691227 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:10.644426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:10.645441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:10.660127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.660928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.665930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.668094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.669104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.669793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.882617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.925130 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-75c9b093-4c2b-42d7-9fd7-d021f03e45ac tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1432 microversion: 2.1 time: 0.290848 Aug 30 04:26:10.929118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1941/3791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:10 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1432 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:10.944944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.955376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.958092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:10.960760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:10.962032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:10.965404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-406cf629-3595-4736-bf57-da622431fbf2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.617881 Aug 30 04:26:10.969998 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1851/3792] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:10 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:10.980651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d565c00f-94e6-4108-8d6e-84c16f558f3e tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] Calling method '.version_select at 0x7fe96924f700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:10.990081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.996501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:10.997105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:10.997906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:10.998387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.008046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.052326 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d565c00f-94e6-4108-8d6e-84c16f558f3e tempest-ServersTestFqdnHostnames-1784451236 tempest-ServersTestFqdnHostnames-1784451236-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-731287238" status: 202 len: 0 microversion: 2.1 time: 0.078538 Aug 30 04:26:11.053178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1852/3793] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:26:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-731287238 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:26:11.304810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:11.305475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:11.317286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.317820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.318274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.322877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.323448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.323905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.402755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:11.413582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1410ed0c-54f6-453e-af32-174c96e37f3a tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.479840 Aug 30 04:26:11.415899 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1942/3794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:10 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:11.428320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:11.429986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:11.452744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.453316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.453899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.454738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.455444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.456088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.904674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:11.912877 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-58f23caf-36c4-4ce1-85f9-8d176078e5fa tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1463 microversion: 2.1 time: 0.612361 Aug 30 04:26:11.918805 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1853/3795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:11 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1463 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:11.943375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67baf8b2-679e-4dab-b68f-feda92d9c6a7", "device": "/dev/sdb"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:11.946612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:11.961218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.963499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.965944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:11.972185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:11.972816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:11.974551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.138907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:12.168827 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f1ff463b-4b29-47e2-a404-c2ae13537ffe tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1475 microversion: 2.1 time: 0.749510 Aug 30 04:26:12.178837 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1943/3796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:11 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1475 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:12.187568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:12.191979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:12.222668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:12.228169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:12.228979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.231490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:12.236276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:12.249675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.326674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:12.327330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:12.329628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.331460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lazy-loading 'fault' on Instance uuid 76a02175-d9f3-4f57-9db1-618596566c85 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:12.443755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:12.472610 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2706888-c7e8-4f71-9823-eda9d961d1cc tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1308 microversion: 2.1 time: 0.291385 Aug 30 04:26:12.479592 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1944/3797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:12 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:12.497701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:12.498609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:12.506247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:12.508715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:12.510243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.511203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:12.516071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:12.517054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:12.966798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:12.984792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:13.003471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:13.009471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-688d96bd-60e2-499d-a618-71e5a0652ea7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.526758 Aug 30 04:26:13.012146 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1945/3798] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:12 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:13.021559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:13.040721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:13.060575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.064918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.065737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.067077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.069922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.070659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.429676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:13.443477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec41ceaf-c903-46d1-9a68-4ab1e9a81536 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1323 microversion: 2.1 time: 0.425725 Aug 30 04:26:13.445624 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1946/3799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:13 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:13.453914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cae2220d-7f2c-429a-87f6-f7ca8b88e3a3 req-29973608-018e-4577-9ed8-6bb6b250a27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a02175-d9f3-4f57-9db1-618596566c85", "name": "network-vif-deleted", "tag": "78448671-cdb4-443f-ae74-c0c03dd6955b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:13.486462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cae2220d-7f2c-429a-87f6-f7ca8b88e3a3 req-29973608-018e-4577-9ed8-6bb6b250a27f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.487223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cae2220d-7f2c-429a-87f6-f7ca8b88e3a3 req-29973608-018e-4577-9ed8-6bb6b250a27f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.487893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cae2220d-7f2c-429a-87f6-f7ca8b88e3a3 req-29973608-018e-4577-9ed8-6bb6b250a27f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.529914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cae2220d-7f2c-429a-87f6-f7ca8b88e3a3 req-29973608-018e-4577-9ed8-6bb6b250a27f service nova] Creating event network-vif-deleted:78448671-cdb4-443f-ae74-c0c03dd6955b for instance 76a02175-d9f3-4f57-9db1-618596566c85 on n-h1-854925-5 Aug 30 04:26:13.548851 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cae2220d-7f2c-429a-87f6-f7ca8b88e3a3 req-29973608-018e-4577-9ed8-6bb6b250a27f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101036 Aug 30 04:26:13.555428 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1947/3800] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:13.571989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:13.573836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:13.595568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.597319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.598171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.600541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.603396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.604240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.874292 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0de5228e-bcbc-4a18-9a2b-03d61064e7d8 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "POST /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.935664 Aug 30 04:26:13.876625 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1854/3801] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:26:11 2022] POST /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3/os-volume_attachments => generated 194 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:13.891126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7edbc7d7-de6a-4fac-b7fa-08db5f36c75f req-d4975a7f-eff6-40ee-880e-0c9092c60a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152", "name": "network-vif-deleted", "tag": "72f2911a-10e3-473d-a172-f8ac8b9e6d12"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:13.919241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7edbc7d7-de6a-4fac-b7fa-08db5f36c75f req-d4975a7f-eff6-40ee-880e-0c9092c60a98 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:13.920007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7edbc7d7-de6a-4fac-b7fa-08db5f36c75f req-d4975a7f-eff6-40ee-880e-0c9092c60a98 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:13.920656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7edbc7d7-de6a-4fac-b7fa-08db5f36c75f req-d4975a7f-eff6-40ee-880e-0c9092c60a98 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:13.936902 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7edbc7d7-de6a-4fac-b7fa-08db5f36c75f req-d4975a7f-eff6-40ee-880e-0c9092c60a98 service nova] Creating event network-vif-deleted:72f2911a-10e3-473d-a172-f8ac8b9e6d12 for instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 on n-h1-854925-5 Aug 30 04:26:13.944492 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7edbc7d7-de6a-4fac-b7fa-08db5f36c75f req-d4975a7f-eff6-40ee-880e-0c9092c60a98 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066209 Aug 30 04:26:13.945853 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1855/3802] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:13.973741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:13.978284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:13.999814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.001188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.003165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.005855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.006555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.008522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.109517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.110318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.113168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.114215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lazy-loading 'fault' on Instance uuid 76a02175-d9f3-4f57-9db1-618596566c85 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:14.330387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ddf0680774f4ea6b7751706667bd896', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7510a67478644f898bebcd31652de940', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:14.344623 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b31052d-cb12-4c73-98ac-8976a8446f8e tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 200 len: 1308 microversion: 2.1 time: 0.396595 Aug 30 04:26:14.359807 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1856/3803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:13 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 1308 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:14.372516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.373428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:14.389218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.390105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.395713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.396769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.399376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.400014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.417607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:14.431292 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec837723-76be-48f5-94b1-0389fcdda7a7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1475 microversion: 2.1 time: 0.873106 Aug 30 04:26:14.446122 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1948/3804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:13 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1475 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:14.468681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:14.469769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:14.481213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.482094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.482763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:14.484429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:14.485100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:14.485856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.638592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:15.660316 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7b503b0-3cd1-4b09-a763-086e070317c0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1517 microversion: 2.1 time: 1.196160 Aug 30 04:26:15.680580 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1949/3805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:14 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1517 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:15.691279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:15.692147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] [instance: 76a02175-d9f3-4f57-9db1-618596566c85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:15.700862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.719919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.720502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.721365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.721919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.722358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.740587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:15.760165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:15.762964 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] HTTP exception thrown: Instance 76a02175-d9f3-4f57-9db1-618596566c85 could not be found. Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Request method failure captured: Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 HTTP/1.1 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCahC8Oikjw7ElKUzhBhOFfLWo-oZx_b53s7JfkJgM4ZpZzmSW1nira4Z-UqN6PSmRR-w6GQdEWdSCnWt3q0yUvO-KybP-VTxBNB5CYi0F6TOISRJbF1twA9maq0FSORSoK8X-srSMufXhh2o54ikUUokswCZEz6aBs5474bvwbHG8 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7510a67478644f898bebcd31652de940 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ListImageFiltersTestJSON-490965513 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7510a67478644f898bebcd31652de940", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7510a67478644f898bebcd31652de940"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7510a67478644f898bebcd31652de940"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7510a67478644f898bebcd31652de940"}]}] Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ListImageFiltersTestJSON-490965513 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7510a67478644f898bebcd31652de940 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-490965513 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ListImageFiltersTestJSON-490965513-project Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 1ddf0680774f4ea6b7751706667bd896 Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ListImageFiltersTestJSON-490965513-project Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 76a02175-d9f3-4f57-9db1-618596566c85 could not be found. Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '76a02175-d9f3-4f57-9db1-618596566c85'} Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a02175-d9f3-4f57-9db1-618596566c85 could not be found. Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a02175-d9f3-4f57-9db1-618596566c85 could not be found. Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:15.766022 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.771516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:15.771516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:15.771516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:15.771516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:15.771516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:15.771516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a02175-d9f3-4f57-9db1-618596566c85 could not be found. Aug 30 04:26:15.771516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:15.773046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Returning 404 to user: Instance 76a02175-d9f3-4f57-9db1-618596566c85 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:15.773985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:15.774300 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9d991538-66a7-41e4-9e92-8c70c364d2ee tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85" status: 404 len: 111 microversion: 2.1 time: 0.091563 Aug 30 04:26:15.776353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89f170d5-0903-4a9d-8f97-a6ea1f62d03e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 1.415269 Aug 30 04:26:15.778347 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1950/3806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:15 2022] GET /compute/v2.1/servers/76a02175-d9f3-4f57-9db1-618596566c85 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:15.779305 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1857/3807] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:14 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:15.790236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:15.791098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:15.800188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:15.800907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:15.805952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.807059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.809463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.810293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.810557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.810801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.811248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.811568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.811962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.812420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.813053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.814705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.950189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:15.954529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:15.954992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:15.955470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lazy-loading 'fault' on Instance uuid a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:16.087705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:16.097829 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b0a32363-a791-4427-9580-21fb221ae7d5 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 200 len: 1309 microversion: 2.1 time: 0.318321 Aug 30 04:26:16.104804 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1951/3808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:15 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 1309 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:16.114712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3ec7e86-18b0-4f96-9cce-1f5095df153b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96978e670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.387836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:16.390369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:16.408256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e48dd677-235b-4a65-83ea-d90be742a4f4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800" status: 200 len: 1516 microversion: 2.1 time: 0.626416 Aug 30 04:26:16.410902 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1858/3809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:15 2022] GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 => generated 1516 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:16.428311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-450a2844-54d6-4667-918c-23209548f87a req-293c9acd-a5dc-405d-8d17-e5dbc84fbf4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385", "name": "network-vif-deleted", "tag": "42d6b307-ca25-4d6f-b9ef-e3622bbc796d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:16.455734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-450a2844-54d6-4667-918c-23209548f87a req-293c9acd-a5dc-405d-8d17-e5dbc84fbf4f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.462020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-450a2844-54d6-4667-918c-23209548f87a req-293c9acd-a5dc-405d-8d17-e5dbc84fbf4f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.462810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-450a2844-54d6-4667-918c-23209548f87a req-293c9acd-a5dc-405d-8d17-e5dbc84fbf4f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.488559 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-450a2844-54d6-4667-918c-23209548f87a req-293c9acd-a5dc-405d-8d17-e5dbc84fbf4f service nova] Creating event network-vif-deleted:42d6b307-ca25-4d6f-b9ef-e3622bbc796d for instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 on n-h1-854925-5 Aug 30 04:26:16.495414 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-450a2844-54d6-4667-918c-23209548f87a req-293c9acd-a5dc-405d-8d17-e5dbc84fbf4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079646 Aug 30 04:26:16.496600 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1859/3810] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:16.501967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.502884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:16.512793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.513683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.514861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.515719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.516318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.516890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.813050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:16.826886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5099e9a1-1606-417f-817b-b7c1b910d787 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 200 len: 1516 microversion: 2.1 time: 0.328861 Aug 30 04:26:16.827836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1860/3811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:16 2022] GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 1516 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:16.840941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.841798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:16.863319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.864839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.865472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.866321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.866904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.867649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.951554 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f3ec7e86-18b0-4f96-9cce-1f5095df153b tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/images/55f6ef74-1fde-481a-a6e3-96553c1dce3c" status: 204 len: 0 microversion: 2.1 time: 0.845382 Aug 30 04:26:16.952990 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1952/3812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:16 2022] DELETE /compute/v2.1/images/55f6ef74-1fde-481a-a6e3-96553c1dce3c => generated 0 bytes in 847 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:16.961087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:16.961921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:16.970806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.973429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.974654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:16.976114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:16.976760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:16.977379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.023825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:17.242256 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9311ba35-287c-4a39-8d09-4689262b3de2 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 204 len: 0 microversion: 2.1 time: 0.279064 Aug 30 04:26:17.245593 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1953/3813] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:16 2022] DELETE /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:17.275338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8df9e70d-5484-4187-b528-6420a16b7516 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe969989700>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:17.359323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:17.375928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:17.379106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:17.380335 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-46517b8b-eed5-4e40-9ca2-c67494ffa2d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.551210 Aug 30 04:26:17.399384 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1861/3814] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:16 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:17.404900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:17.405544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:17.411640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.412128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.412564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.413256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.413739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.414163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.439705 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 could not be found. Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 HTTP/1.1 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 could not be found. Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385'} Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 could not be found. Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 could not be found. Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:17.441896 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 could not be found. Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:17.449159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:17.468861 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dc126e51-c62b-4bfe-8548-3b0afc45099a tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385" status: 404 len: 111 microversion: 2.1 time: 0.064691 Aug 30 04:26:17.471002 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1862/3815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:17 2022] GET /compute/v2.1/servers/a9d21a5c-4cd4-4cd5-bf3d-3dda200f9385 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:17.484957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:17.490529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:17.516639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.523950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.526537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.530560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.533002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.537827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.925027 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8df9e70d-5484-4187-b528-6420a16b7516 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/images/3bb278d4-04be-41c1-9651-14825b93b39a" status: 204 len: 0 microversion: 2.1 time: 0.676654 Aug 30 04:26:17.926723 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1954/3816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:17 2022] DELETE /compute/v2.1/images/3bb278d4-04be-41c1-9651-14825b93b39a => generated 0 bytes in 680 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:17.935977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:17.937569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:17.973835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.975769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.976915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:17.979106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:17.982118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:17.982909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.031034 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 could not be found. Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 HTTP/1.1 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 could not be found. Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152'} Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 could not be found. Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 could not be found. Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:18.037565 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:18.041025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:18.041025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:18.041025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:18.041025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:18.041025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:18.041025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 could not be found. Aug 30 04:26:18.041025 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:18.045761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:18.049671 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7ae88272-6fa1-4737-9dd3-2654081d001e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152" status: 404 len: 111 microversion: 2.1 time: 0.121732 Aug 30 04:26:18.050888 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1955/3817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:17 2022] GET /compute/v2.1/servers/ccdf65f2-6ee5-4a98-a7ea-a518dfbb1152 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:18.059739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3118d205-114f-4bbb-8dd0-f7719fffa505 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] Calling method '.version_select at 0x7fe96978e3a0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:18.063302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:18.076815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9492626d-7805-4764-86e7-3b60dfd4ab63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 200 len: 1522 microversion: 2.1 time: 0.604416 Aug 30 04:26:18.077447 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1863/3818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:17 2022] GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:18.103315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf6c4141-bd85-4481-8860-a9d77bd93725 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:18.168539 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf6c4141-bd85-4481-8860-a9d77bd93725 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/74dc91ba-1f36-4aed-ab77-a48f354c78dc" status: 204 len: 0 microversion: 2.1 time: 0.071616 Aug 30 04:26:18.173754 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1864/3819] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:26:18 2022] DELETE /compute/v2.1/os-server-groups/74dc91ba-1f36-4aed-ab77-a48f354c78dc => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:18.180341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:18.181234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:18.200477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.201537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.212229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.218796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.219697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.221800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.342967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:18.524049 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7f662ef-75c4-4b14-bbbc-e841d3ef864e tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 204 len: 0 microversion: 2.1 time: 0.345745 Aug 30 04:26:18.527995 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1865/3820] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:18 2022] DELETE /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:18.551564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:18.552277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:18.585957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.586475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.587351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.592122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.599635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.600302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.773425 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3118d205-114f-4bbb-8dd0-f7719fffa505 tempest-ListImageFiltersTestJSON-490965513 tempest-ListImageFiltersTestJSON-490965513-project] 10.222.0.27 "DELETE /compute/v2.1/images/c594686e-5338-4a93-81eb-3b921c5e5788" status: 204 len: 0 microversion: 2.1 time: 0.721121 Aug 30 04:26:18.774017 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1956/3821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:18 2022] DELETE /compute/v2.1/images/c594686e-5338-4a93-81eb-3b921c5e5788 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:18.792675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:18.793344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:18.832775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.838412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.839583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:18.844581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:18.848404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:18.859162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:19.335536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:19.347109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:19.371784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:19.375025 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a3b9e8f-8b40-4eb4-8a49-7b0e3138de90 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.841815 Aug 30 04:26:19.392772 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1866/3822] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:18 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:19.406924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:19.408642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:19.420328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:19.421866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:19.423179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:19.424258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:19.428363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:19.430821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:19.926632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:19.936212 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8d3bd878-cc00-4f52-9709-cc524cee5c11 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1471 microversion: 2.1 time: 1.160666 Aug 30 04:26:19.944040 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1957/3823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:18 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1471 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:20.400634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:20.401881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:20.414865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:20.423149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:20.426450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:20.427458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:20.430814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:20.434064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:20.440710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:22.151912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:22.162251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d35ea18c-824c-470f-be7a-9cf0ca092f1e tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 200 len: 1522 microversion: 2.1 time: 2.768115 Aug 30 04:26:22.170188 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1867/3824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:19 2022] GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 1522 bytes in 2777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:22.199966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:22.214500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:22.228611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:22.237283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:22.237875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:22.238629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:22.239105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:22.239535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:22.552875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:22.578254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:22.583581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:22.586633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-60901c54-2b69-490c-ab9f-9164fdbbc929 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 2.188532 Aug 30 04:26:22.621803 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1958/3825] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:20 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:22.944917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3d3310f1-f8a1-48c5-9dd9-51fade26f866 req-43782169-bdbe-4ecd-a5f8-9269a2ceb18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6e8a194-f7bd-4579-ad3a-7b85ab11eaae", "name": "network-vif-deleted", "tag": "be1b5369-d6ce-4842-b558-7e1202b6e6ed"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:22.989299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3d3310f1-f8a1-48c5-9dd9-51fade26f866 req-43782169-bdbe-4ecd-a5f8-9269a2ceb18e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:22.991045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3d3310f1-f8a1-48c5-9dd9-51fade26f866 req-43782169-bdbe-4ecd-a5f8-9269a2ceb18e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:22.992751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3d3310f1-f8a1-48c5-9dd9-51fade26f866 req-43782169-bdbe-4ecd-a5f8-9269a2ceb18e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.041800 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3d3310f1-f8a1-48c5-9dd9-51fade26f866 req-43782169-bdbe-4ecd-a5f8-9269a2ceb18e service nova] Creating event network-vif-deleted:be1b5369-d6ce-4842-b558-7e1202b6e6ed for instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae on n-h2-854925-5 Aug 30 04:26:23.069350 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3d3310f1-f8a1-48c5-9dd9-51fade26f866 req-43782169-bdbe-4ecd-a5f8-9269a2ceb18e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129420 Aug 30 04:26:23.073238 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1959/3826] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:23.195433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:23.197142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:23.227259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.230000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.232320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.234256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.240048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.241235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.358234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:23.376042 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2c88857-0d59-44bf-85d2-5eabd466bed7 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1471 microversion: 2.1 time: 1.187968 Aug 30 04:26:23.377917 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1868/3827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:22 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1471 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:23.383204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.383958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.385710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.387160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lazy-loading 'fault' on Instance uuid d6e8a194-f7bd-4579-ad3a-7b85ab11eaae {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:23.615779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:23.616995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:23.632526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.633460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.634088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.642800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:23.643831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:23.644492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:23.711326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:23.723118 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4cdc5fc2-50ae-4615-b287-2fc22734ab5f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 200 len: 1313 microversion: 2.1 time: 0.532602 Aug 30 04:26:23.739193 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1960/3828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:23 2022] GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 1313 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:24.400215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.402048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:24.453732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.458986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.460274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.464986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.467226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.470080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.520527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:24.534928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:24.536973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:24.543440 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc92ff55-5dcd-402e-9635-553557c5c719 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.931646 Aug 30 04:26:24.544761 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1869/3829] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:23 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:24.760909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.761789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:24.773769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.774515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.775206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.783771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.784492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.785090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.811240 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] HTTP exception thrown: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae HTTP/1.1 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'd6e8a194-f7bd-4579-ad3a-7b85ab11eaae'} Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.813183 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:24.817469 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:24.824575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 404 to user: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:24.825654 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1d87f12-52bc-4b4a-a1b9-cb46a4023333 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 404 len: 111 microversion: 2.1 time: 0.069346 Aug 30 04:26:24.830148 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1870/3830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:26:24.840434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:24.854108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:24.855323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:24.864287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.870045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.870701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.871654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:24.872274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:24.872918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:24.933875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:24.944897 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4b309a6-98fe-4f54-aa0f-4556f3f9c47f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1429 microversion: 2.1 time: 0.549727 Aug 30 04:26:24.961775 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1961/3831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1429 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:25.068555 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4017b62e-3c41-4ee4-ba1a-82e3a4b6da40 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.237069 Aug 30 04:26:25.078923 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1871/3832] 10.222.0.27 () {58 vars in 1230 bytes} [Tue Aug 30 04:26:24 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:26:25.084086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9da03298-0653-4ae0-8ba1-96fa7e0c8aa3 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9da03298-0653-4ae0-8ba1-96fa7e0c8aa3 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: action_args: {} Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 04:26:25.097796 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 30 04:26:25.102227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.105179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9da03298-0653-4ae0-8ba1-96fa7e0c8aa3 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:25.107338 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9da03298-0653-4ae0-8ba1-96fa7e0c8aa3 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.028882 Aug 30 04:26:25.112506 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1962/3833] 10.222.0.27 () {58 vars in 1182 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:25.117671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.127211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.127922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:25.143638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.144283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.144795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.145472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.145935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.148624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.232988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:26:25.301641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a08ec933-eb53-4f7f-8c66-1615682172e9 req-c466cd6f-f254-4305-85c3-4db133787c1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f9d33f1-b907-43a7-95d7-52827d7877c1", "name": "network-vif-deleted", "tag": "6b85a47d-1965-4b93-8908-76dd95f23901"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:25.324876 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30426e77-054c-48a7-aee6-68d7c49ec387 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.209684 Aug 30 04:26:25.328937 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1872/3834] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers => generated 683 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:25.336627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a08ec933-eb53-4f7f-8c66-1615682172e9 req-c466cd6f-f254-4305-85c3-4db133787c1e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.337440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a08ec933-eb53-4f7f-8c66-1615682172e9 req-c466cd6f-f254-4305-85c3-4db133787c1e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.337916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a08ec933-eb53-4f7f-8c66-1615682172e9 req-c466cd6f-f254-4305-85c3-4db133787c1e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.343496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.355468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.356453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.servers [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Removing options 'limit' from query {{(pid=122402) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 30 04:26:25.357965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:25.374047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.374792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.375562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.376575 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a08ec933-eb53-4f7f-8c66-1615682172e9 req-c466cd6f-f254-4305-85c3-4db133787c1e service nova] Creating event network-vif-deleted:6b85a47d-1965-4b93-8908-76dd95f23901 for instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 on n-h2-854925-5 Aug 30 04:26:25.380399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.380895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.383366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.392066 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a08ec933-eb53-4f7f-8c66-1615682172e9 req-c466cd6f-f254-4305-85c3-4db133787c1e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096892 Aug 30 04:26:25.392872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1963/3835] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:25.445853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:26:25.514485 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8cc0fa46-3941-4e3c-925f-7c1011ddc212 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.176692 Aug 30 04:26:25.524284 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1873/3836] 10.222.0.27 () {58 vars in 1144 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:25.530548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1848e72-ce17-411b-8076-2341cf1b76c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1848e72-ce17-411b-8076-2341cf1b76c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: action_args: {} Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi '-1' Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 04:26:25.536304 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 30 04:26:25.541835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.552386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1848e72-ce17-411b-8076-2341cf1b76c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:25.554072 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1848e72-ce17-411b-8076-2341cf1b76c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.029667 Aug 30 04:26:25.556516 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1964/3837] 10.222.0.27 () {58 vars in 1142 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:25.569707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e11cf642-82c7-47be-b051-682998df6c3c tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.571053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.571979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e11cf642-82c7-47be-b051-682998df6c3c tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: action_args: {} Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'testing' Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 30 04:26:25.579106 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 30 04:26:25.584164 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:25.588650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e11cf642-82c7-47be-b051-682998df6c3c tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:25.593966 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e11cf642-82c7-47be-b051-682998df6c3c tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.027360 Aug 30 04:26:25.595607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.596268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.596925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.597595 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1874/3838] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:26:25.598341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.599105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.599768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.620177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cab60e85-99b2-4e8c-90a8-0982805a08d1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.644107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cab60e85-99b2-4e8c-90a8-0982805a08d1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.645476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cab60e85-99b2-4e8c-90a8-0982805a08d1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:25.658266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.servers [None req-cab60e85-99b2-4e8c-90a8-0982805a08d1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Flavor 'non_existing_flavor' could not be found {{(pid=122402) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 30 04:26:25.660157 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cab60e85-99b2-4e8c-90a8-0982805a08d1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.057858 Aug 30 04:26:25.660905 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1875/3839] 10.222.0.27 () {58 vars in 1178 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:26:25.678239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.686839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.688426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:25.700231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.700922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.702335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.703275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.703890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.704664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.901110 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f81f62eb-96f8-47be-a3da-9d9ef2706de0 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.229510 Aug 30 04:26:25.913491 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1876/3840] 10.222.0.27 () {58 vars in 1174 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:26:25.920116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:25.932682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:25.934588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:25.947658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.951683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.952157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:25.953386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:25.954440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:25.955117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.058755 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a53d6c7-fb0f-494c-83e5-13f2f9c8c23f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.143101 Aug 30 04:26:26.059857 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1877/3841] 10.222.0.27 () {58 vars in 1184 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:26:26.064879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:26.065545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:26.071986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.072674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.073161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.073881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.074513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.075144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.346910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.356205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.367286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.386544 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd24e4a6-f4b4-4b47-9cb5-205c6995ee7d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1737 microversion: 2.20 time: 0.818462 Aug 30 04:26:26.390346 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1965/3842] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:25 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1737 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:26.405264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:26.428924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.430675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:26.442745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.443554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.444169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.445402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.446133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.446791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.538542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:26:26.596053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.598344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.601433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.602595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lazy-loading 'fault' on Instance uuid 3f9d33f1-b907-43a7-95d7-52827d7877c1 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:26.649842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.661812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.662491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.663045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.769680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9f9b59a77a4e46b5ac74c179c38224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697646bb2dfd47598fee27be7a58eeeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.786797 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-69442f23-7e95-4665-b058-9139ffa18a6f tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 200 len: 1306 microversion: 2.1 time: 0.725560 Aug 30 04:26:26.787702 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1878/3843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:26 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 1306 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:26.892947 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-260a0587-7393-43b2-96b0-e6e5734392eb tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.498204 Aug 30 04:26:26.892947 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1966/3844] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:26:26 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:26.919541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2317e6df-99d2-4398-a681-f8c76c831281 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:26.924663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2317e6df-99d2-4398-a681-f8c76c831281 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.928309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2317e6df-99d2-4398-a681-f8c76c831281 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012080 Aug 30 04:26:26.928309 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1879/3845] 10.222.0.27 () {58 vars in 1178 bytes} [Tue Aug 30 04:26:26 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:26:26.940764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:26.946174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:26.946873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Searching by: {'deleted': False, 'project_id': '0dcdefb0eee8499e8896e1760e505e75'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:26:26.952381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.952882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.953449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:26.954194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:26.954661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:26.955097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.015633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:26:27.046529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8db49daa-78be-4d09-9616-9b581c406854 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.109577 Aug 30 04:26:27.047341 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1967/3846] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:26:26 2022] GET /compute/v2.1/servers => generated 683 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:27.061056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.061689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.069818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.074073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.074803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.076172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.076853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.077571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.097722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] HTTP exception thrown: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae HTTP/1.1 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'd6e8a194-f7bd-4579-ad3a-7b85ab11eaae'} Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:27.103161 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.106776 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.108968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 404 to user: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:27.110181 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f55c9606-9e4c-44ab-a3c2-4f08bebb3a55 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 404 len: 111 microversion: 2.1 time: 0.055054 Aug 30 04:26:27.112198 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1880/3847] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:27 2022] DELETE /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:27.121677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.122344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.134782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.135963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.136371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.138128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.141822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.144215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.180407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:27.347820 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-53294f5d-0cf0-4f72-bd0f-c93361dbaebf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "DELETE /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800" status: 204 len: 0 microversion: 2.1 time: 0.229752 Aug 30 04:26:27.349646 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1968/3848] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:27 2022] DELETE /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:26:27.357858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.358393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.373849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.374597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.375135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.376025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.376732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.378105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.407350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:27.417182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.418212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.425163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.426436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.427251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.428912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.429495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.430029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.432579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:26:27.541831 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5110e061-5dd8-4b92-9c70-0ef0eaa09fcf tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 204 len: 0 microversion: 2.1 time: 0.187568 Aug 30 04:26:27.543151 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1881/3849] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:26:27 2022] DELETE /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:26:27.560196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.561042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: d6e8a194-f7bd-4579-ad3a-7b85ab11eaae] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.575248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.575857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.576359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.577475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.578148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.578662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.597883 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] HTTP exception thrown: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae HTTP/1.1 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'd6e8a194-f7bd-4579-ad3a-7b85ab11eaae'} Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.599594 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 404 to user: Instance d6e8a194-f7bd-4579-ad3a-7b85ab11eaae could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:27.603155 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68b089ec-73dc-4903-9b64-8f99718810bd tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae" status: 404 len: 111 microversion: 2.1 time: 0.053443 Aug 30 04:26:27.605672 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1882/3850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:27 2022] GET /compute/v2.1/servers/d6e8a194-f7bd-4579-ad3a-7b85ab11eaae => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:27.611036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.611729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.618522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.619112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.620159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.620928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.621541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.622047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.914060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:27.924443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:27.930610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:27.932952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5443d94-1313-44f3-bbfa-32396168603d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1719 microversion: 2.20 time: 0.520488 Aug 30 04:26:27.941947 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1969/3851] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:27 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1719 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:27.947104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:27.948522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] [instance: 3f9d33f1-b907-43a7-95d7-52827d7877c1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:27.967629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.968392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.969051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.970033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:27.970732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:27.971401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:27.996899 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] HTTP exception thrown: Instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 could not be found. Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Request method failure captured: Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 HTTP/1.1 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCPSzHIuqzDn10qxkmm2KV8CysYHvAhxyOwL34MX0RTLWGE4le4uJduCEgaRAjV1geH8UuG0Jorjtz3DGahUhpnuEsowPiPSn7wVOgk6_tpb_RHA9M69cqYz3euzQYuRnb8qjU1YfCQ241KYv72A7SlPi_3h5wNoRqopJ622Wi2R-k Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_697646bb2dfd47598fee27be7a58eeeb", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/697646bb2dfd47598fee27be7a58eeeb"}]}] Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 697646bb2dfd47598fee27be7a58eeeb Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-704653531 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4e9f9b59a77a4e46b5ac74c179c38224 Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersOnMultiNodesTest-704653531-project Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 could not be found. Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '3f9d33f1-b907-43a7-95d7-52827d7877c1'} Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 could not be found. Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 could not be found. Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:27.999852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.003419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:28.003419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:28.003419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:28.003419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:28.003419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:28.003419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 could not be found. Aug 30 04:26:28.003419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:28.006003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] Returning 404 to user: Instance 3f9d33f1-b907-43a7-95d7-52827d7877c1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:28.007160 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f0cd67f2-1379-4f89-adf8-03b5c773f9d6 tempest-ServersOnMultiNodesTest-704653531 tempest-ServersOnMultiNodesTest-704653531-project] 10.222.0.27 "GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1" status: 404 len: 111 microversion: 2.1 time: 0.063903 Aug 30 04:26:28.008284 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1970/3852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:27 2022] GET /compute/v2.1/servers/3f9d33f1-b907-43a7-95d7-52827d7877c1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:28.022606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:28.035823 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea72600a-a586-4abe-aedb-036b001f7b63 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800" status: 200 len: 1522 microversion: 2.1 time: 0.428574 Aug 30 04:26:28.037034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1883/3853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:27 2022] GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:28.976251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:28.977679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:28.992051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:28.994174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:28.996421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:28.998754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:28.999879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.001787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.060089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:29.061380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:29.065621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:29.080758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.081368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.081836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.082592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:29.084976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:29.086517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:29.980434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:29.991819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:30.000263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:30.002164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:30.003416 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-75d23e5a-9dfe-44a3-8a0c-872d2b1a4f75 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800" status: 200 len: 1522 microversion: 2.1 time: 0.948703 Aug 30 04:26:30.003676 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-73a27b2d-1ea6-4ccf-8dff-ebe75e7f396b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1719 microversion: 2.20 time: 1.038423 Aug 30 04:26:30.004748 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1884/3854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:29 2022] GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 => generated 1522 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:30.018832 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1971/3855] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:28 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1719 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:30.412725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e4c3af9c-577c-49f8-8562-dabe800c8a32 req-6d8e80f0-3160-463a-b9cc-b81f602fda40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "name": "network-vif-unplugged", "status": "completed", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:30.433290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e4c3af9c-577c-49f8-8562-dabe800c8a32 req-6d8e80f0-3160-463a-b9cc-b81f602fda40 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:30.439658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e4c3af9c-577c-49f8-8562-dabe800c8a32 req-6d8e80f0-3160-463a-b9cc-b81f602fda40 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:30.448436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e4c3af9c-577c-49f8-8562-dabe800c8a32 req-6d8e80f0-3160-463a-b9cc-b81f602fda40 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:30.470194 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e4c3af9c-577c-49f8-8562-dabe800c8a32 req-6d8e80f0-3160-463a-b9cc-b81f602fda40 service nova] Creating event network-vif-unplugged:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h1-854925-5 Aug 30 04:26:30.507614 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e4c3af9c-577c-49f8-8562-dabe800c8a32 req-6d8e80f0-3160-463a-b9cc-b81f602fda40 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100300 Aug 30 04:26:30.511174 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1972/3856] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:30.703798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d90ada4e-308f-4214-a7a5-bab5fbba0285 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: .version_select at 0x7fe96927f160>, body: {"keypair": {"name": "tempest-keypair-141058585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgcXAXuRi/JBU9ckuylWHyApDRyP4OZ1rPE8YvuDlDHz5KAGf75ZPiPzQ1OwjxgZDKTs662U/bi0MBaBwACumQf6B9FXRxHDmANw0OCkjI4W+DEWGRUbCSh1nyeytYF7g=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:30.740568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d90ada4e-308f-4214-a7a5-bab5fbba0285 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:30.767748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d90ada4e-308f-4214-a7a5-bab5fbba0285 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:30.820442 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d90ada4e-308f-4214-a7a5-bab5fbba0285 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.413671 Aug 30 04:26:30.822540 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1885/3857] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:26:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:31.030519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:31.031033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:31.032049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:31.034272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:31.051884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.052265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.052810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.055476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.058080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.059561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.060227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.060419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.061011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.061181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.061678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.063760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.300445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:31.309716 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71d364f4-3f98-4e18-a476-67cdc03c592f tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800" status: 200 len: 1480 microversion: 2.1 time: 0.284745 Aug 30 04:26:31.311966 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1973/3858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:31 2022] GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 => generated 1480 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:31.411253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0e9afcab-d1b1-487f-a1bf-05de9d871cff req-ee58e6c2-ded6-4923-a930-1fa9e87d5da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800", "name": "network-vif-deleted", "tag": "8acd5cb6-4c52-4486-a973-d61788826f47"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:31.430389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0e9afcab-d1b1-487f-a1bf-05de9d871cff req-ee58e6c2-ded6-4923-a930-1fa9e87d5da0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:31.430882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0e9afcab-d1b1-487f-a1bf-05de9d871cff req-ee58e6c2-ded6-4923-a930-1fa9e87d5da0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:31.431317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0e9afcab-d1b1-487f-a1bf-05de9d871cff req-ee58e6c2-ded6-4923-a930-1fa9e87d5da0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:31.504482 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0e9afcab-d1b1-487f-a1bf-05de9d871cff req-ee58e6c2-ded6-4923-a930-1fa9e87d5da0 service nova] Creating event network-vif-deleted:8acd5cb6-4c52-4486-a973-d61788826f47 for instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 on n-h2-854925-5 Aug 30 04:26:31.525242 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0e9afcab-d1b1-487f-a1bf-05de9d871cff req-ee58e6c2-ded6-4923-a930-1fa9e87d5da0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113347 Aug 30 04:26:31.525954 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1974/3859] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:31.627754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:31.643367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:31.645482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:31.649635 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06e12ac1-d3f2-4175-ac9a-d1094f426d7a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1719 microversion: 2.20 time: 0.623694 Aug 30 04:26:31.652904 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1886/3860] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:31 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1719 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:32.336664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:32.337427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:32.355633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.358041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.358525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.376646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.377257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.377888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.581265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.583580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.586160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.588038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lazy-loading 'fault' on Instance uuid 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:32.605202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-91fbff91-e2c1-4e0f-9794-d1b942a1a846 req-a44990e5-791f-4294-84a1-77623c331ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03491984-41d2-4ea8-a37c-0544b386693b", "name": "network-vif-unplugged", "status": "completed", "tag": "d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:32.653945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-91fbff91-e2c1-4e0f-9794-d1b942a1a846 req-a44990e5-791f-4294-84a1-77623c331ea8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.654470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-91fbff91-e2c1-4e0f-9794-d1b942a1a846 req-a44990e5-791f-4294-84a1-77623c331ea8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.654933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-91fbff91-e2c1-4e0f-9794-d1b942a1a846 req-a44990e5-791f-4294-84a1-77623c331ea8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.706397 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-91fbff91-e2c1-4e0f-9794-d1b942a1a846 req-a44990e5-791f-4294-84a1-77623c331ea8 service nova] Creating event network-vif-unplugged:d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0 for instance 03491984-41d2-4ea8-a37c-0544b386693b on n-h1-854925-5 Aug 30 04:26:32.726191 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-91fbff91-e2c1-4e0f-9794-d1b942a1a846 req-a44990e5-791f-4294-84a1-77623c331ea8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123811 Aug 30 04:26:32.730157 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1887/3861] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:32.736921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:32.737669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:32.754732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:32.772276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.772786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.784281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.785155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:32.785682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:32.786120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:32.789173 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cf0c0e5-e39b-49e9-8a1e-ac232d6aeac7 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800" status: 200 len: 1313 microversion: 2.1 time: 0.452716 Aug 30 04:26:32.807018 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1975/3862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:32 2022] GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 => generated 1313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:33.249453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:33.267712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:33.277499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:33.281500 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a575718-7cab-4cbe-bfeb-0f9f3ad475ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1719 microversion: 2.20 time: 0.547806 Aug 30 04:26:33.290404 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1888/3863] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:32 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1719 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:33.560704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d70ee596-aa56-4c9b-b945-87b81711c546 req-23056319-71f4-4a6c-b3c9-49b387ccd3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03491984-41d2-4ea8-a37c-0544b386693b", "name": "network-vif-deleted", "tag": "d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:33.588609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d70ee596-aa56-4c9b-b945-87b81711c546 req-23056319-71f4-4a6c-b3c9-49b387ccd3c3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.596409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d70ee596-aa56-4c9b-b945-87b81711c546 req-23056319-71f4-4a6c-b3c9-49b387ccd3c3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.597117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d70ee596-aa56-4c9b-b945-87b81711c546 req-23056319-71f4-4a6c-b3c9-49b387ccd3c3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.640435 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d70ee596-aa56-4c9b-b945-87b81711c546 req-23056319-71f4-4a6c-b3c9-49b387ccd3c3 service nova] Creating event network-vif-deleted:d9a99d99-9d44-4a8e-b9dc-bb4839f76fe0 for instance 03491984-41d2-4ea8-a37c-0544b386693b on n-h1-854925-5 Aug 30 04:26:33.647111 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d70ee596-aa56-4c9b-b945-87b81711c546 req-23056319-71f4-4a6c-b3c9-49b387ccd3c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090227 Aug 30 04:26:33.653758 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1976/3864] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:33.814575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:33.815924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:33.835609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.839835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.840500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.841251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.841764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.851453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.901445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] HTTP exception thrown: Instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 could not be found. Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 HTTP/1.1 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 could not be found. Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800'} Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 could not be found. Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 could not be found. Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.953966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 could not be found. Aug 30 04:26:33.958633 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:33.970063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 404 to user: Instance 49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:33.971422 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-15806250-99cd-4f5a-b771-28c9f2e89aa4 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800" status: 404 len: 111 microversion: 2.1 time: 0.161184 Aug 30 04:26:33.972012 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1889/3865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:33 2022] GET /compute/v2.1/servers/49dfa7bd-7c33-41f3-9f4c-1af0e3fbb800 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:33.984018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:33.985318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:33.996660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.997507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:33.998150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:33.999035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:33.999655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:34.003912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:34.033706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:34.065564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:34.066675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:34.067318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:34.068061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lazy-loading 'fault' on Instance uuid 03491984-41d2-4ea8-a37c-0544b386693b {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:26:34.219369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ea053cf590a47ef8f1fc51b1d3be222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dcdefb0eee8499e8896e1760e505e75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:34.228287 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-abedeede-4c81-4495-92e5-0a89bbded97d tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 200 len: 1313 microversion: 2.1 time: 0.251513 Aug 30 04:26:34.254748 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1977/3866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:33 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:34.326814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:34.327436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:34.344039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:34.344546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:34.344997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:34.345771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:34.361230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:34.362867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:34.826927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:34.845641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:34.847129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:34.861814 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4b4069b-c816-4856-b650-5fd5ecb26afc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1722 microversion: 2.20 time: 0.539145 Aug 30 04:26:34.866309 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1890/3867] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:34 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1722 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:34.896456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a88ae02f-b2be-486d-98e6-21d56bef863e"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:34.901024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:34.917320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:34.919371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:34.921940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:34.922644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:34.923113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:34.923544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:35.272267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:35.273365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] [instance: 03491984-41d2-4ea8-a37c-0544b386693b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:35.290428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:35.292191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:35.294396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:35.295604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:35.298870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:35.300310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:35.362290 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] HTTP exception thrown: Instance 03491984-41d2-4ea8-a37c-0544b386693b could not be found. Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Request method failure captured: Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b HTTP/1.1 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZE-z7Am99TfgZCKz7j1pp8EWW7Ygv1LbjZTT_2mV_Ee_49MVj916s4PCmfhRvHlJ_kzifvdr9SLDAR6zLiitBpzOlqAvXPP2eJeFA578vaetxtyTegkITVhzU2kPJIfGQAlnDEUWqcwjEJrtdpWkRuY-X0GHrOCfZNRcNalW-Omk2o Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0dcdefb0eee8499e8896e1760e505e75", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0dcdefb0eee8499e8896e1760e505e75"}]}] Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0dcdefb0eee8499e8896e1760e505e75 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1304495642 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1ea053cf590a47ef8f1fc51b1d3be222 Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ListServersNegativeTestJSON-1304495642-project Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 03491984-41d2-4ea8-a37c-0544b386693b could not be found. Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '03491984-41d2-4ea8-a37c-0544b386693b'} Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03491984-41d2-4ea8-a37c-0544b386693b could not be found. Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03491984-41d2-4ea8-a37c-0544b386693b could not be found. Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:35.370458 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03491984-41d2-4ea8-a37c-0544b386693b could not be found. Aug 30 04:26:35.374133 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:35.377144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] Returning 404 to user: Instance 03491984-41d2-4ea8-a37c-0544b386693b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:35.379105 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-70259354-120f-4f8e-898a-010d4f9d93c1 tempest-ListServersNegativeTestJSON-1304495642 tempest-ListServersNegativeTestJSON-1304495642-project] 10.222.0.27 "GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b" status: 404 len: 111 microversion: 2.1 time: 0.115716 Aug 30 04:26:35.381201 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1891/3868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:35 2022] GET /compute/v2.1/servers/03491984-41d2-4ea8-a37c-0544b386693b => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:26:35.831567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd6c5cb7-08b6-429d-afc7-0c42c1f27c7b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.939868 Aug 30 04:26:35.832901 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1978/3869] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Aug 30 04:26:34 2022] POST /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 188 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:26:35.885052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:35.891719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:35.918067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:35.919624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:35.921552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:35.925634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:35.929845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.003391 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c713efc-5e1c-4b88-984b-124d99008952 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.520736 Aug 30 04:26:36.004283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1892/3870] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:26:35 2022] GET /compute/v2.1/os-services => generated 944 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:36.018944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:36.036076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.043607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.046643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.047770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.050014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.050746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.129510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:36.160222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:36.161177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:36.178727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.187688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.191080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.195062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.196706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.201924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.219295 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52884264-92e1-4047-abc8-4e59fc73ca1c tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?host=n-d-854925-5" status: 200 len: 578 microversion: 2.1 time: 0.205026 Aug 30 04:26:36.221199 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1979/3871] 10.222.0.27 () {58 vars in 1172 bytes} [Tue Aug 30 04:26:36 2022] GET /compute/v2.1/os-services?host=n-d-854925-5 => generated 578 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:36.243110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:36.254257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.255954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.258047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.258976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.261543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.262570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.310906 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f5f7ef79-bfa0-422f-87ad-6a215010d673 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.080673 Aug 30 04:26:36.311728 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1980/3872] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:26:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:36.327588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:36.334953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.335463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.335922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.336660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.344125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.344878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.348389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122402) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:26:36.411113 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4433b123-d816-4750-b518-2de39c1155d7 tempest-ServicesAdminTestJSON-1449558866 tempest-ServicesAdminTestJSON-1449558866-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.088594 Aug 30 04:26:36.421954 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1981/3873] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:26:36 2022] GET /compute/v2.1/os-services => generated 944 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:26:36.535465 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1d32fb6f-685c-4b16-95bc-ef5f9a9f5444 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/action" status: 202 len: 0 microversion: 2.20 time: 0.380991 Aug 30 04:26:36.539657 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1893/3874] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:26:36 2022] POST /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:26:36.545572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:36.546361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:36.561010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.561879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.564551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.568107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:36.570600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:36.571041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:36.679755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:36.919817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1139091382", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18317384-8fd4-47be-a014-e798974b8cdc"}], "security_groups": [{"name": "tempest-securitygroup--1061221685"}], "key_name": "tempest-keypair-141058585", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:37.384656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] validate_networks() for [('18317384-8fd4-47be-a014-e798974b8cdc', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:26:37.388664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:37.407079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:37.408587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:37.420461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e5d7eda-5a28-4e1e-8c7a-0eaef92308b8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1748 microversion: 2.20 time: 0.879369 Aug 30 04:26:37.421118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1982/3875] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:36 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1748 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:38.453899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:38.455260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:38.471131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.471997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.472675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:38.473975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:38.481632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:38.482662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.282184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:39.298542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:39.305110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:39.306844 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d750d6c-9e80-4e95-bfd0-7a1a9000f36c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1748 microversion: 2.20 time: 0.857766 Aug 30 04:26:39.310277 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1983/3876] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:38 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1748 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:39.595467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:26:39.595921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:26:39.599475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:26:39.599908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:26:39.600337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:26:39.667493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.668327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.668873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.671295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:39.672551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:39.673723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:39.725661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:39.751583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:39.794969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:26:39.798950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:26:39.985990 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-67ac3626-a5ab-40cd-9e90-ea913690dc32 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.067421 Aug 30 04:26:39.995705 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1894/3877] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:26:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 3082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:26:40.004171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-45eeb45e-4c5c-485b-8bbf-7cf121c91897 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:40.005673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-45eeb45e-4c5c-485b-8bbf-7cf121c91897 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:40.340179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:40.340722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:40.363813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.364311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.370341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.372748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:40.377540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:40.380133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:40.512615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-45eeb45e-4c5c-485b-8bbf-7cf121c91897 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:40.523662 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-45eeb45e-4c5c-485b-8bbf-7cf121c91897 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1241 microversion: 2.1 time: 0.527510 Aug 30 04:26:40.541400 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1984/3878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:39 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1241 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:41.119592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.136212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.154909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.169705 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68e9f4a9-29ea-431e-aa29-4b9e721f6051 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 0.833983 Aug 30 04:26:41.176918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1895/3879] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:40 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:41.557637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:41.559171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:41.575068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.587154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.590898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.594040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:41.595369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:41.604630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:41.885420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:41.916692 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1aba34d2-a762-417d-91d6-83e98e6dd3d2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1293 microversion: 2.1 time: 0.352418 Aug 30 04:26:41.917399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1985/3880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:41 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1293 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:42.200099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:42.201427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:42.219622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.224518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.227805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.230913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.234930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.240418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.940329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:42.940958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:42.951390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:42.959863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.960369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.960817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.974333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:42.974888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:42.975353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:42.976676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:42.983842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:42.996116 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5407b51c-9c76-4370-afff-420ebd65d6ec tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 0.797503 Aug 30 04:26:42.997883 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1896/3881] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:42 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:43.485238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:43.493805 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df87dfb2-775b-4aa3-914f-3fe702a7cddd tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1299 microversion: 2.1 time: 0.557484 Aug 30 04:26:43.494413 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1986/3882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:42 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1299 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:44.023887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:44.025169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:44.040729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.046424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.047593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.050115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.051018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.053572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.520367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:44.520998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:44.530437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.539178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.539912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.541386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:44.542005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:44.542595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:44.859583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:44.868769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-afac7229-3758-486b-b4c5-7758e45f517d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1299 microversion: 2.1 time: 0.352275 Aug 30 04:26:44.877563 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1987/3883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:44 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1299 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:44.950311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:44.960789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:44.967095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:44.970698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b84ec969-bcf2-4df1-a882-d79beb369b30 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 0.954293 Aug 30 04:26:44.986662 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1897/3884] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:44 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:45.893539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:45.894212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:45.919707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:45.919707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:45.919707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:45.920259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:45.928429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:45.929094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:45.943294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6bf6752d-7f0e-4ab4-ad76-4e34945c4b47 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Action: 'create', calling method: .version_select at 0x7fe96a561e50>, body: {"keypair": {"name": "tempest-keypair-1247534987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/ULrXPKZdIpkRoTGI9aGiazytF8VYg1PWpHC+yn7xfgbsVrtIeg4u9d/d6NxFknLl8piq8p2fUZafvpG8znNam3swWUoJoIZzrKCngeV+YpVae5qLO47/bRJEp/Mr/LA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:45.997192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-6bf6752d-7f0e-4ab4-ad76-4e34945c4b47 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Getting quotas for project eb90da5b84264d9297106dc75b0c321b. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:26:46.013188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-6bf6752d-7f0e-4ab4-ad76-4e34945c4b47 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Getting quotas for user 03b3f68f74a44f718a03d1fccb4ae2ac and project eb90da5b84264d9297106dc75b0c321b. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:26:46.066954 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6bf6752d-7f0e-4ab4-ad76-4e34945c4b47 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.433667 Aug 30 04:26:46.068466 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1988/3885] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:26:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:46.093168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:46.095413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:46.123575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.124447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.125946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.127544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:46.129382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:46.130674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:46.366616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:46.515560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:46.542301 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fc8ce0a-9c68-4d7d-9853-9e392f8e3b5a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1299 microversion: 2.1 time: 0.642785 Aug 30 04:26:46.549211 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1898/3886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:45 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1299 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:26:47.418820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:47.437420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:47.442885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:47.446575 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-915ae8bc-f6d3-421f-af7e-3f94da31a747 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 1.375695 Aug 30 04:26:47.448747 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1989/3887] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:46 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:47.572504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:47.574111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:47.600204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.600847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.601301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:47.602094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:47.602551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:47.603517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:48.217000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-177749a1-1960-41f5-9e23-85e6354adb52 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Calling method '.version_select at 0x7fe969a48e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:48.258721 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-177749a1-1960-41f5-9e23-85e6354adb52 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] HTTP exception thrown: Image not found. Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-177749a1-1960-41f5-9e23-85e6354adb52 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Request method failure captured: Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/images/a36dceb2-9b28-4f0d-a1b4-586e1482a1e4/metadata/os_distro HTTP/1.1 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGHRrMP_DDl39WjFEN-_YcUCg_adqDliAh5jaHb9qPUO_SfjlBn4UD7gdihNFRYlaoVdIwiIxHLg39pBNbLDEFUkwgoQc8P__lkErJqrqe2lhN24i3DPntBYzOrs9uqn-BXSJEvh5Z75VofhesEEkmTB_Hhtbi-EnedxwXPZXJl7AU Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e6f009b3d040d4bdb99f55787d3289", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}] Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 48078ca3202d4c43a7e9937c24c3e92e Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'image_id': 'a36dceb2-9b28-4f0d-a1b4-586e1482a1e4', 'id': 'os_distro'} Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a36dceb2-9b28-4f0d-a1b4-586e1482a1e4 Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:26:48.267181 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a36dceb2-9b28-4f0d-a1b4-586e1482a1e4 could not be found. Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:26:48.271353 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.278879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-177749a1-1960-41f5-9e23-85e6354adb52 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:48.279981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-177749a1-1960-41f5-9e23-85e6354adb52 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] 10.222.0.27 "DELETE /compute/v2.1/images/a36dceb2-9b28-4f0d-a1b4-586e1482a1e4/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.469684 Aug 30 04:26:48.280891 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1990/3888] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Aug 30 04:26:47 2022] DELETE /compute/v2.1/images/a36dceb2-9b28-4f0d-a1b4-586e1482a1e4/metadata/os_distro => generated 62 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:26:48.294727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4985cbe-c905-469f-ab24-8f46ae820798 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Calling method '.version_select at 0x7fe96a7a6d30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:48.365743 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a4985cbe-c905-469f-ab24-8f46ae820798 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] HTTP exception thrown: Image not found. Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4985cbe-c905-469f-ab24-8f46ae820798 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Request method failure captured: Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/images/7dab82a8-04e9-4f7f-8f09-b1c2fe4669ea/metadata/os_version HTTP/1.1 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGHRrMP_DDl39WjFEN-_YcUCg_adqDliAh5jaHb9qPUO_SfjlBn4UD7gdihNFRYlaoVdIwiIxHLg39pBNbLDEFUkwgoQc8P__lkErJqrqe2lhN24i3DPntBYzOrs9uqn-BXSJEvh5Z75VofhesEEkmTB_Hhtbi-EnedxwXPZXJl7AU Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e6f009b3d040d4bdb99f55787d3289", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}] Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 48078ca3202d4c43a7e9937c24c3e92e Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'image_id': '7dab82a8-04e9-4f7f-8f09-b1c2fe4669ea', 'id': 'os_version'} Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7dab82a8-04e9-4f7f-8f09-b1c2fe4669ea Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:26:48.371637 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7dab82a8-04e9-4f7f-8f09-b1c2fe4669ea could not be found. Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:26:48.382698 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.424681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4985cbe-c905-469f-ab24-8f46ae820798 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:48.426176 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a4985cbe-c905-469f-ab24-8f46ae820798 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] 10.222.0.27 "GET /compute/v2.1/images/7dab82a8-04e9-4f7f-8f09-b1c2fe4669ea/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.136393 Aug 30 04:26:48.432192 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1991/3889] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Aug 30 04:26:48 2022] GET /compute/v2.1/images/7dab82a8-04e9-4f7f-8f09-b1c2fe4669ea/metadata/os_version => generated 62 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:26:48.448514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d63eca7c-5cbf-408f-893b-7614bcbb79fa tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Calling method '.version_select at 0x7fe969a48790>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:48.498364 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-d63eca7c-5cbf-408f-893b-7614bcbb79fa tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] HTTP exception thrown: Image not found. Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d63eca7c-5cbf-408f-893b-7614bcbb79fa tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Request method failure captured: Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/images/afa38452-bf3a-4320-8aba-041b61de8fe8/metadata HTTP/1.1 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGHRrMP_DDl39WjFEN-_YcUCg_adqDliAh5jaHb9qPUO_SfjlBn4UD7gdihNFRYlaoVdIwiIxHLg39pBNbLDEFUkwgoQc8P__lkErJqrqe2lhN24i3DPntBYzOrs9uqn-BXSJEvh5Z75VofhesEEkmTB_Hhtbi-EnedxwXPZXJl7AU Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e6f009b3d040d4bdb99f55787d3289", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}] Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 48078ca3202d4c43a7e9937c24c3e92e Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: exception: Image not found. Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'image_id': 'afa38452-bf3a-4320-8aba-041b61de8fe8'} Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID afa38452-bf3a-4320-8aba-041b61de8fe8 Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:26:48.514803 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image afa38452-bf3a-4320-8aba-041b61de8fe8 could not be found. Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d63eca7c-5cbf-408f-893b-7614bcbb79fa tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Returning 404 to user: Image not found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d63eca7c-5cbf-408f-893b-7614bcbb79fa tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] 10.222.0.27 "GET /compute/v2.1/images/afa38452-bf3a-4320-8aba-041b61de8fe8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.076696 Aug 30 04:26:48.518863 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1992/3890] 10.222.0.27 () {58 vars in 1260 bytes} [Tue Aug 30 04:26:48 2022] GET /compute/v2.1/images/afa38452-bf3a-4320-8aba-041b61de8fe8/metadata => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:26:48.543954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:48.544815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:48.562418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.563205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.563853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:48.564732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:48.566449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:48.578154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:49.000191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:49.014393 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-236cbe3c-6365-46f4-97ec-070624c80da2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 1.448875 Aug 30 04:26:49.015846 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1899/3891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:47 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:49.032961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7ca13e21-9cf1-417c-b822-fab26362d5d1 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Action: 'update_all', calling method: .version_select at 0x7fe9698e7280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:49.089073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7ca13e21-9cf1-417c-b822-fab26362d5d1 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] HTTP exception thrown: Image not found. Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7ca13e21-9cf1-417c-b822-fab26362d5d1 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Request method failure captured: Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/images/22530532-44e5-4176-8104-241a50bfe051/metadata HTTP/1.1 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 57 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGHRrMP_DDl39WjFEN-_YcUCg_adqDliAh5jaHb9qPUO_SfjlBn4UD7gdihNFRYlaoVdIwiIxHLg39pBNbLDEFUkwgoQc8P__lkErJqrqe2lhN24i3DPntBYzOrs9uqn-BXSJEvh5Z75VofhesEEkmTB_Hhtbi-EnedxwXPZXJl7AU Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e6f009b3d040d4bdb99f55787d3289", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}] Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 48078ca3202d4c43a7e9937c24c3e92e Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'image_id': '22530532-44e5-4176-8104-241a50bfe051', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 22530532-44e5-4176-8104-241a50bfe051 Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:26:49.092063 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22530532-44e5-4176-8104-241a50bfe051 could not be found. Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:26:49.096677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.101241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7ca13e21-9cf1-417c-b822-fab26362d5d1 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:49.102526 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7ca13e21-9cf1-417c-b822-fab26362d5d1 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] 10.222.0.27 "PUT /compute/v2.1/images/22530532-44e5-4176-8104-241a50bfe051/metadata" status: 404 len: 62 microversion: 2.1 time: 0.085560 Aug 30 04:26:49.103649 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1900/3892] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:26:49 2022] PUT /compute/v2.1/images/22530532-44e5-4176-8104-241a50bfe051/metadata => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:26:49.115030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8922b065-c534-45db-bd66-24141c6801c0 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Action: 'update', calling method: .version_select at 0x7fe9692d00d0>, body: {"meta": {"os_distro": "alt"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:49.155626 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-8922b065-c534-45db-bd66-24141c6801c0 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] HTTP exception thrown: Image not found. Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8922b065-c534-45db-bd66-24141c6801c0 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Request method failure captured: Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/images/d6865ce6-9f57-4ba9-a26c-cbe596da5d61/metadata/os_distro HTTP/1.1 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 30 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGHRrMP_DDl39WjFEN-_YcUCg_adqDliAh5jaHb9qPUO_SfjlBn4UD7gdihNFRYlaoVdIwiIxHLg39pBNbLDEFUkwgoQc8P__lkErJqrqe2lhN24i3DPntBYzOrs9uqn-BXSJEvh5Z75VofhesEEkmTB_Hhtbi-EnedxwXPZXJl7AU Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e6f009b3d040d4bdb99f55787d3289", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}] Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 48078ca3202d4c43a7e9937c24c3e92e Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: {"meta": {"os_distro": "alt"}} Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'image_id': 'd6865ce6-9f57-4ba9-a26c-cbe596da5d61', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d6865ce6-9f57-4ba9-a26c-cbe596da5d61 Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:26:49.166611 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d6865ce6-9f57-4ba9-a26c-cbe596da5d61 could not be found. Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:26:49.170487 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.175528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8922b065-c534-45db-bd66-24141c6801c0 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:49.176684 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8922b065-c534-45db-bd66-24141c6801c0 tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] 10.222.0.27 "PUT /compute/v2.1/images/d6865ce6-9f57-4ba9-a26c-cbe596da5d61/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.066102 Aug 30 04:26:49.177852 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1901/3893] 10.222.0.27 () {60 vars in 1310 bytes} [Tue Aug 30 04:26:49 2022] PUT /compute/v2.1/images/d6865ce6-9f57-4ba9-a26c-cbe596da5d61/metadata/os_distro => generated 62 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:26:49.190022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-787ba4ee-5769-462c-b57b-24ba96068c7f tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Action: 'create', calling method: .version_select at 0x7fe96994b9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:49.230938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-787ba4ee-5769-462c-b57b-24ba96068c7f tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] HTTP exception thrown: Image not found. Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-787ba4ee-5769-462c-b57b-24ba96068c7f tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Request method failure captured: Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/images/1ca66257-fbb4-4644-be98-cd78430db53c/metadata HTTP/1.1 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 57 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGHRrMP_DDl39WjFEN-_YcUCg_adqDliAh5jaHb9qPUO_SfjlBn4UD7gdihNFRYlaoVdIwiIxHLg39pBNbLDEFUkwgoQc8P__lkErJqrqe2lhN24i3DPntBYzOrs9uqn-BXSJEvh5Z75VofhesEEkmTB_Hhtbi-EnedxwXPZXJl7AU Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e7e6f009b3d040d4bdb99f55787d3289", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e7e6f009b3d040d4bdb99f55787d3289"}]}] Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e7e6f009b3d040d4bdb99f55787d3289 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911 Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 48078ca3202d4c43a7e9937c24c3e92e Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1594411911-project Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: exception: Image not found. Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'image_id': '1ca66257-fbb4-4644-be98-cd78430db53c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1ca66257-fbb4-4644-be98-cd78430db53c Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 30 04:26:49.233981 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ca66257-fbb4-4644-be98-cd78430db53c could not be found. Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 30 04:26:49.237638 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:26:49.244308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-787ba4ee-5769-462c-b57b-24ba96068c7f tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] Returning 404 to user: Image not found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:26:49.247745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-787ba4ee-5769-462c-b57b-24ba96068c7f tempest-ImagesMetadataNegativeTestJSON-1594411911 tempest-ImagesMetadataNegativeTestJSON-1594411911-project] 10.222.0.27 "POST /compute/v2.1/images/1ca66257-fbb4-4644-be98-cd78430db53c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062183 Aug 30 04:26:49.248561 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1902/3894] 10.222.0.27 () {60 vars in 1281 bytes} [Tue Aug 30 04:26:49 2022] POST /compute/v2.1/images/1ca66257-fbb4-4644-be98-cd78430db53c/metadata => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:26:49.359323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:49.376148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:49.393793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:49.395412 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86874b35-080f-478b-9174-499dd2de41c2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 0.878690 Aug 30 04:26:49.396164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1993/3895] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:48 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:50.044666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=14 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:50.045834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=10 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:50.063728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:50.064771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:50.108177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.108973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.110717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.112279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.112758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.117644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.233095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:50.455800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:50.459361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:50.477207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.479583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.480624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.485959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:50.490776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:50.498005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:50.872372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:50.886402 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-475032e6-ec91-4a2b-81c7-e1ab4a65c24a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 0.847053 Aug 30 04:26:50.888054 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1903/3896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:50 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:51.187085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:51.238720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:51.249201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:51.259957 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3797aee4-1aba-4582-9ec6-2895d8163ce2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 0.836619 Aug 30 04:26:51.290618 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1994/3897] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:50 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:51.484219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2708b22f-782f-46ad-9078-e798fa293034 req-ddb87f1a-a6d0-4ef1-9f6e-dbc914911808 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab72fe9b-dcf6-43a8-aede-9ff12153d8b8", "tag": "1c9ef8fc-7ef1-4689-b282-c70f317f238c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:26:51.509088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2708b22f-782f-46ad-9078-e798fa293034 req-ddb87f1a-a6d0-4ef1-9f6e-dbc914911808 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.525022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2708b22f-782f-46ad-9078-e798fa293034 req-ddb87f1a-a6d0-4ef1-9f6e-dbc914911808 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.533025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2708b22f-782f-46ad-9078-e798fa293034 req-ddb87f1a-a6d0-4ef1-9f6e-dbc914911808 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.572470 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2708b22f-782f-46ad-9078-e798fa293034 req-ddb87f1a-a6d0-4ef1-9f6e-dbc914911808 service nova] Creating event network-changed:1c9ef8fc-7ef1-4689-b282-c70f317f238c for instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 on n-h2-854925-5 Aug 30 04:26:51.584738 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2708b22f-782f-46ad-9078-e798fa293034 req-ddb87f1a-a6d0-4ef1-9f6e-dbc914911808 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104704 Aug 30 04:26:51.590591 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1904/3898] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:51.908971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:51.910903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:51.922845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.924470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.926446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:51.928437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:51.930097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:51.931687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.327517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:52.328249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:52.345419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:52.349629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:52.350361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.351334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:52.357387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:52.358159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:52.665983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.684010 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ee923cb3-2130-4df5-9939-25ba112bdc0e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 0.779231 Aug 30 04:26:52.707221 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1995/3899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:51 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:52.790764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.817592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.824248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:52.834003 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44e1c92b-291c-4524-8149-36e40536b904 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 0.503500 Aug 30 04:26:52.848579 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1905/3900] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:52 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:26:53.714218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:53.714964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:53.726280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.727013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.727859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.728784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.729615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.730348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.865865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:53.865865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:53.892862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.893891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.894587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:53.895603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:53.896447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:53.897146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:54.012544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:54.023980 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f59bf753-0f41-497f-9e85-f19f282d50d6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 0.313464 Aug 30 04:26:54.024828 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1996/3901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:53 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:54.526168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:54.549813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:54.551497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:54.552786 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3e25b22-4e93-4a82-b151-a97eed37d955 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1750 microversion: 2.20 time: 0.692631 Aug 30 04:26:54.553756 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1906/3902] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:53 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1750 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:55.044735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:55.045941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:55.053372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.066490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.066942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.068370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.072308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.072902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.574287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:55.577999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:55.579278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:55.585447 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-55075231-6b97-464b-97b2-6088ff990cee tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 0.545011 Aug 30 04:26:55.591908 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1997/3903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:55 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:55.607912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.609179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.609837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:55.611187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:55.611812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:55.612712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.016683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:56.026111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:56.028144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:56.029371 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3cedbe10-a0ed-46a0-a0b5-3b22feaa09e5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.456787 Aug 30 04:26:56.033093 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1907/3904] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:55 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:56.621926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:56.637887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:56.656035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:56.669513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:56.675586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:56.678534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.679904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:56.681824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:56.683895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:56.702691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:26:57.059722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:57.060455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:57.087694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.090659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.094571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.097112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:57.099652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:57.100120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:57.664497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:57.677259 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cf9d6f4d-0a94-459f-8d42-bf8f18a95713 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 1.068144 Aug 30 04:26:57.679656 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1998/3905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:56 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:26:57.750744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:57.786908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:57.796294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:57.814941 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-318f64da-5584-45b2-bb36-8f36c9739340 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.756453 Aug 30 04:26:57.817536 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1908/3906] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:57 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:26:58.094835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3f4c00a5-d862-452e-bc83-a9565b7e4ef6 tempest-ListImagesTestJSON-428182960 tempest-ListImagesTestJSON-428182960-project] Calling method '.version_select at 0x7fe96a7a6dc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:58.178202 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3f4c00a5-d862-452e-bc83-a9565b7e4ef6 tempest-ListImagesTestJSON-428182960 tempest-ListImagesTestJSON-428182960-project] 10.222.0.27 "GET /compute/v2.1/images/b5ae2bcd-efca-4003-b452-ab36e7c230c2" status: 200 len: 784 microversion: 2.1 time: 0.495871 Aug 30 04:26:58.178811 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 1999/3907] 10.222.0.27 () {58 vars in 1233 bytes} [Tue Aug 30 04:26:57 2022] GET /compute/v2.1/images/b5ae2bcd-efca-4003-b452-ab36e7c230c2 => generated 784 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:58.195503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b666cfda-2d44-4d3f-a8bd-724c7367081a tempest-ListImagesTestJSON-428182960 tempest-ListImagesTestJSON-428182960-project] Calling method '.version_select at 0x7fe9691c19d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:58.327509 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b666cfda-2d44-4d3f-a8bd-724c7367081a tempest-ListImagesTestJSON-428182960 tempest-ListImagesTestJSON-428182960-project] 10.222.0.27 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.137640 Aug 30 04:26:58.329455 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1909/3908] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 04:26:58 2022] GET /compute/v2.1/images => generated 445 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:58.342542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b15e013-7002-44a2-9a05-4b0bd269a6d9 tempest-ListImagesTestJSON-428182960 tempest-ListImagesTestJSON-428182960-project] Calling method '.version_select at 0x7fe96a5d3e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:58.437266 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b15e013-7002-44a2-9a05-4b0bd269a6d9 tempest-ListImagesTestJSON-428182960 tempest-ListImagesTestJSON-428182960-project] 10.222.0.27 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.099893 Aug 30 04:26:58.437920 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2000/3909] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:26:58 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:26:58.702836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:58.703485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:58.815356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.816034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.823959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.824806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.836237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.851912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:26:58.853723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:26:58.856188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.899044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.941687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.944281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:58.949811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:26:58.955992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:26:58.960225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:26:59.973821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:59.988061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:26:59.999926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:00.005201 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-440aa604-0eff-4bb9-9a6f-2fccc88ed33d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 1.305389 Aug 30 04:27:00.006668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1910/3910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:26:58 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:00.011254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:00.012510 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1141a1e8-8da9-443b-902a-af43a6f683fa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.170697 Aug 30 04:27:00.016390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c3b34a74-bab9-4aa6-928d-18bf0043ea98 req-31c922cc-2f41-4fb0-a023-93f3adebf53e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:00.026540 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2001/3911] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:26:58 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:27:00.067869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:00.070507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c3b34a74-bab9-4aa6-928d-18bf0043ea98 req-31c922cc-2f41-4fb0-a023-93f3adebf53e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:00.071271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c3b34a74-bab9-4aa6-928d-18bf0043ea98 req-31c922cc-2f41-4fb0-a023-93f3adebf53e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:00.072166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c3b34a74-bab9-4aa6-928d-18bf0043ea98 req-31c922cc-2f41-4fb0-a023-93f3adebf53e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:00.105786 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c3b34a74-bab9-4aa6-928d-18bf0043ea98 req-31c922cc-2f41-4fb0-a023-93f3adebf53e service nova] Creating event network-changed:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h2-854925-5 Aug 30 04:27:00.123106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c3b34a74-bab9-4aa6-928d-18bf0043ea98 req-31c922cc-2f41-4fb0-a023-93f3adebf53e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114847 Aug 30 04:27:00.125434 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1911/3912] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:01.033434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:01.034103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:01.063084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:01.063839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:01.076721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.089674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.090140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.090898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.091364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.091808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.120273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.133218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.142064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.147600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:01.148147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:01.151671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:01.810690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:01.819445 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6ecd6ced-6dfe-4305-88fe-a42b16fad244 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 0.796847 Aug 30 04:27:01.837564 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2002/3913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:01 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:02.092895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:02.112548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:02.114422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:02.116493 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-92b227ec-a60f-4ff9-876c-b27186164704 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.064540 Aug 30 04:27:02.120483 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1912/3914] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:01 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:02.847536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:02.848857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:02.863525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.866504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.869458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:02.876077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:02.878743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:02.879364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.433313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e119db9c-02c1-4815-ad3d-df47d0fa203e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe9692d0d30>, body: {"keypair": {"name": "tempest-keypair-175669259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjIbT/AFb5NM5QbzVieLbmrkkdvAuSQ2AoAKezlzzu5QQkDNp3MuCFffDXAs2dfBXEHGotduSLZ6TrhHpFW8dWj1vWFpEl5G4rWxAr9BgTlNZIyHL/GV3dFGUw2HUx/lA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:03.463837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e119db9c-02c1-4815-ad3d-df47d0fa203e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:03.471592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e119db9c-02c1-4815-ad3d-df47d0fa203e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:03.531435 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e119db9c-02c1-4815-ad3d-df47d0fa203e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.524380 Aug 30 04:27:03.536854 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1913/3915] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Aug 30 04:27:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 533 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 30 04:27:03.545942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:03.566125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:03.592902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.599370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.601619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:03.604027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:03.607868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:03.610203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.238681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.262807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.282306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.282306 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3827e19d-c027-4f4d-b74b-8fd6dba9fa14 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.740409 Aug 30 04:27:05.282306 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1914/3916] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:03 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:05.313033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e352aea3-1bc0-49b7-bf8e-f709967ceef6 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe9692d0940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:05.388279 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e352aea3-1bc0-49b7-bf8e-f709967ceef6 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-175669259" status: 200 len: 512 microversion: 2.2 time: 0.101712 Aug 30 04:27:05.391400 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1915/3917] 10.222.0.27 () {60 vars in 1255 bytes} [Tue Aug 30 04:27:05 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-175669259 => generated 512 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:05.397992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4cbaff6c-d3f5-4d73-80d9-e7dd062da70b req-ff5e2299-bdfb-4a94-bd98-11049ec98749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab72fe9b-dcf6-43a8-aede-9ff12153d8b8", "name": "network-vif-plugged", "status": "completed", "tag": "1c9ef8fc-7ef1-4689-b282-c70f317f238c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:05.456033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4cbaff6c-d3f5-4d73-80d9-e7dd062da70b req-ff5e2299-bdfb-4a94-bd98-11049ec98749 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:05.469652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4cbaff6c-d3f5-4d73-80d9-e7dd062da70b req-ff5e2299-bdfb-4a94-bd98-11049ec98749 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:05.470293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4cbaff6c-d3f5-4d73-80d9-e7dd062da70b req-ff5e2299-bdfb-4a94-bd98-11049ec98749 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:05.520784 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4cbaff6c-d3f5-4d73-80d9-e7dd062da70b req-ff5e2299-bdfb-4a94-bd98-11049ec98749 service nova] Creating event network-vif-plugged:1c9ef8fc-7ef1-4689-b282-c70f317f238c for instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 on n-h2-854925-5 Aug 30 04:27:05.544986 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4cbaff6c-d3f5-4d73-80d9-e7dd062da70b req-ff5e2299-bdfb-4a94-bd98-11049ec98749 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137394 Aug 30 04:27:05.549904 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1916/3918] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:05.579661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e242ee6-911c-4626-9427-f8a5b917f201 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96a59c430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:05.647162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e242ee6-911c-4626-9427-f8a5b917f201 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-175669259" status: 204 len: 0 microversion: 2.2 time: 0.092751 Aug 30 04:27:05.653170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:05.663379 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1917/3919] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Aug 30 04:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-175669259 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:05.670501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b5f8dcf-fd0d-409d-bc4f-bab00fbcb4c6 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 2.826811 Aug 30 04:27:05.678485 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2003/3920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:02 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 2839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:05.685084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28aef922-24d7-47e5-8466-c5fca72872a9 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe9692d0940>, body: {"keypair": {"name": "tempest-keypair-2060133351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBG6OYVczOGqEZAM2YF4slSYIuaGYlJmK+58mzeUckyyK3bWerE5yCpkH6WgNheUk9xuHCv8VuwZhfj4Hi5Tp3legWfBxUKvlSjWt1+8ap5xbL34RKTJEvqs4+7eg0IlUQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:05.793091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-28aef922-24d7-47e5-8466-c5fca72872a9 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:05.807675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-28aef922-24d7-47e5-8466-c5fca72872a9 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:05.885842 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28aef922-24d7-47e5-8466-c5fca72872a9 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.212141 Aug 30 04:27:05.888020 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1918/3921] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Aug 30 04:27:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 216 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:27:05.916820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4b62d89-4aa0-4b60-ae52-1c17f435e118 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96a313e50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:05.965084 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4b62d89-4aa0-4b60-ae52-1c17f435e118 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060133351" status: 204 len: 0 microversion: 2.2 time: 0.067098 Aug 30 04:27:05.967777 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2004/3922] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Aug 30 04:27:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2060133351 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:05.982090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-604933c7-37bd-4a35-90de-ecada86954fd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe96924b040>, body: {"keypair": {"name": "tempest-keypair-1319620852", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:06.023150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-604933c7-37bd-4a35-90de-ecada86954fd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:06.040742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-604933c7-37bd-4a35-90de-ecada86954fd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:06.146545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-604933c7-37bd-4a35-90de-ecada86954fd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.165182 Aug 30 04:27:06.150066 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1919/3923] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Aug 30 04:27:05 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 177 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:27:06.163448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd6b10a8-de5c-4dac-960f-febaf69b1d8e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96978e940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.211196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:06.251208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd6b10a8-de5c-4dac-960f-febaf69b1d8e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319620852" status: 204 len: 0 microversion: 2.2 time: 0.094092 Aug 30 04:27:06.266069 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2005/3924] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Aug 30 04:27:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319620852 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:06.282230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dfc2dbc4-06fc-423d-9aee-f6fe48510b33 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe96931bb80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1493436531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLzRE02eTwor9Dlx42/DyEaB3351XtdsObbG0aD9DqMdwbx5Prvyv9jb6wGNyVJAmu6/YUyg3MnQLqVPD2raOSr7jKVKVl++8sQS95F83TywLGyGdVdo0PrIij+S6iRPQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:06.309533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.314505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.370091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.371470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.374356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.383186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.384535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.391800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.406049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-dfc2dbc4-06fc-423d-9aee-f6fe48510b33 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:06.443228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-dfc2dbc4-06fc-423d-9aee-f6fe48510b33 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:06.576848 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dfc2dbc4-06fc-423d-9aee-f6fe48510b33 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.302543 Aug 30 04:27:06.580800 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1920/3925] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Aug 30 04:27:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 307 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:27:06.596335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3057a733-f352-41a5-b8c1-d0dedcf1ee01 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe96a59c700>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1052769902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTKvUfbsDvRNB2+HibgIgowQBUYGMY4ELAo9Y6/2lCT/RfS9rZpTSFKfNZtOGuBrnIUzk19j0k/W4VHTRKxivxYr/s9FoRSmbU198MRRNp7P4Fn1mokgpMZgI4dAARAew=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:06.657118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3057a733-f352-41a5-b8c1-d0dedcf1ee01 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:06.676377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3057a733-f352-41a5-b8c1-d0dedcf1ee01 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:06.742384 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3057a733-f352-41a5-b8c1-d0dedcf1ee01 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.154128 Aug 30 04:27:06.745716 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1921/3926] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Aug 30 04:27:06 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:27:06.763306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:06.766490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:06.784413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.791382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.793701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:06.797618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:06.800357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:06.801077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:07.862275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:07.876749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:07.878260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:07.918114 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ffdbd8f2-67e5-45b6-bae2-976d75bb6f5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.598142 Aug 30 04:27:07.919081 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2006/3927] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:06 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:27:07.947805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14bb3fc8-720b-4d94-8d38-ce6abfe116dd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe969cad4c0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1663455201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLSZz4wwdA9aoH2oi8uuvK1sFVGLUYfSfWr0YY5U3euqu9vrW+Ny2YYv5VoNxvla6/PQeE08nzIkCs/GfqyF4f23IlGwSaZBNLylYXKCXbx/9wg/lkGr6p6blCWiUqBeQ=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:08.057703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:08.072998 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c37d08b6-df5f-4d20-be3c-a393fad87d85 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1367 microversion: 2.1 time: 1.325692 Aug 30 04:27:08.078152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-14bb3fc8-720b-4d94-8d38-ce6abfe116dd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:08.088965 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1922/3928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:06 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1367 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:08.091780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-14bb3fc8-720b-4d94-8d38-ce6abfe116dd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:08.185953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14bb3fc8-720b-4d94-8d38-ce6abfe116dd tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.258328 Aug 30 04:27:08.189478 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2007/3929] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Aug 30 04:27:07 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 264 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:27:08.201559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4485e2e-5f62-4be2-b359-e6d4d3498cb7 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe9691c19d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.213275 n-d-854925-5 devstack@n-api.service[122402]: WARNING oslo_db.sqlalchemy.utils [None req-e4485e2e-5f62-4be2-b359-e6d4d3498cb7 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 04:27:08.268727 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4485e2e-5f62-4be2-b359-e6d4d3498cb7 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1142 microversion: 2.2 time: 0.072925 Aug 30 04:27:08.277787 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1923/3930] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Aug 30 04:27:08 2022] GET /compute/v2.1/os-keypairs => generated 1142 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:08.287750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2162290d-6d4b-4f9d-9e4e-a136340d58ed tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96a52b4c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.353606 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2162290d-6d4b-4f9d-9e4e-a136340d58ed tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1663455201" status: 204 len: 0 microversion: 2.2 time: 0.073995 Aug 30 04:27:08.363674 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2008/3931] 10.222.0.27 () {60 vars in 1321 bytes} [Tue Aug 30 04:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1663455201 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:08.378412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2fb4d884-3353-4a0c-bce3-eb7f94073b90 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe9698281f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.462219 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2fb4d884-3353-4a0c-bce3-eb7f94073b90 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1052769902" status: 204 len: 0 microversion: 2.2 time: 0.093611 Aug 30 04:27:08.462979 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1924/3932] 10.222.0.27 () {60 vars in 1321 bytes} [Tue Aug 30 04:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1052769902 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:08.474373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f117e32e-10ab-4f68-9036-fbd12c4cbb32 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe9693b1430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.555349 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f117e32e-10ab-4f68-9036-fbd12c4cbb32 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1493436531" status: 204 len: 0 microversion: 2.2 time: 0.084281 Aug 30 04:27:08.560743 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2009/3933] 10.222.0.27 () {60 vars in 1321 bytes} [Tue Aug 30 04:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1493436531 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:08.577947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef9c98a5-58a1-46e6-bf27-4a479ce89f85 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe96927f5e0>, body: {"keypair": {"name": "tempest-keypair-953679162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMS/Ap87Dtw1cY2KQNGr5pK+vuRcaYYJiFa9TgOJp9tL33KtAGDNxFcQSl3kucpud1SN6X0WfHehtC1ZSoI6rAVZYDaq8mqmQl45q4Bqzr/0CvGl2igfygWTielPfnaiIA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:08.650535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ef9c98a5-58a1-46e6-bf27-4a479ce89f85 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:08.684817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ef9c98a5-58a1-46e6-bf27-4a479ce89f85 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:08.804889 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef9c98a5-58a1-46e6-bf27-4a479ce89f85 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.231366 Aug 30 04:27:08.810258 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1925/3934] 10.222.0.27 () {62 vars in 1199 bytes} [Tue Aug 30 04:27:08 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 30 04:27:08.827760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37299004-966b-446d-9507-cd04248f2789 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96a5caa60>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.855080 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37299004-966b-446d-9507-cd04248f2789 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-953679162" status: 200 len: 512 microversion: 2.2 time: 0.034445 Aug 30 04:27:08.856942 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2010/3935] 10.222.0.27 () {60 vars in 1255 bytes} [Tue Aug 30 04:27:08 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-953679162 => generated 512 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:08.876280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12de2691-615c-4047-8ae2-28b3c150cb65 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe9691c13a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.876280 n-d-854925-5 devstack@n-api.service[122402]: WARNING oslo_db.sqlalchemy.utils [None req-12de2691-615c-4047-8ae2-28b3c150cb65 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 04:27:08.894587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12de2691-615c-4047-8ae2-28b3c150cb65 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.029416 Aug 30 04:27:08.895726 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1926/3936] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Aug 30 04:27:08 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:08.907206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4d50b86-6f4b-4dc9-ae34-d7cdc180440b tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96a818dc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.948629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:08.949459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:08.964963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.971445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:08.986246 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4d50b86-6f4b-4dc9-ae34-d7cdc180440b tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-953679162" status: 204 len: 0 microversion: 2.2 time: 0.083264 Aug 30 04:27:08.987536 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2011/3937] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Aug 30 04:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-953679162 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:08.988612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:08.993706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:08.999601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.002629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.006508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Action: 'create', calling method: .version_select at 0x7fe96a5ca3a0>, body: {"keypair": {"name": "tempest-keypair-1983362196", "type": "x509"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:09.087874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:09.116271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:09.205061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.processutils [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp4xt4fm8i/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4xt4fm8i/temp.key -subj /CN=6379cdc016d14ebfbcfae1aee2a3343f -extensions v3_req_client {{(pid=122403) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 04:27:09.634282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.processutils [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp4xt4fm8i/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp4xt4fm8i/temp.key -subj /CN=6379cdc016d14ebfbcfae1aee2a3343f -extensions v3_req_client" returned: 0 in 0.439s {{(pid=122403) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 04:27:09.636591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.processutils [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp4xt4fm8i/temp.key -password pass: {{(pid=122403) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 30 04:27:09.688135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.processutils [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp4xt4fm8i/temp.key -password pass:" returned: 0 in 0.051s {{(pid=122403) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 30 04:27:09.791128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:09.846437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Getting quotas for user 6379cdc016d14ebfbcfae1aee2a3343f and project f153ed84b59742c2bcc9bee09d03cccb. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:09.901714 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-554f6cde-14e0-417d-b122-7126febe8b70 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.901176 Aug 30 04:27:09.916223 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2012/3938] 10.222.0.27 () {62 vars in 1198 bytes} [Tue Aug 30 04:27:08 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 917 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:09.938421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:09.941057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:09.963453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.964579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.967459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:09.994134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:09.995022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:09.996710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.335488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.359509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.361141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.362556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0941fd27-76a2-47df-af7f-9e2dd4fbfbaa tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.418004 Aug 30 04:27:10.370414 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1927/3939] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:08 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:10.391962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adf344c0-b1de-4f83-a258-00513524f10f tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96924b940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.429391 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adf344c0-b1de-4f83-a258-00513524f10f tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs/tempest-keypair-1983362196" status: 200 len: 1534 microversion: 2.2 time: 0.048481 Aug 30 04:27:10.441725 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1928/3940] 10.222.0.27 () {60 vars in 1258 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1983362196 => generated 1534 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:10.446813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-673c970a-b5ed-4468-abfd-90837432833e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe9691e93a0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.490866 n-d-854925-5 devstack@n-api.service[122402]: WARNING oslo_db.sqlalchemy.utils [None req-673c970a-b5ed-4468-abfd-90837432833e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 04:27:10.490866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:10.513414 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-673c970a-b5ed-4468-abfd-90837432833e tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.069027 Aug 30 04:27:10.514371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1929/3941] 10.222.0.27 () {60 vars in 1177 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:10.524787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-78f7b69a-73b7-4212-bde4-fec58f86d3b3 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] Calling method '.version_select at 0x7fe96994bd30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.567556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-78f7b69a-73b7-4212-bde4-fec58f86d3b3 tempest-KeyPairsV22TestJSON-785571374 tempest-KeyPairsV22TestJSON-785571374-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983362196" status: 204 len: 0 microversion: 2.2 time: 0.046603 Aug 30 04:27:10.573856 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1930/3942] 10.222.0.27 () {60 vars in 1261 bytes} [Tue Aug 30 04:27:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1983362196 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:27:10.621962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:10.635920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46ac3349-76b6-472f-a671-e05c69d670c8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1558 microversion: 2.1 time: 0.717626 Aug 30 04:27:10.655316 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2013/3943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:09 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1558 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:10.659765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:10.660543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:10.683949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.684453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.684905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.692934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:10.693687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:10.694152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:10.992447 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e6550373-8635-47d9-837d-98dbef90efb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.336505 Aug 30 04:27:10.993395 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1931/3944] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:27:10 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-interface => generated 285 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:11.400283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:11.401826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:11.415276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.418865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.420050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:11.422314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:11.426963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:11.427509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:12.578310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.593284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.597471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:12.601046 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f072f361-5b9e-4c53-bc0a-5a174d8b555c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.205465 Aug 30 04:27:12.604418 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2014/3945] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:11 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:13.627310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:13.628805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:13.655715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.658110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.660505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:13.662962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:13.665714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:13.667011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:15.887270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:15.899886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:15.908210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:15.933384 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-02e69e1c-94bf-4cbe-9cab-35d6bb138a6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 2.310100 Aug 30 04:27:15.956389 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1932/3946] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:13 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:16.962532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:16.963755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:16.998225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:16.999185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:16.999837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:17.000760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:17.014427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:17.021477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:17.981247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:17.999745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:18.001817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:18.007600 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc9106e9-8097-4de5-9619-a7e9759fa784 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.049398 Aug 30 04:27:18.011443 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2015/3947] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:16 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:18.490265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-76525748-87d2-44a7-aebc-53565017d7ce req-1919d78b-b7eb-4b79-bcff-d341cd74118a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab72fe9b-dcf6-43a8-aede-9ff12153d8b8", "tag": "1c9ef8fc-7ef1-4689-b282-c70f317f238c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:18.516835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-76525748-87d2-44a7-aebc-53565017d7ce req-1919d78b-b7eb-4b79-bcff-d341cd74118a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:18.517359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-76525748-87d2-44a7-aebc-53565017d7ce req-1919d78b-b7eb-4b79-bcff-d341cd74118a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:18.532658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-76525748-87d2-44a7-aebc-53565017d7ce req-1919d78b-b7eb-4b79-bcff-d341cd74118a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:18.596168 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-76525748-87d2-44a7-aebc-53565017d7ce req-1919d78b-b7eb-4b79-bcff-d341cd74118a service nova] Creating event network-changed:1c9ef8fc-7ef1-4689-b282-c70f317f238c for instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 on n-h2-854925-5 Aug 30 04:27:18.608776 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-76525748-87d2-44a7-aebc-53565017d7ce req-1919d78b-b7eb-4b79-bcff-d341cd74118a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126877 Aug 30 04:27:18.616155 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1933/3948] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:27:19.040143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:19.041836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:19.063437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.064124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.068366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.069860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.073248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.074920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.674306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=24 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:19.771063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:19.782726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:19.789823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:19.796273 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7610e6aa-b899-4c8b-86ec-61266f1ec987 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.761259 Aug 30 04:27:19.818755 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2016/3949] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:19 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:19.967341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Calling method '.version_select at 0x7fe9692d0a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:19.985598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.986431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.987102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:19.988078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:19.988825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:19.989557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.028696 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c0d558d7-3c9d-4a37-8741-fbdd53b2e0c0 tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] 10.222.0.27 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.359815 Aug 30 04:27:20.030611 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1934/3950] 10.222.0.27 () {58 vars in 1122 bytes} [Tue Aug 30 04:27:19 2022] GET /compute/v2.1/limits => generated 511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:20.130312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-13364968", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:20.169096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:20.257614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:27:20.833237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:20.835148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:20.856240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.856886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.857366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.858840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:20.860760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:20.862585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:20.874602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=78 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:21.333369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Getting quotas for project a11a4e6daa064bb4b41b864626598ab1. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:21.346449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Getting quotas for user c4e25490a1fb4286a2beedc3ea552e80 and project a11a4e6daa064bb4b41b864626598ab1. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:21.417772 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Request method failure captured: Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 1750 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGnl3fh4lNx7HVfskqSjgIh2B8J3S1-Zl5ImftECo2YUT9YhitPX7Jt6PiHBHlZRK0DeXF3C0SqJMBgJslQZDCqilYeSfNhO8-3JvQQ36OrlThTiCMVtf2XBXJs1lEyEGb4P7s4Y5z_HQjPJCQnCIOkwQYQeQyezPVKSdgvuwnKsGY Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a11a4e6daa064bb4b41b864626598ab1 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-790727256 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a11a4e6daa064bb4b41b864626598ab1", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a11a4e6daa064bb4b41b864626598ab1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a11a4e6daa064bb4b41b864626598ab1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a11a4e6daa064bb4b41b864626598ab1"}]}] Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-790727256 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a11a4e6daa064bb4b41b864626598ab1 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-790727256 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-790727256-project Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c4e25490a1fb4286a2beedc3ea552e80 Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-790727256-project Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-13364968", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:27:21.421133 n-d-854925-5 devstack@n-api.service[122403]: exception: Maximum number of metadata items exceeds 128 Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-13364968', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:21.423697 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77d13548-f268-4745-81cc-58953edaa52b tempest-AbsoluteLimitsNegativeTestJSON-790727256 tempest-AbsoluteLimitsNegativeTestJSON-790727256-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.300220 Aug 30 04:27:21.426852 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2017/3951] 10.222.0.27 () {60 vars in 1148 bytes} [Tue Aug 30 04:27:20 2022] POST /compute/v2.1/servers => generated 87 bytes in 1302 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:27:21.444334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:21.469547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:21.480379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:21.488598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ded80a1e-e0f2-4f02-87ff-91f124489988 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.660638 Aug 30 04:27:21.512985 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1935/3952] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:20 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:21.578882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a4f16be-621f-42ee-a287-c554758d7de3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'create', calling method: .version_select at 0x7fe96a5d3b80>, body: {"keypair": {"name": "tempest-keypair-204819063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjEdqtIukr8s0q0Sn0MfycBV4g1nnwVdmDkwWOC3hyQ8+MB6b7lJR1IyGbHeT9CwknFVuvM6XXbni7lqRjEG1POInqs2MBs6VX6nWCg+ULbZbmsci04WJ80M0GjzecmcA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:21.617956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4a4f16be-621f-42ee-a287-c554758d7de3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:21.624463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4a4f16be-621f-42ee-a287-c554758d7de3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for user d4d759ef2dc64a5e8ef6e883efc13d68 and project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:21.734262 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4a4f16be-621f-42ee-a287-c554758d7de3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.309973 Aug 30 04:27:21.735554 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2018/3953] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:27:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:22.520951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:22.521619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:22.559974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.562230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.564560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.567888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:22.571144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:22.573018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:22.974089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:22.989595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:22.993809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:23.000710 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4e71084-c37d-4830-932a-ff7b69212c48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.483484 Aug 30 04:27:23.001925 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1936/3954] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:22 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:24.030020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:24.031297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:24.045186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.046019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.047437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.049224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:24.052589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:24.053872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:24.951167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:24.978770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:24.980837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:24.984555 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8948bb92-8635-40ac-b1ef-65811187a78b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.960004 Aug 30 04:27:24.989564 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2019/3955] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:24 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:26.018862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:26.019486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:26.038792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.039427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.039879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.040621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:26.041089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:26.041557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:26.669737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:26.686925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:26.690380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:26.691848 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-361585a4-6031-49ed-9bd4-9c2414643c5e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.677018 Aug 30 04:27:26.694925 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1937/3956] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:26 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:27.724825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:27.725602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:27.740330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.740835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.741279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.742021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:27.742544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:27.747297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:27.764625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1841870784", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e030e97-f3bc-405c-9a73-9eb51ff4d48e"}], "security_groups": [{"name": "tempest-securitygroup--689484997"}], "key_name": "tempest-keypair-204819063", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:27.772915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=59 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:28.494401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:28.494839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] validate_networks() for [('9e030e97-f3bc-405c-9a73-9eb51ff4d48e', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:27:28.527341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:28.542555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:28.547865 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e9bbb9e-7581-4dd9-a0f0-e4846583ec13 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.828989 Aug 30 04:27:28.555829 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2020/3957] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:27 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:29.439149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:29.449482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:29.451028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:29.451744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:29.453094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:29.481956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.482517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.482979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.483995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.484472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.484913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.537087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:29.549688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for user d4d759ef2dc64a5e8ef6e883efc13d68 and project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:29.583980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:29.584881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:29.621282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.621837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.622282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.626759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:29.628189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:29.629158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:29.629890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:29.631712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:29.787314 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f1a7f20-cdf0-47d7-97cf-978f8afca1e9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.031235 Aug 30 04:27:29.787984 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1938/3958] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:27:29.825996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb1a87bb-56b5-4c33-9f0d-6ad585a731e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:29.826699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb1a87bb-56b5-4c33-9f0d-6ad585a731e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:30.013290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fb1a87bb-56b5-4c33-9f0d-6ad585a731e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:30.034435 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb1a87bb-56b5-4c33-9f0d-6ad585a731e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1238 microversion: 2.1 time: 0.226632 Aug 30 04:27:30.036405 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1939/3959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:29 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1238 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:30.753142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:30.766664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:30.772534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:30.786525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-68f02a6a-7580-4311-b0d9-a15c11d7fda8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.202897 Aug 30 04:27:30.801565 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2021/3960] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:29 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:31.061958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:31.062649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:31.079408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.080179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.080844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.081847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.082453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.083294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.814126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:31.815359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:31.834631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:31.847550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.849769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.851122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:31.853539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:31.855474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:31.858310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:32.154846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:32.170423 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9cfe2803-a1f7-4360-9bb9-edb686bcf90f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1242 microversion: 2.1 time: 1.112265 Aug 30 04:27:32.170958 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1940/3961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:31 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1242 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:33.051058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.066645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.068401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.069663 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5cba7a10-94da-446e-a195-c97d3132213d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.260173 Aug 30 04:27:33.070775 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2022/3962] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:31 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:33.199353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:33.201116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:33.214508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.215419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.216406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.217430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:33.218174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:33.221207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:33.470701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:33.479711 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5387b2fe-a09b-426e-b753-467b58d66090 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1308 microversion: 2.1 time: 0.290991 Aug 30 04:27:33.490037 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1941/3963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:33 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:34.098434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:34.099057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:34.109095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.120550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.121231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.122263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.122863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.123439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.505089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:34.506352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:34.519103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.524357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.525549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.526627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:34.539111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:34.539940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:34.924127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.935023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.961030 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-24feb37c-c385-4f7c-ab53-a9a467d0a5bf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1296 microversion: 2.1 time: 0.460039 Aug 30 04:27:34.961159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.961712 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1942/3964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:34 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1296 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:34.976053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:34.976053 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d854b6f-7233-49f6-a320-e751e6eb6106 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.875813 Aug 30 04:27:35.003509 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2023/3965] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:34 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:35.009893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-20378e81-e256-490f-91b3-de6b2372719e req-23beacde-3f15-4d9a-90e2-ebecfaa92159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "name": "network-vif-plugged", "status": "completed", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:35.052402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-20378e81-e256-490f-91b3-de6b2372719e req-23beacde-3f15-4d9a-90e2-ebecfaa92159 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:35.052901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-20378e81-e256-490f-91b3-de6b2372719e req-23beacde-3f15-4d9a-90e2-ebecfaa92159 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:35.053374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-20378e81-e256-490f-91b3-de6b2372719e req-23beacde-3f15-4d9a-90e2-ebecfaa92159 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:35.101082 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-20378e81-e256-490f-91b3-de6b2372719e req-23beacde-3f15-4d9a-90e2-ebecfaa92159 service nova] Creating event network-vif-plugged:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h2-854925-5 Aug 30 04:27:35.108330 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-20378e81-e256-490f-91b3-de6b2372719e req-23beacde-3f15-4d9a-90e2-ebecfaa92159 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103333 Aug 30 04:27:35.109710 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2024/3966] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:35.983463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:35.984397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.006393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:36.008185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:36.013226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.014833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.019323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.021455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.023209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.023942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.024599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.024836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.026218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:36.027156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:36.027816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:36.029197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.103868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.119005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7cdd84a-c010-40bd-8083-991c5fd8ccc1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 1.140429 Aug 30 04:27:37.141113 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1943/3967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:35 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:37.219348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.247621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.252016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:37.271435 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c68c3e82-447b-45c8-99c9-64997672177d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 1.270958 Aug 30 04:27:37.278066 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2025/3968] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:35 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:37.488167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1076673401", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2e5aa9f9-fa55-4290-9a32-7058df842aea"}], "security_groups": [{"name": "tempest-securitygroup--960478297"}], "key_name": "tempest-keypair-1247534987", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c0bbf9c0-3b27-4a23-8862-ea156d9b6a67", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:37.778511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ea665d67-cb96-4c32-b418-0f7645b5bfd0 req-ec9f81e6-1be1-463e-b689-b83a3ffdb1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:37.788649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:37.802548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ea665d67-cb96-4c32-b418-0f7645b5bfd0 req-ec9f81e6-1be1-463e-b689-b83a3ffdb1a9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:37.803065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ea665d67-cb96-4c32-b418-0f7645b5bfd0 req-ec9f81e6-1be1-463e-b689-b83a3ffdb1a9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:37.803505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ea665d67-cb96-4c32-b418-0f7645b5bfd0 req-ec9f81e6-1be1-463e-b689-b83a3ffdb1a9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:37.845544 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ea665d67-cb96-4c32-b418-0f7645b5bfd0 req-ec9f81e6-1be1-463e-b689-b83a3ffdb1a9 service nova] Creating event network-changed:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:27:37.874358 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ea665d67-cb96-4c32-b418-0f7645b5bfd0 req-ec9f81e6-1be1-463e-b689-b83a3ffdb1a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100332 Aug 30 04:27:37.879358 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2026/3969] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:27:37.907647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] validate_networks() for [('2e5aa9f9-fa55-4290-9a32-7058df842aea', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:27:38.141007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:38.142815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.165317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.170147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.174158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.176741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.178696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.184720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.611498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:38.621109 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25270671-ac07-40ce-ac13-6bb82421f54c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.485010 Aug 30 04:27:38.622991 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2027/3970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:38 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:38.628423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:38.629278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:38.645632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.648318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.648852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:38.649641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:38.650108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:38.652889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.502091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:39.567084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.606585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.613171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:39.614493 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4daaafbd-e2ec-48d4-b6f2-ee9307311832 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1806 microversion: 2.20 time: 0.990305 Aug 30 04:27:39.619125 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2028/3971] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:38 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1806 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:39.650724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:39.651898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:39.673247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.675345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.676181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.681140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.681813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.682409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.713220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Getting quotas for project eb90da5b84264d9297106dc75b0c321b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:39.729397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Getting quotas for user 03b3f68f74a44f718a03d1fccb4ae2ac and project eb90da5b84264d9297106dc75b0c321b. Resources: dict_keys(['metadata_items']) {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:39.765169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:39.767005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:39.767668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:39.768246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:39.770184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:39.790930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.792942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.799077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.800270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:39.800899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:39.801536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:39.843101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Getting quotas for project eb90da5b84264d9297106dc75b0c321b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:39.856073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Getting quotas for user 03b3f68f74a44f718a03d1fccb4ae2ac and project eb90da5b84264d9297106dc75b0c321b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:39.967049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:39.970959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c0bbf9c0-3b27-4a23-8862-ea156d9b6a67',volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:40.216933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.227908 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-96fddad9-ea76-463d-aace-346e55bf0699 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.581761 Aug 30 04:27:40.240797 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2029/3972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:39 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:40.274434 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3bd2842-d5e8-48ca-bb38-f0e92397ea33 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.791317 Aug 30 04:27:40.284934 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1944/3973] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 2802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:27:40.288541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0338ef70-564d-46fc-a973-c4213dbdb57a tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.289645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0338ef70-564d-46fc-a973-c4213dbdb57a tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.466219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0338ef70-564d-46fc-a973-c4213dbdb57a tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:40.478243 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0338ef70-564d-46fc-a973-c4213dbdb57a tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1122 microversion: 2.1 time: 0.194264 Aug 30 04:27:40.483963 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2030/3974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1122 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:40.644609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:40.645573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:40.647210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:40.676203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.676975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.679494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:40.680461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:40.683395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:40.690332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.249279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:41.250128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:41.266252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.266753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.267199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:41.267919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:41.268381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:41.268817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.031241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.050113 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8eee6110-3616-47e4-9dfa-74d0f7859be4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.805081 Aug 30 04:27:42.051163 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2031/3975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:41 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:42.058954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:42.059942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:42.074865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.084667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.085219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.087774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:42.088249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:42.088702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:42.281742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.295689 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad1256fa-7b47-4ae6-b0f7-ed17af07b791 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1220 microversion: 2.1 time: 0.242379 Aug 30 04:27:42.313265 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2032/3976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:42 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1220 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:42.315139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.326652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.328095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:42.331296 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e6fa224b-10c1-4fdd-8223-a6178bd74be7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1793 microversion: 2.20 time: 1.690771 Aug 30 04:27:42.331907 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1945/3977] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:27:40 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1793 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:27:43.078226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:43.078897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:43.100138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.100641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.108164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.111657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.113637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.115628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.322568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:43.323196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:43.345949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.349905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.350724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.351761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:43.355660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:43.378540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:43.635771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:43.649800 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c3c6b03-7ff3-45f4-8788-a412bd88bdc9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1238 microversion: 2.1 time: 0.331657 Aug 30 04:27:43.650705 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1946/3978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:43 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1238 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:43.761840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:43.777789 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b62e9ea-b06a-43a1-95fb-96638618c86c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.708733 Aug 30 04:27:43.780260 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2033/3979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:43 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:44.671168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:44.672344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:44.684134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.684929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.685575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.691160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.692302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.693000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.800372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:44.801002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:44.809025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.809775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.810578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:44.817170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:44.818136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:44.818879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:45.025174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:45.043621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8e4fba3-c847-4634-a33f-4b64dd8731f6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1238 microversion: 2.1 time: 0.375473 Aug 30 04:27:45.047333 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1947/3980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:44 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1238 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:45.350021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:45.375167 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a4eda3a-7011-47be-9c7f-859edeca6934 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.578561 Aug 30 04:27:45.375798 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2034/3981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:44 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:46.064553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:46.065986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:46.082113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.083213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.083863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.084785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.086025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.097043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.397813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:46.399287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:46.412450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.413429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.417630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.418811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:46.419468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:46.420065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:46.653778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:46.674170 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-643b01a0-3730-4bba-9ef9-c991098184cf tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1305 microversion: 2.1 time: 0.603008 Aug 30 04:27:46.691700 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1948/3982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:46 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1305 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:46.852597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:46.879550 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-35273354-c865-4878-a6f4-a55c052efeac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.487016 Aug 30 04:27:46.883124 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2035/3983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:46 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:47.711257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.711922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.721938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.764084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.764672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.765539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.766337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.766791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.903603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:47.904230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:47.918616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.919307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.919988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:47.932314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:47.935142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:47.940239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.220772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:48.232499 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3f5de62-ada6-4ef5-98b3-129fd2c62e00 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1305 microversion: 2.1 time: 0.526014 Aug 30 04:27:48.242078 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1949/3984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1305 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:48.319353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:48.323428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f80f78c7-91e5-4011-be70-21bcbb8d4bda req-4ea05880-10e8-4c99-a054-773fc3916df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c734e7-a2d4-4989-9b27-2122eb927b14", "tag": "e9cd4fec-2688-47cd-bdb5-7cede32eb332"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:48.352251 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d73c33c3-6d64-42ba-a64b-14ab700fe189 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.450725 Aug 30 04:27:48.352903 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2036/3985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:47 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:48.374059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f80f78c7-91e5-4011-be70-21bcbb8d4bda req-4ea05880-10e8-4c99-a054-773fc3916df4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:48.374572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f80f78c7-91e5-4011-be70-21bcbb8d4bda req-4ea05880-10e8-4c99-a054-773fc3916df4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:48.375019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f80f78c7-91e5-4011-be70-21bcbb8d4bda req-4ea05880-10e8-4c99-a054-773fc3916df4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:48.394732 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f80f78c7-91e5-4011-be70-21bcbb8d4bda req-4ea05880-10e8-4c99-a054-773fc3916df4 service nova] Creating event network-changed:e9cd4fec-2688-47cd-bdb5-7cede32eb332 for instance b0c734e7-a2d4-4989-9b27-2122eb927b14 on n-h2-854925-5 Aug 30 04:27:48.430608 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f80f78c7-91e5-4011-be70-21bcbb8d4bda req-4ea05880-10e8-4c99-a054-773fc3916df4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111664 Aug 30 04:27:48.434767 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1950/3986] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:48.839042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-885434627", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "6c0b2df9-5e50-4be8-9c08-95d33a0218f9"}, {"uuid": "732107bc-2cc6-43fa-bd2b-8f54c3831ea6"}, {"uuid": "6c0b2df9-5e50-4be8-9c08-95d33a0218f9"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:48.959946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] validate_networks() for [('6c0b2df9-5e50-4be8-9c08-95d33a0218f9', None, None, None, None, None), ('732107bc-2cc6-43fa-bd2b-8f54c3831ea6', None, None, None, None, None), ('6c0b2df9-5e50-4be8-9c08-95d33a0218f9', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:27:49.267748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:49.268720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:49.294631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.295723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.296629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.297964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.298649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.299302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.621047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:49.661377 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84757709-db4e-46ed-a630-6248c3c6c2a7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1305 microversion: 2.1 time: 0.395609 Aug 30 04:27:49.667840 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1951/3987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:49 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1305 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:49.691602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:49.694672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:49.709484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.710000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.710527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.712722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:49.714955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:49.716303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:49.819174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:49.879449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=20 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:50.254224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:50.267471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2dc4e21-7100-4447-8c93-5ba7c5cc0072 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.596968 Aug 30 04:27:50.268090 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1952/3988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:49 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:50.286392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:50.286913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:50.303249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.303761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.304245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.304983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.305468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.305911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.361722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2abfb8e4-69cd-4c67-a4b5-83a047c0c851 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/ips" status: 200 len: 150 microversion: 2.1 time: 0.092392 Aug 30 04:27:50.362549 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1953/3989] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:27:50 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:50.369912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-76dde39a-4ca6-40bf-b35f-e0bf447f872d req-c472df7d-f4e0-41fc-86d5-aaf5594a381c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-plugged", "status": "completed", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:50.412080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-76dde39a-4ca6-40bf-b35f-e0bf447f872d req-c472df7d-f4e0-41fc-86d5-aaf5594a381c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.412080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-76dde39a-4ca6-40bf-b35f-e0bf447f872d req-c472df7d-f4e0-41fc-86d5-aaf5594a381c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.412080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-76dde39a-4ca6-40bf-b35f-e0bf447f872d req-c472df7d-f4e0-41fc-86d5-aaf5594a381c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.433205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-76dde39a-4ca6-40bf-b35f-e0bf447f872d req-c472df7d-f4e0-41fc-86d5-aaf5594a381c service nova] Creating event network-vif-plugged:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:27:50.446747 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-76dde39a-4ca6-40bf-b35f-e0bf447f872d req-c472df7d-f4e0-41fc-86d5-aaf5594a381c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082651 Aug 30 04:27:50.447562 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1954/3990] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:50.471369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:50.688737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:50.689672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:50.696813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.714020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.715753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:50.717526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:50.718264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:50.718818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.485773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:27:51.486855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:27:51.487538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:27:51.488239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:27:51.489178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:27:51.520330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.522315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.523030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.525309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.527017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.527625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.543758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:51.548104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:51.579809 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bdcc0073-3792-4e0d-b1e7-2420748cb1f9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1305 microversion: 2.1 time: 0.890024 Aug 30 04:27:51.581781 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1955/3991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:50 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1305 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:51.595848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.598690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:51.607819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Getting quotas for project 248467fdcdfd4921be9143a3dd19fe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:27:51.614237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.615130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.618279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Getting quotas for user 2d38b18902064b209737dfd5e13df183 and project 248467fdcdfd4921be9143a3dd19fe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:27:51.635421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:27:51.639514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:27:51.655042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.662221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:51.663189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:51.664289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:51.738645 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-402d7000-83aa-447d-beab-336945072bed tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.905419 Aug 30 04:27:51.739943 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2037/3992] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:27:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:27:51.754842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8d0d93d-21fb-45e3-892b-107ee84ded64 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:51.755622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8d0d93d-21fb-45e3-892b-107ee84ded64 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:52.023714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c8d0d93d-21fb-45e3-892b-107ee84ded64 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:52.033677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8d0d93d-21fb-45e3-892b-107ee84ded64 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1212 microversion: 2.1 time: 0.286768 Aug 30 04:27:52.055588 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2038/3993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:51 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1212 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:52.194155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:52.207380 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7defdfc4-b772-4661-8663-9feba2b00c0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1363 microversion: 2.1 time: 0.624458 Aug 30 04:27:52.210788 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1956/3994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:51 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1363 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:52.618249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:52.619679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:52.629624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:52.630310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:52.631044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:52.632075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:52.633804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:52.637818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.062889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:53.064547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:53.083465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.084630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.087980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.089087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.089814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.091525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.141555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:53.164718 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6b207b98-e12f-421d-ad4f-756ff18a3801 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1305 microversion: 2.1 time: 0.558909 Aug 30 04:27:53.168049 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2039/3995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:52 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1305 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:53.231556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:53.232470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:53.245664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.246385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.247263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.249632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.250364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.251418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.287471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:53.298316 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df6a87cc-9c28-4395-a01a-11a37e55370b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1208 microversion: 2.1 time: 0.239422 Aug 30 04:27:53.314062 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1957/3996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:53 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1208 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:53.743925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:53.747895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:27:53.759171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-97284007-9d77-434b-8eca-adeab68ae31d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1550 microversion: 2.1 time: 0.531451 Aug 30 04:27:53.763005 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2040/3997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:53 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1550 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:53.787952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:53.788973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:53.823672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.840899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.841453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.842222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.842800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.843239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.863762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07f97d81-e722-4bab-82c8-b49d662dcbab"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:53.867068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:53.884788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.892388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.893033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:53.893927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:53.902162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:53.902986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.107252 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bada68b4-6d53-40f4-ae5b-553244f2f0d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.320933 Aug 30 04:27:54.107909 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1958/3998] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:27:53 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/os-interface => generated 284 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:54.192229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:54.193094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:54.211626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.214614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.236195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.238540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.243010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.246897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.659457 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-887d41c4-383f-4fa6-a382-4f48f743cd11 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.801035 Aug 30 04:27:54.666315 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2041/3999] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:27:53 2022] POST /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 194 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:27:54.703430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:54.704180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:54.724192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.729195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.729495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:54.730477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:54.731029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:54.731480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:55.248212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:55.262520 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9c2246b1-7119-45af-9fcd-28580090ad92 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1270 microversion: 2.1 time: 0.594814 Aug 30 04:27:55.263140 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2042/4000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:54 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1270 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:55.296507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:55.306209 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f94107ff-8950-4ed9-b27d-3159966e3854 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1305 microversion: 2.1 time: 1.119297 Aug 30 04:27:55.313392 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1959/4001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:54 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1305 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:56.288601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:56.289298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:56.310600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.314423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.315083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:56.317640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.318280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.318868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:56.326643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:56.327829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:56.350960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.351704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.354065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:56.355014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:56.373755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:56.373755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:57.915833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:57.930043 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c41aa7df-1cf1-4136-aaa1-9c086b907c78 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1293 microversion: 2.1 time: 1.604659 Aug 30 04:27:57.930976 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1960/4002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:56 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1293 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:58.101126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:58.111296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f3cc41d-c6f5-4031-8841-0b38231c574a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1312 microversion: 2.1 time: 1.826588 Aug 30 04:27:58.156058 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2043/4003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:56 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1312 bytes in 1872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:27:58.953342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:58.955624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:58.986830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:58.990151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:58.992992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:58.995887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:58.999239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.000267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.155863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:27:59.156487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:27:59.169203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.169724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.170165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.170882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.171336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.171766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:27:59.870491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:59.882871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40302c89-8bb4-4a0d-b3ca-2e7926e834f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1333 microversion: 2.1 time: 0.730154 Aug 30 04:27:59.883609 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2044/4004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:59 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1333 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:27:59.946449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8062dd28-197d-41fb-8171-235953647307 req-d5f27ea7-c224-4604-9c52-7738d0609ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:27:59.967732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:27:59.978797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8062dd28-197d-41fb-8171-235953647307 req-d5f27ea7-c224-4604-9c52-7738d0609ab6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:27:59.979635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8062dd28-197d-41fb-8171-235953647307 req-d5f27ea7-c224-4604-9c52-7738d0609ab6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:27:59.980365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8062dd28-197d-41fb-8171-235953647307 req-d5f27ea7-c224-4604-9c52-7738d0609ab6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:00.008788 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8062dd28-197d-41fb-8171-235953647307 req-d5f27ea7-c224-4604-9c52-7738d0609ab6 service nova] Creating event network-changed:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:28:00.010285 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8647f4c5-fa1a-4d62-b075-840a5d0ac95d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1293 microversion: 2.1 time: 1.058462 Aug 30 04:28:00.013521 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1961/4005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:27:58 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1293 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:00.036411 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8062dd28-197d-41fb-8171-235953647307 req-d5f27ea7-c224-4604-9c52-7738d0609ab6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093965 Aug 30 04:28:00.044373 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2045/4006] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:00.908734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:00.909875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:00.922106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:00.925497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:00.926174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:00.927071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:00.928614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:00.930010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.044020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:01.044760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:01.066852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:01.067655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:01.069987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.073879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:01.074726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:01.077440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:01.580160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:01.801444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:01.825026 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99d2fa7d-d6b6-45b0-9632-ba593b076778 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1293 microversion: 2.1 time: 0.789063 Aug 30 04:28:01.828085 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2046/4007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:01 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1293 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:01.834584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:01.852169 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dc77d49f-349f-40e1-8dfe-10a881e72a8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.947619 Aug 30 04:28:01.853400 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1962/4008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:00 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:02.848053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:02.848676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:02.861616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:02.875464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:02.876234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:02.893088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:02.893630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:02.894076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:02.894800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:02.895256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:02.895685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:02.899561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:02.907069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:02.907587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:02.908351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:02.908824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:02.909256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:03.618797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:03.655282 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-402a8bcf-e4dc-4d77-936d-be06ec51bb67 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1293 microversion: 2.1 time: 0.810966 Aug 30 04:28:03.656511 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2047/4009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:02 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1293 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:03.674045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:03.682435 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-368036c2-23cd-4e40-9159-8c7395b0a73e tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.811209 Aug 30 04:28:03.685994 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1963/4010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:02 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:03.901129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b09daff2-2256-42c9-9d77-f276d1ace704 req-6b0347eb-d6ce-49ff-87d0-e9a1707c9d9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "tag": "15e8e2b9-5077-4b2f-9edf-86388c11a87f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:03.933292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b09daff2-2256-42c9-9d77-f276d1ace704 req-6b0347eb-d6ce-49ff-87d0-e9a1707c9d9b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:03.933989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b09daff2-2256-42c9-9d77-f276d1ace704 req-6b0347eb-d6ce-49ff-87d0-e9a1707c9d9b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:03.935610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b09daff2-2256-42c9-9d77-f276d1ace704 req-6b0347eb-d6ce-49ff-87d0-e9a1707c9d9b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:03.978100 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b09daff2-2256-42c9-9d77-f276d1ace704 req-6b0347eb-d6ce-49ff-87d0-e9a1707c9d9b service nova] Creating event network-changed:15e8e2b9-5077-4b2f-9edf-86388c11a87f for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:03.990386 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b09daff2-2256-42c9-9d77-f276d1ace704 req-6b0347eb-d6ce-49ff-87d0-e9a1707c9d9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096255 Aug 30 04:28:03.997002 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2048/4011] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:04.679129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:04.680432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:04.699774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.700568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.706828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:04.707738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:04.715826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:04.717910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.719885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.721896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:04.722817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.725933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.727438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:04.730178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:04.731922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:04.733874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:05.357045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:05.369304 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c750bfc1-3ea9-492c-bb4e-8bf07fe611f9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.666608 Aug 30 04:28:05.371999 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2049/4012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:04 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:05.386482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:05.403463 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5cb5486-adf9-4b64-9aee-2837a9929cc0 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1293 microversion: 2.1 time: 0.728207 Aug 30 04:28:05.404884 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1964/4013] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:04 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1293 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:06.089448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2cefde2d-de19-44ee-98bc-b5b885d666b4 req-2664deda-d761-4545-a0a6-2431cf1b62ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "tag": "2ff46970-f385-496c-9155-15559770ff95"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:06.119145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2cefde2d-de19-44ee-98bc-b5b885d666b4 req-2664deda-d761-4545-a0a6-2431cf1b62ed service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.132696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2cefde2d-de19-44ee-98bc-b5b885d666b4 req-2664deda-d761-4545-a0a6-2431cf1b62ed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.132696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2cefde2d-de19-44ee-98bc-b5b885d666b4 req-2664deda-d761-4545-a0a6-2431cf1b62ed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.162200 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2cefde2d-de19-44ee-98bc-b5b885d666b4 req-2664deda-d761-4545-a0a6-2431cf1b62ed service nova] Creating event network-changed:2ff46970-f385-496c-9155-15559770ff95 for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:06.168169 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2cefde2d-de19-44ee-98bc-b5b885d666b4 req-2664deda-d761-4545-a0a6-2431cf1b62ed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087549 Aug 30 04:28:06.169403 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2050/4014] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:06.394242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:06.396192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:06.408567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.409995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.412172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.413718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.415142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.417434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.424655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:06.426219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:06.439015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.446676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.458152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.462060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:06.467005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:06.470710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:06.950594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:06.973904 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-58e9c4e5-e07c-4ce8-96b4-87d97240746c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1293 microversion: 2.1 time: 0.548868 Aug 30 04:28:06.978288 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2051/4015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:06 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1293 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:07.051229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:07.061131 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d1778387-79dd-4d11-997f-0c301e47eba7 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.670277 Aug 30 04:28:07.069852 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1965/4016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:06 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:07.180647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8e849ced-92f3-407d-b815-9c84438314ea req-24cd7e91-e9eb-437c-af3e-97b77db16ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c734e7-a2d4-4989-9b27-2122eb927b14", "name": "network-vif-plugged", "status": "completed", "tag": "e9cd4fec-2688-47cd-bdb5-7cede32eb332"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:07.207800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8e849ced-92f3-407d-b815-9c84438314ea req-24cd7e91-e9eb-437c-af3e-97b77db16ad5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:07.208676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8e849ced-92f3-407d-b815-9c84438314ea req-24cd7e91-e9eb-437c-af3e-97b77db16ad5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:07.209140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8e849ced-92f3-407d-b815-9c84438314ea req-24cd7e91-e9eb-437c-af3e-97b77db16ad5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:07.265050 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8e849ced-92f3-407d-b815-9c84438314ea req-24cd7e91-e9eb-437c-af3e-97b77db16ad5 service nova] Creating event network-vif-plugged:e9cd4fec-2688-47cd-bdb5-7cede32eb332 for instance b0c734e7-a2d4-4989-9b27-2122eb927b14 on n-h2-854925-5 Aug 30 04:28:07.281394 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8e849ced-92f3-407d-b815-9c84438314ea req-24cd7e91-e9eb-437c-af3e-97b77db16ad5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114775 Aug 30 04:28:07.282032 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2052/4017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:08.007855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:08.009208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:08.021339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.022176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.022807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.023780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.024416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.025264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.090632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:08.091356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:08.102049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.102556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.103021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.103729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.104192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.104631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.703548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:08.732348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b02f163f-7614-4a85-b6cc-70f906f9d926 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1293 microversion: 2.1 time: 0.732815 Aug 30 04:28:08.733137 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1966/4018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:07 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1293 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:08.738024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7e0c9546-09cf-493e-96f0-d826d3f0509a req-1b8a9467-b90a-4278-9376-7a6a33a82a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "tag": "a9200e70-110d-42da-8383-e8e1b9feaa3a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:08.752467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e0c9546-09cf-493e-96f0-d826d3f0509a req-1b8a9467-b90a-4278-9376-7a6a33a82a1c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:08.752787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:08.753170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e0c9546-09cf-493e-96f0-d826d3f0509a req-1b8a9467-b90a-4278-9376-7a6a33a82a1c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:08.753796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e0c9546-09cf-493e-96f0-d826d3f0509a req-1b8a9467-b90a-4278-9376-7a6a33a82a1c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:08.760865 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dc1fd8bf-0b1e-4d41-a30c-9e9c9e33b596 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.674799 Aug 30 04:28:08.761485 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2053/4019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:08 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:08.791750 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7e0c9546-09cf-493e-96f0-d826d3f0509a req-1b8a9467-b90a-4278-9376-7a6a33a82a1c service nova] Creating event network-changed:a9200e70-110d-42da-8383-e8e1b9feaa3a for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:08.803326 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7e0c9546-09cf-493e-96f0-d826d3f0509a req-1b8a9467-b90a-4278-9376-7a6a33a82a1c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068470 Aug 30 04:28:08.803864 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1967/4020] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:09.754702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:09.756528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:09.763192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:09.765514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:09.766405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:09.767046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:09.767958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:09.768811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:09.769478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:09.785845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:09.787279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:09.810335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:09.810853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:09.811297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:09.812405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:09.812874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:09.816910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.243386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:10.263662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:10.265601 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e17d8d3-71f7-4fab-a6f4-ff5714aaf626 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1482 microversion: 2.1 time: 0.515994 Aug 30 04:28:10.279755 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2054/4021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:09 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1482 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:10.279988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f693fccb-7f7b-4aaf-9106-152e5c6f4271 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.500120 Aug 30 04:28:10.290741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:10.291568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:10.294876 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1968/4022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:09 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:10.298386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.299113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.300354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.301279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:10.302038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:10.302674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:10.445418 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86f8719d-1082-4f40-b1f7-7b65d8ec3bc8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159202 Aug 30 04:28:10.446554 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2055/4023] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:28:10 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:11.304327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:11.306097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:11.313184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=48 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:11.316722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.317508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.318143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.320637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:11.321812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:11.322826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:11.629648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:11.640617 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d47f6c5d-5f96-442d-9469-1a9a8fa6252c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.340761 Aug 30 04:28:11.642325 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1969/4024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:11 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:12.317996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:12.320199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:12.332073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.333590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.335742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.337229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.337977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.338617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.412943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3d5f2d11-fdbe-4ee4-8f17-5ecd1b3c1c67 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments/a88ae02f-b2be-486d-98e6-21d56bef863e" status: 200 len: 194 microversion: 2.20 time: 0.382138 Aug 30 04:28:12.414157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2056/4025] 10.222.0.27 () {60 vars in 1454 bytes} [Tue Aug 30 04:28:12 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments/a88ae02f-b2be-486d-98e6-21d56bef863e => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:12.486256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:12.487015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:12.502217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-781545cc-6415-49b0-a72b-93f70a5e9cf6 req-701cf8e3-5eeb-4f0c-b17a-fce70d9cb094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c734e7-a2d4-4989-9b27-2122eb927b14", "tag": "e9cd4fec-2688-47cd-bdb5-7cede32eb332"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:12.515164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.515663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.516110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.519171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.521748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.527770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-781545cc-6415-49b0-a72b-93f70a5e9cf6 req-701cf8e3-5eeb-4f0c-b17a-fce70d9cb094 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.528349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.529011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-781545cc-6415-49b0-a72b-93f70a5e9cf6 req-701cf8e3-5eeb-4f0c-b17a-fce70d9cb094 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.531477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-781545cc-6415-49b0-a72b-93f70a5e9cf6 req-701cf8e3-5eeb-4f0c-b17a-fce70d9cb094 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.582016 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-781545cc-6415-49b0-a72b-93f70a5e9cf6 req-701cf8e3-5eeb-4f0c-b17a-fce70d9cb094 service nova] Creating event network-changed:e9cd4fec-2688-47cd-bdb5-7cede32eb332 for instance b0c734e7-a2d4-4989-9b27-2122eb927b14 on n-h2-854925-5 Aug 30 04:28:12.593730 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-781545cc-6415-49b0-a72b-93f70a5e9cf6 req-701cf8e3-5eeb-4f0c-b17a-fce70d9cb094 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096352 Aug 30 04:28:12.597015 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2057/4026] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:12.610163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:12.620068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:12.627266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.628079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.628763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.629748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.630573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.631400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.776030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lazy-loading 'services' on Instance uuid b9e5a44f-46b4-420a-a56d-4bcdaabc66ab {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:28:12.950851 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6a056300-721a-4efc-b2bb-ac378dd0c383 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments/a88ae02f-b2be-486d-98e6-21d56bef863e" status: 202 len: 0 microversion: 2.20 time: 0.352143 Aug 30 04:28:12.955992 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2058/4027] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Aug 30 04:28:12 2022] DELETE /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments/a88ae02f-b2be-486d-98e6-21d56bef863e => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:28:12.969319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:12.970129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:12.983865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.985726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:12.986438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.987051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.989584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:12.990226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:12.993702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:12.999150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:12.999423 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-372e8f7d-0f3e-4408-a79a-b60f59b7caf5 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1482 microversion: 2.1 time: 0.514877 Aug 30 04:28:13.004210 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1970/4028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:12 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1482 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:13.016743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:13.023354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:13.077439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.081276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.084712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.098917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:13.104524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:13.111355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:13.194637 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4118539b-3b83-423e-9d31-829a10759c92 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.189090 Aug 30 04:28:13.196337 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1971/4029] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:13 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:13.728863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:13.739287 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-15c1db9d-5255-48d4-85e9-0f5df9c928e3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.779109 Aug 30 04:28:13.749855 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2059/4030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:12 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:14.096298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-afd822ee-936f-4acb-99e3-5f396b640256 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: .version_select at 0x7fe96931bd30>, body: {"keypair": {"name": "tempest-keypair-879312003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcGzlwUUJhbYhAPL45xB/BxiFsfmrdwYyAY0BoqxudgasN1WCwwS8w0u7mkJd2BR/N0LT/6KbAmI9EaCZgU2oEwmhqMrpjTx//acJIY2XbML/Q1Y35s+0Th0eDIvvflUw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:14.116636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-afd822ee-936f-4acb-99e3-5f396b640256 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:14.129683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-afd822ee-936f-4acb-99e3-5f396b640256 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:14.185598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-afd822ee-936f-4acb-99e3-5f396b640256 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094585 Aug 30 04:28:14.192719 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1972/4031] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:28:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:14.210524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:14.214084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:14.235843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.237987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.238495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:14.239225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.239688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.242264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:14.324283 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-662441e5-972d-4c96-8fae-1e14b0822fed tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119575 Aug 30 04:28:14.329692 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2060/4032] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:14 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:14.777808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:14.778783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:14.794338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.794831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.795273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:14.795994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:14.800546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:14.801011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.339346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:15.341832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:15.358635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.359472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.361002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.368694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:15.369188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:15.372507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:15.434642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:15.453272 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-edd9355d-42ee-48be-bec6-7f5fd9f20645 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.682150 Aug 30 04:28:15.453901 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1973/4033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:14 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:15.474823 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-11eb3173-fb47-4104-a833-d948e5038f28 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140538 Aug 30 04:28:15.478116 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2061/4034] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:15 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:16.492283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:16.495340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:16.495990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:16.498451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:16.516084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.516607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.517048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.523835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.526527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.529568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.530394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.531180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.531790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.540661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:16.541981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:16.542590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:16.595620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:16.642994 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dae45625-b4a3-4364-8cab-949dbb4a5db9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.157177 Aug 30 04:28:16.648872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2062/4035] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:16 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:16.660993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1318787674", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18317384-8fd4-47be-a014-e798974b8cdc"}], "security_groups": [{"name": "tempest-securitygroup--1233854049"}], "key_name": "tempest-keypair-879312003", "user_data": "}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:17.050863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:17.061591 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19e24159-ebaa-48fa-8a94-681629ee97bd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.586922 Aug 30 04:28:17.071427 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1974/4036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:16 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:17.093360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] validate_networks() for [('18317384-8fd4-47be-a014-e798974b8cdc', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:28:17.656995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:17.659242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:17.675476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.675982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.676421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.677862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.678363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.678794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.759220 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e60b31d-eed5-4e68-9cd6-af76f72f7a4f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.106725 Aug 30 04:28:17.759848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1975/4037] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:17 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 04:28:17.820270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:17.820844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:17.828289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:17.828914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:17.829476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:17.849256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.849835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.850418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.851212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:17.851685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:17.852118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:17.873424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:17.881004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:17.898066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:17.901245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:17.967179 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a9ddc7d-2ce7-4401-b7be-17cc9fc2819b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.317117 Aug 30 04:28:17.968030 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2063/4038] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:28:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1319 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:28:17.979693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b88d80d4-d996-45bb-9d01-697b99babfbc tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:17.980574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b88d80d4-d996-45bb-9d01-697b99babfbc tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:18.082024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b88d80d4-d996-45bb-9d01-697b99babfbc tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:18.091572 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b88d80d4-d996-45bb-9d01-697b99babfbc tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1241 microversion: 2.1 time: 0.116171 Aug 30 04:28:18.094816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:18.095642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:18.111295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.111874 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1976/4039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:17 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:18.113223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.114039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.114965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.115652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.116992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.412065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:18.428040 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-57d658a5-bf17-45ef-98b1-83618bf5adbf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.335350 Aug 30 04:28:18.429926 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2064/4040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:18 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:18.779323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:18.783725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:18.813050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.813628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.813973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.833480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:18.834223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:18.834868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:18.995762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a2f67408-2def-4f78-b99d-6aca1b0845fb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.220035 Aug 30 04:28:19.012531 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1977/4041] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:18 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 197 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:19.120002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:19.121645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:19.149570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.150094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.150582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.151798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.152509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.153250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.221565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-154dbc5f-26e2-4d5e-bdf0-73f581668e35 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Action: 'create', calling method: .version_select at 0x7fe96e401700>, body: {"keypair": {"name": "tempest-keypair-1997462772", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMlMl2daOPfn/DXnZFshW5ZZgVHqP53xaxAjTTs9EdKd6Siinp3dy3pbbqqcP1iPF5hJqogzra/C5jmPMm647hNe0HU/iJzIYu39ikRB82lswEePEVnRwf7DlEtcMlycA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:19.277813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-154dbc5f-26e2-4d5e-bdf0-73f581668e35 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Getting quotas for project 7e9d663de1c740fd8f6b3e94bfcd175b. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:19.292174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-154dbc5f-26e2-4d5e-bdf0-73f581668e35 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Getting quotas for user 597f7e8d3d0145019fa489acf03f40d7 and project 7e9d663de1c740fd8f6b3e94bfcd175b. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:19.359932 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-154dbc5f-26e2-4d5e-bdf0-73f581668e35 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.152394 Aug 30 04:28:19.361137 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1978/4042] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:28:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:28:19.455042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:19.455641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:19.461538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.467961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.468693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.469298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.469727 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-473868df-dfcf-4a4b-9501-71f7a437e43a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1237 microversion: 2.1 time: 0.354459 Aug 30 04:28:19.470902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:19.471182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2065/4043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:19 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1237 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:19.471698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:19.485840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:19.830457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:19.851206 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd3f5c3d-abd6-4cb6-9c35-191dc7c5bd86 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.398697 Aug 30 04:28:19.863795 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1979/4044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:19 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:20.023396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.027446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:20.052323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.052826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.053310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.054062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.071263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.074141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.191432 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4e5aa6e-63ee-423d-81d0-c462dfcffa5f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.174138 Aug 30 04:28:20.194987 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2066/4045] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:20 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:20.491781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.492732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:20.501831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.504972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.505782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.509732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.511093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.512143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.601902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:20.612267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20b262e2-9268-4b09-8ed4-f31c82291524 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1299 microversion: 2.1 time: 0.124421 Aug 30 04:28:20.621438 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1980/4046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:20 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:20.888534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:20.889980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:20.909231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.909776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.910353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:20.917850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:20.918356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:20.921318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.133405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.166119 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7fc0e9c7-cd34-481e-8918-7c6ff742910a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.283064 Aug 30 04:28:21.188273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2067/4047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:20 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:21.207030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.213009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.232952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.235404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.236092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.238700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.241158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.242503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.284681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aff8e068-3e88-477d-bfe9-defd09d2a28d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.085174 Aug 30 04:28:21.302530 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1981/4048] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:28:21 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:21.359572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.360863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.369126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.370680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.371564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.373104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.373854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.375382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.424859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:28:21.586909 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-249e466a-7ff4-4b2e-a7f6-1b373d29a8a2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 204 len: 0 microversion: 2.20 time: 0.232337 Aug 30 04:28:21.587870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2068/4049] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:28:21 2022] DELETE /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:28:21.596018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.596630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.607022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.607673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.608163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.609137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.609803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.610301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.642442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:21.643605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:21.652792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.653755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.654864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.656612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:21.657521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:21.658943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:21.813217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.829002 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-984dc32a-76d7-493c-9feb-88d9c93b927b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1299 microversion: 2.1 time: 0.191761 Aug 30 04:28:21.831148 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2069/4050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:21 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:21.859980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.868860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.870375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:21.873421 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8b057185-e03b-4405-bfbf-fab0340cde48 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 0.281353 Aug 30 04:28:21.883785 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1982/4051] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:21 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:22.018844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-db2bed85-10a6-48e9-abe2-711a965496f5 req-0a61ff0f-522a-4ec5-800b-9a5277814435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "name": "network-vif-plugged", "status": "completed", "tag": "2ff46970-f385-496c-9155-15559770ff95"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:22.030221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-db2bed85-10a6-48e9-abe2-711a965496f5 req-0a61ff0f-522a-4ec5-800b-9a5277814435 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.030718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-db2bed85-10a6-48e9-abe2-711a965496f5 req-0a61ff0f-522a-4ec5-800b-9a5277814435 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.031168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-db2bed85-10a6-48e9-abe2-711a965496f5 req-0a61ff0f-522a-4ec5-800b-9a5277814435 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.045757 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-db2bed85-10a6-48e9-abe2-711a965496f5 req-0a61ff0f-522a-4ec5-800b-9a5277814435 service nova] Creating event network-vif-plugged:2ff46970-f385-496c-9155-15559770ff95 for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:22.054553 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-db2bed85-10a6-48e9-abe2-711a965496f5 req-0a61ff0f-522a-4ec5-800b-9a5277814435 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038643 Aug 30 04:28:22.055487 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2070/4052] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:22.194189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.195056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.201446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.201931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.202562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.203420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.204027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.204607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.419108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:22.430392 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4589a6df-0e36-437e-a462-00e93ce5345c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.240547 Aug 30 04:28:22.431552 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1983/4053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:22.852829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.854285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.864460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.864968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.866054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.866752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.867219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.867675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.900199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:22.900830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:22.908103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.908614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.909044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:22.910097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:22.910726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:22.911357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.165412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.170913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.181865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.183323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.184069 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b67dd2fe-86d0-4102-a6bd-4d820dffccff tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1367 microversion: 2.1 time: 0.336596 Aug 30 04:28:23.184512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0727e0e6-526b-40cc-982f-fc7733d0706e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1721 microversion: 2.20 time: 0.288866 Aug 30 04:28:23.185623 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1984/4054] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:23.202186 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2071/4055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:22 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:23.452511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:23.454123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:23.462092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.462935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.463619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.464555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:23.465297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:23.465967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:23.751711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:23.763553 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae71532c-3df0-4ee5-8261-120728e73f69 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.315108 Aug 30 04:28:23.766645 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1985/4056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:23 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:24.019117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-55283177", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "da2f7c47-2a0a-447c-b972-c3dff8903d2e"}, {"port": "899c907b-f883-4730-9a70-09800665ab32", "tag": "port-1"}, {"port": "c22d8565-7b2a-4d2b-b452-d9996280f19e", "tag": "port-2"}, {"uuid": "64b9eb1b-9038-4e16-986b-53ea55de00b1", "tag": "net-1"}, {"uuid": "64b9eb1b-9038-4e16-986b-53ea55de00b1"}, {"uuid": "e154a7d6-c566-4e09-afef-c1628306f455", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e154a7d6-c566-4e09-afef-c1628306f455", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "409357d4-c9bc-4d46-aec2-b98070383020", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e23c8a0b-8f59-4b2c-a149-fa04729374e7", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "20e1d4bc-8024-4d04-bc00-32904c83b0b7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1206716728"}], "key_name": "tempest-keypair-1997462772", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:24.111587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c7c3a5af-b5f0-4de2-a434-c8f4747fb01c req-2db9e535-0b30-4c62-8a2e-26f2c9de01b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "name": "network-vif-plugged", "status": "completed", "tag": "15e8e2b9-5077-4b2f-9edf-86388c11a87f"}, {"server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "name": "network-vif-plugged", "status": "completed", "tag": "a9200e70-110d-42da-8383-e8e1b9feaa3a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:24.136063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c7c3a5af-b5f0-4de2-a434-c8f4747fb01c req-2db9e535-0b30-4c62-8a2e-26f2c9de01b7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.136714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c7c3a5af-b5f0-4de2-a434-c8f4747fb01c req-2db9e535-0b30-4c62-8a2e-26f2c9de01b7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.137367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c7c3a5af-b5f0-4de2-a434-c8f4747fb01c req-2db9e535-0b30-4c62-8a2e-26f2c9de01b7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.156830 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c7c3a5af-b5f0-4de2-a434-c8f4747fb01c req-2db9e535-0b30-4c62-8a2e-26f2c9de01b7 service nova] Creating event network-vif-plugged:15e8e2b9-5077-4b2f-9edf-86388c11a87f for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:24.157367 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c7c3a5af-b5f0-4de2-a434-c8f4747fb01c req-2db9e535-0b30-4c62-8a2e-26f2c9de01b7 service nova] Creating event network-vif-plugged:a9200e70-110d-42da-8383-e8e1b9feaa3a for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:24.164674 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c7c3a5af-b5f0-4de2-a434-c8f4747fb01c req-2db9e535-0b30-4c62-8a2e-26f2c9de01b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071547 Aug 30 04:28:24.168160 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1986/4057] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:24.216641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:24.218656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:24.240794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.241944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.242593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.244895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.245559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.246177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.299304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] validate_networks() for [('da2f7c47-2a0a-447c-b972-c3dff8903d2e', None, None, None, None, None), (None, None, '899c907b-f883-4730-9a70-09800665ab32', None, None, None), (None, None, 'c22d8565-7b2a-4d2b-b452-d9996280f19e', None, None, None), ('64b9eb1b-9038-4e16-986b-53ea55de00b1', None, None, None, None, None), ('64b9eb1b-9038-4e16-986b-53ea55de00b1', None, None, None, None, None), ('e154a7d6-c566-4e09-afef-c1628306f455', '10.2.2.100', None, None, None, None), ('e154a7d6-c566-4e09-afef-c1628306f455', '10.2.2.200', None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:28:24.851106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:24.872148 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6cc2af98-7782-48ea-9511-4d86181a335e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1367 microversion: 2.1 time: 0.663617 Aug 30 04:28:24.873844 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1987/4058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:24 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1367 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:24.901920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:24.902727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:24.910751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.911686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.912912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:24.920159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:24.920965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:24.921724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.045728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.062877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.064621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.069950 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d0511052-450c-44d9-9dc5-77d271b26d8c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 200 len: 1653 microversion: 2.20 time: 0.177641 Aug 30 04:28:25.071193 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1988/4059] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:24 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 1653 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:25.081979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-71e445a9-a92c-49eb-825a-f52ff7a6b55f req-6e4be800-4be4-4e0a-ad1c-32363d8da3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd3bde7-3a79-454c-ab18-3aa36a5293dc", "tag": "cd39cb6e-6157-4618-b27f-246f4ced50cc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:25.105630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-71e445a9-a92c-49eb-825a-f52ff7a6b55f req-6e4be800-4be4-4e0a-ad1c-32363d8da3d4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.106813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-71e445a9-a92c-49eb-825a-f52ff7a6b55f req-6e4be800-4be4-4e0a-ad1c-32363d8da3d4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.107602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-71e445a9-a92c-49eb-825a-f52ff7a6b55f req-6e4be800-4be4-4e0a-ad1c-32363d8da3d4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.124935 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-71e445a9-a92c-49eb-825a-f52ff7a6b55f req-6e4be800-4be4-4e0a-ad1c-32363d8da3d4 service nova] Creating event network-changed:cd39cb6e-6157-4618-b27f-246f4ced50cc for instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc on n-h1-854925-5 Aug 30 04:28:25.131974 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-71e445a9-a92c-49eb-825a-f52ff7a6b55f req-6e4be800-4be4-4e0a-ad1c-32363d8da3d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053699 Aug 30 04:28:25.133429 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1989/4060] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:25.140345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:25.147686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:25.154827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.155880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.156555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.157542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:25.158230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:25.158945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:25.984885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:25.995615 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7910c1a-0947-4cf0-9753-ff8ef1929536 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1354 microversion: 2.1 time: 0.860489 Aug 30 04:28:25.996215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1990/4061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:25 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1354 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:26.012461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cb8e1fab-839a-4fc8-9e11-0519b91986c5 req-50a05dbe-b79d-447d-a9a2-74e8b46d26c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e5a44f-46b4-420a-a56d-4bcdaabc66ab", "name": "network-vif-deleted", "tag": "b0c74d93-5d98-4336-9ae6-1126341cb411"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:26.022545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cb8e1fab-839a-4fc8-9e11-0519b91986c5 req-50a05dbe-b79d-447d-a9a2-74e8b46d26c2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.023031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cb8e1fab-839a-4fc8-9e11-0519b91986c5 req-50a05dbe-b79d-447d-a9a2-74e8b46d26c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.023465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cb8e1fab-839a-4fc8-9e11-0519b91986c5 req-50a05dbe-b79d-447d-a9a2-74e8b46d26c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.035450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cb8e1fab-839a-4fc8-9e11-0519b91986c5 req-50a05dbe-b79d-447d-a9a2-74e8b46d26c2 service nova] Creating event network-vif-deleted:b0c74d93-5d98-4336-9ae6-1126341cb411 for instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab on n-h2-854925-5 Aug 30 04:28:26.042060 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cb8e1fab-839a-4fc8-9e11-0519b91986c5 req-50a05dbe-b79d-447d-a9a2-74e8b46d26c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033312 Aug 30 04:28:26.043242 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1991/4062] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:26.050227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.051101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:26.058736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.059996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.060667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.061622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.062311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.062923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.431531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:26.442217 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-39aeca52-2801-4583-91fe-dd49ba177b9e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1367 microversion: 2.1 time: 0.397153 Aug 30 04:28:26.444250 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1992/4063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:26 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1367 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:26.450362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.451218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:26.458711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.460495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.461131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.462446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:26.463086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:26.463746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:26.482305 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] HTTP exception thrown: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Request method failure captured: Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab HTTP/1.1 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZCi14L-yO2eA-8SLR3KA7uRHnLlMmBQ3kocKMRpEj9zvaScv2feSjaH7K8eUTvxTYBclt9628VF3dS5d9uCalDyR1NAPhTEq-HMPbAmvOSp22U14UerATKJKhu-hWaErf3xw-6Jp8ZVIf_PMrd9mOsqFr93hI2d2pgbBzkLt3_2wHo Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8441920631f94e39a79e27e6ce5e0250", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}] Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 32771c45ac9f4c43a23b413c9cbf4437 Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b9e5a44f-46b4-420a-a56d-4bcdaabc66ab'} Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:26.484685 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:28:26.489965 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:26.492541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Returning 404 to user: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:26.493933 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a7f1e951-402e-4cad-a023-4f89982ad0fd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 404 len: 111 microversion: 2.20 time: 0.047886 Aug 30 04:28:26.495034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1993/4064] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:26 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:28:26.507655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25bfcb11-2e35-487f-8ab6-2f3b115f2209 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '.version_select at 0x7fe96924baf0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:26.534473 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25bfcb11-2e35-487f-8ab6-2f3b115f2209 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84072091" status: 204 len: 0 microversion: 2.20 time: 0.031299 Aug 30 04:28:26.535680 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1994/4065] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:28:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84072091 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:28:27.018136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:27.018688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:27.025769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.026542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.027371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.029057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.030449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.031266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.463689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:27.481599 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-455f4c0d-04f8-4207-863a-fffa441fc8e8 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1805 microversion: 2.1 time: 0.467752 Aug 30 04:28:27.498571 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1995/4066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:27 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1805 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:27.506879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:27.507761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:27.516082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.517428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.518899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.519827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:27.520508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:27.521299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:27.866633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:27.891921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:27.983762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:27.986175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:27.999393 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8debed3b-f59f-45fe-be08-1975a9ac986d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1367 microversion: 2.1 time: 0.499011 Aug 30 04:28:28.014890 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1996/4067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:27 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:28.021788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:28.022400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:28.029320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.030213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.031065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.032036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.032797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.033485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.063506 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ca41479-bb32-466c-894a-0ae445179cef tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12/ips" status: 200 len: 219 microversion: 2.1 time: 0.046926 Aug 30 04:28:28.065010 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1997/4068] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:28:28 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12/ips => generated 219 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:28.079320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:28.079835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:28.087310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.088144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.088735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.091428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.091940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.100509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.166472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:28:28.276083 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c506f86-c461-45ef-a874-e23da964a889 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 204 len: 0 microversion: 2.1 time: 0.202448 Aug 30 04:28:28.279838 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1998/4069] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:28 2022] DELETE /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:28:28.297938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6aac69d8-14af-4049-be2c-88934abca4c7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'create', calling method: .version_select at 0x7fe96e40bc10>, body: {"keypair": {"name": "tempest-keypair-558878679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRK39N7b3GA9s2p3a0oHdksd04i6s1xLh6St8QBEsB9S8WMdwbOnnQE02KbE2wOz/FhpN6mE+qGE9s7YcoruAkb06JmHnZTpU3JKo9hAtiXyP0caudJhDVYIQf4LTPT5A=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:28.331072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6aac69d8-14af-4049-be2c-88934abca4c7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for project 8441920631f94e39a79e27e6ce5e0250. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:28.342406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6aac69d8-14af-4049-be2c-88934abca4c7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for user 32771c45ac9f4c43a23b413c9cbf4437 and project 8441920631f94e39a79e27e6ce5e0250. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:28.370116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:28.387742 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6aac69d8-14af-4049-be2c-88934abca4c7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.105125 Aug 30 04:28:28.390685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 1999/4070] 10.222.0.27 () {62 vars in 1200 bytes} [Tue Aug 30 04:28:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 110 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 04:28:28.403558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:28.404311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:28.425566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.426244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.426697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:28.427440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:28.428449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:28.429147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.261902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.297284 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ca04103-517d-4b22-8876-ad9432aaea40 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1811 microversion: 2.1 time: 0.903075 Aug 30 04:28:29.298599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2000/4071] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:28 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1811 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:29.305842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:29.307144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:29.319342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.321972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.322682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.326476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:29.327419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:29.328391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:29.800870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:29.815986 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2096c527-eb7f-4ec8-8f65-9c9702901e65 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1367 microversion: 2.1 time: 0.513024 Aug 30 04:28:29.820410 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2001/4072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:29 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1367 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:30.326269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:30.326982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:30.377122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.377931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.378593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.383966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.389657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.390307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.750785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:30.751365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:30.751805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:30.752223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:30.752641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:30.772465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.773031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.773525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.774638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.775163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.775599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.797277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Getting quotas for project 7e9d663de1c740fd8f6b3e94bfcd175b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:30.803596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Getting quotas for user 597f7e8d3d0145019fa489acf03f40d7 and project 7e9d663de1c740fd8f6b3e94bfcd175b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:30.808785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:30.817609 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ddbedb7-3b96-44d7-a120-56baf818c906 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1811 microversion: 2.1 time: 0.496744 Aug 30 04:28:30.821477 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2002/4073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:30 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1811 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:30.841245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:30.842757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:30.853871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.854541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.855301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:30.856188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:30.858662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:30.859095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.014007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:31.024029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='409357d4-c9bc-4d46-aec2-b98070383020',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e23c8a0b-8f59-4b2c-a149-fa04729374e7',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='20e1d4bc-8024-4d04-bc00-32904c83b0b7',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:31.130803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.147824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-17667b3c-5181-4d49-9d20-a4a7292d8c6f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1367 microversion: 2.1 time: 0.310190 Aug 30 04:28:31.149297 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2003/4074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:30 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:31.155778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-34295a7d-8461-4fcc-ac7c-f489b68c9caf req-07e9c6b1-c9ce-4334-a039-adc1cffc4741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd3bde7-3a79-454c-ab18-3aa36a5293dc", "name": "network-vif-plugged", "status": "completed", "tag": "cd39cb6e-6157-4618-b27f-246f4ced50cc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:31.167184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-34295a7d-8461-4fcc-ac7c-f489b68c9caf req-07e9c6b1-c9ce-4334-a039-adc1cffc4741 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.168891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-34295a7d-8461-4fcc-ac7c-f489b68c9caf req-07e9c6b1-c9ce-4334-a039-adc1cffc4741 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.169851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-34295a7d-8461-4fcc-ac7c-f489b68c9caf req-07e9c6b1-c9ce-4334-a039-adc1cffc4741 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.188411 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-34295a7d-8461-4fcc-ac7c-f489b68c9caf req-07e9c6b1-c9ce-4334-a039-adc1cffc4741 service nova] Creating event network-vif-plugged:cd39cb6e-6157-4618-b27f-246f4ced50cc for instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc on n-h1-854925-5 Aug 30 04:28:31.194387 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-34295a7d-8461-4fcc-ac7c-f489b68c9caf req-07e9c6b1-c9ce-4334-a039-adc1cffc4741 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043519 Aug 30 04:28:31.195217 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2004/4075] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:31.425531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c4f0056b-cdea-4abd-b129-068df75abc4a req-4e8587ec-f893-4d0f-86ec-1bea2af03237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "name": "network-vif-deleted", "tag": "15e8e2b9-5077-4b2f-9edf-86388c11a87f"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:31.447674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c4f0056b-cdea-4abd-b129-068df75abc4a req-4e8587ec-f893-4d0f-86ec-1bea2af03237 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.450029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c4f0056b-cdea-4abd-b129-068df75abc4a req-4e8587ec-f893-4d0f-86ec-1bea2af03237 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.450910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c4f0056b-cdea-4abd-b129-068df75abc4a req-4e8587ec-f893-4d0f-86ec-1bea2af03237 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.486612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c4f0056b-cdea-4abd-b129-068df75abc4a req-4e8587ec-f893-4d0f-86ec-1bea2af03237 service nova] Creating event network-vif-deleted:15e8e2b9-5077-4b2f-9edf-86388c11a87f for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:31.502109 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c4f0056b-cdea-4abd-b129-068df75abc4a req-4e8587ec-f893-4d0f-86ec-1bea2af03237 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080652 Aug 30 04:28:31.503178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2005/4076] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:31.653585 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eca5fcf1-ab74-4f42-be0c-cc3f3d5f6437 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 7.641065 Aug 30 04:28:31.659430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2072/4077] 10.222.0.27 () {62 vars in 1189 bytes} [Tue Aug 30 04:28:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 7653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:28:31.670415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26d38671-805a-4b73-aa27-0afe1e2230ed tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.671162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26d38671-805a-4b73-aa27-0afe1e2230ed tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.805798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.806291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.818276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.819062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.819874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.820899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.821643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.823047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.828107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26d38671-805a-4b73-aa27-0afe1e2230ed tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.843002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26d38671-805a-4b73-aa27-0afe1e2230ed tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.845291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26d38671-805a-4b73-aa27-0afe1e2230ed tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:31.847612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26d38671-805a-4b73-aa27-0afe1e2230ed tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1284 microversion: 2.32 time: 0.184178 Aug 30 04:28:31.850168 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2006/4078] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:31 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1284 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:31.856076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:31.864795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:31.875638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.886385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.887233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.888198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:31.888858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:31.889521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:31.971545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lazy-loading 'services' on Instance uuid 102d4935-336f-4a28-bbad-4adda3e5c7e3 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:28:32.145141 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6841d3f0-6220-4cfd-94ac-ec40f618ca47 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "DELETE /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3/os-volume_attachments/67baf8b2-679e-4dab-b68f-feda92d9c6a7" status: 202 len: 0 microversion: 2.1 time: 0.343168 Aug 30 04:28:32.145794 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2073/4079] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:28:31 2022] DELETE /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3/os-volume_attachments/67baf8b2-679e-4dab-b68f-feda92d9c6a7 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:28:32.173947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:32.174814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:32.183130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.184009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.184684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.185645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.186326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.186974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.828721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:32.845681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d0c3686c-8880-4d4d-a4eb-175dee66d56d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1675 microversion: 2.1 time: 0.989804 Aug 30 04:28:32.846338 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2007/4080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:31 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1675 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:32.873989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:32.874885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:32.902874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.905111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.907219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:32.908246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:32.909137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:32.911002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.187119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.212451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.230023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.234323 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a318df8a-f919-412d-a03e-5ee4de175de9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1518 microversion: 2.32 time: 0.365165 Aug 30 04:28:33.245921 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2008/4081] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:32 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1518 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:33.247587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:33.259675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1238012198", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c60b633-d776-4897-a4be-2817eeb3438c"}], "security_groups": [{"name": "tempest-securitygroup--816093586"}], "key_name": "tempest-keypair-558878679", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:33.266681 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-85a24c15-dc9d-4140-8635-0d7580363cac tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1367 microversion: 2.1 time: 1.093593 Aug 30 04:28:33.267793 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2074/4082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:32 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1367 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:33.538429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] validate_networks() for [('2c60b633-d776-4897-a4be-2817eeb3438c', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:28:33.651977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1190fa59-3089-4e59-8a9e-e7e83b2e86db req-d56fbd56-02e2-4505-99be-7c028b6c2814 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "name": "network-vif-deleted", "tag": "a9200e70-110d-42da-8383-e8e1b9feaa3a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:33.663539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1190fa59-3089-4e59-8a9e-e7e83b2e86db req-d56fbd56-02e2-4505-99be-7c028b6c2814 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.664085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1190fa59-3089-4e59-8a9e-e7e83b2e86db req-d56fbd56-02e2-4505-99be-7c028b6c2814 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.664702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1190fa59-3089-4e59-8a9e-e7e83b2e86db req-d56fbd56-02e2-4505-99be-7c028b6c2814 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.679330 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1190fa59-3089-4e59-8a9e-e7e83b2e86db req-d56fbd56-02e2-4505-99be-7c028b6c2814 service nova] Creating event network-vif-deleted:a9200e70-110d-42da-8383-e8e1b9feaa3a for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:33.685749 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1190fa59-3089-4e59-8a9e-e7e83b2e86db req-d56fbd56-02e2-4505-99be-7c028b6c2814 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037258 Aug 30 04:28:33.687078 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2075/4083] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:28:33.875566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:33.876542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:33.886202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.887018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.887625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.888670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:33.889289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:33.890525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:33.897086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:34.408878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.418964 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ba0da35-b338-47a6-a2dc-637ac32789ae tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1495 microversion: 2.1 time: 0.548495 Aug 30 04:28:34.422688 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2076/4084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:33 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1495 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:34.434109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5d0eb15c-0a81-418b-b61a-741ab6741cb8 req-70d8f87e-3890-4720-8bf7-8dc926ecc3b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "name": "network-vif-unplugged", "status": "completed", "tag": "2ff46970-f385-496c-9155-15559770ff95"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:34.477625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d0eb15c-0a81-418b-b61a-741ab6741cb8 req-70d8f87e-3890-4720-8bf7-8dc926ecc3b7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.480546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d0eb15c-0a81-418b-b61a-741ab6741cb8 req-70d8f87e-3890-4720-8bf7-8dc926ecc3b7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.481182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d0eb15c-0a81-418b-b61a-741ab6741cb8 req-70d8f87e-3890-4720-8bf7-8dc926ecc3b7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.523986 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5d0eb15c-0a81-418b-b61a-741ab6741cb8 req-70d8f87e-3890-4720-8bf7-8dc926ecc3b7 service nova] Creating event network-vif-unplugged:2ff46970-f385-496c-9155-15559770ff95 for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:34.532509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5d0eb15c-0a81-418b-b61a-741ab6741cb8 req-70d8f87e-3890-4720-8bf7-8dc926ecc3b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107381 Aug 30 04:28:34.537789 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2077/4085] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:34.559938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:34.560876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:34.575314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.575829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.584081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.585095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.585884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.586508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.765731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.781380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.785160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:34.788577 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27c7fac0-18c0-4ab9-b55b-073893249b0d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1592 microversion: 2.32 time: 0.247138 Aug 30 04:28:34.790727 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2078/4086] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:34 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1592 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:34.822082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:34.823189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:34.841187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.843264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.843873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:34.847446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:34.848828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:34.849314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:35.958357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:35.974285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc51c6a8-7012-40b2-82fd-1e57664e8faf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1557 microversion: 2.1 time: 1.168574 Aug 30 04:28:35.975193 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2079/4087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:34 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1557 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:35.991827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:35.992680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.029100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.034997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.036133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.040385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.040892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.043429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.062546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:36.067369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:36.069611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:36.070363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:36.070945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:36.085243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.086002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.086850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.088417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.089506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.090482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.138991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.139417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.140258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.140928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lazy-loading 'fault' on Instance uuid 2ad68a88-0468-472f-a007-14515c7e7a12 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:28:36.144193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for project 8441920631f94e39a79e27e6ce5e0250. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:36.157277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Getting quotas for user 32771c45ac9f4c43a23b413c9cbf4437 and project 8441920631f94e39a79e27e6ce5e0250. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:36.201377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:36.204403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:36.261803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.276822 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6ce63cd6-d352-4faf-93c4-715905d5a18c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 200 len: 1302 microversion: 2.1 time: 0.296443 Aug 30 04:28:36.277880 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2080/4088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:35 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 1302 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:36.284562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:36.285256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.295171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-949b2dc7-1094-48b1-82c7-3db4c22ba776 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.047407 Aug 30 04:28:36.295987 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2009/4089] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:28:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:28:36.309581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:36.310560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.313056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.315010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.315616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.319377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.321044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.321879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.334023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.334873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.335685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.336775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.337481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.338104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.726692 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c4bf1a9-0777-42ae-9bc9-512d1c029678 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.429146 Aug 30 04:28:36.728030 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2010/4090] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:28:36 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc/os-interface => generated 284 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:36.738759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-14952e32-96c8-40d3-a365-50ec809466f3 req-a9aea73f-4674-4bad-bf9a-a36c7335b993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ad68a88-0468-472f-a007-14515c7e7a12", "name": "network-vif-deleted", "tag": "2ff46970-f385-496c-9155-15559770ff95"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:36.758958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-14952e32-96c8-40d3-a365-50ec809466f3 req-a9aea73f-4674-4bad-bf9a-a36c7335b993 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:36.760445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-14952e32-96c8-40d3-a365-50ec809466f3 req-a9aea73f-4674-4bad-bf9a-a36c7335b993 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:36.760891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-14952e32-96c8-40d3-a365-50ec809466f3 req-a9aea73f-4674-4bad-bf9a-a36c7335b993 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:36.786229 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-14952e32-96c8-40d3-a365-50ec809466f3 req-a9aea73f-4674-4bad-bf9a-a36c7335b993 service nova] Creating event network-vif-deleted:2ff46970-f385-496c-9155-15559770ff95 for instance 2ad68a88-0468-472f-a007-14515c7e7a12 on n-h2-854925-5 Aug 30 04:28:36.792859 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-14952e32-96c8-40d3-a365-50ec809466f3 req-a9aea73f-4674-4bad-bf9a-a36c7335b993 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063579 Aug 30 04:28:36.794404 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2011/4091] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:36.800220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2218bc29-9491-466e-9f93-4cfcca3eacab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:36.801144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2218bc29-9491-466e-9f93-4cfcca3eacab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:36.940017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2218bc29-9491-466e-9f93-4cfcca3eacab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.976636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2218bc29-9491-466e-9f93-4cfcca3eacab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.982537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2218bc29-9491-466e-9f93-4cfcca3eacab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:36.983737 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2218bc29-9491-466e-9f93-4cfcca3eacab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1281 microversion: 2.20 time: 0.187991 Aug 30 04:28:36.984524 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2012/4092] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:36 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:37.004416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:37.018345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:37.020805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:37.026868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28e35ed6-9169-4841-9bf9-21bbf53d95bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1660 microversion: 2.32 time: 0.745064 Aug 30 04:28:37.030432 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2081/4093] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:36 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1660 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:37.302446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:37.304193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:37.315474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:37.317833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:37.319623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:37.323428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:37.324853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:37.327817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:37.354636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] HTTP exception thrown: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Request method failure captured: Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 HTTP/1.1 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZHA5pnYlTjvzwgy2Sha57XA63ysL1zf2g3i86iEnHv_qInP3cRF3IjywapBRp_kV6YO31PGt0GXewP369XTyz7KM4saatzlBPN41p5VxkrOX3goPmvaiE_C7oxICyqcm39GJXPn1ISTdkQh2VWxyZ27HjW0ZO8bKn1bR1n8p6DYLKI Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_248467fdcdfd4921be9143a3dd19fe6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}] Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestMultiNic-1308593560 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2d38b18902064b209737dfd5e13df183 Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2ad68a88-0468-472f-a007-14515c7e7a12'} Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:37.356390 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:37.362361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Returning 404 to user: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:37.363752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a0a54d1-2e44-4c27-ac14-0d0accc06a6f tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 404 len: 111 microversion: 2.1 time: 0.059493 Aug 30 04:28:37.366115 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2013/4094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:37 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:38.007694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:38.008308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:38.022936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.026011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.026750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.028540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.030752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.032406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.056349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:38.057107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:38.078418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.078939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.079396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.085532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:38.086197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:38.086665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:38.250913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.260624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.268786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.270113 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ad1dc58-2509-4a38-bdf1-f840a0c170ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1333 microversion: 2.20 time: 0.266459 Aug 30 04:28:38.293944 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2082/4095] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:38 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1333 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:38.763373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.772858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.778712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:38.782604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ad2aa71-dec9-4c40-85d8-e3cc9343b38d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1707 microversion: 2.32 time: 0.734435 Aug 30 04:28:38.783320 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2014/4096] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:38 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1707 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:39.300268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:39.300880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:39.313117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.314055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.314971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.326608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.327440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.328197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.664654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5544ecf2-adea-40a5-9619-3a31f77d7e78 req-296da675-07d4-4f90-b13d-8abd4ba708c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd3bde7-3a79-454c-ab18-3aa36a5293dc", "tag": "cd39cb6e-6157-4618-b27f-246f4ced50cc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:39.685251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5544ecf2-adea-40a5-9619-3a31f77d7e78 req-296da675-07d4-4f90-b13d-8abd4ba708c4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.686509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5544ecf2-adea-40a5-9619-3a31f77d7e78 req-296da675-07d4-4f90-b13d-8abd4ba708c4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.689046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5544ecf2-adea-40a5-9619-3a31f77d7e78 req-296da675-07d4-4f90-b13d-8abd4ba708c4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.722419 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5544ecf2-adea-40a5-9619-3a31f77d7e78 req-296da675-07d4-4f90-b13d-8abd4ba708c4 service nova] Creating event network-changed:cd39cb6e-6157-4618-b27f-246f4ced50cc for instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc on n-h1-854925-5 Aug 30 04:28:39.736317 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5544ecf2-adea-40a5-9619-3a31f77d7e78 req-296da675-07d4-4f90-b13d-8abd4ba708c4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077254 Aug 30 04:28:39.739502 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2015/4097] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:39.812521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:39.814005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:39.829571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.831371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.834412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:39.836028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:39.837632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:39.839103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:40.187747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.197411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.203796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.209503 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36d06d77-650e-49b5-9ff0-faa928450fb6 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1339 microversion: 2.20 time: 0.911787 Aug 30 04:28:40.221272 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2083/4098] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:39 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1339 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:40.962149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.978612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.983214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:40.984482 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8d17fd0d-da55-4b20-94dc-e6576caf0769 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1754 microversion: 2.32 time: 1.178834 Aug 30 04:28:40.988301 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2016/4099] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:39 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1754 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:41.103933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:41.104855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:41.110990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:41.111939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:41.113058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:41.121266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.122008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.122591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.123553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.124222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.124726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.167957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:28:41.236562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:41.237502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:41.250125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.251310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.252240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.254796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.258673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.259536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.342719 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a3fb7915-1419-405b-b59d-1bc8e5e9b8f6 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "DELETE /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 204 len: 0 microversion: 2.1 time: 0.244818 Aug 30 04:28:41.344321 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2084/4100] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:41 2022] DELETE /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:28:41.357367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:41.358442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:41.366117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.367161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.367894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.369288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:41.370505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:41.371408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:41.482429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.501015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.503141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.504983 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e061effc-cdf1-4813-ac1f-7d62c5c312d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1339 microversion: 2.20 time: 0.272938 Aug 30 04:28:41.518312 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2017/4101] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:41 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1339 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:41.742019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:41.757923 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a65dc9ce-e0e4-4e9a-ab0f-af2ebf3e158a tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1469 microversion: 2.1 time: 0.408393 Aug 30 04:28:41.758851 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2085/4102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:41 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:42.015827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:42.016544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:42.034322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.035101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.035719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.036617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.037272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.037898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.340772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:42.357425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:42.359097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:42.365805 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3fc73c8c-7902-4676-a5cd-6c86156ae1d0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1801 microversion: 2.32 time: 0.353409 Aug 30 04:28:42.390276 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2018/4103] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:42 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1801 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:42.532848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:42.534256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:42.544953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.554105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.554954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.555987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.556823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.557596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.784431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:42.785442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:42.796665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.797264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.797914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.799119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:42.799976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:42.800633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:42.829671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:43.120796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.130193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.138327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.139670 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-682bd904-aa5a-427f-8a7d-b141b5fc829a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1406 microversion: 2.20 time: 0.611151 Aug 30 04:28:43.158282 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2086/4104] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:42 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1406 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:43.225755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.246648 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ddffb91c-be8e-4ddf-b8c3-cffdc3d454f2 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1469 microversion: 2.1 time: 0.465989 Aug 30 04:28:43.247259 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2019/4105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:42 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1469 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:43.256695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a417e150-49f7-4273-bba5-addb5c3643b4 req-2669c9db-36f3-472e-bd2f-dc432816989a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16adb378-53ec-46b0-a31f-4fe4e38dd2d1", "tag": "1892a3e5-332c-42ee-b372-a61fac0274ec"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:43.276929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a417e150-49f7-4273-bba5-addb5c3643b4 req-2669c9db-36f3-472e-bd2f-dc432816989a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.277448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a417e150-49f7-4273-bba5-addb5c3643b4 req-2669c9db-36f3-472e-bd2f-dc432816989a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.277890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a417e150-49f7-4273-bba5-addb5c3643b4 req-2669c9db-36f3-472e-bd2f-dc432816989a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.304463 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a417e150-49f7-4273-bba5-addb5c3643b4 req-2669c9db-36f3-472e-bd2f-dc432816989a service nova] Creating event network-changed:1892a3e5-332c-42ee-b372-a61fac0274ec for instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 on n-h2-854925-5 Aug 30 04:28:43.321735 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a417e150-49f7-4273-bba5-addb5c3643b4 req-2669c9db-36f3-472e-bd2f-dc432816989a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068101 Aug 30 04:28:43.329430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2087/4106] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:43.396215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:43.397209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:43.405640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.406690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.407478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.408379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:43.409020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:43.409666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:43.775833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.791824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.798928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:43.803678 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31ef5166-556c-4233-abfd-74d9c173818a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1801 microversion: 2.32 time: 0.410423 Aug 30 04:28:43.813549 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2020/4107] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:43 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1801 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:44.179199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.180765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.190050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.190995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.191722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.192665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.194437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.195093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.276907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.278114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.289450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.290234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.290903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.292001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.292991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.293669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.817223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.835386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18b6cfa93004da9886b8358708dc306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12fbaa93748b4d7784101fa1b5d63784', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.841162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.843415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:44.844847 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7580da6-bc56-4b7b-a93e-6fa79c7987eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1406 microversion: 2.20 time: 0.672502 Aug 30 04:28:44.847445 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2088/4108] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1406 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:44.853610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:44.855116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:44.861774 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88d19b3b-dea2-4d72-aa57-252e485578c5 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 200 len: 1469 microversion: 2.1 time: 0.590416 Aug 30 04:28:44.867285 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2021/4109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 1469 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:44.872644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.873382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.874149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:44.875058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:44.875763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:44.876342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.303293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:45.318675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:45.321377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:45.324009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da16c91b-8667-4d6b-879d-2beeaa476da0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1848 microversion: 2.32 time: 0.475067 Aug 30 04:28:45.325070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2089/4110] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:44 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1848 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:45.367059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5f8e390d-6194-4482-882c-701d1ef81a44 req-c21d055b-3057-47e2-bce7-4ec8ce06f8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102d4935-336f-4a28-bbad-4adda3e5c7e3", "name": "network-vif-deleted", "tag": "d23c3020-e156-4999-8b30-8706ae0a8a96"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:45.379218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5f8e390d-6194-4482-882c-701d1ef81a44 req-c21d055b-3057-47e2-bce7-4ec8ce06f8a4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.380023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5f8e390d-6194-4482-882c-701d1ef81a44 req-c21d055b-3057-47e2-bce7-4ec8ce06f8a4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.380699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5f8e390d-6194-4482-882c-701d1ef81a44 req-c21d055b-3057-47e2-bce7-4ec8ce06f8a4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.399556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5f8e390d-6194-4482-882c-701d1ef81a44 req-c21d055b-3057-47e2-bce7-4ec8ce06f8a4 service nova] Creating event network-vif-deleted:d23c3020-e156-4999-8b30-8706ae0a8a96 for instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 on n-h1-854925-5 Aug 30 04:28:45.406676 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5f8e390d-6194-4482-882c-701d1ef81a44 req-c21d055b-3057-47e2-bce7-4ec8ce06f8a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043007 Aug 30 04:28:45.408967 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2022/4111] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:45.870220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:45.871280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:45.879168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.879284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.879657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.880977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.882870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.882870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.906346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:45.907349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] [instance: 102d4935-336f-4a28-bbad-4adda3e5c7e3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:45.918114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.918878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.919506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.920408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:45.921894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:45.922532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:45.958335 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] HTTP exception thrown: Instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 could not be found. Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Request method failure captured: Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 HTTP/1.1 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZEy3FME0Bfh7ra3nu2XjiTpGjzY_e5F0X4eIk_YD0PNnuUrc-8bQScSxW67ioNzgbN5gyxN1Ijg8Q1U_-qKSFDm_Cy-15WpW1H-EGzZ7_uHK3YZyu9CrxpJZq15kKnp7EgiNMOdTOW2ftEJA1VVAQjhyYY82wsCyImXb2aKHZFiqM4 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 12fbaa93748b4d7784101fa1b5d63784 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesBackupsTest-2108863855 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_12fbaa93748b4d7784101fa1b5d63784", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/12fbaa93748b4d7784101fa1b5d63784"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12fbaa93748b4d7784101fa1b5d63784"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/12fbaa93748b4d7784101fa1b5d63784"}]}] Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesBackupsTest-2108863855 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 12fbaa93748b4d7784101fa1b5d63784 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesBackupsTest-2108863855 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesBackupsTest-2108863855-project Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: c18b6cfa93004da9886b8358708dc306 Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesBackupsTest-2108863855-project Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 could not be found. Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '102d4935-336f-4a28-bbad-4adda3e5c7e3'} Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 could not be found. Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 could not be found. Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:28:45.962904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:45.967577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:28:45.967577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:28:45.967577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:28:45.967577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:28:45.967577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:28:45.967577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 could not be found. Aug 30 04:28:45.967577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:28:45.969193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] Returning 404 to user: Instance 102d4935-336f-4a28-bbad-4adda3e5c7e3 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:28:45.970333 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-824bc3eb-d363-400d-b5c8-fa7226a07d48 tempest-VolumesBackupsTest-2108863855 tempest-VolumesBackupsTest-2108863855-project] 10.222.0.27 "GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3" status: 404 len: 111 microversion: 2.1 time: 0.075201 Aug 30 04:28:45.986422 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2023/4112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:45 2022] GET /compute/v2.1/servers/102d4935-336f-4a28-bbad-4adda3e5c7e3 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:28:46.348063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:46.348933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:46.352982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:46.363536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.365948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.366564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.369219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:46.374519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:46.375244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:46.723098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.733961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.744712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.745725 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0216ff62-ee58-432b-9a68-0edb6ab4173b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1406 microversion: 2.20 time: 0.879487 Aug 30 04:28:46.746312 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2090/4113] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:45 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1406 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:46.920467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.939826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.949786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:46.955734 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6eefab3d-bc9f-43d4-9383-e5e64b07656d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1848 microversion: 2.32 time: 0.610527 Aug 30 04:28:46.965181 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2024/4114] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:46 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1848 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:47.047939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cc3ab6d3-ff06-404d-8463-5743db132062 req-f2a20397-470f-44b6-bcd3-066f2a1bfae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "dda5b7e4-c290-4a46-bdaa-376387119bd3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:47.070165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cc3ab6d3-ff06-404d-8463-5743db132062 req-f2a20397-470f-44b6-bcd3-066f2a1bfae2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.075750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cc3ab6d3-ff06-404d-8463-5743db132062 req-f2a20397-470f-44b6-bcd3-066f2a1bfae2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.076328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cc3ab6d3-ff06-404d-8463-5743db132062 req-f2a20397-470f-44b6-bcd3-066f2a1bfae2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.102452 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cc3ab6d3-ff06-404d-8463-5743db132062 req-f2a20397-470f-44b6-bcd3-066f2a1bfae2 service nova] Creating event network-changed:dda5b7e4-c290-4a46-bdaa-376387119bd3 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:28:47.118151 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cc3ab6d3-ff06-404d-8463-5743db132062 req-f2a20397-470f-44b6-bcd3-066f2a1bfae2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073755 Aug 30 04:28:47.118785 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2091/4115] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:47.770829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:47.772976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:47.785485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=24 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:47.792466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.793185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.793676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.794408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:47.794876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:47.795313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:47.985190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:47.988238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:48.002909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.012727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.013363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.014567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.015252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.015918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.344221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.359949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.370179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.373086 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c07b8bc7-f3fb-4f61-97bc-21d01321d089 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1406 microversion: 2.20 time: 0.607313 Aug 30 04:28:48.374313 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2025/4116] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:47 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1406 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:48.538437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-add20d8d-3b8a-4ea7-9500-f00104f60977 req-1d15e35b-4e26-48a4-ab7d-4ed5cbff9bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16adb378-53ec-46b0-a31f-4fe4e38dd2d1", "name": "network-vif-plugged", "status": "completed", "tag": "1892a3e5-332c-42ee-b372-a61fac0274ec"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:48.552320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-add20d8d-3b8a-4ea7-9500-f00104f60977 req-1d15e35b-4e26-48a4-ab7d-4ed5cbff9bc3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:48.556975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-add20d8d-3b8a-4ea7-9500-f00104f60977 req-1d15e35b-4e26-48a4-ab7d-4ed5cbff9bc3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:48.557712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-add20d8d-3b8a-4ea7-9500-f00104f60977 req-1d15e35b-4e26-48a4-ab7d-4ed5cbff9bc3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:48.566671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.578179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:48.587761 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-add20d8d-3b8a-4ea7-9500-f00104f60977 req-1d15e35b-4e26-48a4-ab7d-4ed5cbff9bc3 service nova] Creating event network-vif-plugged:1892a3e5-332c-42ee-b372-a61fac0274ec for instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 on n-h2-854925-5 Aug 30 04:28:48.591177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.597807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:48.601055 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-add20d8d-3b8a-4ea7-9500-f00104f60977 req-1d15e35b-4e26-48a4-ab7d-4ed5cbff9bc3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070773 Aug 30 04:28:48.601976 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2026/4117] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:48.603114 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18327c3e-5639-44e0-84c8-7f2e44ef9c49 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1869 microversion: 2.32 time: 0.620016 Aug 30 04:28:48.605101 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2092/4118] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:47 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1869 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:49.353294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-53048d19-c0fb-4eb3-804a-9ec3901ce2a8 req-fdebb1a1-2794-4798-bb2c-6feae5a9f957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "899c907b-f883-4730-9a70-09800665ab32"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:49.366884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-53048d19-c0fb-4eb3-804a-9ec3901ce2a8 req-fdebb1a1-2794-4798-bb2c-6feae5a9f957 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.367604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-53048d19-c0fb-4eb3-804a-9ec3901ce2a8 req-fdebb1a1-2794-4798-bb2c-6feae5a9f957 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.368326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-53048d19-c0fb-4eb3-804a-9ec3901ce2a8 req-fdebb1a1-2794-4798-bb2c-6feae5a9f957 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.381214 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-53048d19-c0fb-4eb3-804a-9ec3901ce2a8 req-fdebb1a1-2794-4798-bb2c-6feae5a9f957 service nova] Creating event network-changed:899c907b-f883-4730-9a70-09800665ab32 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:28:49.386868 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-53048d19-c0fb-4eb3-804a-9ec3901ce2a8 req-fdebb1a1-2794-4798-bb2c-6feae5a9f957 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039977 Aug 30 04:28:49.387993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2027/4119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:49.402521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.403716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.414383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.415353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.416236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.417226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.417944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.418853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.628443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:49.629155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:49.643465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.643976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.644421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.645142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:49.645637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:49.646171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:49.719879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.732186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.737743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:49.754816 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16b5eefd-2a92-4ff4-8a45-5f323c00c840 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1406 microversion: 2.20 time: 0.360466 Aug 30 04:28:49.756598 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2093/4120] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:49.876583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-206991383", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "426790e0-e45f-4a08-be2e-417102692ad9"}, {"uuid": "d06ad252-4c36-493f-a172-9b92335971d9"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:49.982170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] validate_networks() for [('426790e0-e45f-4a08-be2e-417102692ad9', None, None, None, None, None), ('d06ad252-4c36-493f-a172-9b92335971d9', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:28:50.673895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:50.687884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:50.699111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:50.703636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d08ba821-c1be-4d57-8be5-cc559fa8d910 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1869 microversion: 2.32 time: 1.080122 Aug 30 04:28:50.705099 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2028/4121] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:49 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1869 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:50.780645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:50.781263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:50.792588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.793158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.793654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:50.797370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:50.797942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:50.798454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:51.883864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:51.896259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:51.903300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:51.904707 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a37e038-c8b8-40f9-8a57-0d4abceb187d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1599 microversion: 2.20 time: 1.128140 Aug 30 04:28:51.918660 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2029/4122] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:50 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1599 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:28:51.937359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:51.937996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:51.956184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:51.956919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:51.959518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:51.960609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:51.961405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:51.969648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.548761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:52.572613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:52.576226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:52.582056 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e81b4d7a-8ba1-4647-8612-0db01466239c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1890 microversion: 2.32 time: 0.662142 Aug 30 04:28:52.583392 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2030/4123] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:51 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1890 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:52.621742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d803c4d9-1237-44e4-b114-662b275fac8d req-e1b9318f-5a8a-4e04-9616-5f0e53b181cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "c22d8565-7b2a-4d2b-b452-d9996280f19e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:52.641135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d803c4d9-1237-44e4-b114-662b275fac8d req-e1b9318f-5a8a-4e04-9616-5f0e53b181cc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.642001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d803c4d9-1237-44e4-b114-662b275fac8d req-e1b9318f-5a8a-4e04-9616-5f0e53b181cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.647514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d803c4d9-1237-44e4-b114-662b275fac8d req-e1b9318f-5a8a-4e04-9616-5f0e53b181cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.669837 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d803c4d9-1237-44e4-b114-662b275fac8d req-e1b9318f-5a8a-4e04-9616-5f0e53b181cc service nova] Creating event network-changed:c22d8565-7b2a-4d2b-b452-d9996280f19e for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:28:52.678207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d803c4d9-1237-44e4-b114-662b275fac8d req-e1b9318f-5a8a-4e04-9616-5f0e53b181cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090885 Aug 30 04:28:52.679450 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2031/4124] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:52.688531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:52.689598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:52.698946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.699988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.701116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:52.703004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:52.703743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:52.712128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.208958 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01728569-3fb7-43db-b233-afe61e2421ab tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-interface" status: 200 len: 285 microversion: 2.20 time: 1.525064 Aug 30 04:28:54.214115 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2032/4125] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 04:28:52 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-interface => generated 285 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:28:54.222763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:54.229170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:54.244210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.244736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.245182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:54.245968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:54.246420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:54.246850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.480243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:28:55.480844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:28:55.481208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:28:55.482273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:28:55.482706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:28:55.499082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.499668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.506567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.507939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.508617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.509241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.564891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Getting quotas for project 248467fdcdfd4921be9143a3dd19fe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:28:55.580089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Getting quotas for user 2d38b18902064b209737dfd5e13df183 and project 248467fdcdfd4921be9143a3dd19fe6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:28:55.620688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:28:55.627456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:28:55.749392 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1ce60fde-ef9f-4f16-b67c-2128e221d6db tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.876511 Aug 30 04:28:55.762596 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2094/4126] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:28:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 5890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:28:55.819579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.845584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.856120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.859584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5871bd67-bfcf-4ef7-8bd5-5c9d4d849050 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1890 microversion: 2.32 time: 1.643829 Aug 30 04:28:55.860184 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2033/4127] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:54 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1890 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:55.896729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:55.916573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:55.919185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "13475dce-cbe1-4768-8aea-e49281d30daf"}, {"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "a2f39c69-25f2-4aac-8cf3-37819f843b3a"}, {"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "65fedda3-a97f-4c7d-a4a7-bc638e7f590b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:55.923581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Searching by: {'deleted': False, 'project_id': 'eb90da5b84264d9297106dc75b0c321b'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:28:55.948804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.949355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.949783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.955797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.956287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.956725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.958344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:55.960678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:55.961141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:55.997391 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] Creating event network-changed:13475dce-cbe1-4768-8aea-e49281d30daf for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:28:55.997985 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] Creating event network-changed:a2f39c69-25f2-4aac-8cf3-37819f843b3a for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:28:55.998503 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] Creating event network-changed:65fedda3-a97f-4c7d-a4a7-bc638e7f590b for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:28:56.016108 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b1b8a5d4-d1d1-4631-b54b-b3baee885d3d req-b8c05bd8-e994-4633-be59-c06fa61f32a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.236479 Aug 30 04:28:56.017910 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2095/4128] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:56.038086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-013d3693-94e9-46c0-8aa2-31eaac27e346 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.039298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-013d3693-94e9-46c0-8aa2-31eaac27e346 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.040867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:28:56.145259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22e279d2-3a2e-49bd-8d99-d16eb4516ec7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.277368 Aug 30 04:28:56.150718 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2034/4129] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 04:28:55 2022] GET /compute/v2.1/servers => generated 344 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:56.166358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.178176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:56.182706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Searching by: {'deleted': False, 'project_id': 'eb90da5b84264d9297106dc75b0c321b'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 04:28:56.193803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.194696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.195149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.196051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.196520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.196958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.291862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 04:28:56.404110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:56.416706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.417827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.418976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.526272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-013d3693-94e9-46c0-8aa2-31eaac27e346 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:56.536455 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-013d3693-94e9-46c0-8aa2-31eaac27e346 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1212 microversion: 2.1 time: 0.516988 Aug 30 04:28:56.537732 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2096/4130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1212 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:56.890494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:56.892253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:56.922133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.922644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.923179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:56.923906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:56.924704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:56.925301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.610439 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-96a674d3-5ccb-45ba-a949-8465bcabd10f tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.450705 Aug 30 04:28:57.621360 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2035/4131] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:57.621360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:57.621360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:57.630737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.632691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.633681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:57.634892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:57.635739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:57.636482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.230806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:58.253509 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b65f887c-8dc7-4481-896a-46744902afdf tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1264 microversion: 2.1 time: 0.640282 Aug 30 04:28:58.254622 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2036/4132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:57 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1264 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:58.266205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e847a8bd-9e52-40df-9f37-5f14cd349257 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:58.281062 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e847a8bd-9e52-40df-9f37-5f14cd349257 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023862 Aug 30 04:28:58.282293 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2037/4133] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:28:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:58.287177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-716bbdb8-2d3a-4e2b-842d-fdaed9503af9 req-0ddbe8a6-ff02-4bc5-9b9f-9510aead1507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "37b76ba8-1408-4f27-ae51-a8cfb19391a6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:28:58.297245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:58.299326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-716bbdb8-2d3a-4e2b-842d-fdaed9503af9 req-0ddbe8a6-ff02-4bc5-9b9f-9510aead1507 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.301664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-716bbdb8-2d3a-4e2b-842d-fdaed9503af9 req-0ddbe8a6-ff02-4bc5-9b9f-9510aead1507 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.302343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-716bbdb8-2d3a-4e2b-842d-fdaed9503af9 req-0ddbe8a6-ff02-4bc5-9b9f-9510aead1507 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.316450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-716bbdb8-2d3a-4e2b-842d-fdaed9503af9 req-0ddbe8a6-ff02-4bc5-9b9f-9510aead1507 service nova] Creating event network-changed:37b76ba8-1408-4f27-ae51-a8cfb19391a6 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:28:58.324008 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-716bbdb8-2d3a-4e2b-842d-fdaed9503af9 req-0ddbe8a6-ff02-4bc5-9b9f-9510aead1507 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040206 Aug 30 04:28:58.324878 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2038/4134] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:28:58.336827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:58.351899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:58.355118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:58.359772 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8f11dd8c-1d7d-4af1-a437-9b0ac90ad4de tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1890 microversion: 2.32 time: 1.475925 Aug 30 04:28:58.360628 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2097/4135] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:56 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1890 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:28:58.597840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:58.598901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:58.607767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.608403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.608941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.609771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.610454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.611529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.651751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:28:58.689900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:28:58.793115 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a9298fa0-cfb7-40ce-8b73-03af3bdf50d8 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 204 len: 0 microversion: 2.1 time: 0.201175 Aug 30 04:28:58.794214 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2039/4136] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:28:58 2022] DELETE /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:28:58.804746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:58.806393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:58.823421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.824661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.825533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:58.827454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:58.829281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:58.830175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.275764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:59.276631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:59.295570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.296075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.296723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.297642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.298267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.300872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.484051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:59.502117 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3bc0ca7b-be94-4e41-a4d7-4f451cc47adb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1270 microversion: 2.1 time: 0.231126 Aug 30 04:28:59.523335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:28:59.534173 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9a45227-5322-4a6a-84e0-c07a92e58909 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1607 microversion: 2.1 time: 0.735445 Aug 30 04:28:59.541828 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2040/4137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:59 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1270 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:28:59.557362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2098/4138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:28:58 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1607 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:28:59.558563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:28:59.558563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:28:59.561939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.562436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.562877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:28:59.563579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:28:59.564659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:28:59.565179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.195912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:00.209535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:00.210989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:00.212183 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f48926b4-6344-480a-a054-7b95db47b382 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1890 microversion: 2.32 time: 0.669639 Aug 30 04:29:00.212749 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2041/4139] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:28:59 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1890 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:00.527102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:00.527720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:00.535988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:00.537357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:00.537978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.538883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:00.539864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:00.540487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.568078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:00.569042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:00.586526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:00.588184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:00.589977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.592482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:00.593827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:00.595254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:00.847795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:00.868354 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e27101e3-9c27-482e-b725-071538f2e45a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1270 microversion: 2.1 time: 0.345091 Aug 30 04:29:00.872669 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2099/4140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:00 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1270 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:01.027764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3af5bbcd-bfb2-4180-bdc6-4ed7c2e486a6 req-0beee9d5-2044-40b6-97ba-c5297995d558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16adb378-53ec-46b0-a31f-4fe4e38dd2d1", "tag": "1892a3e5-332c-42ee-b372-a61fac0274ec"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:01.047165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3af5bbcd-bfb2-4180-bdc6-4ed7c2e486a6 req-0beee9d5-2044-40b6-97ba-c5297995d558 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.047648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3af5bbcd-bfb2-4180-bdc6-4ed7c2e486a6 req-0beee9d5-2044-40b6-97ba-c5297995d558 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.048967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3af5bbcd-bfb2-4180-bdc6-4ed7c2e486a6 req-0beee9d5-2044-40b6-97ba-c5297995d558 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.086715 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3af5bbcd-bfb2-4180-bdc6-4ed7c2e486a6 req-0beee9d5-2044-40b6-97ba-c5297995d558 service nova] Creating event network-changed:1892a3e5-332c-42ee-b372-a61fac0274ec for instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 on n-h2-854925-5 Aug 30 04:29:01.103042 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3af5bbcd-bfb2-4180-bdc6-4ed7c2e486a6 req-0beee9d5-2044-40b6-97ba-c5297995d558 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080694 Aug 30 04:29:01.128930 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2100/4141] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:01.238897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:01.240004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:01.252003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.256565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.257920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.258901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.261994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.268086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.351662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:01.366011 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4ac38d9-3747-49fb-93bf-85911ec2ade9 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1607 microversion: 2.1 time: 0.802136 Aug 30 04:29:01.366611 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2042/4142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:00 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1607 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:01.878879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:01.890014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:01.890922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:01.907096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.913150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.914539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.914885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:01.917734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:01.918800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:01.922051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:01.924189 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a8835cd7-dc04-4e02-86a0-aece7283a93e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1890 microversion: 2.32 time: 0.691993 Aug 30 04:29:01.924405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:01.928996 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2101/4143] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:01 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1890 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:02.387484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:02.388115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:02.419073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.427002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.428449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.430139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.431834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.433953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.738870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:02.751568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-175ff48a-1a66-4a86-b02b-edae3a46041d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1540 microversion: 2.1 time: 0.368210 Aug 30 04:29:02.752881 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2102/4144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:02 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1540 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:02.763509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e4d841d7-6904-42f9-9b0a-fbe5bd9e814e req-d4069fbb-cf44-4322-b453-e759a7e50755 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c734e7-a2d4-4989-9b27-2122eb927b14", "name": "network-vif-deleted", "tag": "e9cd4fec-2688-47cd-bdb5-7cede32eb332"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:02.787101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e4d841d7-6904-42f9-9b0a-fbe5bd9e814e req-d4069fbb-cf44-4322-b453-e759a7e50755 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.787887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e4d841d7-6904-42f9-9b0a-fbe5bd9e814e req-d4069fbb-cf44-4322-b453-e759a7e50755 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.788502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e4d841d7-6904-42f9-9b0a-fbe5bd9e814e req-d4069fbb-cf44-4322-b453-e759a7e50755 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.815176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:02.825543 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-db78233f-1f05-4af4-8725-5f46757d94fe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1312 microversion: 2.1 time: 0.940170 Aug 30 04:29:02.826150 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2043/4145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:01 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1312 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:02.828822 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e4d841d7-6904-42f9-9b0a-fbe5bd9e814e req-d4069fbb-cf44-4322-b453-e759a7e50755 service nova] Creating event network-vif-deleted:e9cd4fec-2688-47cd-bdb5-7cede32eb332 for instance b0c734e7-a2d4-4989-9b27-2122eb927b14 on n-h2-854925-5 Aug 30 04:29:02.836201 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e4d841d7-6904-42f9-9b0a-fbe5bd9e814e req-d4069fbb-cf44-4322-b453-e759a7e50755 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081839 Aug 30 04:29:02.840021 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2103/4146] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:02.951023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:02.951926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:02.959682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.968540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.969248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:02.970221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:02.970688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:02.971126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.500861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:03.516099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:03.521010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:03.526431 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b34c5a68-ddfc-4dfc-8e3e-0b831653b9ff tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1890 microversion: 2.32 time: 0.577246 Aug 30 04:29:03.530252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2044/4147] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:02 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1890 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:03.777837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:03.779365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:03.791065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.797571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.798211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.799113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.799878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.800467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.852428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:03.853760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:03.863176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.868707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.869471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.870395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:03.871020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:03.871635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:03.925076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:03.936920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e96a5cf3-3b41-45f4-88fb-f903d07f4fd2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1253 microversion: 2.1 time: 0.163376 Aug 30 04:29:03.941037 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2104/4148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:03 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1253 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:04.209917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:04.221259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84411ec8-9743-42e7-823c-8105dc65e00c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1312 microversion: 2.1 time: 0.374003 Aug 30 04:29:04.235611 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2045/4149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:03 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1312 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:04.555978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:04.556605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:04.565672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:04.566178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:04.566625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:04.567386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:04.567851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:04.568287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:04.962319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:04.963236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:04.996573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:04.998283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:04.999394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.000168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:05.000640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:05.001107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.495133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:05.512418 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f95520f7-7331-48c3-9f3d-4fb26d319553 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1253 microversion: 2.1 time: 0.553862 Aug 30 04:29:05.515293 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2046/4150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:04 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1253 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:05.525086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:05.530836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:05.536640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:05.550477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:05.551236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:05.552492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.554735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:05.557800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:05.559428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:05.997524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.009176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.013003 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0f195010-7e44-4469-8716-d018663e2850 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.495341 Aug 30 04:29:06.017403 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2047/4151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:05 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:06.022816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.032113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.033786 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-416a158d-8e3f-4561-b13e-8632a0362e2d tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1890 microversion: 2.32 time: 1.482407 Aug 30 04:29:06.035012 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2105/4152] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:04 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1890 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:06.533753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:06.534734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:06.545699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:06.548136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:06.576430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.581525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.586513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.590549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:06.594260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:06.594765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:06.806626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:06.815979 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e45aa517-f83f-4824-9581-5c8547b0f29c tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1253 microversion: 2.1 time: 0.287239 Aug 30 04:29:06.829215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2048/4153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:06 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1253 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:07.036873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:07.037654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:07.048712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:07.057835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.058330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.058774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.059481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.066923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.072694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:07.073592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:07.073982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.087320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.090091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.091561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.095895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:07.098271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:07.100412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:07.970066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:07.989735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:07.991222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:07.992447 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9488d574-b5b4-4f02-aa69-709c8a884ff0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.936362 Aug 30 04:29:08.016149 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2049/4154] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:07 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:08.025585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:08.033382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:08.040426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.050180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.050907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.052516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.053942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.054560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.119463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:08.141945 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd0f977d-a521-4178-9129-e1274369b8c5 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 1.109615 Aug 30 04:29:08.143133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2106/4155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:07 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:08.358844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:08.373780 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec721d4c-6647-44f1-af5b-3ed6afdd50c2 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1253 microversion: 2.1 time: 0.352870 Aug 30 04:29:08.374439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2050/4156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:08 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1253 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:08.838570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c7f13ea9-5ef8-4b86-9ec3-618a58650eb8 req-54cdae55-6790-4042-af84-6ec1ba257187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeebd39a-3d4f-47b2-b37a-905d34e92645", "tag": "8bc814d9-27bb-47f7-9b56-373cf5665f5a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:08.872062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c7f13ea9-5ef8-4b86-9ec3-618a58650eb8 req-54cdae55-6790-4042-af84-6ec1ba257187 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:08.875123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c7f13ea9-5ef8-4b86-9ec3-618a58650eb8 req-54cdae55-6790-4042-af84-6ec1ba257187 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:08.875863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c7f13ea9-5ef8-4b86-9ec3-618a58650eb8 req-54cdae55-6790-4042-af84-6ec1ba257187 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:08.910296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c7f13ea9-5ef8-4b86-9ec3-618a58650eb8 req-54cdae55-6790-4042-af84-6ec1ba257187 service nova] Creating event network-changed:8bc814d9-27bb-47f7-9b56-373cf5665f5a for instance eeebd39a-3d4f-47b2-b37a-905d34e92645 on n-h1-854925-5 Aug 30 04:29:08.924436 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c7f13ea9-5ef8-4b86-9ec3-618a58650eb8 req-54cdae55-6790-4042-af84-6ec1ba257187 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102509 Aug 30 04:29:08.925610 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2107/4157] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:09.031577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:09.032307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:09.042703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.049124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.049963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.050954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.052228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.053067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.164324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:09.165366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:09.179375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.182089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.182656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.184150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:09.189138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:09.190389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:09.966272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.002048 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ac6c3008-cd95-405e-a1ea-51e372e525ab tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.840772 Aug 30 04:29:10.008044 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2108/4158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:09 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:10.033930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:10.034500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:10.057402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:10.059621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:10.060117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:10.060857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:10.061321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:10.064169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:10.307456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.329644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.331829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.337999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:10.341787 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb4e98ab-b0b6-4ea8-942f-3a96a44e4495 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1253 microversion: 2.1 time: 0.326744 Aug 30 04:29:10.343941 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0e5e1fe-c0d2-488c-b4d9-362f1c2a6a15 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.316073 Aug 30 04:29:10.345254 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2051/4159] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:09 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:10.346198 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2109/4160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:10 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1253 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:11.035363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:11.036928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:11.048906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.053573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.070060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.071075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.072434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.074677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.368243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:11.369772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:11.382338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:11.390421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.391895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.394119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.397961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.399126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.400291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.774956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:11.799734 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b4cb296e-77c6-4cb6-a0fa-e102c7f940fc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.768854 Aug 30 04:29:11.808806 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2052/4161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:11 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:11.821926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:11.822565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:11.846104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.846596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.847048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:11.847764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:11.848207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:11.848667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.484895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:12.572404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2cb3c621-a6ea-4a1a-ae4b-47214922f1e6 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1253 microversion: 2.1 time: 0.753222 Aug 30 04:29:12.576595 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2053/4162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:11 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1253 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:12.587241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c7481aac-6d19-4573-a54f-e4c599c42037 req-6ed1558e-e28a-43e9-8023-7bfd206211e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeebd39a-3d4f-47b2-b37a-905d34e92645", "tag": "9fa8df55-30dd-4c53-9812-04af5350791d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:12.603405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:12.607334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c7481aac-6d19-4573-a54f-e4c599c42037 req-6ed1558e-e28a-43e9-8023-7bfd206211e9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.607999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c7481aac-6d19-4573-a54f-e4c599c42037 req-6ed1558e-e28a-43e9-8023-7bfd206211e9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.608602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c7481aac-6d19-4573-a54f-e4c599c42037 req-6ed1558e-e28a-43e9-8023-7bfd206211e9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.618319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:12.628122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c7481aac-6d19-4573-a54f-e4c599c42037 req-6ed1558e-e28a-43e9-8023-7bfd206211e9 service nova] Creating event network-changed:9fa8df55-30dd-4c53-9812-04af5350791d for instance eeebd39a-3d4f-47b2-b37a-905d34e92645 on n-h1-854925-5 Aug 30 04:29:12.635709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:12.640873 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5f46b2b9-bca3-496c-b376-49545fcd8c37 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.277309 Aug 30 04:29:12.641215 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c7481aac-6d19-4573-a54f-e4c599c42037 req-6ed1558e-e28a-43e9-8023-7bfd206211e9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062953 Aug 30 04:29:12.644476 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2110/4163] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:11 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:12.647187 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2054/4164] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:12.821164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:12.822124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:12.839264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.841225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.842350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:12.842908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:12.843360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:12.846553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.458688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:13.469107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f0b2c9db-e4a8-4e9e-a2c8-b19a095d9a0a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.652678 Aug 30 04:29:13.475250 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2111/4165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:12 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:13.605094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:13.606468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:13.621059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.626425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.627298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.632914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.635910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.636560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.672189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:13.673942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:13.691238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.692692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.700228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.703894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.704565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.706297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.769822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:13.774218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:13.774689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:13.775169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lazy-loading 'fault' on Instance uuid b0c734e7-a2d4-4989-9b27-2122eb927b14 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:29:14.140805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03b3f68f74a44f718a03d1fccb4ae2ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb90da5b84264d9297106dc75b0c321b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:14.148187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:14.153865 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd3a609e-1541-42b0-ae72-f9a4a8bcd9d7 tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 200 len: 1212 microversion: 2.1 time: 0.559133 Aug 30 04:29:14.154504 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2055/4166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:13 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 1212 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:14.497185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:14.497830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:14.506358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:14.525232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:14.526716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:14.527921 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c27bce7-7a20-42ad-abbe-5bb553c57537 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.862518 Aug 30 04:29:14.541540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:14.543179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:14.544866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:14.545931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:14.549112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:14.549938 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2112/4167] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:13 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:14.557510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.114464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:15.128134 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74da1950-70c1-412c-8c46-3ffdf12a015c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.636672 Aug 30 04:29:15.128935 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2056/4168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:14 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:15.166596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.169316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:15.179694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.180329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] [instance: b0c734e7-a2d4-4989-9b27-2122eb927b14] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:15.193277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.193813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.194263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.194997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.195457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.195892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.198440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.200120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.207305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.208607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.209098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.209573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.323540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] HTTP exception thrown: Instance b0c734e7-a2d4-4989-9b27-2122eb927b14 could not be found. Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Request method failure captured: Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 HTTP/1.1 Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGFF1dS5_lpFcU9TzH4mtp9kJrAQDk0J8mr0Mxch0rWiDnGRxHlZhi4sFQ82YkggMN5KbCXoFA7chcAcNlZgYdPZkYRyTr0zOThahACZBgHzWFCtPD-yltMVRpBn_15T1wRuIiO-oN7AGBdGKyfrZG3lNxE-ny0yk0danCZecU5G6w Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: eb90da5b84264d9297106dc75b0c321b Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestBootFromVolume-927071003 Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_eb90da5b84264d9297106dc75b0c321b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/eb90da5b84264d9297106dc75b0c321b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb90da5b84264d9297106dc75b0c321b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/eb90da5b84264d9297106dc75b0c321b"}]}] Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestBootFromVolume-927071003 Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: eb90da5b84264d9297106dc75b0c321b Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestBootFromVolume-927071003 Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestBootFromVolume-927071003-project Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 03b3f68f74a44f718a03d1fccb4ae2ac Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestBootFromVolume-927071003-project Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b0c734e7-a2d4-4989-9b27-2122eb927b14 could not be found. Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b0c734e7-a2d4-4989-9b27-2122eb927b14'} Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c734e7-a2d4-4989-9b27-2122eb927b14 could not be found. Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c734e7-a2d4-4989-9b27-2122eb927b14 could not be found. Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:15.329020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c734e7-a2d4-4989-9b27-2122eb927b14 could not be found. Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Returning 404 to user: Instance b0c734e7-a2d4-4989-9b27-2122eb927b14 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:15.333820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-95eb57e3-1276-4041-bfa1-3310b3454b5d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14" status: 404 len: 111 microversion: 2.1 time: 0.157152 Aug 30 04:29:15.344351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2057/4169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:15 2022] GET /compute/v2.1/servers/b0c734e7-a2d4-4989-9b27-2122eb927b14 => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:15.366922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce0700c8-be8e-4b77-8a97-f26a0b6e7a3d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] Calling method '.version_select at 0x7fe96994b9d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.405448 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce0700c8-be8e-4b77-8a97-f26a0b6e7a3d tempest-ServersTestBootFromVolume-927071003 tempest-ServersTestBootFromVolume-927071003-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247534987" status: 202 len: 0 microversion: 2.1 time: 0.059357 Aug 30 04:29:15.406787 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2058/4170] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:29:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1247534987 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:29:15.557741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:15.558361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:15.579073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.580238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.581253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:15.582326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:15.586431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:15.588834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.394191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:16.399307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:16.412633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16f509ed-8482-4f04-985e-9e632332ce99 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 1.250082 Aug 30 04:29:16.413806 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2113/4171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:15 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:16.422799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:16.430487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:16.456194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:16.457079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.462050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.462616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.464219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.465273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.467455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.514654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:16.518194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:16.529531 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eaf1296b-6853-4cfa-ad92-b13ccfe7e562 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.972447 Aug 30 04:29:16.542016 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2059/4172] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:15 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:16.563624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:16.567254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:16.577882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.578407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.578850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:16.588491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:16.589361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:16.590561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.177721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.185768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a152b960-bb6c-46a3-ab73-d77275b93105 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.642493 Aug 30 04:29:17.186366 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2060/4173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:16 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:17.205907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.206531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.215536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.229594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd964103-7cf5-41a7-ac96-df510c57bfcb tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.814343 Aug 30 04:29:17.229796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.230699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.231320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.231721 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2114/4174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:16 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:17.233712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.236747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.238745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.512214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:17.525392 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0dc4768a-154f-45e8-95e4-de0090f9537d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.323458 Aug 30 04:29:17.542854 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2061/4175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:17.552342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1295835216"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:17.555799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:17.555969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.560618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:17.575159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.575339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.576051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.576873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.576979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.577196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.579341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.581974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.583202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:17.590568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:17.591453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:17.600573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.087159 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5fad2d03-1da1-4833-b392-f2e6d3d87c49 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.538616 Aug 30 04:29:18.089656 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2115/4176] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:29:17 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 04:29:18.272185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:18.277861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:18.297184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.299783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.300532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.305189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:18.306775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:18.307805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:18.471688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:18.495239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:18.495239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:18.496248 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-763c4f1f-81ed-4c5d-adae-d3e23fdd230f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.944438 Aug 30 04:29:18.535041 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2062/4177] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:17 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:18.768343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:18.782809 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d2fd19e-0d27-4ce5-8076-5da9f6516519 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.533743 Aug 30 04:29:18.783837 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2116/4178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:18 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:19.547297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.549273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:19.564249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.564895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.565605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.571296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.573303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.576525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.806605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:19.808129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:19.820196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.823600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.824389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:19.828883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:19.829853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:19.830633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:20.696486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.711935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.712370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.714341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:20.720510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-edf7ae70-5d07-4979-a327-e4d1c6f9f048 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.179605 Aug 30 04:29:20.720981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df5c534b-a73f-4a10-aa25-822198cd58ca tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.919083 Aug 30 04:29:20.721848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2063/4179] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:19 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:20.726069 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2117/4180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:19 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:21.762239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.762872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:21.771411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:21.772032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:21.779080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.779584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.780023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.780725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.781180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.786674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.788935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.794965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.795767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:21.796518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:21.796974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:21.805631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.543391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:22.556455 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e04b0de8-378e-4a46-9169-6c243a1a20f6 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.795700 Aug 30 04:29:22.571380 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2118/4181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:22.744826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:22.756512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:22.758501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:22.760967 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e27461f7-ed87-4bd6-bd61-b17c89cf3347 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.004042 Aug 30 04:29:22.762093 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2064/4182] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:21 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:22.930131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e6a634d2-a357-4a39-b524-8ad192131dfb req-d12d2fa7-aeed-47d7-b417-dda7cd2301c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeebd39a-3d4f-47b2-b37a-905d34e92645", "name": "network-vif-plugged", "status": "completed", "tag": "8bc814d9-27bb-47f7-9b56-373cf5665f5a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:22.943863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6a634d2-a357-4a39-b524-8ad192131dfb req-d12d2fa7-aeed-47d7-b417-dda7cd2301c9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:22.944669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6a634d2-a357-4a39-b524-8ad192131dfb req-d12d2fa7-aeed-47d7-b417-dda7cd2301c9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:22.945752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6a634d2-a357-4a39-b524-8ad192131dfb req-d12d2fa7-aeed-47d7-b417-dda7cd2301c9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:22.963965 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e6a634d2-a357-4a39-b524-8ad192131dfb req-d12d2fa7-aeed-47d7-b417-dda7cd2301c9 service nova] Creating event network-vif-plugged:8bc814d9-27bb-47f7-9b56-373cf5665f5a for instance eeebd39a-3d4f-47b2-b37a-905d34e92645 on n-h1-854925-5 Aug 30 04:29:22.970752 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e6a634d2-a357-4a39-b524-8ad192131dfb req-d12d2fa7-aeed-47d7-b417-dda7cd2301c9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166738 Aug 30 04:29:22.976837 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2119/4183] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:23.581645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:23.584100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:23.598317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.600964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.603346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.604524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.607059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.607804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.784999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:23.785805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:23.803622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.804392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.805037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:23.805962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:23.806583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:23.807279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:24.420216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.433448 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3ee22ba9-32d1-4710-ab69-a697ddb84d97 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.852302 Aug 30 04:29:24.446193 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2065/4184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:23 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:24.625949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.656781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.671488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:24.678179 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94fcb304-b3f0-406b-8d63-5b078e369378 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.894933 Aug 30 04:29:24.681482 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2120/4185] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:23 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:25.455773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:25.456481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:25.468993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.469716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.470168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.470895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.471359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.471806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.713232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:25.713232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:25.716653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.717161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.717642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:25.718353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:25.718818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:25.729697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:26.098601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.111677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7af9d7e4-28d6-4763-bcd4-5d796bc95589 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.659915 Aug 30 04:29:26.112859 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2066/4186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:25 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:26.237717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.256309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.293358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:26.299798 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7c6d2476-37cc-411f-80bc-046375b3eb0f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.598783 Aug 30 04:29:26.300425 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2121/4187] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:25 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:27.133357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:27.134117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:27.144088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.147340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.148079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.151553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.154042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.154614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.328003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:27.328633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:27.349135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.349576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.350017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.350731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.351188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.351620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.402380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:27.411750 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7ff76277-9167-4f6d-9212-c61fb16bafb3 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.282747 Aug 30 04:29:27.412844 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2067/4188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:27 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:27.417663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:27.418401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:27.425193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.425923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.426569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.427434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:27.428155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:27.428772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:27.455225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f30ca2a-e4cc-4e54-89a7-b251c0be9888 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/ips" status: 200 len: 153 microversion: 2.20 time: 0.041114 Aug 30 04:29:27.456237 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2068/4189] 10.222.0.27 () {60 vars in 1289 bytes} [Tue Aug 30 04:29:27 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:29:27.783538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:27.794774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:27.796906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:27.799463 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd821559-bcfa-4257-9225-0eb14b357941 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.475355 Aug 30 04:29:27.800792 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2122/4190] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:27 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:28.434663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:28.435174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:28.451178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.451694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.454752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.456923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.459160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.459624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.781578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:28.793135 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-761a60f5-b552-4632-86aa-75d36c759c13 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.359374 Aug 30 04:29:28.806540 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2069/4191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:28 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:28.827818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:28.828503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:28.854319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.854844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.855294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:28.856022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:28.856649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:28.857077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.328809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.360242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.362451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:29.364432 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-333adc42-accc-4ca0-b90b-98c1ed05214c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.540851 Aug 30 04:29:29.367310 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2123/4192] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:28 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:29.445528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3f37923a-357f-442e-baa6-3e474756048a req-58a02662-8ebb-4f52-87fe-eebb63ed79da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-plugged", "status": "completed", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:29.471168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:29.479469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3f37923a-357f-442e-baa6-3e474756048a req-58a02662-8ebb-4f52-87fe-eebb63ed79da service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.481146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3f37923a-357f-442e-baa6-3e474756048a req-58a02662-8ebb-4f52-87fe-eebb63ed79da service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.481664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3f37923a-357f-442e-baa6-3e474756048a req-58a02662-8ebb-4f52-87fe-eebb63ed79da service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.519489 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3f37923a-357f-442e-baa6-3e474756048a req-58a02662-8ebb-4f52-87fe-eebb63ed79da service nova] Creating event network-vif-plugged:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:29:29.543168 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3f37923a-357f-442e-baa6-3e474756048a req-58a02662-8ebb-4f52-87fe-eebb63ed79da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101471 Aug 30 04:29:29.543798 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2070/4193] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:29.814810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:29.816060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:29.846429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.849877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.851208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:29.854266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:29.856189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:29.856729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.206060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:30.230186 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6341f0e-786a-465e-aecc-71f011a75cad tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 0.418121 Aug 30 04:29:30.231152 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2124/4194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:29 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:30.395499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:30.396296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:30.426000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.427302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.427955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.430685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.431178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.431626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:30.804621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:30.826083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:30.830572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:30.835895 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-002d64ac-9947-4917-b08a-c575774dbb47 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.445884 Aug 30 04:29:30.840344 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2071/4195] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:30 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:30.979973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:30.981358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:30.995375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:30.996208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:30.997785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.000974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.002983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.005600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.073916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lazy-loading 'flavor' on Instance uuid 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:29:31.257139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:31.258256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:31.266230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.267202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.268436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.269452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.270655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.271334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.631135 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18df4cbe-62fa-49c0-b61f-2952abf95cad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/action" status: 202 len: 0 microversion: 2.20 time: 0.654826 Aug 30 04:29:31.631764 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2125/4196] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:29:30 2022] POST /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:31.652351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-30753593-d020-4399-aba6-2cb8bd88d171 req-e77cc8bd-0af8-41d2-812f-e0c719db8f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeebd39a-3d4f-47b2-b37a-905d34e92645", "name": "network-vif-plugged", "status": "completed", "tag": "9fa8df55-30dd-4c53-9812-04af5350791d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:31.685225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-30753593-d020-4399-aba6-2cb8bd88d171 req-e77cc8bd-0af8-41d2-812f-e0c719db8f29 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.686026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-30753593-d020-4399-aba6-2cb8bd88d171 req-e77cc8bd-0af8-41d2-812f-e0c719db8f29 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.686643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-30753593-d020-4399-aba6-2cb8bd88d171 req-e77cc8bd-0af8-41d2-812f-e0c719db8f29 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.729958 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-30753593-d020-4399-aba6-2cb8bd88d171 req-e77cc8bd-0af8-41d2-812f-e0c719db8f29 service nova] Creating event network-vif-plugged:9fa8df55-30dd-4c53-9812-04af5350791d for instance eeebd39a-3d4f-47b2-b37a-905d34e92645 on n-h1-854925-5 Aug 30 04:29:31.749517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-30753593-d020-4399-aba6-2cb8bd88d171 req-e77cc8bd-0af8-41d2-812f-e0c719db8f29 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113090 Aug 30 04:29:31.750447 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2126/4197] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:31.761347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:31.762067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:31.780124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.780644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.781094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:31.786882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:31.787461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:31.787925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.286392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.301584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ef24e5c-e33c-4112-8879-833ba88888e9 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 1.051025 Aug 30 04:29:32.322116 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2072/4198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:31 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:32.334103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:32.336896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:32.351518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.352022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.352465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.353176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:32.356967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:32.357465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:32.401259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.411670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.427237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.433102 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dc145a61-ab28-48a3-961b-7683ec361725 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.681459 Aug 30 04:29:32.445843 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2127/4199] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:31 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:32.979280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.989590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.991040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:32.992217 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-33a9fac9-094a-47d5-819c-391c24bdee0b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.669041 Aug 30 04:29:32.992786 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2073/4200] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:32 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:33.323454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:33.324364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:33.336585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.337354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.338670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.339978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.340733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.341869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.364783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:33.462229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:33.463539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:33.470513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.471290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.471882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:33.473321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:33.473985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:33.476876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.422572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.443360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-60392dd7-9705-4fd9-8cad-4c2244ef40dc tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1333 microversion: 2.1 time: 1.124808 Aug 30 04:29:34.457390 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2128/4201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:33 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1333 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:34.457390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:34.457390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:34.460176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.477783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.478362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.479145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:34.479615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:34.480310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:34.647233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.660432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.665176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:34.666750 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1afc573f-cff5-4469-a5d9-8e5bc2a04de0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 1.210432 Aug 30 04:29:34.669753 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2074/4202] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:33 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:35.346477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:35.366701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:35.369891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:35.382874 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e99e1f42-fa0a-44a6-9fee-64c4058686c6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.937441 Aug 30 04:29:35.383748 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2129/4203] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:34 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:35.468093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:35.475081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:35.486630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.492950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.493727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.524722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.531146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.532600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.595161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:35.694323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:35.695047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:35.705531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.709469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.712168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:35.713467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:35.714172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:35.714851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.359848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.372350 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b6b7956-e07c-4ccf-9ab3-3b9834b0e4cd tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1668 microversion: 2.1 time: 0.907362 Aug 30 04:29:36.373657 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2075/4204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:35 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1668 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:36.407049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.407883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:36.433922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.435329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.436039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.436973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.437627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.438209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.494118 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-510ff1fb-452d-43cb-8e9a-22a317c54712 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645/ips" status: 200 len: 179 microversion: 2.1 time: 0.094418 Aug 30 04:29:36.505685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.525543 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2076/4205] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:29:36 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645/ips => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:36.528859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.541745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.549489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:36.552059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d26a427-9920-4a3f-a71d-d92ea0a343c3 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.861820 Aug 30 04:29:36.555666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:36.556474 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2130/4206] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:35 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:36.574111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.579038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.579872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:36.582414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.584608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.585575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.587931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.588540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.593146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.594000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.594617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.598854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.599524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.600121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.685416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:29:36.859542 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bab02f08-af26-4639-9557-38e9cda7c99a tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 204 len: 0 microversion: 2.1 time: 0.297619 Aug 30 04:29:36.860263 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2131/4207] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:36 2022] DELETE /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:36.869576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:36.870283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:36.876709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.877788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.878446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:36.879969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:36.880724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:36.881393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.502679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:37.518230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:37.526016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:37.531913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:37.536029 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0585bd56-5f6a-414d-a3e5-b80710f8877f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.008677 Aug 30 04:29:37.538229 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec6c20d2-d23c-4919-8f01-a01ba337804c tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1674 microversion: 2.1 time: 0.672794 Aug 30 04:29:37.539348 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2132/4208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:36 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1674 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:37.547167 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2077/4209] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:36 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:37.589637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:37.590258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:37.607873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.608410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.608853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:37.609608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:37.610066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:37.610493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.161937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:38.176950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:38.179344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:38.181215 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-097a85e0-4aa2-4132-be9a-cdca4db350f5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.595542 Aug 30 04:29:38.182286 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2133/4210] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:37 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:38.560716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:38.561307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:38.577746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:38.578368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:38.589748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.592416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.594607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.596225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.596225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.611903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.613095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.616073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.617060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:38.618367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:38.622418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:38.623947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.155430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.183595 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c01e04a-1b17-4de3-a388-f3e4095befbe tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1674 microversion: 2.1 time: 1.626240 Aug 30 04:29:40.187181 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2078/4211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:38 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1674 bytes in 1631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:40.200781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:40.201792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:40.221473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.223354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.224602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.234231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:40.237010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:40.237803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:40.592855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.616114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.617919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:40.618979 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bb8392ba-2310-4fb0-bd7e-e689b29adb94 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 2.045356 Aug 30 04:29:40.642607 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2134/4212] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:38 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:41.212947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:41.214224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:41.234395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.235251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.235762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:41.236777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:41.238738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:41.240611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.607416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:42.621510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:42.641141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:42.646500 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cecf4a14-76d1-4159-93b0-729e42bd6a50 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 2.453275 Aug 30 04:29:42.647642 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2079/4213] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:40 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 2459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:42.654754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:42.655580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:42.664800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.665546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.666145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.667015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:42.667625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:42.668212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:42.981244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:43.003088 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a2f9348-034b-456f-9521-4200f8a4fd57 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1674 microversion: 2.1 time: 1.794774 Aug 30 04:29:43.004886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2135/4214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:41 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1674 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:43.473867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a1f7ce6b-8788-4f76-b734-27b10c886c04 req-9cdf8044-3f31-43c2-aab8-9ac675373904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeebd39a-3d4f-47b2-b37a-905d34e92645", "name": "network-vif-deleted", "tag": "9fa8df55-30dd-4c53-9812-04af5350791d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:43.515791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:43.527798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1f7ce6b-8788-4f76-b734-27b10c886c04 req-9cdf8044-3f31-43c2-aab8-9ac675373904 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.528321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1f7ce6b-8788-4f76-b734-27b10c886c04 req-9cdf8044-3f31-43c2-aab8-9ac675373904 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.528775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1f7ce6b-8788-4f76-b734-27b10c886c04 req-9cdf8044-3f31-43c2-aab8-9ac675373904 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.573662 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a1f7ce6b-8788-4f76-b734-27b10c886c04 req-9cdf8044-3f31-43c2-aab8-9ac675373904 service nova] Creating event network-vif-deleted:9fa8df55-30dd-4c53-9812-04af5350791d for instance eeebd39a-3d4f-47b2-b37a-905d34e92645 on n-h1-854925-5 Aug 30 04:29:43.605927 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a1f7ce6b-8788-4f76-b734-27b10c886c04 req-9cdf8044-3f31-43c2-aab8-9ac675373904 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.501426 Aug 30 04:29:43.608413 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2136/4215] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:43.618182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a1f3a507-535e-4fe5-9457-ff1acd6718ac req-8efc2f0c-26e4-4205-84a5-ba88da110982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeebd39a-3d4f-47b2-b37a-905d34e92645", "name": "network-vif-unplugged", "status": "completed", "tag": "8bc814d9-27bb-47f7-9b56-373cf5665f5a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:43.672393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1f3a507-535e-4fe5-9457-ff1acd6718ac req-8efc2f0c-26e4-4205-84a5-ba88da110982 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.672917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1f3a507-535e-4fe5-9457-ff1acd6718ac req-8efc2f0c-26e4-4205-84a5-ba88da110982 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.673419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a1f3a507-535e-4fe5-9457-ff1acd6718ac req-8efc2f0c-26e4-4205-84a5-ba88da110982 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.709756 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a1f3a507-535e-4fe5-9457-ff1acd6718ac req-8efc2f0c-26e4-4205-84a5-ba88da110982 service nova] Creating event network-vif-unplugged:8bc814d9-27bb-47f7-9b56-373cf5665f5a for instance eeebd39a-3d4f-47b2-b37a-905d34e92645 on n-h1-854925-5 Aug 30 04:29:43.723275 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a1f3a507-535e-4fe5-9457-ff1acd6718ac req-8efc2f0c-26e4-4205-84a5-ba88da110982 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113181 Aug 30 04:29:43.723915 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2137/4216] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:43.734267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:43.736768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:43.752617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.756561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.757013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.757799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:43.758261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:43.758690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:43.915736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:43.943573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:43.948796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:43.953196 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-017149b2-00aa-43ef-ac08-3d3bd35518a0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.304321 Aug 30 04:29:43.953990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2080/4217] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:42 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:44.028048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:44.028955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.045458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.046233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.046843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.047710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.048321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.048903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.337234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.351176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.371636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-783c9c45-9667-462b-b6d7-ac064967388d tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1495 microversion: 2.1 time: 0.348035 Aug 30 04:29:44.372436 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2081/4218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:44 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1495 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:44.383573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.384935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:44.386195 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc5bff19-4f91-4343-977f-94652a644c64 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.659959 Aug 30 04:29:44.386775 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2138/4219] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:43 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:44.981732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:44.982405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:44.996276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.997092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.997764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:44.998679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:44.999322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:44.999991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.399282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:45.401340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:45.414081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.418238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.421693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.422858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.423506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.424167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.828255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:45.841284 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f98df515-6bad-467e-b220-12ddf0fc7783 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1453 microversion: 2.1 time: 0.448400 Aug 30 04:29:45.842876 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2139/4220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:45 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1453 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:45.863749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:45.866940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:45.895420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.921649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.922309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:45.926319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:45.927074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:45.928917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.147312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.175190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.181840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.188940 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b76944f7-bf45-4b42-a576-f4ae8bb322a7 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.210816 Aug 30 04:29:46.195287 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2082/4221] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:44 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:46.211957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3805f10e-6ccc-4850-bfd4-6e7f75840751 req-e1e4fdc1-b336-4bab-8640-d2dd4eccf2cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-plugged", "status": "completed", "tag": "c22d8565-7b2a-4d2b-b452-d9996280f19e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:46.258513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3805f10e-6ccc-4850-bfd4-6e7f75840751 req-e1e4fdc1-b336-4bab-8640-d2dd4eccf2cc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.264189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3805f10e-6ccc-4850-bfd4-6e7f75840751 req-e1e4fdc1-b336-4bab-8640-d2dd4eccf2cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.268198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3805f10e-6ccc-4850-bfd4-6e7f75840751 req-e1e4fdc1-b336-4bab-8640-d2dd4eccf2cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.309284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.325715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.327857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:46.338538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3805f10e-6ccc-4850-bfd4-6e7f75840751 req-e1e4fdc1-b336-4bab-8640-d2dd4eccf2cc service nova] Creating event network-vif-plugged:c22d8565-7b2a-4d2b-b452-d9996280f19e for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:29:46.339141 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-853584e1-bfed-44b5-ba28-02f1a52309c1 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.492216 Aug 30 04:29:46.341560 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2140/4222] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:45 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:46.348514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bb1d406e-8ded-44fe-a4b7-39fb0b98bad2 req-494f043f-9ceb-417a-8a05-87ba3508cde8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeebd39a-3d4f-47b2-b37a-905d34e92645", "name": "network-vif-deleted", "tag": "8bc814d9-27bb-47f7-9b56-373cf5665f5a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:46.362877 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3805f10e-6ccc-4850-bfd4-6e7f75840751 req-e1e4fdc1-b336-4bab-8640-d2dd4eccf2cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162787 Aug 30 04:29:46.363715 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2083/4223] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:46.382328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb1d406e-8ded-44fe-a4b7-39fb0b98bad2 req-494f043f-9ceb-417a-8a05-87ba3508cde8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.383114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb1d406e-8ded-44fe-a4b7-39fb0b98bad2 req-494f043f-9ceb-417a-8a05-87ba3508cde8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.383801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb1d406e-8ded-44fe-a4b7-39fb0b98bad2 req-494f043f-9ceb-417a-8a05-87ba3508cde8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.398011 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bb1d406e-8ded-44fe-a4b7-39fb0b98bad2 req-494f043f-9ceb-417a-8a05-87ba3508cde8 service nova] Creating event network-vif-deleted:8bc814d9-27bb-47f7-9b56-373cf5665f5a for instance eeebd39a-3d4f-47b2-b37a-905d34e92645 on n-h1-854925-5 Aug 30 04:29:46.405576 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bb1d406e-8ded-44fe-a4b7-39fb0b98bad2 req-494f043f-9ceb-417a-8a05-87ba3508cde8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062508 Aug 30 04:29:46.412538 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2141/4224] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:46.702793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-60203318", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "2f7235d3-0772-4dc5-b1a3-7959b9c9a850"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:46.826471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] validate_networks() for [('2f7235d3-0772-4dc5-b1a3-7959b9c9a850', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:29:46.865442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:46.866301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:46.881074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.881074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.881074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:46.886828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:46.887333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:46.889663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.018315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.018577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.019025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.025444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lazy-loading 'fault' on Instance uuid eeebd39a-3d4f-47b2-b37a-905d34e92645 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:29:47.334630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d38b18902064b209737dfd5e13df183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '248467fdcdfd4921be9143a3dd19fe6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.350067 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0deee96-e15e-40ca-980e-9f640b07494b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 200 len: 1302 microversion: 2.1 time: 0.487134 Aug 30 04:29:47.352551 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2142/4225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:46 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 1302 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:29:47.363629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:47.365267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:47.379962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.382837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.383527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.387420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.387994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.388891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.860731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.877012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.892680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:47.894303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4a4af9a-5a4f-4170-bd75-3e79ba1ee59b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.539917 Aug 30 04:29:47.896773 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2143/4226] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:47 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:47.907347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:47.909942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:47.943322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.945077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.945893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:47.962070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:47.962766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:47.967106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.395231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:29:48.396371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:29:48.397143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:29:48.397818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:29:48.398526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:29:48.420729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.429041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:48.435206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.436002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.439181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.439666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:48.441219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.441440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:48.443043 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80c063be-1992-43b5-a0be-4847c9cb676a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.544757 Aug 30 04:29:48.443600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.445445 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2144/4227] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:47 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:48.453315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:48.454169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:48.466297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.467049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.467658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.468659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.469308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.469946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.495500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:29:48.512977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for user 9c91ba9579a24655a2c6842bac6e7034 and project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:29:48.529616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:48.542002 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] HTTP exception thrown: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Request method failure captured: Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 HTTP/1.1 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZHA5pnYlTjvzwgy2Sha57XA63ysL1zf2g3i86iEnHv_qInP3cRF3IjywapBRp_kV6YO31PGt0GXewP369XTyz7KM4saatzlBPN41p5VxkrOX3goPmvaiE_C7oxICyqcm39GJXPn1ISTdkQh2VWxyZ27HjW0ZO8bKn1bR1n8p6DYLKI Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_248467fdcdfd4921be9143a3dd19fe6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}] Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 2d38b18902064b209737dfd5e13df183 Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'eeebd39a-3d4f-47b2-b37a-905d34e92645'} Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:48.544120 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:48.548981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:48.548981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:48.548981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:48.548981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:48.548981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:48.548981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:48.548981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:48.552695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Returning 404 to user: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:48.557599 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d188618-9292-4b94-97f8-714f0f49946b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 404 len: 111 microversion: 2.1 time: 0.110554 Aug 30 04:29:48.558733 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2145/4228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:48 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:48.568144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-83c341f2-27d4-4df3-aad0-a1baf1a5f428 req-dc9fcaa3-39f6-47cb-8b9b-bffa33e42fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-plugged", "status": "completed", "tag": "899c907b-f883-4730-9a70-09800665ab32"}, {"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-plugged", "status": "completed", "tag": "a2f39c69-25f2-4aac-8cf3-37819f843b3a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:48.577376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:29:48.593944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:29:48.602094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-83c341f2-27d4-4df3-aad0-a1baf1a5f428 req-dc9fcaa3-39f6-47cb-8b9b-bffa33e42fb7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.604533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-83c341f2-27d4-4df3-aad0-a1baf1a5f428 req-dc9fcaa3-39f6-47cb-8b9b-bffa33e42fb7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.610058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-83c341f2-27d4-4df3-aad0-a1baf1a5f428 req-dc9fcaa3-39f6-47cb-8b9b-bffa33e42fb7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.678815 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-83c341f2-27d4-4df3-aad0-a1baf1a5f428 req-dc9fcaa3-39f6-47cb-8b9b-bffa33e42fb7 service nova] Creating event network-vif-plugged:899c907b-f883-4730-9a70-09800665ab32 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:29:48.700943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-83c341f2-27d4-4df3-aad0-a1baf1a5f428 req-dc9fcaa3-39f6-47cb-8b9b-bffa33e42fb7 service nova] Creating event network-vif-plugged:a2f39c69-25f2-4aac-8cf3-37819f843b3a for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:29:48.716460 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-83c341f2-27d4-4df3-aad0-a1baf1a5f428 req-dc9fcaa3-39f6-47cb-8b9b-bffa33e42fb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.148458 Aug 30 04:29:48.722156 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2146/4229] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:48.725347 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f125bf5-2c74-40cd-9a1d-759d4f9beb82 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.140588 Aug 30 04:29:48.733984 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2084/4230] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:29:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 2150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:29:48.747240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99535438-307a-4231-9275-965e97dcced1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:48.748602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99535438-307a-4231-9275-965e97dcced1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:48.921362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:48.922223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:48.947142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.953627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.960952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:48.961757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:48.963508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:48.968108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.262243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-99535438-307a-4231-9275-965e97dcced1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:49.271408 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99535438-307a-4231-9275-965e97dcced1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1213 microversion: 2.1 time: 0.529377 Aug 30 04:29:49.286822 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2147/4231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:48 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1213 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:49.469975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:49.470592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:49.484848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.487500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.488781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:49.489587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:49.490081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:49.490519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.106543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.127265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.138784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.140456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec74467e-49e1-4eea-a6b7-0d4e9de7dadc tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.224600 Aug 30 04:29:50.143689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2085/4232] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:48 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:50.191370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.252293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.255541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.267815 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dbb93529-422d-4ba7-b2d9-ec0ab5b0a19b tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.800546 Aug 30 04:29:50.272390 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2148/4233] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:49 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:50.294576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:50.295496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:50.321258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.330240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.330925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.334415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.336697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.339144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.687880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:50.702916 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-208bd5bd-0e3a-47d3-82dd-ac1367a89d4c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1217 microversion: 2.1 time: 0.412525 Aug 30 04:29:50.704476 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2086/4234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:50 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1217 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:50.870338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-dcd8f160-8a0a-4b56-9f79-9444c43fc4a8 req-b0d90d76-9ab1-46ef-96e7-67f91a70d4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-plugged", "status": "completed", "tag": "65fedda3-a97f-4c7d-a4a7-bc638e7f590b"}, {"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-plugged", "status": "completed", "tag": "37b76ba8-1408-4f27-ae51-a8cfb19391a6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:50.891042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-dcd8f160-8a0a-4b56-9f79-9444c43fc4a8 req-b0d90d76-9ab1-46ef-96e7-67f91a70d4b9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:50.892879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-dcd8f160-8a0a-4b56-9f79-9444c43fc4a8 req-b0d90d76-9ab1-46ef-96e7-67f91a70d4b9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:50.894507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-dcd8f160-8a0a-4b56-9f79-9444c43fc4a8 req-b0d90d76-9ab1-46ef-96e7-67f91a70d4b9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:50.932856 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-dcd8f160-8a0a-4b56-9f79-9444c43fc4a8 req-b0d90d76-9ab1-46ef-96e7-67f91a70d4b9 service nova] Creating event network-vif-plugged:65fedda3-a97f-4c7d-a4a7-bc638e7f590b for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:29:50.938253 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-dcd8f160-8a0a-4b56-9f79-9444c43fc4a8 req-b0d90d76-9ab1-46ef-96e7-67f91a70d4b9 service nova] Creating event network-vif-plugged:37b76ba8-1408-4f27-ae51-a8cfb19391a6 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:29:50.961915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-dcd8f160-8a0a-4b56-9f79-9444c43fc4a8 req-b0d90d76-9ab1-46ef-96e7-67f91a70d4b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093323 Aug 30 04:29:50.966290 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2149/4235] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:51.178614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:51.179230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:51.202303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.211095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.211809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.212779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.221242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.224222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.300268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:51.301151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:51.318549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.319055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.319504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:51.320225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:51.320685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:51.325135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.107688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.121623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.124052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.128369 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6ad26647-7316-4319-82f2-30567d2efbc0 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 1.832384 Aug 30 04:29:53.147579 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2150/4236] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:51 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:29:53.158088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:53.159174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:53.167441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.168235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.168991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.169992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.170680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.171340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.213002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.233643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.237681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.238988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3eba227-b34d-4e9d-a1c0-19c2fd2333a9 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 2.064932 Aug 30 04:29:53.242402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2087/4237] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:51 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:53.319448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:53.328296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3a9d9aa8-aaa3-4663-a750-39371190c53f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1271 microversion: 2.1 time: 0.179377 Aug 30 04:29:53.334573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2151/4238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:53 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:53.717501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c3af735d-2bd5-4fef-a4c4-ec768d1eccaa req-2bb9758f-5f3f-45c9-a816-3a87d59c7786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-plugged", "status": "completed", "tag": "13475dce-cbe1-4768-8aea-e49281d30daf"}, {"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-plugged", "status": "completed", "tag": "dda5b7e4-c290-4a46-bdaa-376387119bd3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:53.744907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c3af735d-2bd5-4fef-a4c4-ec768d1eccaa req-2bb9758f-5f3f-45c9-a816-3a87d59c7786 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:53.748886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c3af735d-2bd5-4fef-a4c4-ec768d1eccaa req-2bb9758f-5f3f-45c9-a816-3a87d59c7786 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:53.749995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c3af735d-2bd5-4fef-a4c4-ec768d1eccaa req-2bb9758f-5f3f-45c9-a816-3a87d59c7786 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:53.790664 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c3af735d-2bd5-4fef-a4c4-ec768d1eccaa req-2bb9758f-5f3f-45c9-a816-3a87d59c7786 service nova] Creating event network-vif-plugged:13475dce-cbe1-4768-8aea-e49281d30daf for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:29:53.792089 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c3af735d-2bd5-4fef-a4c4-ec768d1eccaa req-2bb9758f-5f3f-45c9-a816-3a87d59c7786 service nova] Creating event network-vif-plugged:dda5b7e4-c290-4a46-bdaa-376387119bd3 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:29:53.810124 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c3af735d-2bd5-4fef-a4c4-ec768d1eccaa req-2bb9758f-5f3f-45c9-a816-3a87d59c7786 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094452 Aug 30 04:29:53.811415 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2088/4239] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:29:54.160327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:54.160976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:54.175530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.179521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.182228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.186827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.187836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.189258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.267588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:54.269169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:54.300955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.302570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.305291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:54.309277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:54.312703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:54.318975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.170702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.199012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.200504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.207617 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4df97e96-4c50-47dd-b491-9c741ab7c94c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 0.941048 Aug 30 04:29:55.222458 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2089/4240] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:54 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:55.240872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:55.241719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:55.250743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.252180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.252978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.254643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.255308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.255940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.442567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.455036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.463931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.467416 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8555f8f6-32eb-464c-ba1a-155117d7b196 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1745 microversion: 2.20 time: 1.310625 Aug 30 04:29:55.470346 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2152/4241] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:54 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1745 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:55.695492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:55.696441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:55.708922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.710474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.712287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.720358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.721291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.725193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.788975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:55.806560 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a69be46-a814-4f04-bfe1-11687defef8f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 0.580452 Aug 30 04:29:55.810710 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2090/4242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:55 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:55.860250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a75cbf85-f995-4bf4-98c1-ecdef8e97718 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc/ips" status: 200 len: 150 microversion: 2.1 time: 0.162961 Aug 30 04:29:55.862793 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2153/4243] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:29:55 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc/ips => generated 150 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:55.875220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07f97d81-e722-4bab-82c8-b49d662dcbab"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:55.880093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:55.900990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.902177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.902816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:55.904034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:55.905659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:55.906313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.126048 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Invalid volume: volume 07f97d81-e722-4bab-82c8-b49d662dcbab is already attached to instances: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc/os-volume_attachments HTTP/1.1 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 74 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: {"volumeAttachment": {"volumeId": "07f97d81-e722-4bab-82c8-b49d662dcbab"}} Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid volume: volume 07f97d81-e722-4bab-82c8-b49d662dcbab is already attached to instances: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': 'cdd3bde7-3a79-454c-ab18-3aa36a5293dc', 'body': {'volumeAttachment': {'volumeId': '07f97d81-e722-4bab-82c8-b49d662dcbab'}}} Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 07f97d81-e722-4bab-82c8-b49d662dcbab is already attached to instances: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:29:56.131533 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 07f97d81-e722-4bab-82c8-b49d662dcbab is already attached to instances: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 07f97d81-e722-4bab-82c8-b49d662dcbab is already attached to instances: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 Aug 30 04:29:56.136329 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.138496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 400 to user: Invalid volume: volume 07f97d81-e722-4bab-82c8-b49d662dcbab is already attached to instances: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:56.141162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2354476d-ff7d-4522-b604-d7807b99bd0a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.270613 Aug 30 04:29:56.146330 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2091/4244] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:29:55 2022] POST /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc/os-volume_attachments => generated 174 bytes in 276 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:29:56.163862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.164753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.182786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.183562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.184166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.185040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.185669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.189433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.238630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.239684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.264316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.265092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.266935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.267907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.270908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.273127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.319842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:29:56.593758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd9a0435-452f-4dc4-a0c6-dca4d08c33cf tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 204 len: 0 microversion: 2.1 time: 0.439955 Aug 30 04:29:56.598225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2154/4245] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:56 2022] DELETE /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:29:56.622660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.624126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.632261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.633172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.633889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.634891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.635551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.636513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.655151 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] HTTP exception thrown: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Request method failure captured: Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 HTTP/1.1 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZHA5pnYlTjvzwgy2Sha57XA63ysL1zf2g3i86iEnHv_qInP3cRF3IjywapBRp_kV6YO31PGt0GXewP369XTyz7KM4saatzlBPN41p5VxkrOX3goPmvaiE_C7oxICyqcm39GJXPn1ISTdkQh2VWxyZ27HjW0ZO8bKn1bR1n8p6DYLKI Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_248467fdcdfd4921be9143a3dd19fe6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}] Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 2d38b18902064b209737dfd5e13df183 Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'eeebd39a-3d4f-47b2-b37a-905d34e92645'} Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:56.657669 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:56.662380 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:56.665816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Returning 404 to user: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:56.666999 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-375a2d52-c80f-4e6c-b877-b5af577129f4 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 404 len: 111 microversion: 2.1 time: 0.066892 Aug 30 04:29:56.668119 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2155/4246] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:56 2022] DELETE /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:56.673478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:56.674392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:56.683840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.684608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.686158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:56.687819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:56.688512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:56.689119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.404935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.424152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.425818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.427256 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b87e66b6-eaad-4285-b542-58b5c75befa2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.757876 Aug 30 04:29:57.427843 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2156/4247] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:56 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:57.443747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:57.444371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:57.448363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.460511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.461977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:57.463404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d0e59dd-28e0-4684-ad89-8e8c34d69b0a tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1878 microversion: 2.32 time: 1.229707 Aug 30 04:29:57.492796 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2092/4248] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:56 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1878 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:57.498019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:57.498625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: eeebd39a-3d4f-47b2-b37a-905d34e92645] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:57.500367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.510210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.511135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.512111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.513052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.513903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.527195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.532045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.537975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.538991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.539721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.546043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.590884 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] HTTP exception thrown: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Request method failure captured: Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 HTTP/1.1 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZHA5pnYlTjvzwgy2Sha57XA63ysL1zf2g3i86iEnHv_qInP3cRF3IjywapBRp_kV6YO31PGt0GXewP369XTyz7KM4saatzlBPN41p5VxkrOX3goPmvaiE_C7oxICyqcm39GJXPn1ISTdkQh2VWxyZ27HjW0ZO8bKn1bR1n8p6DYLKI Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_248467fdcdfd4921be9143a3dd19fe6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}] Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2d38b18902064b209737dfd5e13df183 Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'eeebd39a-3d4f-47b2-b37a-905d34e92645'} Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:57.592840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:57.601083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Returning 404 to user: Instance eeebd39a-3d4f-47b2-b37a-905d34e92645 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:57.606988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7be9314d-b059-484f-9ab0-2c884e3cbe8b tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645" status: 404 len: 111 microversion: 2.1 time: 0.112941 Aug 30 04:29:57.616763 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2093/4249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:57 2022] GET /compute/v2.1/servers/eeebd39a-3d4f-47b2-b37a-905d34e92645 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:57.630310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:57.631553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:57.655174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.656067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.666075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:57.667216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:57.667914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:57.668567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.277504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:58.291735 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-04c6405f-a757-4f7b-aeef-904ecc66e68e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1682 microversion: 2.1 time: 0.862294 Aug 30 04:29:58.297234 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2157/4250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:57 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1682 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:58.303907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c15507ac-de76-4eff-ac98-b4624d9a0ea7 req-6d97716f-f816-4554-9d33-2f9ce1039f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16adb378-53ec-46b0-a31f-4fe4e38dd2d1", "name": "network-vif-plugged", "status": "completed", "tag": "1892a3e5-332c-42ee-b372-a61fac0274ec"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:58.335755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c15507ac-de76-4eff-ac98-b4624d9a0ea7 req-6d97716f-f816-4554-9d33-2f9ce1039f42 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.336458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c15507ac-de76-4eff-ac98-b4624d9a0ea7 req-6d97716f-f816-4554-9d33-2f9ce1039f42 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.337060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c15507ac-de76-4eff-ac98-b4624d9a0ea7 req-6d97716f-f816-4554-9d33-2f9ce1039f42 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.367608 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c15507ac-de76-4eff-ac98-b4624d9a0ea7 req-6d97716f-f816-4554-9d33-2f9ce1039f42 service nova] Creating event network-vif-plugged:1892a3e5-332c-42ee-b372-a61fac0274ec for instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 on n-h2-854925-5 Aug 30 04:29:58.375027 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c15507ac-de76-4eff-ac98-b4624d9a0ea7 req-6d97716f-f816-4554-9d33-2f9ce1039f42 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076162 Aug 30 04:29:58.375887 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2158/4251] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:58.386559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.389300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.415096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.415598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.416042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.416756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.417216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.417682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.466457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:58.473691 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] HTTP exception thrown: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Request method failure captured: Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 HTTP/1.1 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZHA5pnYlTjvzwgy2Sha57XA63ysL1zf2g3i86iEnHv_qInP3cRF3IjywapBRp_kV6YO31PGt0GXewP369XTyz7KM4saatzlBPN41p5VxkrOX3goPmvaiE_C7oxICyqcm39GJXPn1ISTdkQh2VWxyZ27HjW0ZO8bKn1bR1n8p6DYLKI Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_248467fdcdfd4921be9143a3dd19fe6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}] Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 2d38b18902064b209737dfd5e13df183 Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '2ad68a88-0468-472f-a007-14515c7e7a12'} Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:58.476077 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Returning 404 to user: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:58.480749 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81f54fbb-5a16-4efa-9665-2c12cde39469 tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 404 len: 111 microversion: 2.1 time: 0.098177 Aug 30 04:29:58.486351 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2159/4252] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:29:58 2022] DELETE /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:58.491735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-59431689-546a-4197-8b78-bf06bb2fb69c req-62aa817a-08f7-428e-a584-9b1c9e58dd00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcba77df-7855-4317-b51b-54e773b19f2a", "tag": "7224c316-36a6-4af0-880e-759189477950"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:29:58.503711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-59431689-546a-4197-8b78-bf06bb2fb69c req-62aa817a-08f7-428e-a584-9b1c9e58dd00 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.504564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-59431689-546a-4197-8b78-bf06bb2fb69c req-62aa817a-08f7-428e-a584-9b1c9e58dd00 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.505231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-59431689-546a-4197-8b78-bf06bb2fb69c req-62aa817a-08f7-428e-a584-9b1c9e58dd00 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.528210 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-59431689-546a-4197-8b78-bf06bb2fb69c req-62aa817a-08f7-428e-a584-9b1c9e58dd00 service nova] Creating event network-changed:7224c316-36a6-4af0-880e-759189477950 for instance dcba77df-7855-4317-b51b-54e773b19f2a on n-h1-854925-5 Aug 30 04:29:58.541169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:58.554101 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-59431689-546a-4197-8b78-bf06bb2fb69c req-62aa817a-08f7-428e-a584-9b1c9e58dd00 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065963 Aug 30 04:29:58.557761 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2160/4253] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:29:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:29:58.570114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.593254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.606981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.608797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.609510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.610975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.611721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.612485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.817193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:58.820395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:58.853844 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e8bb8717-78f8-4aa4-9731-b298b095c458 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 1.222329 Aug 30 04:29:58.855495 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2094/4254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:57 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:58.887214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.889968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] [instance: 2ad68a88-0468-472f-a007-14515c7e7a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.915196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.922473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.927887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.931918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.932611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.934439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.954491 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] HTTP exception thrown: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Request method failure captured: Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 HTTP/1.1 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZHA5pnYlTjvzwgy2Sha57XA63ysL1zf2g3i86iEnHv_qInP3cRF3IjywapBRp_kV6YO31PGt0GXewP369XTyz7KM4saatzlBPN41p5VxkrOX3goPmvaiE_C7oxICyqcm39GJXPn1ISTdkQh2VWxyZ27HjW0ZO8bKn1bR1n8p6DYLKI Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_248467fdcdfd4921be9143a3dd19fe6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/248467fdcdfd4921be9143a3dd19fe6b"}]}] Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 248467fdcdfd4921be9143a3dd19fe6b Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestMultiNic-1308593560 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2d38b18902064b209737dfd5e13df183 Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestMultiNic-1308593560-project Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '2ad68a88-0468-472f-a007-14515c7e7a12'} Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:29:58.956349 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.961998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:29:58.961998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:29:58.961998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:29:58.961998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:29:58.961998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:29:58.961998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. Aug 30 04:29:58.961998 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:29:58.964102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] Returning 404 to user: Instance 2ad68a88-0468-472f-a007-14515c7e7a12 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:29:58.965188 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-87f6435c-f969-4076-a640-eb2e05f8e9ea tempest-ServersTestMultiNic-1308593560 tempest-ServersTestMultiNic-1308593560-project] 10.222.0.27 "GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12" status: 404 len: 111 microversion: 2.1 time: 0.104541 Aug 30 04:29:58.966373 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2095/4255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:58 2022] GET /compute/v2.1/servers/2ad68a88-0468-472f-a007-14515c7e7a12 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:29:58.971297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:58.972178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:58.980098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.980913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.981672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:58.982597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:58.983648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:58.984629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.013241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.027672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.032329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.038905 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14797349-92ed-4c9d-9691-eb56b30e0393 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.479814 Aug 30 04:29:59.039276 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2161/4256] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:58 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:29:59.062289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:59.063169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:59.073891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.077111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.077824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.079063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.083400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.084654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.267450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:29:59.590084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:29:59.613872 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31c1aec7-c5a6-4e18-8c69-fb3dcad8e219 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.561719 Aug 30 04:29:59.618145 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2162/4257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:59 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:29:59.631845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:29:59.632903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:29:59.651291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.652437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.653111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:29:59.654102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:29:59.654778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:29:59.655442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.175710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.199566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.210587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.214757 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26188a67-cf32-42a1-9c39-a6e1bfd36169 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2830 microversion: 2.32 time: 1.246815 Aug 30 04:30:00.217052 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2096/4258] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:29:58 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2830 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:00.238305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:00.239117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:00.260179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:00.263934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.270775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.275655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.289626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.292101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.292572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.295174 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be040d66-2621-4e5b-b089-2ed1f4ca4cba tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1682 microversion: 2.1 time: 0.673377 Aug 30 04:30:00.312631 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2163/4259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:29:59 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1682 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:00.326808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:00.327395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:00.342293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.342827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.343277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:00.346997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:00.347210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:00.347659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.392772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.410933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.411602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.419000 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6697b34f-caae-44ef-8665-b1ffc1081110 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 1.099186 Aug 30 04:30:01.425001 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2164/4260] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:00 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:01.471506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.472048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.473191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:01.483922 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-56237998-4ab7-4bf4-881b-af6b97481ddb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 1.264043 Aug 30 04:30:01.486400 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2097/4261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:00 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:01.496791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.497707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.498208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.500029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.500513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.509526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.515488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.517030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.529961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:01.534130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.535707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.536816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.538175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.540087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.541159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.816602 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e330f8f2-467b-44f2-a1d2-31f855e63153 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.387792 Aug 30 04:30:01.819673 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2165/4262] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7/os-interface => generated 1831 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:01.835026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:01.837118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:01.855648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.858636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.859472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.864097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:01.865182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:01.865863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:01.941053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:02.011773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.023384 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea033511-c9c3-4c7c-b54a-5c85e67cb36a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.517943 Aug 30 04:30:02.034259 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2098/4263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:02.060892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-735999888"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:02.063760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:02.083296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.083816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.084268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.084998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.085500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.085937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.101441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:02.120380 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc2d57b1-03f7-4725-aa48-de2a82179558 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1614 microversion: 2.1 time: 0.299197 Aug 30 04:30:02.121009 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2166/4264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:01 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1614 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:02.462819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:02.463928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:02.473121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.473650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.474099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.474813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.475269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.475697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.571707 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1a553b4-ef4a-4386-b3e1-3c9d70cd9643 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.516515 Aug 30 04:30:02.575641 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2099/4265] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:30:02 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 04:30:02.589939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:02.597529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:02.615523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.617935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.618674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:02.621537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:02.623185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:02.623874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.146045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.157604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.163281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.170117 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06632228-3431-4121-8548-79744196e179 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.716770 Aug 30 04:30:03.171294 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2167/4266] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:02 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:03.176650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9ff37fa7-74fc-4181-9963-1c7821ef5a21 req-632f0b29-6033-4c3b-b9bd-ff688e5cf5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-unplugged", "status": "completed", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:03.218047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9ff37fa7-74fc-4181-9963-1c7821ef5a21 req-632f0b29-6033-4c3b-b9bd-ff688e5cf5a1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.218838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9ff37fa7-74fc-4181-9963-1c7821ef5a21 req-632f0b29-6033-4c3b-b9bd-ff688e5cf5a1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.221416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9ff37fa7-74fc-4181-9963-1c7821ef5a21 req-632f0b29-6033-4c3b-b9bd-ff688e5cf5a1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.273289 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9ff37fa7-74fc-4181-9963-1c7821ef5a21 req-632f0b29-6033-4c3b-b9bd-ff688e5cf5a1 service nova] Creating event network-vif-unplugged:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:30:03.303933 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9ff37fa7-74fc-4181-9963-1c7821ef5a21 req-632f0b29-6033-4c3b-b9bd-ff688e5cf5a1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128845 Aug 30 04:30:03.311399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2168/4267] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:03.326538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:03.328811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:03.348696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.349539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.352910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.353908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.354541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.355353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.382191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.394382 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2534c33a-777c-48cc-8f2b-abe81b6e5fdb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 0.817062 Aug 30 04:30:03.408267 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2100/4268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:02 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:03.424677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7a2f1670-6740-4146-86e7-6a47b9471a62 req-9768ed6b-2bc6-4764-8250-e194fc5a4cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd3bde7-3a79-454c-ab18-3aa36a5293dc", "name": "network-vif-deleted", "tag": "cd39cb6e-6157-4618-b27f-246f4ced50cc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:03.458827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7a2f1670-6740-4146-86e7-6a47b9471a62 req-9768ed6b-2bc6-4764-8250-e194fc5a4cab service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:03.461306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7a2f1670-6740-4146-86e7-6a47b9471a62 req-9768ed6b-2bc6-4764-8250-e194fc5a4cab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:03.461828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7a2f1670-6740-4146-86e7-6a47b9471a62 req-9768ed6b-2bc6-4764-8250-e194fc5a4cab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:03.508800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:03.517172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7144648d-7c85-416a-8e31-8cec8c617b8b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 200 len: 1614 microversion: 2.1 time: 0.204435 Aug 30 04:30:03.536772 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2169/4269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:03 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 1614 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:03.546809 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7a2f1670-6740-4146-86e7-6a47b9471a62 req-9768ed6b-2bc6-4764-8250-e194fc5a4cab service nova] Creating event network-vif-deleted:cd39cb6e-6157-4618-b27f-246f4ced50cc for instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc on n-h1-854925-5 Aug 30 04:30:03.557533 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7a2f1670-6740-4146-86e7-6a47b9471a62 req-9768ed6b-2bc6-4764-8250-e194fc5a4cab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146425 Aug 30 04:30:03.560667 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2101/4270] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:04.198695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.200238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:04.213469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.215719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.216385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.220792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.221924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.224288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.431927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.434593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:04.473695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.475713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.478574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.479651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.481732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.483075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.633848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.648123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.655836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.662806 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d36123fe-4862-456a-a077-70de93e43f5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.468341 Aug 30 04:30:04.668606 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2170/4271] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:04 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:04.681277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.684899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:04.710227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.713590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.716994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.717802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:04.721744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:04.727078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:04.777574 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc HTTP/1.1 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'cdd3bde7-3a79-454c-ab18-3aa36a5293dc'} Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:04.782112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:04.787495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:04.787495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:04.787495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:04.787495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:04.787495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:04.787495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:30:04.787495 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:04.791109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:04.794447 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4a9dd47a-e7f6-40f3-ad9f-784b62d33b88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 404 len: 111 microversion: 2.1 time: 0.124443 Aug 30 04:30:04.795563 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2171/4272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:04 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:04.810508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-abdf58f7-2226-473a-9dad-7ef0b37f073b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '.version_select at 0x7fe96924d940>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:04.835732 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abdf58f7-2226-473a-9dad-7ef0b37f073b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [8dd2a198-3d7d-4bab-ac63-d9702e11791a] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:30:04.974500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:04.989815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cb672e73-3f5c-4f69-a625-df4aac4bf8d8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 0.562587 Aug 30 04:30:04.991799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2102/4273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:04 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:05.694076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:05.695249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:05.710078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.729684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.730521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.732597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:05.733308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:05.734028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:05.847565 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [None req-abdf58f7-2226-473a-9dad-7ef0b37f073b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [8dd2a198-3d7d-4bab-ac63-d9702e11791a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 55730. Aug 30 04:30:05.926567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-abdf58f7-2226-473a-9dad-7ef0b37f073b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879312003" status: 202 len: 0 microversion: 2.1 time: 1.126059 Aug 30 04:30:05.935791 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2172/4274] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:30:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879312003 => generated 0 bytes in 1136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:30:05.984610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:05.999982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.004831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.007387 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8613ef39-9ec5-4041-9729-eb4b15be9995 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.319773 Aug 30 04:30:06.011659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:06.012507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:06.012700 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2103/4275] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:05 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:06.029415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.029912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.030358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.031085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:06.031545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:06.031976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:06.433960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:06.457082 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fe55bb66-22b1-44eb-973d-646c1423208e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 0.449487 Aug 30 04:30:06.459583 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2173/4276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:06 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:07.036759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:07.037275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.051100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.058894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.060277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.061354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.061923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.062439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.406408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d0b1588b-a8d5-4120-9f12-6af3ac7ca7ec req-ba0171dc-e1b2-428c-b4b7-92309a2f44bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "tag": "dda5b7e4-c290-4a46-bdaa-376387119bd3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:07.434763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d0b1588b-a8d5-4120-9f12-6af3ac7ca7ec req-ba0171dc-e1b2-428c-b4b7-92309a2f44bf service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.435858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d0b1588b-a8d5-4120-9f12-6af3ac7ca7ec req-ba0171dc-e1b2-428c-b4b7-92309a2f44bf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.436667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d0b1588b-a8d5-4120-9f12-6af3ac7ca7ec req-ba0171dc-e1b2-428c-b4b7-92309a2f44bf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.479949 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d0b1588b-a8d5-4120-9f12-6af3ac7ca7ec req-ba0171dc-e1b2-428c-b4b7-92309a2f44bf service nova] Creating event network-changed:dda5b7e4-c290-4a46-bdaa-376387119bd3 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:30:07.500694 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d0b1588b-a8d5-4120-9f12-6af3ac7ca7ec req-ba0171dc-e1b2-428c-b4b7-92309a2f44bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097312 Aug 30 04:30:07.501731 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2174/4277] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:07.515558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:07.522972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:07.535911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.536672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.537398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:07.539878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:07.541658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:07.542344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:08.387190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.407904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.409188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.413349 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3475e290-ee54-4404-97d5-f26ee325a0ad tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 1.381850 Aug 30 04:30:08.430615 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2104/4278] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:07 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:08.819023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:08.835400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7017fc69-bcbf-401c-be32-dbce0994bff8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 1.326977 Aug 30 04:30:08.839746 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2175/4279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:07 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:09.440327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:09.441708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:09.459729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.460298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.460664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.461408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.472517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.473212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.864028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:09.864954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:09.888851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.896341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.915019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:09.916483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:09.917144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:09.918148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.547742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.560741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.563816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.565246 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34edd0f3-4bf2-42fa-9214-d4147cd4cd57 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 1.128967 Aug 30 04:30:10.566850 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2105/4280] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:09 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:10.669289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:10.677626 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52c70951-d428-4454-861d-3dad9c20ee32 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 0.818654 Aug 30 04:30:10.678231 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2176/4281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:09 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:10.702433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c1c31752-27b8-499b-86ed-e14bdf201082 req-419b6c84-ada4-4f9a-99aa-06dcdbc4dc2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcba77df-7855-4317-b51b-54e773b19f2a", "name": "network-vif-plugged", "status": "completed", "tag": "7224c316-36a6-4af0-880e-759189477950"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:10.755555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c1c31752-27b8-499b-86ed-e14bdf201082 req-419b6c84-ada4-4f9a-99aa-06dcdbc4dc2b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:10.759329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c1c31752-27b8-499b-86ed-e14bdf201082 req-419b6c84-ada4-4f9a-99aa-06dcdbc4dc2b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:10.766032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c1c31752-27b8-499b-86ed-e14bdf201082 req-419b6c84-ada4-4f9a-99aa-06dcdbc4dc2b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:10.855815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c1c31752-27b8-499b-86ed-e14bdf201082 req-419b6c84-ada4-4f9a-99aa-06dcdbc4dc2b service nova] Creating event network-vif-plugged:7224c316-36a6-4af0-880e-759189477950 for instance dcba77df-7855-4317-b51b-54e773b19f2a on n-h1-854925-5 Aug 30 04:30:10.954996 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c1c31752-27b8-499b-86ed-e14bdf201082 req-419b6c84-ada4-4f9a-99aa-06dcdbc4dc2b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.248669 Aug 30 04:30:10.981831 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2106/4282] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:11.063532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.064635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.073243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.073807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.074255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.075428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.075880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.076876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.316267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lazy-loading 'services' on Instance uuid ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:30:11.459654 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e33fe905-b036-471a-8782-2cf6c333e170 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments/07f97d81-e722-4bab-82c8-b49d662dcbab" status: 202 len: 0 microversion: 2.1 time: 0.399890 Aug 30 04:30:11.466277 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2177/4283] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:30:11 2022] DELETE /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments/07f97d81-e722-4bab-82c8-b49d662dcbab => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:30:11.470575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.473816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.504260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.506466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.508587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.511962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.514444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.515078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.613894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.616799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.634698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d4d258e5-eaab-462e-96b0-1465ddc066e5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162298 Aug 30 04:30:11.636444 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2107/4284] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:11 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:11.642455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.642959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.643398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.644187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.646091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.646539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.702574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:11.703642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:11.716202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.717929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.719837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:11.721925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:11.722608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:11.726079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.166145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.186922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.192121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.203212 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59988e85-9406-4505-a691-c3f3ae446c22 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.606700 Aug 30 04:30:12.212057 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2178/4285] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:11 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:12.260935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:12.285270 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28ee38dd-2dad-4580-94db-7c22ee3cafaa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1313 microversion: 2.1 time: 0.584787 Aug 30 04:30:12.291816 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2108/4286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:11 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1313 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:12.658690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:12.692591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:12.740903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.741425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.753753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.756198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:12.773033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:12.777016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:12.966416 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c9ae6ca-6dff-4307-bea8-0b0096fa3cef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.321121 Aug 30 04:30:12.976157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2179/4287] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:12 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:13.261403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:13.261937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-28143459-8a37-43e8-9ade-e88c21b0f983 req-992db790-8c50-43f6-87f7-d94811258536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-plugged", "status": "completed", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:13.267622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:13.269502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:13.290462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28143459-8a37-43e8-9ade-e88c21b0f983 req-992db790-8c50-43f6-87f7-d94811258536 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.290948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28143459-8a37-43e8-9ade-e88c21b0f983 req-992db790-8c50-43f6-87f7-d94811258536 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.309048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28143459-8a37-43e8-9ade-e88c21b0f983 req-992db790-8c50-43f6-87f7-d94811258536 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.394300 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-28143459-8a37-43e8-9ade-e88c21b0f983 req-992db790-8c50-43f6-87f7-d94811258536 service nova] Creating event network-vif-plugged:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:30:13.420120 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-28143459-8a37-43e8-9ade-e88c21b0f983 req-992db790-8c50-43f6-87f7-d94811258536 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160744 Aug 30 04:30:13.423866 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2180/4288] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:13.458439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.458598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:13.459223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:13.468511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.474421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.486187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.486799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.487257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.497762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.498307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.501279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:13.504798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:13.505353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:13.513011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.260417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.291094 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a50e3812-95cd-4fa7-84e1-75f5124b2c9e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1499 microversion: 2.1 time: 0.862782 Aug 30 04:30:14.292810 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2181/4289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:13 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1499 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:14.304894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:14.312619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:14.327211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.328087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.329672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.331067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.332009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.333839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.363879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.391036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.397319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:14.408812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d995b89-02c6-4203-b903-1d3de01f0259 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 1.179833 Aug 30 04:30:14.414463 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2109/4290] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:13 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:14.418674 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23ff4800-3e7f-4821-b326-5797f04c437b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124265 Aug 30 04:30:14.426412 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2182/4291] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:14 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:14.442924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:14.446071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:14.480173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.481224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.482601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.485968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.492858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.497129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.632228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:30:14.826649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:14.922510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dc3edd70-09fa-475c-823c-0b9fad995d83 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 204 len: 0 microversion: 2.1 time: 0.506633 Aug 30 04:30:14.934228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2110/4292] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:30:14 2022] DELETE /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:30:14.942003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:14.942640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:14.966530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.967042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.967492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:14.968205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:14.975172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:14.976793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:15.452552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:15.460022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:15.503112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:15.503748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:15.504201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:15.511449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:15.516981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:15.519068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:16.911939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:16.939594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aaa07143-276e-483d-9025-8d6ed1290d6d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1505 microversion: 2.1 time: 2.001524 Aug 30 04:30:16.964874 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2183/4293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:14 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1505 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:16.994417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:17.003714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:17.026482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.030383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:17.031146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:17.032325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.034559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:17.036385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:17.152936 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-70c3853f-125a-4672-a0d5-ab95e8ffda76 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185654 Aug 30 04:30:17.165707 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2184/4294] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:16 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:17.177665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.191118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.192708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:17.194242 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-37cc5acc-5476-4cdd-93a6-120c2f4fa9eb tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 1.760213 Aug 30 04:30:17.195139 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2111/4295] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:15 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:17.961793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:17.962498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:17.977399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.984953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:17.989793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:17.990598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:17.998924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.002331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.172948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:18.176864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:18.214290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.246530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.251243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.252696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.265595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.274442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.371365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:18.375093 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e22f7328-611a-457c-8bc4-1d0b1e7c3a48 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207722 Aug 30 04:30:18.386181 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2112/4296] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:18 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:18.415116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:18.418494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:18.430231 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-781072b5-622a-4fc4-a84a-28690c353dc9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1463 microversion: 2.1 time: 0.464803 Aug 30 04:30:18.432076 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2185/4297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:17 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1463 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:18.452948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.460156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1bb7987f-0fce-4c20-8d59-5a2cba1a42bf req-bd235bfb-5a98-4a3b-a1a6-b4525ed24924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcba77df-7855-4317-b51b-54e773b19f2a", "name": "network-vif-deleted", "tag": "7224c316-36a6-4af0-880e-759189477950"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:18.485936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.486590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.488036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.490515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.499222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.533271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1bb7987f-0fce-4c20-8d59-5a2cba1a42bf req-bd235bfb-5a98-4a3b-a1a6-b4525ed24924 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:18.540924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1bb7987f-0fce-4c20-8d59-5a2cba1a42bf req-bd235bfb-5a98-4a3b-a1a6-b4525ed24924 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:18.541920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1bb7987f-0fce-4c20-8d59-5a2cba1a42bf req-bd235bfb-5a98-4a3b-a1a6-b4525ed24924 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:18.578615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:18.679625 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1bb7987f-0fce-4c20-8d59-5a2cba1a42bf req-bd235bfb-5a98-4a3b-a1a6-b4525ed24924 service nova] Creating event network-vif-deleted:7224c316-36a6-4af0-880e-759189477950 for instance dcba77df-7855-4317-b51b-54e773b19f2a on n-h1-854925-5 Aug 30 04:30:18.704637 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1bb7987f-0fce-4c20-8d59-5a2cba1a42bf req-bd235bfb-5a98-4a3b-a1a6-b4525ed24924 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263361 Aug 30 04:30:18.711839 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2186/4298] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:19.259057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.300746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.302911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.304404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b5a428a9-5f06-43d0-859b-4c9b8147bb63 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.915100 Aug 30 04:30:19.305557 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2113/4299] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:18 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:19.401639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:19.404298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:19.414824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.415659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.416309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.417749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.418412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.419036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.453360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:19.575678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:19.576222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17ff041a-ded9-4a8d-9c96-e1aba1c4e0e8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079431 Aug 30 04:30:19.576222 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2187/4300] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:19 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:19.576497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.576497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.576497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.576497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.576497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.576497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.625060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:19.625060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:19.625060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:19.625060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lazy-loading 'fault' on Instance uuid dcba77df-7855-4317-b51b-54e773b19f2a {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:30:19.840388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:19.855506 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d737569-1ea8-40fc-aac4-9fac71702614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 200 len: 1303 microversion: 2.1 time: 0.407115 Aug 30 04:30:19.886815 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2114/4301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:19 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 1303 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:20.337727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:20.339201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:20.381647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.382523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.385191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.386230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.389875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.392754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.594809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:20.601630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:20.641610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.642159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.642618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.646997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.649277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.650597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.746606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.756574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.759944 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45867de1-58fe-4de9-8f7f-7fb4323d367d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179044 Aug 30 04:30:20.763774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:20.766765 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2115/4302] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:20 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:20.774011 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-53ab1e5f-0b83-4d8e-b32c-120f5b0da489 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.445534 Aug 30 04:30:20.775764 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2188/4303] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:20 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:20.891235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:20.891869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:20.899211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.899721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.900167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.900950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:20.901444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:20.901943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:20.933466 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a HTTP/1.1 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'dcba77df-7855-4317-b51b-54e773b19f2a'} Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:20.936966 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:30:20.941370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:20.942122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-092da006-a51a-4821-9ff0-bdfee8656bea tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 404 len: 111 microversion: 2.1 time: 0.054050 Aug 30 04:30:20.954330 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2116/4304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:20 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:21.173580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1951750758", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "2f7235d3-0772-4dc5-b1a3-7959b9c9a850"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:21.780087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:21.784299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:21.821839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.822567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.825342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.829121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.829708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.830169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.953962 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18b44d52-e2b7-4b10-9ba0-24477fa7396d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177811 Aug 30 04:30:21.955356 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2117/4305] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:21 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:21.963691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:21.970083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:21.989186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.989186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.989598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:21.997854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:21.998594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:21.999234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.411687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.422388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.426076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:22.439870 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3298b404-34db-4d7b-b192-65fc53da40b7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1740 microversion: 2.20 time: 0.483188 Aug 30 04:30:22.443480 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2118/4306] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:21 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1740 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:22.558230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] validate_networks() for [('2f7235d3-0772-4dc5-b1a3-7959b9c9a850', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:30:22.966691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:22.969560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:22.982349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.989908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:22.992983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:22.994541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:22.997363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.000367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.110340 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3d191357-e73b-40f3-8b20-0bd665c9baa0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147470 Aug 30 04:30:23.110945 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2119/4307] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:22 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:23.472946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:23.474034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:23.500124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.501016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.501709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.502686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.503625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.505183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.749734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:23.750265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:23.750635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:23.751051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:23.751474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:23.770801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.771647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.772086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.774010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:23.775294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:23.778550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:23.826564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:23.841362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for user 9c91ba9579a24655a2c6842bac6e7034 and project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:23.871948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:23.874692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:24.026644 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbd499d4-ab32-4750-890f-a2b9b94f26bf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.857864 Aug 30 04:30:24.034677 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2189/4308] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:30:24.041847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-787d2dcd-1971-4bfe-b51c-072e38b47768 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.044461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-787d2dcd-1971-4bfe-b51c-072e38b47768 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.520638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-787d2dcd-1971-4bfe-b51c-072e38b47768 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.559156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-787d2dcd-1971-4bfe-b51c-072e38b47768 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1215 microversion: 2.1 time: 0.522193 Aug 30 04:30:24.564423 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2190/4309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:24 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1215 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:24.578022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.582987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.601695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.602983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.604381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.605394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.606140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.606788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.687266 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-67565077-2e9c-4b8d-afee-948e2b2ddf1e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119998 Aug 30 04:30:24.696174 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2191/4310] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:30:24 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8/os-volume_attachments => generated 25 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:30:24.814683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.832608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:24.834766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:24.840726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.845438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:24.851716 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-95e428c9-8909-41be-847e-ff39329daef4 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1722 microversion: 2.20 time: 1.383435 Aug 30 04:30:24.852063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.852528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.854532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.855518 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2120/4311] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:23 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1722 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:24.876050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:24.879957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:24.880624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:24.982169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:30:25.164729 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c05735e-2124-4cd4-9dfd-c70a5f833d5c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 204 len: 0 microversion: 2.1 time: 0.338506 Aug 30 04:30:25.165798 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2192/4312] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:30:24 2022] DELETE /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:30:25.177386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:25.178201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:25.194932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.195500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.196073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.203312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.207986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.209188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.443652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.475732 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-614993e3-0ddc-44e8-b67d-9375bfe67493 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1682 microversion: 2.1 time: 0.305362 Aug 30 04:30:25.489355 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2121/4313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:25 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1682 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:25.587715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:25.588675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:25.611256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.611780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.620956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.622212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.622964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.623613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.883545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:25.884874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:25.893351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.897153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.897856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.899457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:25.902109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:25.902763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:25.928916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:25.949062 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-363e23eb-7828-4694-abc5-7d8e68e86844 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1267 microversion: 2.1 time: 0.366717 Aug 30 04:30:25.972585 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2193/4314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:25 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1267 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:26.363899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.379092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.381208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.383223 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a98228cf-dfc4-4163-8442-8bebe47b57cd tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1722 microversion: 2.20 time: 0.503727 Aug 30 04:30:26.384219 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2122/4315] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:25 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1722 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:26.500292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:26.501182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:26.534221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.536073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.538147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.539230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.539858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.540592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.757826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:26.771273 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbfa0c57-abd0-4abb-ba3c-8b332d97eb6b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1682 microversion: 2.1 time: 0.276281 Aug 30 04:30:26.772280 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2194/4316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:26 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1682 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:26.976151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:26.976789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:26.988925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.989468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.995345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:26.996254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:26.996754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:26.997360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.147732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.162073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d259c7ed-efcf-4159-b924-08caedda997f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1273 microversion: 2.1 time: 0.183537 Aug 30 04:30:27.163119 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2123/4317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:26 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:27.382167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-42a52dc7-5500-4fbd-becb-fe8c8d36632b req-0ed4aade-922d-416d-9b4e-e2a37f2ebe89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16adb378-53ec-46b0-a31f-4fe4e38dd2d1", "name": "network-vif-unplugged", "status": "completed", "tag": "1892a3e5-332c-42ee-b372-a61fac0274ec"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:27.413405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:27.414010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:27.431793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.433509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.434553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.435794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.436579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.437232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.450456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-42a52dc7-5500-4fbd-becb-fe8c8d36632b req-0ed4aade-922d-416d-9b4e-e2a37f2ebe89 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.450953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-42a52dc7-5500-4fbd-becb-fe8c8d36632b req-0ed4aade-922d-416d-9b4e-e2a37f2ebe89 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.451384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-42a52dc7-5500-4fbd-becb-fe8c8d36632b req-0ed4aade-922d-416d-9b4e-e2a37f2ebe89 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.562495 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-42a52dc7-5500-4fbd-becb-fe8c8d36632b req-0ed4aade-922d-416d-9b4e-e2a37f2ebe89 service nova] Creating event network-vif-unplugged:1892a3e5-332c-42ee-b372-a61fac0274ec for instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 on n-h2-854925-5 Aug 30 04:30:27.596410 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-42a52dc7-5500-4fbd-becb-fe8c8d36632b req-0ed4aade-922d-416d-9b4e-e2a37f2ebe89 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.213877 Aug 30 04:30:27.605135 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2195/4318] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:27.802569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:27.803287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:27.836349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.836860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.837300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.843003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:27.849773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:27.852669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:27.863187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.876585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.879515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:27.880935 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-27dbed51-28b1-4c3f-a01d-bed8b4ee9d24 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1722 microversion: 2.20 time: 0.473024 Aug 30 04:30:27.889835 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2124/4319] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:27 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:28.187363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:28.188001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:28.216526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.217049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.227117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.228609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.237604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.238404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.565397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:28.597658 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b4fec7a-f2f7-4dae-9497-b7fc0b573f37 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1273 microversion: 2.1 time: 0.414774 Aug 30 04:30:28.625851 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2125/4320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:28 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1273 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:28.923640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:28.926351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:28.939975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.953700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.954350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:28.979064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:28.982387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:28.991277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.334160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.345815 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ba3dc64d-82d9-43ed-9bfe-662efc258b9a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1682 microversion: 2.1 time: 1.549737 Aug 30 04:30:29.359275 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2196/4321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:27 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1682 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:29.622780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.631468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:29.632310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:29.642853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.647266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.651906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.652763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.653750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.654400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.656240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.657935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.660901 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7287cbcd-2017-4dff-94c0-a14586c7ccbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1665 microversion: 2.20 time: 0.742333 Aug 30 04:30:29.666559 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2126/4322] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:28 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1665 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:29.694397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c4ea399-92e2-40c6-a141-930e7b73aef2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:29.706956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:29.731045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.731966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.735096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.740787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:29.749633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:29.750380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:29.834431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:29.916673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:29.940041 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-15a78333-b6de-4c8e-abda-21dc8c19ab80 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1273 microversion: 2.1 time: 0.315474 Aug 30 04:30:29.955785 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2197/4323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:29 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1273 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:30.371970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:30.372613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:30.407757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.412245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.416735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.418189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:30.421441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:30.423776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:30.999898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dc8b2f37-7b79-4b78-b9b3-49c7205a29d9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.315747 Aug 30 04:30:31.005434 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2127/4324] 10.222.0.27 () {62 vars in 1364 bytes} [Tue Aug 30 04:30:29 2022] POST /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-volume_attachments => generated 188 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:30:31.026109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:31.031094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:31.051204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.058330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.058795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.059562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.060061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.060465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.157318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:31.185766 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d53825b7-d8cd-4dd5-a5e8-1a2bb94d01ab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1682 microversion: 2.1 time: 0.818056 Aug 30 04:30:31.193389 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2198/4325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:30 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1682 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:31.353644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:31.354201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:31.374118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.374729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.375143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:31.375860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:31.376339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:31.376742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.107978 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3349acea-f29f-4392-bd86-89b2d0c7b0c9 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-volume_attachments/1c4ea399-92e2-40c6-a141-930e7b73aef2" status: 202 len: 0 microversion: 2.20 time: 0.765505 Aug 30 04:30:32.108780 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2199/4326] 10.222.0.27 () {60 vars in 1457 bytes} [Tue Aug 30 04:30:31 2022] DELETE /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-volume_attachments/1c4ea399-92e2-40c6-a141-930e7b73aef2 => generated 0 bytes in 767 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:30:32.152712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.166710 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-198728bc-fa7f-46b0-8fbd-e745cd886529 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 1.159396 Aug 30 04:30:32.172283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2128/4327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:31 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:32.214301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:32.215253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:32.241810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.254395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:32.256876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:32.257847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.263735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.264182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:32.265369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.265829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.266257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.273948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.274683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.278343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.280277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.281094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.281748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.367860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122402) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:30:32.456495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:32.484842 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-362f3974-1199-4a73-851a-c586ce557c89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1614 microversion: 2.1 time: 0.274337 Aug 30 04:30:32.490215 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2200/4328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:32 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1614 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:32.535212 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aae09684-71c3-44c5-aac1-af534d105753 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "POST /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/action" status: 202 len: 0 microversion: 2.20 time: 0.286522 Aug 30 04:30:32.535845 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2129/4329] 10.222.0.27 () {62 vars in 1319 bytes} [Tue Aug 30 04:30:32 2022] POST /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:30:32.544227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:32.544844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:32.554686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.566947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.567493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.568253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.568724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.569155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.657693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:32.728944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-62769a5f-0277-445c-8d12-5098f497208f req-317be039-1eee-4af0-a5b6-38878bb4c13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab72fe9b-dcf6-43a8-aede-9ff12153d8b8", "name": "network-vif-deleted", "tag": "1c9ef8fc-7ef1-4689-b282-c70f317f238c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:32.776019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-62769a5f-0277-445c-8d12-5098f497208f req-317be039-1eee-4af0-a5b6-38878bb4c13d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:32.786777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-62769a5f-0277-445c-8d12-5098f497208f req-317be039-1eee-4af0-a5b6-38878bb4c13d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:32.790768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-62769a5f-0277-445c-8d12-5098f497208f req-317be039-1eee-4af0-a5b6-38878bb4c13d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:32.833728 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-62769a5f-0277-445c-8d12-5098f497208f req-317be039-1eee-4af0-a5b6-38878bb4c13d service nova] Creating event network-vif-deleted:1c9ef8fc-7ef1-4689-b282-c70f317f238c for instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 on n-h2-854925-5 Aug 30 04:30:32.850105 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-62769a5f-0277-445c-8d12-5098f497208f req-317be039-1eee-4af0-a5b6-38878bb4c13d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126040 Aug 30 04:30:32.857725 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2130/4330] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:33.191620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:33.196691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:33.207866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.221107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.228765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.229458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.230178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.231579 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6406c3c-59e4-4ba1-a281-0ae8af0d3269 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1673 microversion: 2.20 time: 0.691281 Aug 30 04:30:33.232239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.233179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.233979 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2201/4331] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:32 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1673 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:33.234814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.235394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.512978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:33.513638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:33.532204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.546874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.551460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.555829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.565276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.574747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.654219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.669388 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c13a0371-cead-4690-9969-bc797414d42b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 0.482683 Aug 30 04:30:33.673254 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2131/4332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:33 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:33.794042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:33.794983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:33.795672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:33.806918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lazy-loading 'fault' on Instance uuid ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:30:33.819435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:33.957921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:33.967396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-291b96c9-abc0-4073-8eef-c98074bba4c4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 200 len: 1331 microversion: 2.1 time: 0.461648 Aug 30 04:30:33.973547 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2202/4333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:33 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 1331 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:34.051095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a20643b2-1d40-4138-b0ca-08a42e4ba044 req-dfe5f949-c678-4e5a-a02e-f88e00aaf345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b56463-5681-406f-b7f3-f53c84d1eee1", "tag": "d5ffcd49-f306-4496-b334-faa1351ca667"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:34.080351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a20643b2-1d40-4138-b0ca-08a42e4ba044 req-dfe5f949-c678-4e5a-a02e-f88e00aaf345 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.090438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a20643b2-1d40-4138-b0ca-08a42e4ba044 req-dfe5f949-c678-4e5a-a02e-f88e00aaf345 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.091255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a20643b2-1d40-4138-b0ca-08a42e4ba044 req-dfe5f949-c678-4e5a-a02e-f88e00aaf345 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.122726 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a20643b2-1d40-4138-b0ca-08a42e4ba044 req-dfe5f949-c678-4e5a-a02e-f88e00aaf345 service nova] Creating event network-changed:d5ffcd49-f306-4496-b334-faa1351ca667 for instance 17b56463-5681-406f-b7f3-f53c84d1eee1 on n-h1-854925-5 Aug 30 04:30:34.137038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a20643b2-1d40-4138-b0ca-08a42e4ba044 req-dfe5f949-c678-4e5a-a02e-f88e00aaf345 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087788 Aug 30 04:30:34.138114 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2203/4334] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:34.264706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:34.265972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:34.295098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.296000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.296687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.300070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:34.301940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:34.305372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:34.434605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1805875432", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:34.553214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:34.742826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] validate_networks() for [('bde43f05-3cea-450e-bf96-f5fd4f4811dc', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:30:35.278550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:35.312235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:35.315552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:35.325893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1dcaa405-d592-40cb-a6fe-dc9f00e9d69f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1673 microversion: 2.20 time: 1.059694 Aug 30 04:30:35.329079 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2204/4335] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:34 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1673 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:35.348670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:35.368335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:35.402895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.405645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.411890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:35.412683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:35.414132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:35.414605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.512251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:36.528659 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c1c6b65f-6740-4d84-b38c-393385d69f09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 1.191637 Aug 30 04:30:36.545586 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2205/4336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:35 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:36.578964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:36.580645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:36.606237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.607259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.608439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.611593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.613618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.615001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.670432 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 HTTP/1.1 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'ab72fe9b-dcf6-43a8-aede-9ff12153d8b8'} Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:30:36.677190 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.683450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:30:36.683450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:30:36.683450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:30:36.683450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:30:36.683450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:30:36.683450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:30:36.683450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:30:36.689548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:30:36.691413 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6b0bf435-3360-4976-b126-1fc9eae28ac2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 404 len: 111 microversion: 2.1 time: 0.144402 Aug 30 04:30:36.709012 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2206/4337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:36 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:30:36.720618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:36.724068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:36.742903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.745302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.746130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:36.747375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:36.748968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:36.754005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.543708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:37.544779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:37.545488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:37.546347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:37.560998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:37.607024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.616871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.623645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.626942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.627708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:37.628164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.628965 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-651a6467-768a-45ff-8d96-b10296128428 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1673 microversion: 2.20 time: 0.917334 Aug 30 04:30:37.629381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.631222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.631823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.642356 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2207/4338] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:36 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1673 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:37.652910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95a44324-d86d-4863-a85b-da5f3df7238e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '.version_select at 0x7fe969251b80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.681004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Getting quotas for project 5948d1073d6643d299485a07f760966d. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:37.691549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Getting quotas for user 1216a651e1cb4d3b89341577c3f2ac75 and project 5948d1073d6643d299485a07f760966d. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:37.694576 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95a44324-d86d-4863-a85b-da5f3df7238e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-141058585" status: 202 len: 0 microversion: 2.1 time: 0.050317 Aug 30 04:30:37.697265 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2208/4339] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:30:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-141058585 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:30:37.716069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:37.725737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:37.732653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.733623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:37.787244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.791215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.796735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.802558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:37.809656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:37.810374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:37.825645 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06793896-8ff2-4deb-8309-13766f9b1987 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.082965 Aug 30 04:30:37.826905 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2132/4340] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:30:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 4085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:30:37.843181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b2cde8e-9d26-4c2f-8f6f-b3bf4fdacfa8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:37.844245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b2cde8e-9d26-4c2f-8f6f-b3bf4fdacfa8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:38.190004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7b2cde8e-9d26-4c2f-8f6f-b3bf4fdacfa8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:38.231504 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b2cde8e-9d26-4c2f-8f6f-b3bf4fdacfa8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1214 microversion: 2.1 time: 0.395003 Aug 30 04:30:38.236318 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2133/4341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:37 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1214 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:38.422675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:38.443948 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c1cb4a7-dd46-4dbe-bb63-e25912b75c5a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 0.745381 Aug 30 04:30:38.463892 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2209/4342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:37 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:38.670387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:38.671866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:38.689602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.694356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.696476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:38.702267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:38.704556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:38.706224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:39.260725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be709187-07ec-400a-ac10-b0b74bc5d261 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:39.261482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be709187-07ec-400a-ac10-b0b74bc5d261 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:39.901453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be709187-07ec-400a-ac10-b0b74bc5d261 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:39.934611 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be709187-07ec-400a-ac10-b0b74bc5d261 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1214 microversion: 2.1 time: 0.678532 Aug 30 04:30:39.935225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2210/4343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:39 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1214 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:39.999043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:40.012353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:40.084637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.085150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.093090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.096642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:40.102858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:40.104476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:40.786479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:40.828875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:40.831456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:40.837616 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6336bc68-0521-4504-932a-0ed03cc63bbc tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 2.173103 Aug 30 04:30:40.839217 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2134/4344] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:38 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:40.950053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:40.959126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:40.965084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:40.998564 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38281aaa-706b-46a8-9c38-5d5c69729631 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 1.045232 Aug 30 04:30:41.008981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:41.010956 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2211/4345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:39 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:41.013154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:41.014664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:41.016075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:41.018393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:41.022351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:41.163728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ba51d1f-7159-4c23-b250-c6422d55191d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: .version_select at 0x7fe9692511f0>, body: {"keypair": {"name": "tempest-keypair-722536413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjLAJWPm4TE5DSjX0OJtEqps+8yE8i/y862foNeZXhdmeXiy3QOxrQRDKrICOvvoEkkAV5VP51J9zqnBTCikV2vizaJDyBdqWIUdWuFf9Ak8nn/ACjWUZLnaos72oXDsg=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:41.267162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8ba51d1f-7159-4c23-b250-c6422d55191d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:41.305162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8ba51d1f-7159-4c23-b250-c6422d55191d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:41.416356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:41.491053 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ba51d1f-7159-4c23-b250-c6422d55191d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.327368 Aug 30 04:30:41.494620 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2212/4346] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:30:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:41.602963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:41.711390 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0352b8ed-2bad-4f5e-97b9-13aeb07e12c1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1266 microversion: 2.1 time: 0.756955 Aug 30 04:30:41.722303 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2135/4347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:40 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1266 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:41.896715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:41.920420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:41.964882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:41.969197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:41.976733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:41.981318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:41.984624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:41.988359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.028965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:42.030223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:42.044317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.060705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.061546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:42.066767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:42.070974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:42.075130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.323595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.337418 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c9e605f4-4362-434f-a1b8-717c4f07c740 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 1.308048 Aug 30 04:30:43.338756 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2136/4348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:42 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:43.350282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:43.353872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:43.370178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.371174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.371900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.373812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:43.376256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:43.377037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:43.477797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.491793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.494366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.503241 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0455b528-db34-45d3-a6bb-878548c0e80a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 1.639397 Aug 30 04:30:43.504407 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2213/4349] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:41 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:43.538454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:43.547418 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19f263c2-b641-46de-b2ad-e74e30b34b5d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1272 microversion: 2.1 time: 0.207295 Aug 30 04:30:43.552445 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2137/4350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:43 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:44.358604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:44.359237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:44.367396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.367889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.368334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:44.369044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.369532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.369967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:44.527634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:44.528252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:44.551836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.552333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.552779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:44.553526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:44.553985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:44.557390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.014334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:45.037832 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-596cae53-12e7-40de-a008-b98791b0ba3c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 0.682294 Aug 30 04:30:45.042822 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2214/4351] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:44 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:45.077839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:45.078509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:45.098675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.099177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.099630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.100352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.106357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.108452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.649192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:45.671414 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c0ef999-96d8-4ccd-9588-c6b4d4cc33b0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1314 microversion: 2.1 time: 0.617879 Aug 30 04:30:45.673817 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2215/4352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:45 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:45.693076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f53f410d-13b5-4ee9-878f-6ee21ce91e00 req-0af49676-a58b-4c3e-b4ec-1bf70274bee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b56463-5681-406f-b7f3-f53c84d1eee1", "name": "network-vif-plugged", "status": "completed", "tag": "d5ffcd49-f306-4496-b334-faa1351ca667"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:45.733432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f53f410d-13b5-4ee9-878f-6ee21ce91e00 req-0af49676-a58b-4c3e-b4ec-1bf70274bee6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:45.733926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f53f410d-13b5-4ee9-878f-6ee21ce91e00 req-0af49676-a58b-4c3e-b4ec-1bf70274bee6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:45.734405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f53f410d-13b5-4ee9-878f-6ee21ce91e00 req-0af49676-a58b-4c3e-b4ec-1bf70274bee6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:45.764723 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f53f410d-13b5-4ee9-878f-6ee21ce91e00 req-0af49676-a58b-4c3e-b4ec-1bf70274bee6 service nova] Creating event network-vif-plugged:d5ffcd49-f306-4496-b334-faa1351ca667 for instance 17b56463-5681-406f-b7f3-f53c84d1eee1 on n-h1-854925-5 Aug 30 04:30:45.793940 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f53f410d-13b5-4ee9-878f-6ee21ce91e00 req-0af49676-a58b-4c3e-b4ec-1bf70274bee6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112940 Aug 30 04:30:45.798320 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2216/4353] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:45.855821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:45.870776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:45.872576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:45.879176 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23509206-579d-4eef-aa34-a367265f0334 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 1.355340 Aug 30 04:30:45.881773 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2138/4354] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:44 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:30:46.068345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:46.069958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:46.101938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.103402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.104118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.109046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.110107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.111317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.130911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:46.131827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:46.156266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.163810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.164805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.165808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.166443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.167053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.782618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:46.793720 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9834040a-5cdb-42c3-81d9-b722e0de6ee9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.672635 Aug 30 04:30:46.804407 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2139/4355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:46 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:46.821195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:46.824311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:46.847675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.850443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.853034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.855493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.858878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.862235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.864963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:46.875036 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b695052-8c42-4526-8cf5-d282411f1713 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 0.814952 Aug 30 04:30:46.891439 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2217/4356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:46 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:46.909469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:46.910540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:46.920567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.921505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.922115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:46.923532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:46.924984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:46.925662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.384236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.404373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.408865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.416156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b41d5e7d-f8ca-4597-b91f-bda1441ccf6a tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.511856 Aug 30 04:30:47.434231 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2218/4357] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:46 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:47.441094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9de1a9b6-cd07-4c28-ab71-ff9e469c3219 req-9fcf0776-5f36-4a44-a26c-b2302e5636ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dafb19e-3c3d-49c9-a2da-083173730a4e", "tag": "aaab730e-ce6f-42df-ba69-8af9d6d7e0ab"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:47.452932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9de1a9b6-cd07-4c28-ab71-ff9e469c3219 req-9fcf0776-5f36-4a44-a26c-b2302e5636ca service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.454537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9de1a9b6-cd07-4c28-ab71-ff9e469c3219 req-9fcf0776-5f36-4a44-a26c-b2302e5636ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.455124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9de1a9b6-cd07-4c28-ab71-ff9e469c3219 req-9fcf0776-5f36-4a44-a26c-b2302e5636ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.468928 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9de1a9b6-cd07-4c28-ab71-ff9e469c3219 req-9fcf0776-5f36-4a44-a26c-b2302e5636ca service nova] Creating event network-changed:aaab730e-ce6f-42df-ba69-8af9d6d7e0ab for instance 5dafb19e-3c3d-49c9-a2da-083173730a4e on n-h2-854925-5 Aug 30 04:30:47.475250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9de1a9b6-cd07-4c28-ab71-ff9e469c3219 req-9fcf0776-5f36-4a44-a26c-b2302e5636ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038646 Aug 30 04:30:47.476396 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2219/4358] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:47.657812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:47.755910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:47.772890 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-400b647e-26c1-4db6-9994-a473c4f6af6d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1314 microversion: 2.1 time: 0.965713 Aug 30 04:30:47.774085 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2140/4359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:46 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:47.819013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:47.819830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:47.845179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.846526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.847133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.848002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.858112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.858835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.896729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:47.898063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:47.907578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.908935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.909647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:47.910560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:47.911181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:47.911769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.215009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:48.546424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.564359 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e80d3d2-3f2b-434d-a3e1-b2e4679a672a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.751341 Aug 30 04:30:48.580264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:48.589731 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2220/4360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:47 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:48.595601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2097823199", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18317384-8fd4-47be-a014-e798974b8cdc"}], "security_groups": [{"name": "tempest-securitygroup--2014191490"}], "key_name": "tempest-keypair-722536413", "user_data": "}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:48.597492 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e24c24c0-e9c8-4b40-b80d-823e2537fc1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1315 microversion: 2.1 time: 0.705102 Aug 30 04:30:48.610816 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2141/4361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:47 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:48.620884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:48.621922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:48.659116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.659921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.660536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.661463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:48.662073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:48.662699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:48.985780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] validate_networks() for [('18317384-8fd4-47be-a014-e798974b8cdc', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:30:49.122881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.127167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:49.140373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.149624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.156903 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0f96a52-b715-4f0a-bf01-e0d5ecf387a5 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.539232 Aug 30 04:30:49.160791 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2142/4362] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:48 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:49.179499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:49.197064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:49.211371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.213371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.214676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.234698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.238083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.238944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.701912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.718082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.719608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:49.720928 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e9b5ee78-3860-48ce-b689-2f6e555adbe0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2948 microversion: 2.32 time: 0.558837 Aug 30 04:30:49.724861 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2143/4363] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:49 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2948 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:49.733754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-497576851"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:49.741176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:49.754684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.755188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.755628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.756340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.756795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.757216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.922664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:30:49.923656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:30:49.924851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:30:49.925471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:30:49.926042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:30:49.947745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.948235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.948848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.949935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:49.950570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:49.951173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:49.990090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:30:50.009987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:30:50.036573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:30:50.052593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:30:50.138246 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-241f6fea-4baf-40da-a45a-6f1ba8ab9c7d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.546911 Aug 30 04:30:50.142519 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2221/4364] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:30:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:30:50.146402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.147242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:50.165681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-282abf72-0ddd-4377-b7a3-3ef0dbb6a577 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.436124 Aug 30 04:30:50.167124 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2144/4365] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:30:49 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 30 04:30:50.167874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.168388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.168836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.169589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.170050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.170484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.242184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.242889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:50.250590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.259136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.259596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.272394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.272956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.277500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.707397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.722467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-390dd2a3-69b4-4eff-9ca6-4ffcb81710e0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1501 microversion: 2.1 time: 0.552341 Aug 30 04:30:50.723052 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2145/4366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:50 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1501 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:50.741610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.742141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:50.756193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:50.763221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.764358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.764358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.764855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:50.765315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:50.766177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:50.787132 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c78dcc7f-a08d-4bd8-a919-125f3c9177ef tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1314 microversion: 2.1 time: 0.645223 Aug 30 04:30:50.791343 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2222/4367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:50 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1314 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:50.826471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff4c2a55-9d61-4f87-9a89-5fe4bd874e03 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:50.827030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff4c2a55-9d61-4f87-9a89-5fe4bd874e03 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:51.199483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff4c2a55-9d61-4f87-9a89-5fe4bd874e03 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:51.220587 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff4c2a55-9d61-4f87-9a89-5fe4bd874e03 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1241 microversion: 2.1 time: 0.409026 Aug 30 04:30:51.225719 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2223/4368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:50 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1241 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:51.243117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:51.244046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:51.274189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.279273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.279947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.284042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.284559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.285005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.414908 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c81a068-aa83-4b00-be37-b81b46237319 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.686367 Aug 30 04:30:51.415558 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2146/4369] 10.222.0.27 () {60 vars in 1316 bytes} [Tue Aug 30 04:30:50 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7/os-interface => generated 1831 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:51.420869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:51.421719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:51.446368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.454273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.458536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:51.461571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:51.462064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:51.462510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.810209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:52.821674 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5add5aa-0640-42f0-a5c0-d356d2f3bf76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 1.593819 Aug 30 04:30:52.831824 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2224/4370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:51 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:52.859509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0f47f91d-17ea-48e8-a78f-58992265b171 req-f77391d0-e5bb-481a-ab04-799b3becb8ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-unplugged", "status": "completed", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:52.890663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f47f91d-17ea-48e8-a78f-58992265b171 req-f77391d0-e5bb-481a-ab04-799b3becb8ac service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.894633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f47f91d-17ea-48e8-a78f-58992265b171 req-f77391d0-e5bb-481a-ab04-799b3becb8ac service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:52.919279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:52.929022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:52.930028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f47f91d-17ea-48e8-a78f-58992265b171 req-f77391d0-e5bb-481a-ab04-799b3becb8ac service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:52.945379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:52.950390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:52.954571 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c8846f45-31ee-449a-a9d1-0895512d01d2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 1.537766 Aug 30 04:30:52.959183 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2147/4371] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:51 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:52.968932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:52.969830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:52.980866 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0f47f91d-17ea-48e8-a78f-58992265b171 req-f77391d0-e5bb-481a-ab04-799b3becb8ac service nova] Creating event network-vif-unplugged:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:30:52.995361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:52.998157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.000024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.000581 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0f47f91d-17ea-48e8-a78f-58992265b171 req-f77391d0-e5bb-481a-ab04-799b3becb8ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.155453 Aug 30 04:30:53.002374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.004706 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2225/4372] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:53.005954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.014074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.027380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:53.035948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:53.073421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.073935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.074382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.079579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.082550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.083585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.659009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.674031 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-60bfdbd9-7d14-453f-9e3d-f4610ec0b392 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1311 microversion: 2.1 time: 0.658816 Aug 30 04:30:53.674694 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2226/4373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:53 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1311 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:53.792987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:53.801678 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4247a9b0-9113-4c80-b6a6-991ab753e6b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1314 microversion: 2.1 time: 0.841113 Aug 30 04:30:53.821741 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2148/4374] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:52 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:53.857097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:53.858735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:53.873924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.875105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.876612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.877665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:53.878627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:53.879204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:53.986856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:53.988537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.003561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.005978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.006694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.007888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.009670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.011698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.579773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.593791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29642a7d-56ba-490f-ba5f-36492a3bb7ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1686 microversion: 2.1 time: 0.741729 Aug 30 04:30:54.594686 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2227/4375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:53 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1686 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:54.637205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.671775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.676138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:54.679368 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c3defd5b-6c00-4a63-9fc3-4700343d575e tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.695158 Aug 30 04:30:54.680197 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2149/4376] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:53 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:54.699250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:54.700226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.725014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.728152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.730266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.731193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.733235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.735636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.842866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:54.843977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:54.862663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.883634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.890352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:54.891756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:54.894124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:54.898882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.405751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:55.429907 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46fda383-0fc6-4fd7-a6a0-6dc9e503a7aa tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1299 microversion: 2.1 time: 0.736268 Aug 30 04:30:55.446490 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2228/4377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:54 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1299 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:55.463898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bf9db004-5fff-495b-aa8b-f9e40397ef7e req-c4e9ad76-2479-4f4e-b753-9f7e18f9c652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dafb19e-3c3d-49c9-a2da-083173730a4e", "name": "network-vif-plugged", "status": "completed", "tag": "aaab730e-ce6f-42df-ba69-8af9d6d7e0ab"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:55.493097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bf9db004-5fff-495b-aa8b-f9e40397ef7e req-c4e9ad76-2479-4f4e-b753-9f7e18f9c652 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.495112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bf9db004-5fff-495b-aa8b-f9e40397ef7e req-c4e9ad76-2479-4f4e-b753-9f7e18f9c652 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.495584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bf9db004-5fff-495b-aa8b-f9e40397ef7e req-c4e9ad76-2479-4f4e-b753-9f7e18f9c652 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.525938 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bf9db004-5fff-495b-aa8b-f9e40397ef7e req-c4e9ad76-2479-4f4e-b753-9f7e18f9c652 service nova] Creating event network-vif-plugged:aaab730e-ce6f-42df-ba69-8af9d6d7e0ab for instance 5dafb19e-3c3d-49c9-a2da-083173730a4e on n-h2-854925-5 Aug 30 04:30:55.554261 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bf9db004-5fff-495b-aa8b-f9e40397ef7e req-c4e9ad76-2479-4f4e-b753-9f7e18f9c652 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096676 Aug 30 04:30:55.557573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2229/4378] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:55.577759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af469c57-600e-43d9-92c4-821f5b97c0e5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:55.583916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:55.634238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.639524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.641872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.650411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.653806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.656533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.801085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:55.844472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74cf9dcd-dac8-4a30-904c-da4ded119ef6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1314 microversion: 2.1 time: 1.004093 Aug 30 04:30:55.846562 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2150/4379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:54 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1314 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:55.872557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:55.873680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:55.933436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.934155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.937897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:55.942168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:55.942980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:55.955922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.329839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-03d7e88d-fb2e-489c-88de-649c7b433741 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766273 Aug 30 04:30:56.331728 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2230/4380] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:30:55 2022] POST /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1/os-volume_attachments => generated 194 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:30:56.341896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:56.349849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:56.362797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.363729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.364419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.365319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.366282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.366915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.556202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.566359 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a1b268d-c539-415f-bb31-6e2a3410c017 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1686 microversion: 2.1 time: 0.707926 Aug 30 04:30:56.570577 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2151/4381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:55 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1686 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:56.582931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:56.584958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:56.600836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.601682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.602338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.603294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.605237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.607027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.861054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.881672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.885958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:56.896844 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b25251c-b528-43e7-af82-e689d325ba23 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.561763 Aug 30 04:30:56.914530 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2231/4382] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:56 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:56.940514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:56.946744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:56.968480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.974001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.975043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:56.976031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:56.977352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:56.983630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.247931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:57.274769 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b274783e-505e-4680-a3b6-ad917dbc857f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.702644 Aug 30 04:30:57.280512 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2152/4383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:56 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:57.348088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-88fad732-26fc-41cd-8d28-30be763a75db req-58ca3b93-5b1d-45c8-a115-27aacbc224db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c629df0c-85ca-4656-962c-6c2a89e54371", "tag": "411fafbb-a2ff-422d-8ad8-b1b67d15327d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:57.368647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-88fad732-26fc-41cd-8d28-30be763a75db req-58ca3b93-5b1d-45c8-a115-27aacbc224db service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.374702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-88fad732-26fc-41cd-8d28-30be763a75db req-58ca3b93-5b1d-45c8-a115-27aacbc224db service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.375352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-88fad732-26fc-41cd-8d28-30be763a75db req-58ca3b93-5b1d-45c8-a115-27aacbc224db service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.429466 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-88fad732-26fc-41cd-8d28-30be763a75db req-58ca3b93-5b1d-45c8-a115-27aacbc224db service nova] Creating event network-changed:411fafbb-a2ff-422d-8ad8-b1b67d15327d for instance c629df0c-85ca-4656-962c-6c2a89e54371 on n-h1-854925-5 Aug 30 04:30:57.449369 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-88fad732-26fc-41cd-8d28-30be763a75db req-58ca3b93-5b1d-45c8-a115-27aacbc224db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104963 Aug 30 04:30:57.455201 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2153/4384] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:57.473268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:57.515570 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fe7dba1c-3531-4bf3-b083-7117fbfcd1c7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1314 microversion: 2.1 time: 0.597172 Aug 30 04:30:57.518370 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2232/4385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:56 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:57.588731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:57.589730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:57.612577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.613989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.625996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.634296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.634888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.637115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.701586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cbb25909-51b7-4100-b949-062d63b2f4c3 req-2c43bb85-5e33-4393-9447-d9f89fbc10a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-plugged", "status": "completed", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:57.729911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cbb25909-51b7-4100-b949-062d63b2f4c3 req-2c43bb85-5e33-4393-9447-d9f89fbc10a3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.732690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cbb25909-51b7-4100-b949-062d63b2f4c3 req-2c43bb85-5e33-4393-9447-d9f89fbc10a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.734770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cbb25909-51b7-4100-b949-062d63b2f4c3 req-2c43bb85-5e33-4393-9447-d9f89fbc10a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.808276 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cbb25909-51b7-4100-b949-062d63b2f4c3 req-2c43bb85-5e33-4393-9447-d9f89fbc10a3 service nova] Creating event network-vif-plugged:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:30:57.850852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cbb25909-51b7-4100-b949-062d63b2f4c3 req-2c43bb85-5e33-4393-9447-d9f89fbc10a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152747 Aug 30 04:30:57.851499 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2233/4386] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:30:57.934169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:57.938024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:57.953164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.958660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.961100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.962485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:57.965362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:57.967485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:57.982076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:57.992018 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e87c97fe-16e1-43cd-a932-e9ce96789796 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1686 microversion: 2.1 time: 0.407489 Aug 30 04:30:58.018512 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2154/4387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:57 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1686 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:58.256441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.269254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.275041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.277946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-176214d4-8a5e-4cf3-ab72-14916ac4df5d tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.352721 Aug 30 04:30:58.281683 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2234/4388] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:57 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:30:58.311147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:58.312543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:58.330050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:58.330936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:58.331961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:58.332911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:58.333914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:58.334585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:58.544848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:58.546045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:58.560658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:58.564081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:58.566069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:58.569581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:58.571335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:58.572218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:58.621708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.632809 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e7c3ad7e-fd24-4137-80c0-7c9d80431408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.325824 Aug 30 04:30:58.634416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2155/4389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:58 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:58.949412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:58.964847 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff254ea5-126f-4125-abd7-fafc2795eb34 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1500 microversion: 2.1 time: 0.426932 Aug 30 04:30:58.965764 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2235/4390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:58 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1500 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:58.987658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:30:58.990661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.006107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.008686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.009380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.011092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.013183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.015757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.035162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.036404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.118712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.124401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.125244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lazy-loading 'flavor' on Instance uuid 5dafb19e-3c3d-49c9-a2da-083173730a4e {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:30:59.125978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.131118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.140346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.141358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.310557 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e79079ef-7ea3-41ff-a81a-b43222a61ffc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "POST /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e/action" status: 200 len: 32 microversion: 2.1 time: 0.309791 Aug 30 04:30:59.311755 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2156/4391] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:30:58 2022] POST /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:30:59.344518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.345244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.379594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.380404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.382242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.385351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.387569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.388306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.394894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:59.447354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.469251 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-acbdafa7-b4b0-4a37-bd5d-a62cbbb83b9d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1686 microversion: 2.1 time: 0.440837 Aug 30 04:30:59.470478 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2236/4392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1686 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:30:59.485552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.487055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.497641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.498411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.505480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.506472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:30:59.507586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:30:59.508235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:30:59.967107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.974743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:30:59.985156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8e7ed6fa-d30a-43e9-aa9e-4718c6e89ee2 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.512751 Aug 30 04:30:59.985985 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2237/4393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:30:59.987393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:30:59.992500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:30:59.993317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:30:59.995957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.001642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.002362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.003005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.003891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.004514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.005940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.008902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.019854 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dea827b3-e534-4c0e-b4f6-d75055326fc2 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.698023 Aug 30 04:31:00.033572 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2157/4394] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:00.201532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.211790 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-699233d2-a419-4f67-bec5-08c4dc30004a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.223881 Aug 30 04:31:00.212806 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2238/4395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:30:59 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:00.495742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:00.496350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:00.506389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.507524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.508228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.509092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:00.509840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:00.510602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:00.671909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:00.680063 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3184a24-cbbb-4fd4-b2a5-542b2d204d08 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1686 microversion: 2.1 time: 0.189204 Aug 30 04:31:00.694908 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2158/4396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:00 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1686 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:01.008903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.010555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.018582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.019341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.019959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.020900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.021551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.022147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.050732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.051731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.062111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.062614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.063062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.065591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.066998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.067450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.205293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=14 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:01.329389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.369109 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7fa35cec-54be-41ea-ab54-8d42c98b9566 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.365172 Aug 30 04:31:01.370429 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2239/4397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:01.386381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.387274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.416134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.416622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.417072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.417826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.423221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.424981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.535395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.553099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.567282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.571995 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d813cfef-8e07-492a-af64-860ffed20623 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.526120 Aug 30 04:31:01.574015 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2159/4398] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:01.705826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:01.707076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:01.728901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.731105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.731982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.733349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:01.734033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:01.734837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:01.787385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:01.802793 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ebe8566a-5bc3-44b1-8183-60504d2f4375 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.426215 Aug 30 04:31:01.808489 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2240/4399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:01.994079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.003343 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8784e14f-89d6-429b-a3ce-d42a1119a5df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.303327 Aug 30 04:31:02.004249 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2160/4400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:01 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:02.394446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:02.395484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:02.416168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.416975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.417650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.430560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.431389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.432482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.601485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:02.602041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:02.609632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:02.623350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.625056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.626392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.627355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.627982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.629093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.842057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:02.854418 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-809b172c-42f1-4d6e-9bb0-13cf10517884 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.467532 Aug 30 04:31:02.855011 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2241/4401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:02 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:02.892018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:02.892806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:02.943608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.944123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.944573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:02.945338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:02.945813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:02.946296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.015346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:03.307529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.316855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.333964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.335490 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f4cc565-6e15-4c2a-8d2a-158b9b8bf7af tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.739350 Aug 30 04:31:03.341231 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2161/4402] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:02 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:03.387559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:03.390799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:03.416783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.418612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.419136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.419364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.420218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.423350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.426343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.427039 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a69d2f9-a0a9-4a12-8772-6f2302e8e09d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.548155 Aug 30 04:31:03.427633 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2242/4403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:02 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:03.746996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:03.755703 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6fae10d-6a71-4d3a-91c3-d015b41bdf63 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.395787 Aug 30 04:31:03.758739 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2162/4404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:03 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:03.880969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:03.881897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:03.894268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.894974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.895588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:03.896479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:03.910296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:03.910743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.257475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.270918 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-393a3cf3-604f-49bd-844f-179d8eee798f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.394631 Aug 30 04:31:04.285206 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2243/4405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:03 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:04.371517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:04.372444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:04.387259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.388056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.388669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.389706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.390711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.391333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.454901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:04.457804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:04.474915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.476138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.478070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.478993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.480911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.486136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.787362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.802985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.804551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.805824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6959ffa1-2d2c-4065-8f1c-0fd730816ea8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.438663 Aug 30 04:31:04.822133 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2163/4406] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:04 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:04.827663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:04.837452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:04.849182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.853457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.854115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.858174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:04.858843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:04.859476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:04.926981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:04.936215 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-43128290-0fc3-47f3-8b8d-b229772192a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.491647 Aug 30 04:31:04.942735 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2244/4407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:04 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:05.175112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.199476 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32d7c872-a430-40af-a97b-6a1993a2cf8a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.376148 Aug 30 04:31:05.200084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2164/4408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:04 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:05.299727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:05.300350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:05.322326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.326524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.330962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.347744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.348551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.349856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.595417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:05.608808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d6497b5-cec3-4acb-94b5-19c02f5bb56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.313391 Aug 30 04:31:05.617432 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2245/4409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:05 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:05.804628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-8e0842db-91c3-4cc4-96d6-284e5de45da5 req-4b17f725-28b8-40cb-af69-32041416608a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c629df0c-85ca-4656-962c-6c2a89e54371", "name": "network-vif-plugged", "status": "completed", "tag": "411fafbb-a2ff-422d-8ad8-b1b67d15327d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:05.835297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8e0842db-91c3-4cc4-96d6-284e5de45da5 req-4b17f725-28b8-40cb-af69-32041416608a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.835828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8e0842db-91c3-4cc4-96d6-284e5de45da5 req-4b17f725-28b8-40cb-af69-32041416608a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.836275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8e0842db-91c3-4cc4-96d6-284e5de45da5 req-4b17f725-28b8-40cb-af69-32041416608a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.849759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:05.851038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:05.872169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.872704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.873156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.875507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:05.875976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:05.878036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:05.889784 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-8e0842db-91c3-4cc4-96d6-284e5de45da5 req-4b17f725-28b8-40cb-af69-32041416608a service nova] Creating event network-vif-plugged:411fafbb-a2ff-422d-8ad8-b1b67d15327d for instance c629df0c-85ca-4656-962c-6c2a89e54371 on n-h1-854925-5 Aug 30 04:31:05.900937 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-8e0842db-91c3-4cc4-96d6-284e5de45da5 req-4b17f725-28b8-40cb-af69-32041416608a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101734 Aug 30 04:31:05.908101 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2165/4410] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:05.997221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:05.997991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.022834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.023526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.028237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.029315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.030622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.030953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.346773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.358691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6e08a4e-0fc3-420c-8a6b-73ef7ef5bd82 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.399148 Aug 30 04:31:06.373140 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2166/4411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:05 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:06.384520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:06.388018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.397679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.398538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.399151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.400052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.400675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.401269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.467581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.480724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.482187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.483372 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e10c5746-6e6e-482d-833a-c67001896ec8 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.646385 Aug 30 04:31:06.505987 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2246/4412] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:05 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:06.610342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.620243 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6994ac0f-c815-459f-ac86-b8b0dfcdfc62 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.245781 Aug 30 04:31:06.622035 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2167/4413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:06 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:06.640390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:06.641927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:06.655315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.656523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.657088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.659046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:06.659588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:06.660094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:06.875388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:06.885841 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8109c489-4f0f-45ec-bcb6-db73722467b3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.250928 Aug 30 04:31:06.900935 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2247/4414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:06 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:07.384937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:07.386282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:07.405098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.405887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.406503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.407384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.408532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.409116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.513835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:07.515132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:07.526199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.526699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.527140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.527860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.528321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.539243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.620692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:07.631181 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f104b2d-131d-47bd-aa69-7a4b682839df tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1367 microversion: 2.1 time: 0.251612 Aug 30 04:31:07.650617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2168/4415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:07 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:07.656101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:07.656723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:07.686698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.687204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.687866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:07.688603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:07.689077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:07.689543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.049833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.081355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.083783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.085825 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4871bb9-e777-4894-b945-d81d2feb1498 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.577826 Aug 30 04:31:08.089354 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2248/4416] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:07 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:31:08.095477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:08.110204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:08.114388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.117891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.118396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.118848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.119563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.120029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.120465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.123125 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-604520cd-1929-4644-ad08-fd0e6b6885c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.471210 Aug 30 04:31:08.123576 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2169/4417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:07 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:08.142389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-56e52238-c531-42c3-97dc-a1bc62ad9b3a req-3adcbfaf-e527-405e-accb-9a148fb82746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16adb378-53ec-46b0-a31f-4fe4e38dd2d1", "name": "network-vif-plugged", "status": "completed", "tag": "1892a3e5-332c-42ee-b372-a61fac0274ec"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:08.199126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-56e52238-c531-42c3-97dc-a1bc62ad9b3a req-3adcbfaf-e527-405e-accb-9a148fb82746 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.203033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-56e52238-c531-42c3-97dc-a1bc62ad9b3a req-3adcbfaf-e527-405e-accb-9a148fb82746 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.206103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-56e52238-c531-42c3-97dc-a1bc62ad9b3a req-3adcbfaf-e527-405e-accb-9a148fb82746 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.243927 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-56e52238-c531-42c3-97dc-a1bc62ad9b3a req-3adcbfaf-e527-405e-accb-9a148fb82746 service nova] Creating event network-vif-plugged:1892a3e5-332c-42ee-b372-a61fac0274ec for instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 on n-h2-854925-5 Aug 30 04:31:08.259807 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-56e52238-c531-42c3-97dc-a1bc62ad9b3a req-3adcbfaf-e527-405e-accb-9a148fb82746 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125440 Aug 30 04:31:08.261771 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2170/4418] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:08.425207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:08.438552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a03ce3ed-a37c-42d3-98fb-f284671aef24 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.347282 Aug 30 04:31:08.439795 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2249/4419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:08 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:08.653224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:08.653967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:08.666155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.672447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.673138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:08.674298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:08.675004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:08.675602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.056086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.070237 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd4f35c8-aac0-446f-95ab-ed0b98638d09 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1557 microversion: 2.1 time: 0.421426 Aug 30 04:31:09.071163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2171/4420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:08 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1557 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:09.102471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:09.103588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:09.115599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:09.117827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:09.129008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.130195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.131330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.132331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.132998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.133694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.134596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.135488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.136146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.136778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.137401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.138584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.342234 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbed883a-4167-45b6-9b74-abb5d67d389c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247083 Aug 30 04:31:09.343162 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2250/4421] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:31:09 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-interface => generated 284 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:09.348272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:09.349045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:09.368604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.369108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.369575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.370285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.370742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.371171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.716395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.728960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.737118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.739625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea55f63d-3397-489c-93e0-ea7541c4180f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.628456 Aug 30 04:31:09.742283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2172/4422] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:09 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:09.749951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:09.752921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:09.771110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.775020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.776412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.780906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:09.781832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:09.782448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:09.808875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:09.817105 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b03f1c0a-3680-4825-9cf4-625d31cde9c5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.472724 Aug 30 04:31:09.819406 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2251/4423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:09 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:10.156730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:10.168436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9221afac-0ec9-47f4-ad81-7389d3814ec0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.422178 Aug 30 04:31:10.175145 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2173/4424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:09 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:10.767859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:10.768509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:10.793100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:10.805700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.806217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.806667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.809582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.810542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.810806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.840307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:10.842380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:10.870542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.883286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.883889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:10.884576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:10.887688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:10.891848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.347986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.376376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.386711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.393147 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-570ec350-ac9f-45b0-a596-ea34f2825552 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1731 microversion: 2.20 time: 0.625365 Aug 30 04:31:11.395341 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2252/4425] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:10 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1731 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:11.404187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:11.404994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:11.411883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.412697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.413313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.414258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:11.414721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:11.415161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:11.580189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.590628 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af1c5898-483a-422c-9734-5f939294b508 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.754058 Aug 30 04:31:11.591852 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2174/4426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:10 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:11.739938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:11.750258 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4a59993-826a-4a08-b612-8fc3bd588c66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.353224 Aug 30 04:31:11.764311 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2253/4427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:11 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:11.984634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-af879562-53ed-446d-91e2-9838f6721e29 req-4a02bde6-cc5a-4f0e-ab83-0b120b8f440a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c629df0c-85ca-4656-962c-6c2a89e54371", "tag": "411fafbb-a2ff-422d-8ad8-b1b67d15327d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:12.002878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af879562-53ed-446d-91e2-9838f6721e29 req-4a02bde6-cc5a-4f0e-ab83-0b120b8f440a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.006374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af879562-53ed-446d-91e2-9838f6721e29 req-4a02bde6-cc5a-4f0e-ab83-0b120b8f440a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.008958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af879562-53ed-446d-91e2-9838f6721e29 req-4a02bde6-cc5a-4f0e-ab83-0b120b8f440a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.021133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:12.039238 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-af879562-53ed-446d-91e2-9838f6721e29 req-4a02bde6-cc5a-4f0e-ab83-0b120b8f440a service nova] Creating event network-changed:411fafbb-a2ff-422d-8ad8-b1b67d15327d for instance c629df0c-85ca-4656-962c-6c2a89e54371 on n-h1-854925-5 Aug 30 04:31:12.053148 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-af879562-53ed-446d-91e2-9838f6721e29 req-4a02bde6-cc5a-4f0e-ab83-0b120b8f440a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072261 Aug 30 04:31:12.054097 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2175/4428] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:12.421074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:12.421802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:12.436257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.438109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.439606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.442609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.443074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.445059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.614569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:12.615289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:12.627253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.631257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.631909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.632985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.635158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.635811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.674702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:12.689690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:12.691572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:12.693298 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7cb4a63-bc06-4e1c-ab76-39c895f7b445 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1718 microversion: 2.20 time: 0.277157 Aug 30 04:31:12.694699 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2254/4429] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:12 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1718 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:12.777905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:12.779826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:12.793902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.797038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.797725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:12.801189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:12.801922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:12.803033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.072188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:13.093175 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ab9e28bf-ae65-4cb2-8ead-8afbcc84fae5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.483707 Aug 30 04:31:13.107063 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2176/4430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:12 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:13.147028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:13.148303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:13.159954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.167441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.168420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.170447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.171092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.171870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.222532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:13.247750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d370f9e6-10f2-43de-ad87-53e96418356f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.473285 Aug 30 04:31:13.252188 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2255/4431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:12 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:13.258257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:31:13.487689 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a02d8f9a-bd9d-42bd-a087-ee29c08eba76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 204 len: 0 microversion: 2.1 time: 0.377639 Aug 30 04:31:13.488859 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2177/4432] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:31:13 2022] DELETE /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:31:13.497831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:13.498349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:13.525119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.527809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.528379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.529361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:13.538092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:13.538925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:13.758553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:13.768547 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-007bb289-6f0a-4433-9a4f-2da162e9ffbf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1553 microversion: 2.1 time: 0.275405 Aug 30 04:31:13.786034 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2256/4433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:13 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:14.126250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:14.128070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:14.146701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.147641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.148521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.149553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.150018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.150677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.272597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:14.274105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:14.289167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.289941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.290575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.293610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.294256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.294911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.419378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.433162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c5344b23-2152-4251-aa60-1bebd26d940e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.311141 Aug 30 04:31:14.434029 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2178/4434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:14 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:14.609729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:14.627773 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5165f889-5153-447f-b00b-f6c1600655c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.358900 Aug 30 04:31:14.637429 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2257/4435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:14 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:14.790009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:14.790790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:14.801274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.802552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.803221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:14.804167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:14.804639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:14.805136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.024490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.056519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d5fdf01-aa74-4ec1-94c1-bdc043b6ebac tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1553 microversion: 2.1 time: 0.269648 Aug 30 04:31:15.069886 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2179/4436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:14 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:15.460345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:15.461350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:15.468453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.469134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.470224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.471107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.471788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.472381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.647074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.648610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:15.649306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:15.655460 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76edaf5b-01de-4797-a7ef-2287435a7237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.199789 Aug 30 04:31:15.657273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2258/4437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:15 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:15.659625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.660117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.660667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.661904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:15.662597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:15.663024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:15.860977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:15.877220 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c8e8e37-7b1e-4326-a70a-ed0c749b1bb3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.232232 Aug 30 04:31:15.912528 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2180/4438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:15 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:16.078855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:16.079994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:16.091249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.093101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.095624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.096557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.098787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.100410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.124567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:16.340560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:16.354714 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a7a3a30-16a0-49af-8521-5fb27ef1b9ad tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1553 microversion: 2.1 time: 0.280654 Aug 30 04:31:16.355327 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2259/4439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:16 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1553 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:16.691781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:16.693864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:16.722944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.726006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.728769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.729689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.733736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.734314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.908231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:16.909567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:16.950699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.963342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.964498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:16.965695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:16.966382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:16.966985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.071187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:17.093311 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b3bbe6a-1824-414d-a69a-e2713e5f603e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.405945 Aug 30 04:31:17.096266 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2181/4440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:16 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:17.131631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-60806548-998f-4bc5-b190-c563d7811b50 req-834650fd-8b56-4ad3-bc57-b260d6b2d97a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b56463-5681-406f-b7f3-f53c84d1eee1", "name": "network-vif-deleted", "tag": "d5ffcd49-f306-4496-b334-faa1351ca667"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:17.164081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60806548-998f-4bc5-b190-c563d7811b50 req-834650fd-8b56-4ad3-bc57-b260d6b2d97a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.164949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60806548-998f-4bc5-b190-c563d7811b50 req-834650fd-8b56-4ad3-bc57-b260d6b2d97a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.165653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60806548-998f-4bc5-b190-c563d7811b50 req-834650fd-8b56-4ad3-bc57-b260d6b2d97a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.178598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-60806548-998f-4bc5-b190-c563d7811b50 req-834650fd-8b56-4ad3-bc57-b260d6b2d97a service nova] Creating event network-vif-deleted:d5ffcd49-f306-4496-b334-faa1351ca667 for instance 17b56463-5681-406f-b7f3-f53c84d1eee1 on n-h1-854925-5 Aug 30 04:31:17.185680 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-60806548-998f-4bc5-b190-c563d7811b50 req-834650fd-8b56-4ad3-bc57-b260d6b2d97a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087687 Aug 30 04:31:17.186950 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2182/4441] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:17.291424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:17.306540 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df193b21-01fb-4121-8809-098758e872ad tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.407051 Aug 30 04:31:17.307136 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2260/4442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:16 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:17.376814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:17.378153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:17.397754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.398425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.398965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.399772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:17.400542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:17.401394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:17.504761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:17.513767 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3494e85e-fb85-4ac6-96d2-74f382774d67 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1346 microversion: 2.1 time: 0.141275 Aug 30 04:31:17.525349 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2183/4443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:17 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:18.118439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:18.119235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:18.130995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.132014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.132747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.133766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.134451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.135104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.330002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:18.331347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:18.341146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.342368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.345259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.346227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.347193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.350131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.375958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.392409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ade8e495-c633-4c75-9930-795467571e7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.278249 Aug 30 04:31:18.414338 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2261/4444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:18 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:18.535915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:18.537107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:18.553279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.553990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.554542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.557618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:18.558221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:18.560980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:18.689069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.706349 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c467dcb-4abc-4585-9abd-6a7cb1266f22 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1346 microversion: 2.1 time: 0.174726 Aug 30 04:31:18.707374 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2262/4445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:18 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:18.717220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:18.727444 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-158813eb-7985-4dee-a34c-1fb44cc6e1d7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.402632 Aug 30 04:31:18.731520 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2184/4446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:18 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:19.443398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:19.444169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:19.467467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.468230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.468806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.469717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.470466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.471020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.655735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:19.665760 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-084e1a5e-afd0-415c-a63d-f8b2e652e63e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.227436 Aug 30 04:31:19.670258 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2263/4447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:19 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:19.736926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:19.737971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:19.753071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:19.754149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:19.774835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.775638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.776341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.777351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.778049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.778709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.795661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.796486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.797080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:19.800136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:19.800791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:19.801474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.002401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:20.014244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a80eb131-47c1-4515-90be-c9d2f62f3679 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1346 microversion: 2.1 time: 0.286206 Aug 30 04:31:20.018906 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2185/4448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:19 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1346 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:20.127177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:20.140332 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-93cff3ba-305d-459d-b323-88258056410b tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.391882 Aug 30 04:31:20.154629 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2264/4449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:19 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:20.694300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:20.695049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:20.711128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.711853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.712325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.713071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:20.713566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:20.714005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:20.984717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:20.993660 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03750217-4526-4fc9-8571-74a5d0dde590 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1681 microversion: 2.1 time: 0.305586 Aug 30 04:31:20.994464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2186/4450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:20 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:21.040300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:21.040918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:21.059549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.060567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.063220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.064693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.065192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.065651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.160629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:21.161292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:21.168784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.169566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.170161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.171508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:21.171964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:21.172394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:21.189959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:21.199724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-020e7d2c-0696-4f18-97da-9ab6674aa25e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1346 microversion: 2.1 time: 0.163336 Aug 30 04:31:21.200650 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2265/4451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:21 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1346 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:21.350581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:21.359100 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c93dfbc-99d6-4126-8f18-c9a5d7315b66 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.202316 Aug 30 04:31:21.385605 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2187/4452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:21 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:22.019069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:22.019287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:22.028203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.029375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.031062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.032387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.033144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.033849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.222146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:22.223687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:22.233202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.233989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.234648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.236118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.236794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.237461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.289600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.297494 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6b1825f-154d-48d4-bb66-ddd4878b92f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.285110 Aug 30 04:31:22.298114 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2266/4453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:22 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:22.364196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.378827 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-79bd01e3-29ab-4576-9706-880767a2764a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1346 microversion: 2.1 time: 0.160835 Aug 30 04:31:22.381526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:22.382380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:22.393290 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2188/4454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:22 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:22.395247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.395972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.396633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.397603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:22.398279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:22.398922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:22.667367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:22.684589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7caac6fb-ce5b-4696-933d-406006f5253f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.304271 Aug 30 04:31:22.685415 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2267/4455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:22 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:23.399294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:23.400120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:23.415233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.416034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.416692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.417437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.418077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.418514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.423566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:23.424515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:23.435509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.436136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.436602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.438264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.438787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.439843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.543404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.565917 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f80f4390-05fe-4e4e-b00e-c212eff5f783 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 200 len: 1346 microversion: 2.1 time: 0.170349 Aug 30 04:31:23.580301 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2189/4456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:23 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 1346 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:23.660325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.681175 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-731c9792-ba8f-419c-91e9-b1acdf09a358 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.265216 Aug 30 04:31:23.685821 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2268/4457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:23 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:23.716976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:23.718723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:23.729367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.729908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.730484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.731193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:23.731651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:23.732083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:23.907133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:23.926221 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-966c27f6-c7ad-4c6f-b654-219d761596f1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.218389 Aug 30 04:31:23.929697 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2190/4458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:23 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:24.587279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:24.592513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:24.611518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.612018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.612441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.613346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.613816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.614226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.642944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 HTTP/1.1 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '17b56463-5681-406f-b7f3-f53c84d1eee1'} Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:24.645581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f89b318-a21b-4728-89bf-afcca219e58d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 404 len: 111 microversion: 2.1 time: 0.064206 Aug 30 04:31:24.653516 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2269/4459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:24 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:24.786842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:24.789763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:24.799124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.799847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.800518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.801503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.802171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.802807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.826481 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1/os-volume_attachments HTTP/1.1 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '17b56463-5681-406f-b7f3-f53c84d1eee1'} Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:24.828698 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-48e50b2a-8a0d-4c5b-b775-9689a3a9ab81 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048085 Aug 30 04:31:24.836344 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2191/4460] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:31:24 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:24.951345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:24.953194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:24.969630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.972297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.973066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:24.974356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:24.975021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:24.975593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:25.088222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-498599276", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "2f7235d3-0772-4dc5-b1a3-7959b9c9a850"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:25.151170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] validate_networks() for [('2f7235d3-0772-4dc5-b1a3-7959b9c9a850', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:31:25.657712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.668805 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ba7e420-d822-4387-8972-aae8152c205c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.724652 Aug 30 04:31:25.670983 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2270/4461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:24 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:25.676813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:25.677683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:25.684527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:25.685261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:25.686010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:25.687233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:25.689570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:25.690340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:25.956136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:25.964219 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2bec83eb-ba0f-42cd-83d4-b07487baca74 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.291966 Aug 30 04:31:25.964920 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2271/4462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:25 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:25.969591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1b98d068-4cb0-4e8d-802a-225bada6e7a7 req-a7487801-a9ed-472c-a3d7-d1117624ad8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-unplugged", "status": "completed", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:25.996308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1b98d068-4cb0-4e8d-802a-225bada6e7a7 req-a7487801-a9ed-472c-a3d7-d1117624ad8c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:25.997461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1b98d068-4cb0-4e8d-802a-225bada6e7a7 req-a7487801-a9ed-472c-a3d7-d1117624ad8c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.000285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1b98d068-4cb0-4e8d-802a-225bada6e7a7 req-a7487801-a9ed-472c-a3d7-d1117624ad8c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.016404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1b98d068-4cb0-4e8d-802a-225bada6e7a7 req-a7487801-a9ed-472c-a3d7-d1117624ad8c service nova] Creating event network-vif-unplugged:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:31:26.022471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1b98d068-4cb0-4e8d-802a-225bada6e7a7 req-a7487801-a9ed-472c-a3d7-d1117624ad8c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056190 Aug 30 04:31:26.023834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2272/4463] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:26.030278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.031218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.038359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.039146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.039804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.040732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.041496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.042146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.123843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:31:26.124530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:31:26.125018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:31:26.125522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:31:26.125950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:31:26.140333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.140333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.140333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.140333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.140333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.140333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.149300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:26.168475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:26.176028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for user 9c91ba9579a24655a2c6842bac6e7034 and project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:26.190675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:31:26.193010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:31:26.216777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:26.225431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4bfbf6b0-73ae-47c3-be03-8aad9a607941 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.200094 Aug 30 04:31:26.226608 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2273/4464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:26.249941 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3e0a1f2c-8a69-4555-9553-a8a5baeba05a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166481 Aug 30 04:31:26.251649 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2192/4465] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:31:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:31:26.255259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.256132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.263793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.264348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.264912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.265175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f68dfb0-ec6c-4bda-8b79-fb00f19a48f1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.265872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f68dfb0-ec6c-4bda-8b79-fb00f19a48f1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.266229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.267414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.268013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.351949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f68dfb0-ec6c-4bda-8b79-fb00f19a48f1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:26.359892 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f68dfb0-ec6c-4bda-8b79-fb00f19a48f1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf" status: 200 len: 1214 microversion: 2.1 time: 0.101743 Aug 30 04:31:26.360701 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2193/4466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:26.385035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8716b9b0-0d3f-4fff-bc91-c9e52cc7f397 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.395691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8716b9b0-0d3f-4fff-bc91-c9e52cc7f397 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.418577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8716b9b0-0d3f-4fff-bc91-c9e52cc7f397 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:31:26.563278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:26.572731 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ed2294c-29a7-4487-957c-2b93d40d8092 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.323484 Aug 30 04:31:26.573577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2274/4467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:26.594099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:26.597390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.603878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.604640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.605150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.606082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.607356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.608229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.710870 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71777f13-d82a-4aa8-af72-7bbe4fa84ade tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.121363 Aug 30 04:31:26.711981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2275/4468] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:26 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:31:26.720926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.722093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.729825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.730571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.731343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.732489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.733244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.734785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.763493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:26.765162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.scheduler.client.report [None req-8716b9b0-0d3f-4fff-bc91-c9e52cc7f397 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Deleted allocations for instance 842b3037-8504-4a9b-bf82-926d7bd94faf Aug 30 04:31:26.774029 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.api [None req-8716b9b0-0d3f-4fff-bc91-c9e52cc7f397 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] Instance Mapping does not exist while attempting local delete cleanup. Aug 30 04:31:26.775038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8716b9b0-0d3f-4fff-bc91-c9e52cc7f397 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf" status: 204 len: 0 microversion: 2.1 time: 0.396260 Aug 30 04:31:26.779689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2194/4469] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:31:26 2022] DELETE /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:31:26.786159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:26.787071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:26.790902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:26.824396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.825066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.825561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.826319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:26.826775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:26.827211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:26.990212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.000085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e69d2313-c1de-44e5-87c3-ea8d00b1a171 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.286150 Aug 30 04:31:27.015715 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2276/4470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:27.021728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6fe90cc-e732-4448-af52-cdfc1cb1b9e7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:27.023036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6fe90cc-e732-4448-af52-cdfc1cb1b9e7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:27.029279 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-c6fe90cc-e732-4448-af52-cdfc1cb1b9e7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6fe90cc-e732-4448-af52-cdfc1cb1b9e7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf HTTP/1.1 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '842b3037-8504-4a9b-bf82-926d7bd94faf'} Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:27.031090 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6fe90cc-e732-4448-af52-cdfc1cb1b9e7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6fe90cc-e732-4448-af52-cdfc1cb1b9e7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf" status: 404 len: 111 microversion: 2.1 time: 0.015347 Aug 30 04:31:27.045718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2277/4471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:27 2022] GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:27.061691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.072811 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-124918c7-1ed7-4564-8d7e-efec3e2288bb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1670 microversion: 2.1 time: 0.291818 Aug 30 04:31:27.073778 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2195/4472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:26 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1670 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:27.105026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-981599495", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "2f7235d3-0772-4dc5-b1a3-7959b9c9a850"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:27.166442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] validate_networks() for [('2f7235d3-0772-4dc5-b1a3-7959b9c9a850', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:31:27.584045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:31:27.585135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:31:27.587065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:31:27.588569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:31:27.589865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:31:27.611646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.612142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.612628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.614238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:27.614892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:27.615957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:27.638530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:27.644965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for user 9c91ba9579a24655a2c6842bac6e7034 and project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:27.658800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:31:27.661470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:31:27.719327 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5723741-c478-43af-897c-e4e73f6b22c3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619286 Aug 30 04:31:27.720974 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2278/4473] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:31:27.741407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1030fabf-50b3-43cb-a3fc-7600aa64ae10 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:27.742568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1030fabf-50b3-43cb-a3fc-7600aa64ae10 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:27.804181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1030fabf-50b3-43cb-a3fc-7600aa64ae10 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:27.812568 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1030fabf-50b3-43cb-a3fc-7600aa64ae10 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1214 microversion: 2.1 time: 0.084706 Aug 30 04:31:27.813140 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2196/4474] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:27 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:28.026246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.026971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.035244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.036092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.038128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.039036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.039660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.040249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.096537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.097156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.115030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.118752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.119782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.125831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.127340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.130003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.329206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.348038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a3c8a421-76cc-46bf-afef-d338467d2383 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1506 microversion: 2.1 time: 0.327402 Aug 30 04:31:28.348668 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2279/4475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:28.411010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.419694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f7840c1-0f83-4041-95ab-fb8be20fa39e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1675 microversion: 2.1 time: 0.327441 Aug 30 04:31:28.435669 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2197/4476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1675 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:28.841907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:28.844031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:28.851752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.865188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.866049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.866808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:28.867454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:28.867930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:28.958432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:28.968220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77936a26-f4b0-4d0f-b377-3f5c6b343dd4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1266 microversion: 2.1 time: 0.135727 Aug 30 04:31:28.976062 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2280/4477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:28 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:29.369645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:29.371041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.380855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.381639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.382336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.383221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.383994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.384603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.444663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:29.445831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.457284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.459342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.466057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.466824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.467301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.467736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.621848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.635932 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f7838b48-f651-4ff0-90c5-ba6e2421a507 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1486 microversion: 2.1 time: 0.270349 Aug 30 04:31:29.641434 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2198/4478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:29 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:29.682835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:29.691915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c817efd-b498-4c12-b909-3515be026a1d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.253364 Aug 30 04:31:29.692504 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2281/4479] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:29 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:29.715595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:29.719172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.726547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.727486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.728328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.729223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.729982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.730699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.801893 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a99dc29c-d0be-4b8a-a5a2-21064c309d76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 200 len: 324 microversion: 2.1 time: 0.091409 Aug 30 04:31:29.804121 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2199/4480] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:29 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 324 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:31:29.815108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:29.816827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:29.829355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.830207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.830873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.831890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:29.832605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:29.833276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:29.848400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2106834161", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:29.981981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] validate_networks() for [('bde43f05-3cea-450e-bf96-f5fd4f4811dc', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:31:30.132631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:30.147481 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da7fca95-a402-4baf-b4e1-196d4c1c0c4e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.337964 Aug 30 04:31:30.152266 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2282/4481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:29 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:30.160145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:30.160770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:30.193591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.194687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.196414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.199039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.199610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.200078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.571604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:30.592722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6cc81fea-e4b0-4cad-9fd9-e33adae45a97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.438553 Aug 30 04:31:30.593413 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2283/4482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:30 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:30.607333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:30.608039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:30.620242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.620847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.628980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.629958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.630516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.631950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.867670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:30.880933 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-961be85b-abca-4106-ad99-07bf80b0021b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.284594 Aug 30 04:31:30.882228 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2284/4483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:30 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:30.901984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:30.903405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:30.912263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.912767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.913214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.913987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.914449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.914889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.929528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:31:30.930558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:31:30.931205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:31:30.931804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:31:30.932371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:31:30.949691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.950762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.951232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:30.951976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:30.952438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:30.952880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.045855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Getting quotas for project 5948d1073d6643d299485a07f760966d. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:31.062598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Getting quotas for user 1216a651e1cb4d3b89341577c3f2ac75 and project 5948d1073d6643d299485a07f760966d. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:31.085638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:31:31.090375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:31:31.139531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.157992 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc7d2f9a-d347-4c1f-a2d0-60ee580a6a7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.257586 Aug 30 04:31:31.158777 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2285/4484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:30 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:31.170550 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c522dc85-b570-41db-8330-008579513ea4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.319343 Aug 30 04:31:31.170550 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2200/4485] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:31:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:31:31.182284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1edbc538-22bf-4491-9d40-a322a1e0fe0a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:31.184402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1edbc538-22bf-4491-9d40-a322a1e0fe0a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:31.205567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:31.206956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:31.219600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.220610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.220610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.221427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.221900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.222912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.284922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1edbc538-22bf-4491-9d40-a322a1e0fe0a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.303019 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1edbc538-22bf-4491-9d40-a322a1e0fe0a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1214 microversion: 2.1 time: 0.131885 Aug 30 04:31:31.307383 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2201/4486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:31 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:31.364860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-226480c3-d3d5-4100-9b47-fadd0adf67bb req-b19195ec-29e1-4e3e-9219-77b883e86b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f02cc8-3a97-4f72-8c1d-3dfb72f305ee", "tag": "f91e9971-d117-41b3-beff-c1574bf66b6f"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:31.407515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.417582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-226480c3-d3d5-4100-9b47-fadd0adf67bb req-b19195ec-29e1-4e3e-9219-77b883e86b04 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.419126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-226480c3-d3d5-4100-9b47-fadd0adf67bb req-b19195ec-29e1-4e3e-9219-77b883e86b04 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.419676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-226480c3-d3d5-4100-9b47-fadd0adf67bb req-b19195ec-29e1-4e3e-9219-77b883e86b04 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.435050 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8bd1bb77-6f9f-497f-bcbb-ca18102f88a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.259694 Aug 30 04:31:31.435471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-226480c3-d3d5-4100-9b47-fadd0adf67bb req-b19195ec-29e1-4e3e-9219-77b883e86b04 service nova] Creating event network-changed:f91e9971-d117-41b3-beff-c1574bf66b6f for instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee on n-h1-854925-5 Aug 30 04:31:31.442456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-226480c3-d3d5-4100-9b47-fadd0adf67bb req-b19195ec-29e1-4e3e-9219-77b883e86b04 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084208 Aug 30 04:31:31.443648 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2202/4487] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:31:31.458866 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2286/4488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:31 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:31.608100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-515878607", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "9e030e97-f3bc-405c-9a73-9eb51ff4d48e"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:31.623248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:31.624267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:31.631704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.632285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.632747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.633700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:31.634386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:31.635020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:31.702232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] validate_networks() for [('9e030e97-f3bc-405c-9a73-9eb51ff4d48e', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:31:31.918031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:31.931131 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-112cebaf-ef92-46c5-8029-78f99862abb5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.317441 Aug 30 04:31:31.933646 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2287/4489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:31 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:32.325836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.327182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.343483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.344010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.344455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.346583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.349862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.350382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.487334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.492682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:31:32.493173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:31:32.494022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:31:32.494431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:31:32.494841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:31:32.515841 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d3812d0-02d6-4aab-b686-3ec5cd6e87b1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1266 microversion: 2.1 time: 0.194030 Aug 30 04:31:32.516488 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2288/4490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:32.550095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.551114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.551972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.555471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.556538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.557248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.591727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:32.602032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for user d4d759ef2dc64a5e8ef6e883efc13d68 and project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:32.623089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:31:32.627367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:31:32.683531 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f53bd2f9-a2f6-4d9b-ad9a-8b7ade36caf9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079579 Aug 30 04:31:32.684652 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2203/4491] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:31:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:31:32.696870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cd2e5e6-a12c-4b6f-9201-b1dc3c839a1e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.697724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0cd2e5e6-a12c-4b6f-9201-b1dc3c839a1e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.770980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0cd2e5e6-a12c-4b6f-9201-b1dc3c839a1e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:32.778274 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0cd2e5e6-a12c-4b6f-9201-b1dc3c839a1e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1214 microversion: 2.1 time: 0.085628 Aug 30 04:31:32.791678 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2289/4492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:32.955793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:32.956727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:32.968578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.969288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.970482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:32.971351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:32.972074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:32.972663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.139977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.150781 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-546d25ff-3d25-4995-ae6f-75a18d9942a6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.199779 Aug 30 04:31:33.152150 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2204/4493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:32 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:33.540175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:33.541029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:33.553727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.556969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.557607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.558437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.559055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.577081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.749808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.760354 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dcbf3d12-7a54-412b-bc80-861125d07a83 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1272 microversion: 2.1 time: 0.224159 Aug 30 04:31:33.762007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2290/4494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:33 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:33.800559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:33.802271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:33.813317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.814800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.814987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.816900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:33.817360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:33.817801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:33.924716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:33.933537 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e95dedf7-81e1-4769-8ba1-4c175b3a5601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1266 microversion: 2.1 time: 0.137595 Aug 30 04:31:33.934116 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2205/4495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:33 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:34.172382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:34.173059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:34.182208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.183073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.183804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.184679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.186308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.186904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.363746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:34.372674 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfef184d-d1df-447f-ac13-fbd682e1dc91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.204319 Aug 30 04:31:34.373470 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2291/4496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:34 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:34.783655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:34.784356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:34.796132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.796654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.803582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.804486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.805015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.805552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.955641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:34.957179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:34.965283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.966928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.967612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:34.968528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:34.969208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:34.970260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.145426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:35.162378 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-48146e18-5938-4eaf-93e2-265b60ec054d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1272 microversion: 2.1 time: 0.210614 Aug 30 04:31:35.166061 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2292/4497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:34 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:35.339396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:35.350469 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-816d9189-101c-40ae-b48b-a89266d5dc37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1314 microversion: 2.1 time: 0.571267 Aug 30 04:31:35.351252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2206/4498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:34 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:35.395776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:35.396542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:35.410063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:35.414524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:35.415130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.417102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:35.421110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:35.422048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.677958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f9687b9b-3e74-4265-bb35-d82e0f974ce3 req-66b83930-9227-4071-9630-f863c528b935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9daf4876-b209-43c1-ac26-6cac5d5ef42a", "tag": "0d471830-3b50-419c-8337-e11d1e053cef"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:35.707861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f9687b9b-3e74-4265-bb35-d82e0f974ce3 req-66b83930-9227-4071-9630-f863c528b935 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:35.708352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f9687b9b-3e74-4265-bb35-d82e0f974ce3 req-66b83930-9227-4071-9630-f863c528b935 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:35.709053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f9687b9b-3e74-4265-bb35-d82e0f974ce3 req-66b83930-9227-4071-9630-f863c528b935 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:35.771443 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f9687b9b-3e74-4265-bb35-d82e0f974ce3 req-66b83930-9227-4071-9630-f863c528b935 service nova] Creating event network-changed:0d471830-3b50-419c-8337-e11d1e053cef for instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a on n-h2-854925-5 Aug 30 04:31:35.793090 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f9687b9b-3e74-4265-bb35-d82e0f974ce3 req-66b83930-9227-4071-9630-f863c528b935 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132534 Aug 30 04:31:35.802130 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2207/4499] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:35.982320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:35.995073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99b63e56-182a-4ea7-bd6d-1290eb46d4b1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.604621 Aug 30 04:31:35.996341 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2293/4500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:35 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:36.192860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:36.193698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:36.202546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.203387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.204126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.205075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.205823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.206496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.373697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:36.374606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:36.386397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:36.388508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.389189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.392713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.393688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.394325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.394949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.435005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.447776 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01853422-4c92-4fd6-b8e5-76f08f1ff6e7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.259985 Aug 30 04:31:36.450634 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2208/4501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:36 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:36.690414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:36.702402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0071c3d1-caa7-4c57-b7e7-004eb075b040 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1314 microversion: 2.1 time: 0.332350 Aug 30 04:31:36.719684 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2294/4502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:36 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:36.801862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-8f51a995-4a9a-4f9e-9bc9-843b51e08803 req-1ba16636-0393-469e-a6b7-c6d8c0e43ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2a98ffe-aaba-46a4-85f3-cb46d351ecb2", "tag": "100bb0f7-03a4-4af9-996e-ef98d871afa6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:36.821485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8f51a995-4a9a-4f9e-9bc9-843b51e08803 req-1ba16636-0393-469e-a6b7-c6d8c0e43ae9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:36.822141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8f51a995-4a9a-4f9e-9bc9-843b51e08803 req-1ba16636-0393-469e-a6b7-c6d8c0e43ae9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:36.822592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8f51a995-4a9a-4f9e-9bc9-843b51e08803 req-1ba16636-0393-469e-a6b7-c6d8c0e43ae9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:36.841500 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-8f51a995-4a9a-4f9e-9bc9-843b51e08803 req-1ba16636-0393-469e-a6b7-c6d8c0e43ae9 service nova] Creating event network-changed:100bb0f7-03a4-4af9-996e-ef98d871afa6 for instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 on n-h2-854925-5 Aug 30 04:31:36.847605 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-8f51a995-4a9a-4f9e-9bc9-843b51e08803 req-1ba16636-0393-469e-a6b7-c6d8c0e43ae9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049278 Aug 30 04:31:36.848592 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2209/4503] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:37.016252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.016976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.024923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.025469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.025936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.026638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.027091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.027830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.166947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:37.170674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:37.176961 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c404d42-1cd6-4a94-8ce6-133b70a55694 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.164593 Aug 30 04:31:37.177829 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2295/4504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:37 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:37.476585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.477299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.506765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.513722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.514404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.515344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.517993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.518437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.724833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:37.726111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:37.749161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:37.751995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.766254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.767541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:37.768539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:37.769318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:37.775180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.074871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.084480 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e693bd83-7a1b-4170-adb3-b86d1fd8f3dc tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.612045 Aug 30 04:31:38.091925 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2210/4505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:37 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:38.105747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-79f4206b-e768-42ef-bc2e-743f81ccfce1 req-5d84493e-5421-4d82-a0d1-302c2ac85ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f02cc8-3a97-4f72-8c1d-3dfb72f305ee", "name": "network-vif-plugged", "status": "completed", "tag": "f91e9971-d117-41b3-beff-c1574bf66b6f"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:38.122454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-79f4206b-e768-42ef-bc2e-743f81ccfce1 req-5d84493e-5421-4d82-a0d1-302c2ac85ab8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.123040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-79f4206b-e768-42ef-bc2e-743f81ccfce1 req-5d84493e-5421-4d82-a0d1-302c2ac85ab8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.123600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-79f4206b-e768-42ef-bc2e-743f81ccfce1 req-5d84493e-5421-4d82-a0d1-302c2ac85ab8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.142636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-79f4206b-e768-42ef-bc2e-743f81ccfce1 req-5d84493e-5421-4d82-a0d1-302c2ac85ab8 service nova] Creating event network-vif-plugged:f91e9971-d117-41b3-beff-c1574bf66b6f for instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee on n-h1-854925-5 Aug 30 04:31:38.150082 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-79f4206b-e768-42ef-bc2e-743f81ccfce1 req-5d84493e-5421-4d82-a0d1-302c2ac85ab8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055699 Aug 30 04:31:38.153874 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2211/4506] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:38.190466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.198723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:38.199513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:38.202453 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e424bc2-44bb-480a-84c6-43bb149d087e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1314 microversion: 2.1 time: 0.481494 Aug 30 04:31:38.203275 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2296/4507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:37 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:38.226856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.229921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.230698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.232347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:38.233680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:38.234337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:38.960865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:38.973541 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30f0bb30-5086-4a6c-8e7d-33bdf750574f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.779105 Aug 30 04:31:38.975033 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2212/4508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:38 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:39.111597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:39.112250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:39.125585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.126407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.127156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.128066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.128683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.129269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.226186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:39.227964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:39.242929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.243688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.244726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.245987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:39.248429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:39.249600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:39.591765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:39.611803 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0a21e7f-b695-4ae6-bedd-32fdf53c68ce tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1314 microversion: 2.1 time: 0.390511 Aug 30 04:31:39.627312 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2213/4509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:39 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:39.658129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:39.679796 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e9d725b-753f-4f43-be15-bb442d0012a8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.572843 Aug 30 04:31:39.711646 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2297/4510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:39 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:39.996723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:39.998119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:40.009154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.009941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.011351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.018350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.019114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.020291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.299696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.311630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5a7ff2be-f0a8-45d7-8a61-b0e038cdba63 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1314 microversion: 2.1 time: 0.318843 Aug 30 04:31:40.314790 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2214/4511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:39 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:40.632708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:40.633362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:40.644479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.645072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.645437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.647530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.648147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.648711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.703454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:40.705527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:40.712824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.713527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.714271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.715151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:40.715925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:40.716352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:40.855542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.865404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d533865c-e8c1-4cd4-8dd5-862341d2e163 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1314 microversion: 2.1 time: 0.236983 Aug 30 04:31:40.866770 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2298/4512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:40 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:40.920801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:40.935668 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-976f5224-3e3c-42ad-ac94-2b9e7809ac13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.235993 Aug 30 04:31:40.950599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2215/4513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:40 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:41.337290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:41.338226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:41.345090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.346381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.346987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.348213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.348699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.349303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.574594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:41.588875 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a9a748d8-775f-43dc-ad02-f3c54cfcca91 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1500 microversion: 2.1 time: 0.257502 Aug 30 04:31:41.589719 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2299/4514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:41 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1500 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:41.619096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:41.619096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:41.628569 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:31:41.629053 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 04:31:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee/action (ip 10.222.0.27) !!! Aug 30 04:31:41.633774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.634591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.635039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.635741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.636199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.636655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.722461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:41.743934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82f36738-02e2-4915-88b5-46e2aee36e06 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee/action" status: 202 len: 0 microversion: 2.1 time: 0.136476 Aug 30 04:31:41.747578 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2216/4515] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:41 2022] POST /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:31:41.756411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:41.757621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:41.768380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.769053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.769776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.770867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.771425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.771989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.888442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:41.889228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:41.924454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.924979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.925560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:41.926507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:41.927035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:41.927532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.006949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.017625 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f1532437-bf9d-4254-883d-53a2a9c070b6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1505 microversion: 2.1 time: 0.265365 Aug 30 04:31:42.019146 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2300/4516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:41 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:42.031813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:42.034811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:42.050434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.051565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.053989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.055155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.056785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.057757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.285742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.289627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:42.297388 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37e84fe5-12f8-456c-87bd-6b8a47b7d2fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.276174 Aug 30 04:31:42.297559 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a31cea6-01ca-4872-adf0-3545ec2c76c5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1314 microversion: 2.1 time: 0.414145 Aug 30 04:31:42.312963 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2217/4517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:41 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:42.314098 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2301/4518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:42 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:42.445612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a5d06593-9d23-4d7d-b58c-9481f78803b2 req-6be05cd7-0ed7-47ba-b172-66e9f5db8fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daf4876-b209-43c1-ac26-6cac5d5ef42a", "name": "network-vif-plugged", "status": "completed", "tag": "0d471830-3b50-419c-8337-e11d1e053cef"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:42.459687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a5d06593-9d23-4d7d-b58c-9481f78803b2 req-6be05cd7-0ed7-47ba-b172-66e9f5db8fdb service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:42.462201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a5d06593-9d23-4d7d-b58c-9481f78803b2 req-6be05cd7-0ed7-47ba-b172-66e9f5db8fdb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:42.462706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a5d06593-9d23-4d7d-b58c-9481f78803b2 req-6be05cd7-0ed7-47ba-b172-66e9f5db8fdb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:42.489440 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a5d06593-9d23-4d7d-b58c-9481f78803b2 req-6be05cd7-0ed7-47ba-b172-66e9f5db8fdb service nova] Creating event network-vif-plugged:0d471830-3b50-419c-8337-e11d1e053cef for instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a on n-h2-854925-5 Aug 30 04:31:42.496460 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a5d06593-9d23-4d7d-b58c-9481f78803b2 req-6be05cd7-0ed7-47ba-b172-66e9f5db8fdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057477 Aug 30 04:31:42.497402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2218/4519] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:43.045283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.048204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.063062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:43.076352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.076910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.077531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.078328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.078885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.079788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.254475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.265604 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a461846a-ca61-46ee-8e91-40202731f0a7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1485 microversion: 2.1 time: 0.228421 Aug 30 04:31:43.266217 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2302/4520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1485 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:43.302147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:43.302147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=26 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:43.302147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.302770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.313867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.322087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.322728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.326036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.326519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.327280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.327798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.328196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.338183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.338685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.339134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.339862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.340319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.340754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.384549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:31:43.498624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2cfb068d-296e-441c-ab7e-0b2b2ddb8000 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 204 len: 0 microversion: 2.1 time: 0.204261 Aug 30 04:31:43.499492 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2219/4521] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:31:43 2022] DELETE /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:31:43.505696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.506818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.514321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.514923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.515457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.516560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.517529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.518174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.532744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.541035 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3aee44c4-d44d-4f5e-89e4-c85590ce09cb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1314 microversion: 2.1 time: 0.225570 Aug 30 04:31:43.553837 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2303/4522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:43.560688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:43.561562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:43.568420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.568844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.569293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.570008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:43.570646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:43.571077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:43.731223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.740287 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0e4a5245-86a8-4dbd-974f-da621ea982e1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.238953 Aug 30 04:31:43.741114 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2220/4523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:43.759715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:43.775172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e57fa950-cb77-42ab-8787-ff6f0c3203e2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1491 microversion: 2.1 time: 0.219559 Aug 30 04:31:43.776267 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2304/4524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:43 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1491 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:44.532154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-98b6ee3b-0322-4d03-ba6d-259a665ace19 req-c4b47a82-720a-4b33-8849-62a6942e1e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a98ffe-aaba-46a4-85f3-cb46d351ecb2", "name": "network-vif-plugged", "status": "completed", "tag": "100bb0f7-03a4-4af9-996e-ef98d871afa6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:44.543061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-98b6ee3b-0322-4d03-ba6d-259a665ace19 req-c4b47a82-720a-4b33-8849-62a6942e1e87 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.543956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-98b6ee3b-0322-4d03-ba6d-259a665ace19 req-c4b47a82-720a-4b33-8849-62a6942e1e87 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.544560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-98b6ee3b-0322-4d03-ba6d-259a665ace19 req-c4b47a82-720a-4b33-8849-62a6942e1e87 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.557125 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-98b6ee3b-0322-4d03-ba6d-259a665ace19 req-c4b47a82-720a-4b33-8849-62a6942e1e87 service nova] Creating event network-vif-plugged:100bb0f7-03a4-4af9-996e-ef98d871afa6 for instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 on n-h2-854925-5 Aug 30 04:31:44.562421 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-98b6ee3b-0322-4d03-ba6d-259a665ace19 req-c4b47a82-720a-4b33-8849-62a6942e1e87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035115 Aug 30 04:31:44.563899 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2221/4525] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:44.568501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:44.569502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:44.577581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.578550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.579185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.580555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.582909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.583520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.763227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:44.763941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:44.776476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.778238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.780844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.781658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.782758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.783207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.811082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:44.826657 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e102e3c-763b-40dd-8fc4-f36a5c7725e5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1499 microversion: 2.1 time: 0.263480 Aug 30 04:31:44.828693 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2305/4526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:44 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1499 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:44.838605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:44.840300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:44.852776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.852776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.853086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:44.856669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:44.858918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:44.859443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.002195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:45.010609 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-94295a4b-e64e-4a75-be15-4073b92a99e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.251694 Aug 30 04:31:45.011437 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2222/4527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:44 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:45.016489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:45.019482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:45.025724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.026418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.027001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.027927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.028555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.029144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.065535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lazy-loading 'flavor' on Instance uuid 9daf4876-b209-43c1-ac26-6cac5d5ef42a {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:31:45.072994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:45.084528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-74bb7810-3edb-4be3-bf3d-b12911f5f8d0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1491 microversion: 2.1 time: 0.255882 Aug 30 04:31:45.090469 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2306/4528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:44 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1491 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:45.166173 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e910c111-f63d-4d03-85a7-524b75250d4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "POST /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a/action" status: 200 len: 32 microversion: 2.1 time: 0.153236 Aug 30 04:31:45.167451 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2223/4529] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:45 2022] POST /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:31:45.178640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:45.179740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:45.197163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.200919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.201858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.202795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:45.206130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:45.206763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:45.354511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:45.363666 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41889701-d490-41bf-a307-78ea9168747f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.190830 Aug 30 04:31:45.364451 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2307/4530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:45 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:46.035820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.037678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.046800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.048490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.049574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.050979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.052482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.053417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.104888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.105441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.118469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.119215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.120639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.123116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.123765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.125102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.316177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.324693 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db500376-c17d-4ba8-9330-a4c229de2f64 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 200 len: 1449 microversion: 2.1 time: 0.223694 Aug 30 04:31:46.329583 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2308/4531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:46 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 1449 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:46.348862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0eb23d68-2d71-4e26-b431-d0385449a6ff req-989247ea-b4ed-429f-9524-2973e8615c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f02cc8-3a97-4f72-8c1d-3dfb72f305ee", "name": "network-vif-deleted", "tag": "f91e9971-d117-41b3-beff-c1574bf66b6f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:46.384239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0eb23d68-2d71-4e26-b431-d0385449a6ff req-989247ea-b4ed-429f-9524-2973e8615c5e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.384720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0eb23d68-2d71-4e26-b431-d0385449a6ff req-989247ea-b4ed-429f-9524-2973e8615c5e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.385152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0eb23d68-2d71-4e26-b431-d0385449a6ff req-989247ea-b4ed-429f-9524-2973e8615c5e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.402100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.416174 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-97d50fe4-7c3c-4c15-9a03-e618b18f69c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1314 microversion: 2.1 time: 0.388146 Aug 30 04:31:46.420920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0eb23d68-2d71-4e26-b431-d0385449a6ff req-989247ea-b4ed-429f-9524-2973e8615c5e service nova] Creating event network-vif-deleted:f91e9971-d117-41b3-beff-c1574bf66b6f for instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee on n-h1-854925-5 Aug 30 04:31:46.422408 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2224/4532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:46 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:46.448554 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0eb23d68-2d71-4e26-b431-d0385449a6ff req-989247ea-b4ed-429f-9524-2973e8615c5e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097723 Aug 30 04:31:46.448841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.449151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2309/4533] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:31:46.451444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.461894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.464818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.466979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.471019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.471612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.473417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.476233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.481490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.498020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.500922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.501646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.502574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.505538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.506177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.585384 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a50b9137-1e32-48df-a27f-3e422f9e92ee tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.160768 Aug 30 04:31:46.589769 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2225/4534] 10.222.0.27 () {60 vars in 1343 bytes} [Tue Aug 30 04:31:46 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1/os-volume_attachments => generated 25 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:46.690440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.691160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.699041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:46.700638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.701301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.701994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.703131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.704572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.705170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.706632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:46.716250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4f72272-a796-4749-834a-c5aa0d7f2f74 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.254354 Aug 30 04:31:46.717130 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2310/4535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:46 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:46.767451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:31:46.891887 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a221571-190a-4d92-bccb-46b3e09e8800 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 204 len: 0 microversion: 2.20 time: 0.205876 Aug 30 04:31:46.912655 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2226/4536] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:31:46 2022] DELETE /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:31:46.923990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:46.924852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:46.933381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.934261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.934868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:46.935778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:46.936410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:46.937122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.099060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.122392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.124042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.125490 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16806905-5f90-45ba-8792-b325363f5ac7 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.207409 Aug 30 04:31:47.126905 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2311/4537] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:46 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:47.354705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:47.355427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:47.362739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.363227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.363668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.364373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.364828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.365256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.380078 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee HTTP/1.1 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '17f02cc8-3a97-4f72-8c1d-3dfb72f305ee'} Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:47.381690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7dbea532-8979-4da6-a74b-c509cdc5d81f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 404 len: 111 microversion: 2.1 time: 0.032926 Aug 30 04:31:47.392677 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2227/4538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:47 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:31:47.440421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:47.441050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:47.447735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.448226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.448851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.449812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.450442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.451045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.511890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1897989496", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "2f7235d3-0772-4dc5-b1a3-7959b9c9a850"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:47.589208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] validate_networks() for [('2f7235d3-0772-4dc5-b1a3-7959b9c9a850', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:31:47.617822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:47.627258 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2d45c5b-011c-4a4c-8a09-78af938eb2a1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1502 microversion: 2.1 time: 0.191342 Aug 30 04:31:47.627853 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2312/4539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:47 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:47.649783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-342606ef-48f1-4a1f-9eca-5ad03f7aaa83 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:47.657043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-342606ef-48f1-4a1f-9eca-5ad03f7aaa83 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.658215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-342606ef-48f1-4a1f-9eca-5ad03f7aaa83 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.658931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-342606ef-48f1-4a1f-9eca-5ad03f7aaa83 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.685195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:47.691086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-342606ef-48f1-4a1f-9eca-5ad03f7aaa83 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Going to try to stop instance {{(pid=122403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:31:47.757038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-342606ef-48f1-4a1f-9eca-5ad03f7aaa83 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2/action" status: 202 len: 0 microversion: 2.1 time: 0.111795 Aug 30 04:31:47.757957 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2313/4540] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:31:47 2022] POST /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:31:47.764007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:47.764727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:47.772603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.773040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.773525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:47.774257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:47.774722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:47.775242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.067846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:48.079901 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4fe34fdb-84f3-4101-a983-9bb2d6f56c96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.320569 Aug 30 04:31:48.080516 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2314/4541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:47 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:48.090920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:48.091584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:48.103690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.104187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.104630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.105372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.112343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.112803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.170041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:31:48.170775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:31:48.171273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:31:48.172257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:31:48.172894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:31:48.184403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.184904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.185939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.186781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.187354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.187889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.207918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:31:48.213938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for user 9c91ba9579a24655a2c6842bac6e7034 and project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:31:48.227992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:31:48.230527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:31:48.298600 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8db7456a-2eca-48c6-97f5-58bda91201b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.791645 Aug 30 04:31:48.299715 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2228/4542] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:31:48.306050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:48.306952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:48.316238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.317186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.318198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.319208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:48.320194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:48.320961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:48.417101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:48.432275 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b7183f1-16fa-4a46-8ae8-62bfa76018ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.349599 Aug 30 04:31:48.433872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2315/4543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:48 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:48.446595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61dea394-1cf3-4f01-bb63-32f9cc66c3dc tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:48.447650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-61dea394-1cf3-4f01-bb63-32f9cc66c3dc tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:48.568764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-61dea394-1cf3-4f01-bb63-32f9cc66c3dc tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:48.580579 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61dea394-1cf3-4f01-bb63-32f9cc66c3dc tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1215 microversion: 2.1 time: 0.144049 Aug 30 04:31:48.594880 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2316/4544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:48 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:48.674999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:48.686802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:48.688947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:48.690225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf170ea5-6a44-4fcd-b961-ca5c9bb1222f tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1724 microversion: 2.20 time: 0.389325 Aug 30 04:31:48.691543 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2229/4545] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:48 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:49.103477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:49.104426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:49.120864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.121728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.124455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.125554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.127744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.129500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.435337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.450037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fda77676-aab1-4c5a-8e7c-2328980c2024 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.352386 Aug 30 04:31:49.455558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:49.456377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:49.466881 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2317/4546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:49 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:49.474948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.476367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.478456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.479412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.480633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.482580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.606188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:49.607353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:49.642821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.653038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.653556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.654330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.658059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.661746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.837082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.852514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d088209c-e33c-4a3a-8180-a7d0e1081b35 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1267 microversion: 2.1 time: 0.249295 Aug 30 04:31:49.853409 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2318/4547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:49 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:49.855328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:49.858539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:49.861280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:49.862258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:49.870785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.871642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.872177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-775c7852-aa9c-4343-b4c3-546d8f369632 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.421712 Aug 30 04:31:49.872603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.873952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:49.874644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:49.875432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:49.885365 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2230/4548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:49 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:50.033403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:50.046037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:50.051571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '32771c45ac9f4c43a23b413c9cbf4437', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8441920631f94e39a79e27e6ce5e0250', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:50.055500 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c83c2528-eafb-48bb-a58f-97a3482b5846 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 200 len: 1657 microversion: 2.20 time: 0.198068 Aug 30 04:31:50.056491 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2319/4549] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:49 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 1657 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:31:50.117898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-16d62633-6bc2-4e60-8a0b-ef01c5b84a65 req-b55fd930-26ea-4326-b8d2-12c7406f15ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16adb378-53ec-46b0-a31f-4fe4e38dd2d1", "name": "network-vif-deleted", "tag": "1892a3e5-332c-42ee-b372-a61fac0274ec"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:50.152446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-16d62633-6bc2-4e60-8a0b-ef01c5b84a65 req-b55fd930-26ea-4326-b8d2-12c7406f15ac service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.156042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-16d62633-6bc2-4e60-8a0b-ef01c5b84a65 req-b55fd930-26ea-4326-b8d2-12c7406f15ac service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.156775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-16d62633-6bc2-4e60-8a0b-ef01c5b84a65 req-b55fd930-26ea-4326-b8d2-12c7406f15ac service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.198123 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-16d62633-6bc2-4e60-8a0b-ef01c5b84a65 req-b55fd930-26ea-4326-b8d2-12c7406f15ac service nova] Creating event network-vif-deleted:1892a3e5-332c-42ee-b372-a61fac0274ec for instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 on n-h2-854925-5 Aug 30 04:31:50.214565 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-16d62633-6bc2-4e60-8a0b-ef01c5b84a65 req-b55fd930-26ea-4326-b8d2-12c7406f15ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104679 Aug 30 04:31:50.216297 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2231/4550] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:50.475629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:50.477507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:50.511113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.512145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.513076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.515828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.516810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.517550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.791652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:50.806724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21623827-e8ad-4ecf-9c37-749e79789fd1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.335813 Aug 30 04:31:50.807953 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2320/4551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:50 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:50.879726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:50.880630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:50.893411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.896595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.907247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.907472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:50.907943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:50.909070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.910084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.911031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.934131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.934684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.935132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:50.936726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:50.937207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:50.937722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:51.092557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:51.105404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4821f8bb-d348-4467-83fe-541544fcc1c8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1273 microversion: 2.1 time: 0.231625 Aug 30 04:31:51.109697 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2232/4552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:50 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:51.121257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:51.135183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:51.149178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:51.157193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:51.166001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:51.166826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:51.167391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:51.167843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:51.210253 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] HTTP exception thrown: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Request method failure captured: Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 HTTP/1.1 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZCi14L-yO2eA-8SLR3KA7uRHnLlMmBQ3kocKMRpEj9zvaScv2feSjaH7K8eUTvxTYBclt9628VF3dS5d9uCalDyR1NAPhTEq-HMPbAmvOSp22U14UerATKJKhu-hWaErf3xw-6Jp8ZVIf_PMrd9mOsqFr93hI2d2pgbBzkLt3_2wHo Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8441920631f94e39a79e27e6ce5e0250", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}] Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 32771c45ac9f4c43a23b413c9cbf4437 Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '16adb378-53ec-46b0-a31f-4fe4e38dd2d1'} Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:51.211926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:31:51.217005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Returning 404 to user: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:51.226817 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01e46334-8a93-4284-a4da-753a40d2d557 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 404 len: 111 microversion: 2.20 time: 0.109299 Aug 30 04:31:51.227629 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2233/4553] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:51 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:31:51.247608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b6aa618-2a32-4a3e-8c4b-03b9a9e40651 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '.version_select at 0x7fe969223280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:51.294867 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b6aa618-2a32-4a3e-8c4b-03b9a9e40651 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558878679" status: 204 len: 0 microversion: 2.20 time: 0.058905 Aug 30 04:31:51.297208 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2234/4554] 10.222.0.27 () {60 vars in 1259 bytes} [Tue Aug 30 04:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558878679 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:31:51.367661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:51.377783 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af52491f-3e4c-42e7-a33d-2362d7ae86c7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.481604 Aug 30 04:31:51.381841 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2321/4555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:50 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:51.837073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:51.851025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:51.884505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:51.886680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:51.887385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:51.889898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:51.892354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:51.893069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.128925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:52.129651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:52.149418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.152327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.153001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.154519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.162957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.163735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.231448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.250402 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0692e565-cb18-41af-a028-cbac97a47208 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.420929 Aug 30 04:31:52.251606 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2235/4556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:51 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:52.407887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:52.408815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:52.426388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.427637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.429356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.432684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:52.433311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:52.433914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:52.533563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.542282 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e556df64-6b39-42b0-a329-2de79cc279ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1315 microversion: 2.1 time: 0.417228 Aug 30 04:31:52.560886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2322/4557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:52 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:52.723734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:52.738056 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee49fd88-0dcb-451b-a41b-f11cd0a16d0d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.334825 Aug 30 04:31:52.750302 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2236/4558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:52 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:53.090978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4e3490fa-8eaf-47a7-aa89-75940fa60ee8 req-185bd4c6-974f-486f-8f39-880c3434b0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "971ab824-5282-4e7c-8cfb-ffaa195156c4", "tag": "23f42608-02e9-48e3-b5de-c188fa36665e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:53.101890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4e3490fa-8eaf-47a7-aa89-75940fa60ee8 req-185bd4c6-974f-486f-8f39-880c3434b0ca service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.102643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4e3490fa-8eaf-47a7-aa89-75940fa60ee8 req-185bd4c6-974f-486f-8f39-880c3434b0ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.103233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4e3490fa-8eaf-47a7-aa89-75940fa60ee8 req-185bd4c6-974f-486f-8f39-880c3434b0ca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.120207 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4e3490fa-8eaf-47a7-aa89-75940fa60ee8 req-185bd4c6-974f-486f-8f39-880c3434b0ca service nova] Creating event network-changed:23f42608-02e9-48e3-b5de-c188fa36665e for instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 on n-h1-854925-5 Aug 30 04:31:53.125303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4e3490fa-8eaf-47a7-aa89-75940fa60ee8 req-185bd4c6-974f-486f-8f39-880c3434b0ca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038638 Aug 30 04:31:53.126634 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2323/4559] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:31:53.278693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:53.279922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:53.288569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.298683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.299406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.300335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.300806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.301234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.553271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:53.562812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b71b0df7-d643-440f-8928-d9437437bab7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.288627 Aug 30 04:31:53.566378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:53.568292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:53.576254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.576953 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2237/4560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:53 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:53.577297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.578295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.579555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.580049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.581012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.762844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:53.765056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:53.773218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.774122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.774784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.776565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:53.777598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:53.778322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:53.834646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:53.848506 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25a2092d-1e2d-47b7-a51c-09df31fbf31e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1315 microversion: 2.1 time: 0.288182 Aug 30 04:31:53.850577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2324/4561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:53 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:54.251551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:54.251551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9dd8c4da-0547-44f5-b538-d65cdc13a472 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.293544 Aug 30 04:31:54.251551 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2238/4562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:53 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:54.588946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:54.590537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:54.603699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.604477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.605470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.607436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.608310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.608943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.789817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:54.801514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4cbbc734-e264-4292-bd55-e3ba605f30b5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.220708 Aug 30 04:31:54.818537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2325/4563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:54 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:54.871478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:54.872095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:54.880956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.885133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.887380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:54.889197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:54.889800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:54.890479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.072383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:55.072798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:55.085447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.085953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.086406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.091828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.101388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.101388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.111009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:55.133518 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-40319803-64fc-4d54-ba4b-4d3256024f1a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1315 microversion: 2.1 time: 0.265912 Aug 30 04:31:55.135261 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2239/4564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:54 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:55.275000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:55.284558 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a1490c29-d8cc-4cc9-b75d-c5c4eeffc323 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.216205 Aug 30 04:31:55.285164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2326/4565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:55 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:55.827096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:55.827322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:55.836950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.838322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.838954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:55.839780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:55.840306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:55.840732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.002036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:56.010113 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-98b2b76c-6e66-4083-9c8c-fa671c3b4ddb tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.187952 Aug 30 04:31:56.011017 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2240/4566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:55 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:56.137875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:56.138436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:56.146595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.146808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.147363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.147796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.148637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.148637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.161171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:56.161831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:56.173621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.174589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.175229 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] HTTP exception thrown: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.175363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.176513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Request method failure captured: Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 HTTP/1.1 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCi14L-yO2eA-8SLR3KA7uRHnLlMmBQ3kocKMRpEj9zvaScv2feSjaH7K8eUTvxTYBclt9628VF3dS5d9uCalDyR1NAPhTEq-HMPbAmvOSp22U14UerATKJKhu-hWaErf3xw-6Jp8ZVIf_PMrd9mOsqFr93hI2d2pgbBzkLt3_2wHo Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8441920631f94e39a79e27e6ce5e0250", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}] Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 32771c45ac9f4c43a23b413c9cbf4437 Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '16adb378-53ec-46b0-a31f-4fe4e38dd2d1'} Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:56.177088 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Returning 404 to user: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ade3ba7e-54f8-473e-acbe-5516baff6e37 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 404 len: 111 microversion: 2.20 time: 0.044986 Aug 30 04:31:56.182393 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2327/4567] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:31:56 2022] DELETE /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:31:56.186106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.186831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.186961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:56.187654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: 16adb378-53ec-46b0-a31f-4fe4e38dd2d1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:56.194298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.194790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.195229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.196027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.196367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.196793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.226160 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] HTTP exception thrown: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Request method failure captured: Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 HTTP/1.1 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCi14L-yO2eA-8SLR3KA7uRHnLlMmBQ3kocKMRpEj9zvaScv2feSjaH7K8eUTvxTYBclt9628VF3dS5d9uCalDyR1NAPhTEq-HMPbAmvOSp22U14UerATKJKhu-hWaErf3xw-6Jp8ZVIf_PMrd9mOsqFr93hI2d2pgbBzkLt3_2wHo Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8441920631f94e39a79e27e6ce5e0250", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}] Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 32771c45ac9f4c43a23b413c9cbf4437 Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '16adb378-53ec-46b0-a31f-4fe4e38dd2d1'} Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.228023 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. Aug 30 04:31:56.232126 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:31:56.234122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Returning 404 to user: Instance 16adb378-53ec-46b0-a31f-4fe4e38dd2d1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:31:56.235742 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d2ed816e-9561-41d0-91ec-701daa96cf27 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1" status: 404 len: 111 microversion: 2.20 time: 0.052026 Aug 30 04:31:56.246073 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2328/4568] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:31:56 2022] GET /compute/v2.1/servers/16adb378-53ec-46b0-a31f-4fe4e38dd2d1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:31:56.307175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:56.307808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:56.324131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.337904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.340190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.346316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:56.347056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:56.347893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:56.589185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:56.602959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-420b2021-9ab5-4590-9ec2-7674dc7f547c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1315 microversion: 2.1 time: 0.444417 Aug 30 04:31:56.604162 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2241/4569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:56 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:56.653080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:56.668683 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1e4e61ab-6179-4578-b04a-412f12681ea9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.365982 Aug 30 04:31:56.669288 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2329/4570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:56 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:57.032327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:57.034012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:57.059255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.062293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.063494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.066954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.067552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.069271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.238046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:57.247711 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-feda5573-592c-4736-a474-7581eb57bd4e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.219483 Aug 30 04:31:57.249072 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2242/4571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:57 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:57.630446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:57.631678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:57.644169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.644916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.645622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.646544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.647572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.648776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.691970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:57.692601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:57.705120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.705932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.706589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.707533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:57.708189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:57.709102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:57.931394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:57.944852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8d5dae8e-c155-4614-9183-34ccccdd4f2d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1315 microversion: 2.1 time: 0.317077 Aug 30 04:31:57.958220 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2330/4572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:57 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:57.991289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:58.000614 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a03059cd-5809-4276-b1a6-d5ac05c215dd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.312159 Aug 30 04:31:58.002236 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2243/4573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:57 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:58.273659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:58.274852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:58.285201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:58.286360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:58.287044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:58.291771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:58.293002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:58.293682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:58.464023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:58.472617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:58.474020 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-418f849f-90f2-4e18-8f59-fdcca4dcc9e7 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.206962 Aug 30 04:31:58.475274 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2331/4574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:58 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:58.968913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:58.970377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:58.977372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:58.978239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:58.980280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:58.980914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:58.981404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:58.982438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:58.983154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:58.983739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.024960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:59.026525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:59.040792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:31:59.053714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.058911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.059383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.060156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.060644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.061409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.288365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:59.298679 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b787e852-327c-427a-affb-b62edf1427df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1315 microversion: 2.1 time: 0.333931 Aug 30 04:31:59.312503 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2244/4575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:58 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:59.374999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:59.384589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f87fc91a-17c4-464c-9e50-ffafb7803998 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.364288 Aug 30 04:31:59.399579 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2332/4576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:59 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:31:59.498199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:31:59.499462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:31:59.507218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.508041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.508965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.509934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.510607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.511247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.718455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:31:59.728845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68b60593-1dd1-426a-98a5-42fdc538f56e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.234528 Aug 30 04:31:59.730670 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2245/4577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:31:59 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:31:59.748273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a97071e6-0d02-4ddc-b61d-34f7b232241d req-5f83fd93-591a-4b65-bef6-392cd4a572f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ab824-5282-4e7c-8cfb-ffaa195156c4", "name": "network-vif-plugged", "status": "completed", "tag": "23f42608-02e9-48e3-b5de-c188fa36665e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:31:59.758323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a97071e6-0d02-4ddc-b61d-34f7b232241d req-5f83fd93-591a-4b65-bef6-392cd4a572f4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:31:59.759047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a97071e6-0d02-4ddc-b61d-34f7b232241d req-5f83fd93-591a-4b65-bef6-392cd4a572f4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:31:59.759702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a97071e6-0d02-4ddc-b61d-34f7b232241d req-5f83fd93-591a-4b65-bef6-392cd4a572f4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:31:59.773789 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a97071e6-0d02-4ddc-b61d-34f7b232241d req-5f83fd93-591a-4b65-bef6-392cd4a572f4 service nova] Creating event network-vif-plugged:23f42608-02e9-48e3-b5de-c188fa36665e for instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 on n-h1-854925-5 Aug 30 04:31:59.787169 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a97071e6-0d02-4ddc-b61d-34f7b232241d req-5f83fd93-591a-4b65-bef6-392cd4a572f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042633 Aug 30 04:31:59.787872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2333/4578] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:00.319987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:00.320614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:00.328277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.329692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.330448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.331325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.331942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.332531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.408400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:00.409673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:00.425149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.426784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.429606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.430673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.431355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.432514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.552599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:00.563608 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c9dc9ee6-0407-4d6b-be20-191f7156ba40 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1315 microversion: 2.1 time: 0.245309 Aug 30 04:32:00.564350 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2246/4579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:00 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:00.663217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:00.671714 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e2662d5-3785-48bb-b9d8-65499cc1c766 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.268821 Aug 30 04:32:00.673370 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2334/4580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:00 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:00.751797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:00.752299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:00.752731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:00.753599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:00.761850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.762367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.762665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.762805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.763496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.763731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.763951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.764384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.764820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.765788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.767019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.767893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.798402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] HTTP exception thrown: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Request method failure captured: Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab HTTP/1.1 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCi14L-yO2eA-8SLR3KA7uRHnLlMmBQ3kocKMRpEj9zvaScv2feSjaH7K8eUTvxTYBclt9628VF3dS5d9uCalDyR1NAPhTEq-HMPbAmvOSp22U14UerATKJKhu-hWaErf3xw-6Jp8ZVIf_PMrd9mOsqFr93hI2d2pgbBzkLt3_2wHo Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8441920631f94e39a79e27e6ce5e0250", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}] Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 32771c45ac9f4c43a23b413c9cbf4437 Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b9e5a44f-46b4-420a-a56d-4bcdaabc66ab'} Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:00.806249 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.811098 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.813430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Returning 404 to user: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:00.814557 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b9f90e0-20c4-48bf-97ef-d00c6a761573 tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 404 len: 111 microversion: 2.20 time: 0.067266 Aug 30 04:32:00.815639 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2335/4581] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:32:00 2022] DELETE /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:32:00.823293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:00.824225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] [instance: b9e5a44f-46b4-420a-a56d-4bcdaabc66ab] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:00.832099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.832824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.833490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.834682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:00.836654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:00.837465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:00.855415 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] HTTP exception thrown: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Request method failure captured: Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab HTTP/1.1 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZCi14L-yO2eA-8SLR3KA7uRHnLlMmBQ3kocKMRpEj9zvaScv2feSjaH7K8eUTvxTYBclt9628VF3dS5d9uCalDyR1NAPhTEq-HMPbAmvOSp22U14UerATKJKhu-hWaErf3xw-6Jp8ZVIf_PMrd9mOsqFr93hI2d2pgbBzkLt3_2wHo Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8441920631f94e39a79e27e6ce5e0250", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8441920631f94e39a79e27e6ce5e0250"}]}] Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 8441920631f94e39a79e27e6ce5e0250 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1738418208 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 32771c45ac9f4c43a23b413c9cbf4437 Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1738418208-project Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b9e5a44f-46b4-420a-a56d-4bcdaabc66ab'} Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.857706 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. Aug 30 04:32:00.862526 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:00.863915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] Returning 404 to user: Instance b9e5a44f-46b4-420a-a56d-4bcdaabc66ab could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:00.865073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31a64b83-c728-4446-adc0-11033c37fb7c tempest-AttachVolumeShelveTestJSON-1738418208 tempest-AttachVolumeShelveTestJSON-1738418208-project] 10.222.0.27 "GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab" status: 404 len: 111 microversion: 2.20 time: 0.045640 Aug 30 04:32:00.865845 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2336/4582] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:00 2022] GET /compute/v2.1/servers/b9e5a44f-46b4-420a-a56d-4bcdaabc66ab => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:32:00.979787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:00.989950 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22e47312-2fa8-4f76-b570-84dd8718e4c6 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.242236 Aug 30 04:32:00.991011 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2247/4583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:00 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:01.591017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:01.592325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:01.603731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.604608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.605623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.606635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.607326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.608130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.697358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:01.699614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:01.721777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.729873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.730667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.733871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.734721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.735375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.827477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.843301 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bca5d8fa-8e70-4ca0-9541-541d83c91d25 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1501 microversion: 2.1 time: 0.262731 Aug 30 04:32:01.849759 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2337/4584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:01 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1501 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:01.875618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:01.876765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:01.887848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.888352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.894937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.895771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:01.896256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:01.896853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:01.949962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lazy-loading 'flavor' on Instance uuid 971ab824-5282-4e7c-8cfb-ffaa195156c4 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:32:01.980379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:01.994180 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ada35b5-8880-4784-861b-2788a702ada3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.304480 Aug 30 04:32:02.005764 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2248/4585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:01 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:02.025011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.026341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.038696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.039285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.039743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.040487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.040950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.041428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.276999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:02.280163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:02.288207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-47549653-359e-48c7-970d-ecda6b9156ee tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.277500 Aug 30 04:32:02.293387 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2249/4586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:02.329771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f9a67dc-a257-4591-8b76-3ff0ef3ffe48 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4/action" status: 202 len: 0 microversion: 2.1 time: 0.457839 Aug 30 04:32:02.337005 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2338/4587] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:01 2022] POST /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:02.342315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:02.342931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:02.354977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.355515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.356056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.359148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:02.360597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:02.362497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:02.551613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:02.574825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6fb2bf27-2d96-4a04-a8e6-409dcf681584 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.235992 Aug 30 04:32:02.589719 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2250/4588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:02 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:03.022896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:03.024331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:03.040550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.041273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.042494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.045594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.046241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.046964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.312142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:03.312894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:03.326734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.332655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.332655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.332655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.332655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.334298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.754907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:03.763190 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-615e9fe8-2c00-47d5-81ab-3d802ab3ea13 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.454903 Aug 30 04:32:03.769220 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2251/4589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:03 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:03.788268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:03.793520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:03.809076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.809909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.810540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.811475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:03.824741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:03.824741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:03.838551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:03.851308 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06d81d92-6549-4f1b-8d67-cc6d093226e2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.834843 Aug 30 04:32:03.863310 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2339/4590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:03 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:04.136421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:04.149488 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77888beb-1bab-437f-b330-4b05aa89018f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.378613 Aug 30 04:32:04.153710 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2252/4591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:03 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:04.820745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:04.821493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:04.829284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.830014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.830992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.832303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.833007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.833714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.875033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:04.877249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:04.885297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.886183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.887094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:04.887998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:04.888635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:04.889224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.174808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.183469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.183737 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7c827fe-67b4-44df-b333-8401b3ce8c59 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.312685 Aug 30 04:32:05.190075 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2253/4592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:04 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:05.198549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:05.199171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:05.207974 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81e23f1b-caaf-4e99-9607-dc05f1ba1417 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.392066 Aug 30 04:32:05.212638 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2340/4593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:04 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:05.216179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.216800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.217677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.233120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:05.233985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:05.235373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:05.652404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:05.665045 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fdde074c-9512-4ab5-9393-e3b8c94ecc26 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.473799 Aug 30 04:32:05.666391 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2254/4594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:05 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:06.208268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.209880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.246749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.247353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.248132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.248340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.248960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.249911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.253483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.253953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.260606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.261270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.261848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.263314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.264083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.268348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.629561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.638458 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28ebe535-deee-4314-9467-bf266d2d8bbc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.403561 Aug 30 04:32:06.643034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2255/4595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:06 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:06.687317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:06.687985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:06.690938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:06.697894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.699897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.700249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:06.701206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:06.702517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6507046c-9f47-4f96-9214-d5d41d2dc365 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.498623 Aug 30 04:32:06.702676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2341/4596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:06 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:06.705858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:06.706971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.024304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:07.037764 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd2b017f-d8b5-46e2-adfa-438a86655415 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.355207 Aug 30 04:32:07.050423 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2256/4597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:06 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:07.693909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:07.703831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:07.718172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:07.722898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.723356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:07.723857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.723857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.724073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:07.724568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.725004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.725472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.732283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.737289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.737876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:07.742198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:07.743050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:07.743801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.042867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.054767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.060381 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0a4a128-1b89-484c-9b8d-f125c2d7bde3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.401102 Aug 30 04:32:08.066151 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7334c2d-4fe1-4269-9c91-ff8539ca0b30 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.346570 Aug 30 04:32:08.066741 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2257/4598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:08.073968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:08.079617 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2342/4599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:07 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:08.080847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:08.097842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.098370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.098767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.103365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:08.103841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:08.104283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:08.291775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:08.310749 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-04e9ed36-2dd2-4375-b828-655eb15cef00 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.241731 Aug 30 04:32:08.311717 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2258/4600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:08 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:09.084070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:09.084717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:09.092772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.093240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.093436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:09.094282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:09.095013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.096244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.096900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.097630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.107906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.108664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.109111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.109926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.112327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.112769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.342857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:09.352007 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-baa23f65-3309-4320-ae85-0ad96e42663c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.272045 Aug 30 04:32:09.355529 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2343/4601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:09 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:09.373707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:09.375956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:09.381992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:09.383534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.384262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.385658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.386612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:09.387294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:09.387952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:09.390703 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d8a2ff0-389f-4c62-85d9-8cafc1e5d0c2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.303238 Aug 30 04:32:09.405193 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2259/4602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:09 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:09.605030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:09.613608 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c0bdd9c-975a-4cad-9257-ee14b37fdbab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.256671 Aug 30 04:32:09.614190 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2344/4603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:09 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:10.376035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.376658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:10.387051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.391015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.401984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.402973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.403617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.404244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.412601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.413828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:10.425859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.434008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.434706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.435641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.436115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.436551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.818744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:10.830982 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-652e8fa9-e2f0-4adb-9130-4e4cbe8717a7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.422114 Aug 30 04:32:10.845981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2345/4604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:10 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:10.859098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:10.863102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:10.876928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.877865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.878257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.879197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:10.879661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:10.880286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:10.926900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:10.936102 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f1515ed-a460-43b2-a61b-0ebc86695144 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.563881 Aug 30 04:32:10.945437 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2260/4605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:10 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:11.057391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:11.067848 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae57484b-f972-4d99-94a3-011e33c73944 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.220425 Aug 30 04:32:11.068570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2346/4606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:10 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:11.861139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:11.861817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:11.874304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.875054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.875764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.876634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.877449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.884256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.963395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:11.964646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:11.973387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.974399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.975607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:11.976785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:11.977756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:11.978411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.143221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:12.154299 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ac3c6c1-7ebf-4b15-ae94-9aba09369dbd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.297709 Aug 30 04:32:12.155088 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2261/4607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:11 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:12.160446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:12.161240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:12.167841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.168512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.169162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.170333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:12.171357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:12.172946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:12.198407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:12.209981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6946fd88-6134-4926-8c35-98838be0415d tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.248086 Aug 30 04:32:12.212954 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2347/4608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:11 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:12.352516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:12.361268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-082249cd-cbfa-4ca9-8abf-75ab2b309899 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.205027 Aug 30 04:32:12.362272 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2262/4609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:12 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:13.178777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:13.178777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:13.183583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.184084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.184667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.185387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.185855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.186294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.207255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:13.233086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:13.234439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:13.241092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.241537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.241983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.242692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.243160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.243612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.456256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.461132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.464728 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be074fab-8b52-48f3-b381-3ca4f57e0fa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.293073 Aug 30 04:32:13.465764 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2348/4610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:13 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:13.470868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:13.471507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:13.478170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.478949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.479396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.480324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:13.480792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:13.481234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:13.483175 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac2d41b5-9f50-4e3a-9d7a-8d5b632fed91 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.253181 Aug 30 04:32:13.487359 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2263/4611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:13 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:13.635940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:13.644795 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-44d863db-1385-4fae-91ad-2c31e505beba tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.177803 Aug 30 04:32:13.646019 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2349/4612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:13 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:14.486367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:14.487088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:14.495068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.495552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.495992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.496697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.497151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.498550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.504234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:14.505764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:14.526451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.526978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.527441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.528177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.528643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.529279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.782019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:14.789557 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-57831c86-8960-4f88-bf88-4be849cef039 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.307319 Aug 30 04:32:14.790156 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2264/4613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:14 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:14.807783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:14.808721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:14.812437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:14.826790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.827292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.827733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.828471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:14.828934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:14.829386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:14.849504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:14.862172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-84a5f71f-70b9-4b51-8b97-6c346f42d9c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.361925 Aug 30 04:32:14.881417 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2350/4614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:14 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:15.044481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:15.056270 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31e28e0e-5a42-4129-8925-bfb721febb4e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.258685 Aug 30 04:32:15.077514 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2265/4615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:14 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:15.816295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:15.816921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:15.823650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.824155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.824835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.825783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.826443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.827074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.892773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:15.894298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:15.912526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.913177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.914808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.915642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:15.916207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:15.916871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:15.946722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:16.052747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:16.063955 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-367533c2-d4d9-491d-a942-b4547deee829 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.251981 Aug 30 04:32:16.066512 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2351/4616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:15 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:16.080118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:16.081067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:16.094211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:16.095914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:16.097301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.099990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:16.100483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:16.100929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:16.161932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:16.171654 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c08b7de-0873-422a-85eb-4ae757f087dc tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.283502 Aug 30 04:32:16.186074 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2266/4617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:15 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:16.348679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:16.380648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9c67a287-5063-4d06-9b05-302d63066706 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.304916 Aug 30 04:32:16.381449 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2352/4618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:16 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:17.092876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:17.095152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:17.104070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.106732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.107402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.109194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.110081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.111018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.194008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:17.194635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:17.206334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.210405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.211178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.212153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.214807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.215502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.387527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.398068 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c0a9191-1fcd-46f1-90a4-63c4962291e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.309495 Aug 30 04:32:17.398628 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2267/4619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:17 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:17.413719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:17.426258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:17.433160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.433743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.434431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.435375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.436057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.436682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.471744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.479673 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4629151-93ab-4fbc-8dcc-70838c7affd3 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1485 microversion: 2.1 time: 0.289520 Aug 30 04:32:17.480272 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2353/4620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:17 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1485 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:17.506145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:17.506746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:17.521275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.522310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.523190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.524006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.524567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.525001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.659380 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-525c7850-a69c-4c89-9e74-3232d94d21d0 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "POST /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a/action" status: 202 len: 0 microversion: 2.1 time: 0.158271 Aug 30 04:32:17.660842 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2354/4621] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:17 2022] POST /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:32:17.669244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.674420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:17.675424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:17.679687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-255147d3-1ee5-4ab4-8c98-869742228a5c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.273146 Aug 30 04:32:17.681235 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2268/4622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:17 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:17.688866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.689541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.690078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.690884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:17.691440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:17.691973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:17.851883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:17.861610 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7704cba4-27a6-4d3e-a84c-0bfc1eefa8c4 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1493 microversion: 2.1 time: 0.195683 Aug 30 04:32:17.862974 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2355/4623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:17 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1493 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:18.423597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:18.424218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:18.444210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.449358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.449885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.450697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.451154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.454798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.665891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:18.676835 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3f8a4ea-6ec5-41a0-aad6-0d3b1773ebe8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.258468 Aug 30 04:32:18.677939 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2269/4624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:18 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:18.700929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:18.702239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:18.729477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.730345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.735519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.736639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.737381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.738135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.889911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:18.891156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:18.898247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.899077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.899733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.900670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:18.901933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:18.902593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:18.903452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:18.913002 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f26a6028-c0f2-4789-919f-529258b1edb7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.215811 Aug 30 04:32:18.914209 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2356/4625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:18 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:19.071348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:19.081074 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b35500a7-3233-462d-8520-8dafc743151c tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1493 microversion: 2.1 time: 0.194870 Aug 30 04:32:19.081705 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2270/4626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:18 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1493 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:19.700252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:19.700870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:19.707264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.707840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.708336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.709457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.710095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.710536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.917765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:19.928459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-24566f93-29b2-4381-945b-ce1ed57aec50 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1512 microversion: 2.1 time: 0.232088 Aug 30 04:32:19.933870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:19.934592 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2357/4627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:19 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:19.935311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:19.951825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.952439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.952949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:19.954290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:19.954808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:19.955401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.105959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:20.106605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:20.122255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.122765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.123210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.123924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.124381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.124811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.227401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.235979 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ebbae881-bc72-4360-b1a2-3e8a23db869e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.305669 Aug 30 04:32:20.236852 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2271/4628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:19 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:20.363535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.380256 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9063060e-b78f-41ec-bbc6-bb4cbaedf361 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1499 microversion: 2.1 time: 0.279557 Aug 30 04:32:20.380865 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2358/4629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:20 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1499 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:20.411031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:20.411541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:20.424629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.425136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.427106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.427831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.428292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.428722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.482841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:32:20.575959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25cc8b69-3380-483f-9d65-44aef2813de8 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 204 len: 0 microversion: 2.1 time: 0.168818 Aug 30 04:32:20.576862 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2272/4630] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:32:20 2022] DELETE /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:20.585667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:20.586342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:20.593360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.594392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.595078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.596036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:20.596711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:20.597388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:20.822403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:20.834514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e134111-1bee-42a1-b741-1428303d943e tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.251407 Aug 30 04:32:20.835103 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2359/4631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:20 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:21.198880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:21.200067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.208585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.209778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.210604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.212496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.213568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.214844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.257247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:21.258205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.270234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.272208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.273168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.275107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.276861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.278600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.538780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:21.566087 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0147b507-a5cf-4e2d-8e92-fe3be7cec4c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1489 microversion: 2.1 time: 0.620357 Aug 30 04:32:21.567874 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2273/4632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:20 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1489 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:21.595099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:21.598362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.606554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.607776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.608451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.610294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.611022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.611842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.634768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:21.647517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-702a5bf4-be9f-4d7d-ad15-62c32249b44f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.393198 Aug 30 04:32:21.662696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2360/4633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:21 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:21.732431 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20c51aed-dfb0-4fce-b858-facc5f708ab2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 200 len: 128 microversion: 2.1 time: 0.144069 Aug 30 04:32:21.733158 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2274/4634] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:21 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 128 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:21.744160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:21.744787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.752443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.753106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.753893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.754820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.755507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.756114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.856645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:21.857656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:21.873578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.874342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.875769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.877184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:21.877840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:21.878269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:21.992643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.004942 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81ef7c4f-74b7-4cc1-8124-b205258b9bd0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.265304 Aug 30 04:32:22.006252 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2361/4635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:21 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:22.035317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.036539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.043554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.044374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.045035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.046187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.046946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.047625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.088081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.098582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32153c4f-345f-4fec-8dc9-0c77afb51f37 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.246964 Aug 30 04:32:22.099730 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2275/4636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:21 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:22.213513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.227942 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-160f04f8-d374-4895-9bac-429d44d4d29b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.197049 Aug 30 04:32:22.243739 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2362/4637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:22 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:22.252127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.252755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.259563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.260258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.260862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.261754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.262374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.262991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.440557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.453994 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-385864c5-1337-4719-bfae-dc6a0947ac72 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.206484 Aug 30 04:32:22.455295 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2276/4638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:22 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:22.479301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.481072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.488558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.490815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.491604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.492718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.493645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.494536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.668144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:22.668769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:22.683352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.683856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.684491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.685429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:22.686054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:22.686652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:22.703501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.757247 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-339b29d1-78a3-4fbc-ae0c-f941e6e4a373 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.282719 Aug 30 04:32:22.769352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2363/4639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:22 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:22.933961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-860878919", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "9e030e97-f3bc-405c-9a73-9eb51ff4d48e"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:22.986172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:22.999761 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07b54494-d1ee-44de-b938-5c4c855b3186 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.335404 Aug 30 04:32:23.013362 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2277/4640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:22 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:23.041870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] validate_networks() for [('9e030e97-f3bc-405c-9a73-9eb51ff4d48e', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:32:23.120928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:23.121590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:23.132632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.133137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.133609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.134328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.134790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.138764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.476954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:23.490768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e1edc1f-64bd-4911-9c40-76bbb3ca47f5 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.375214 Aug 30 04:32:23.504692 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2278/4641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:23 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:23.765104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:32:23.766242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:32:23.766749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:32:23.767116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:32:23.767537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:32:23.778291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.778862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.779301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.780046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:23.780523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:23.781226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:23.792103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:23.821756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:32:23.831604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for user d4d759ef2dc64a5e8ef6e883efc13d68 and project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:32:23.866580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:32:23.869814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:32:23.959305 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f10cbf6b-1099-473b-a786-7f21e39bcbce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031083 Aug 30 04:32:23.960771 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2364/4642] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:32:23.971653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec39f4f0-c075-4b5b-b01d-30730ef739c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:23.972463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec39f4f0-c075-4b5b-b01d-30730ef739c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:24.027065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:24.027992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:24.048281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.049586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.050769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.052543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.057927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.058599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.079645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec39f4f0-c075-4b5b-b01d-30730ef739c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.095401 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec39f4f0-c075-4b5b-b01d-30730ef739c6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1214 microversion: 2.1 time: 0.123833 Aug 30 04:32:24.096948 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2279/4643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:23 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:24.436259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.447497 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a0751a74-7710-4be8-b0c9-f0a1925f473c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.426979 Aug 30 04:32:24.448266 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2365/4644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:24 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:24.514221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:24.514916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:24.535475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.535983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.536430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.540280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:24.540731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:24.541237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:24.857973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:24.870528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bdaa68a8-a6a6-4256-84ad-46f42fffdc8f tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 200 len: 1505 microversion: 2.1 time: 0.361397 Aug 30 04:32:24.877668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2280/4645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:24 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:25.082998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-738c2138-4fe8-4220-91c7-f9f79ea217a5 req-bf225a1d-8806-476c-90c2-66dc2b29114b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9daf4876-b209-43c1-ac26-6cac5d5ef42a", "name": "network-vif-deleted", "tag": "0d471830-3b50-419c-8337-e11d1e053cef"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:25.103832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-738c2138-4fe8-4220-91c7-f9f79ea217a5 req-bf225a1d-8806-476c-90c2-66dc2b29114b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.104625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-738c2138-4fe8-4220-91c7-f9f79ea217a5 req-bf225a1d-8806-476c-90c2-66dc2b29114b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.105584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-738c2138-4fe8-4220-91c7-f9f79ea217a5 req-bf225a1d-8806-476c-90c2-66dc2b29114b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.117076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:25.118271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:25.133091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.136701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.137360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.141810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.142486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.145092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.164766 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-738c2138-4fe8-4220-91c7-f9f79ea217a5 req-bf225a1d-8806-476c-90c2-66dc2b29114b service nova] Creating event network-vif-deleted:0d471830-3b50-419c-8337-e11d1e053cef for instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a on n-h2-854925-5 Aug 30 04:32:25.202029 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-738c2138-4fe8-4220-91c7-f9f79ea217a5 req-bf225a1d-8806-476c-90c2-66dc2b29114b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121472 Aug 30 04:32:25.204343 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2366/4646] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:25.355324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.367593 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b6bcc4d2-d3ae-4246-80ff-0708e09e9646 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1266 microversion: 2.1 time: 0.255471 Aug 30 04:32:25.368749 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2281/4647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:25 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:25.474120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:25.474826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:25.493270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.493791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.494228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.494927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.495384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.495812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.672897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:25.692602 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c727f5e2-4ba1-4bb1-8c17-ab92f787a563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.223823 Aug 30 04:32:25.695279 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2367/4648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:25 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:25.915066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:25.916777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 9daf4876-b209-43c1-ac26-6cac5d5ef42a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:25.931175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.933481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.934347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.936388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:25.937895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:25.941768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:25.996720 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] HTTP exception thrown: Instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a could not be found. Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Request method failure captured: Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a HTTP/1.1 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZJptO2yQlRyWlOAYnK62KNNVzM0OJC8WI0GDxjGvMldDDWay2oPkUdZB5ijpRYtyluO7D9mw6rgXUCN8FLX0weLr-CAApBzEWKgZpmftcmYjIk1XxP_AKNOZ_5D6NqDNs37177RJLhSZ5vnyD9-r5SsthZAG9yAmDkYG75OUE9dWNk Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 5948d1073d6643d299485a07f760966d Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerRescueTestJSON-1961905258 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5948d1073d6643d299485a07f760966d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5948d1073d6643d299485a07f760966d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5948d1073d6643d299485a07f760966d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5948d1073d6643d299485a07f760966d"}]}] Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerRescueTestJSON-1961905258 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 5948d1073d6643d299485a07f760966d Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerRescueTestJSON-1961905258 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerRescueTestJSON-1961905258-project Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 1216a651e1cb4d3b89341577c3f2ac75 Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerRescueTestJSON-1961905258-project Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a could not be found. Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9daf4876-b209-43c1-ac26-6cac5d5ef42a'} Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a could not be found. Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a could not be found. Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:25.998627 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a could not be found. Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Returning 404 to user: Instance 9daf4876-b209-43c1-ac26-6cac5d5ef42a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:26.003331 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1bdea03-507a-43e4-8315-2c7a48113b6a tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a" status: 404 len: 111 microversion: 2.1 time: 0.100559 Aug 30 04:32:26.004410 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2282/4649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:25 2022] GET /compute/v2.1/servers/9daf4876-b209-43c1-ac26-6cac5d5ef42a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:26.012264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.013069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.024924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.025963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.026659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.028254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.029235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.030314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.092287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:32:26.251471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e1870823-20d7-4960-8ba1-e98a178b2952 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 204 len: 0 microversion: 2.1 time: 0.241956 Aug 30 04:32:26.256326 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2368/4650] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:32:26 2022] DELETE /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:32:26.267007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.267785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.284067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.284360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.287314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.288093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.288562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.288997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.321425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:26.394855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.396026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.402857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.403740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.410828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.412042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.413050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.413693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.535450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.552645 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-073febc6-39bb-4385-8196-60fee38a59ae tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1492 microversion: 2.1 time: 0.295731 Aug 30 04:32:26.554645 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2283/4651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:26 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1492 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:26.597125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.613285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0fd770fa-24dd-4fbc-9a8b-3eb4ea567104 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1272 microversion: 2.1 time: 0.223623 Aug 30 04:32:26.614354 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2369/4652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:26 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1272 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:26.720666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:26.721301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:26.728718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.729283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.730665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.731931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:26.732028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:26.732459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:26.957280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:26.971073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6b733792-81a3-462c-ba78-39f115c2919f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.257214 Aug 30 04:32:26.975141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2284/4653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:26 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:27.575461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:27.576601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:27.590662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.591165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.591612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.592322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.592813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.593246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.638320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:27.639285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:27.649968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.653320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.653911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.654970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:27.655581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:27.657301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:27.948543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:27.964781 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5be5717e-c115-488a-833c-61b1489812d3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.330472 Aug 30 04:32:27.979305 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2285/4654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:27 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:27.988361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:27.994779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:27.995880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:28.004837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.005416 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41291da0-915d-435e-8fa6-0774a630afe1 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1492 microversion: 2.1 time: 0.425993 Aug 30 04:32:28.005884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.006168 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2370/4655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:27 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1492 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:28.006763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.007811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.008428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.009013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.268711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:28.280005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3ecdff2f-33c4-4476-839e-10fd7c139e0f req-6ad310dd-5509-4f13-a811-6314d082c4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d9b7611-df0f-4feb-b7e7-1b6f9b95101a", "tag": "b73403c0-38a8-46a6-bad4-2f430f458559"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:28.281504 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5ab47bc-e804-44c6-aef3-4f30c14f3908 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.290587 Aug 30 04:32:28.282359 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2286/4656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:27 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:28.300576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3ecdff2f-33c4-4476-839e-10fd7c139e0f req-6ad310dd-5509-4f13-a811-6314d082c4c7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:28.301500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3ecdff2f-33c4-4476-839e-10fd7c139e0f req-6ad310dd-5509-4f13-a811-6314d082c4c7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:28.304501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3ecdff2f-33c4-4476-839e-10fd7c139e0f req-6ad310dd-5509-4f13-a811-6314d082c4c7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:28.320887 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3ecdff2f-33c4-4476-839e-10fd7c139e0f req-6ad310dd-5509-4f13-a811-6314d082c4c7 service nova] Creating event network-changed:b73403c0-38a8-46a6-bad4-2f430f458559 for instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a on n-h1-854925-5 Aug 30 04:32:28.329387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3ecdff2f-33c4-4476-839e-10fd7c139e0f req-6ad310dd-5509-4f13-a811-6314d082c4c7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056838 Aug 30 04:32:28.330088 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2371/4657] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:28.989702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:28.990334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:29.003124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.007437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.008069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.009041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.010099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.012560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.033387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:29.034136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:29.046061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.046562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.047065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.047780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.048234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.048652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.796425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.805994 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6be2baeb-fcad-4a30-bf59-2bda8a883076 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.820725 Aug 30 04:32:29.806771 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2287/4658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:28 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:29.811865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:29.812885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:29.819707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.820484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.821048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.821890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:29.823752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:29.824289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:29.824980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1216a651e1cb4d3b89341577c3f2ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5948d1073d6643d299485a07f760966d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:29.837538 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7b0b803-19a7-47bc-9e27-995b58035667 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 200 len: 1492 microversion: 2.1 time: 0.809026 Aug 30 04:32:29.850162 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2372/4659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:29 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 1492 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:30.050111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:30.060492 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07577dd6-d380-4930-9969-87718ad53051 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.252329 Aug 30 04:32:30.061216 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2288/4660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:29 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:30.346324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-85232b76-4c23-4c0f-bade-1d6ad5e09281 req-b432c591-4ec9-456b-8870-ae6c1f12665f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dafb19e-3c3d-49c9-a2da-083173730a4e", "name": "network-vif-deleted", "tag": "aaab730e-ce6f-42df-ba69-8af9d6d7e0ab"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:30.356885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-85232b76-4c23-4c0f-bade-1d6ad5e09281 req-b432c591-4ec9-456b-8870-ae6c1f12665f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.357498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-85232b76-4c23-4c0f-bade-1d6ad5e09281 req-b432c591-4ec9-456b-8870-ae6c1f12665f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.357944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-85232b76-4c23-4c0f-bade-1d6ad5e09281 req-b432c591-4ec9-456b-8870-ae6c1f12665f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.375085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-85232b76-4c23-4c0f-bade-1d6ad5e09281 req-b432c591-4ec9-456b-8870-ae6c1f12665f service nova] Creating event network-vif-deleted:aaab730e-ce6f-42df-ba69-8af9d6d7e0ab for instance 5dafb19e-3c3d-49c9-a2da-083173730a4e on n-h2-854925-5 Aug 30 04:32:30.380884 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-85232b76-4c23-4c0f-bade-1d6ad5e09281 req-b432c591-4ec9-456b-8870-ae6c1f12665f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038728 Aug 30 04:32:30.381558 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2373/4661] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:30.828372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.828997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.841620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.842785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.843392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.845376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.846140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.846760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.862261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:30.862979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] [instance: 5dafb19e-3c3d-49c9-a2da-083173730a4e] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:30.871611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.872117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.872562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.873274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:30.873768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:30.874204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:30.890970 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] HTTP exception thrown: Instance 5dafb19e-3c3d-49c9-a2da-083173730a4e could not be found. Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Request method failure captured: Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e HTTP/1.1 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZJptO2yQlRyWlOAYnK62KNNVzM0OJC8WI0GDxjGvMldDDWay2oPkUdZB5ijpRYtyluO7D9mw6rgXUCN8FLX0weLr-CAApBzEWKgZpmftcmYjIk1XxP_AKNOZ_5D6NqDNs37177RJLhSZ5vnyD9-r5SsthZAG9yAmDkYG75OUE9dWNk Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 5948d1073d6643d299485a07f760966d Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerRescueTestJSON-1961905258 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5948d1073d6643d299485a07f760966d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5948d1073d6643d299485a07f760966d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5948d1073d6643d299485a07f760966d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5948d1073d6643d299485a07f760966d"}]}] Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerRescueTestJSON-1961905258 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 5948d1073d6643d299485a07f760966d Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerRescueTestJSON-1961905258 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerRescueTestJSON-1961905258-project Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 1216a651e1cb4d3b89341577c3f2ac75 Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerRescueTestJSON-1961905258-project Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 5dafb19e-3c3d-49c9-a2da-083173730a4e could not be found. Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5dafb19e-3c3d-49c9-a2da-083173730a4e'} Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dafb19e-3c3d-49c9-a2da-083173730a4e could not be found. Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dafb19e-3c3d-49c9-a2da-083173730a4e could not be found. Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:30.892685 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dafb19e-3c3d-49c9-a2da-083173730a4e could not be found. Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] Returning 404 to user: Instance 5dafb19e-3c3d-49c9-a2da-083173730a4e could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:30.897643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-35b5d521-f573-46b8-ac81-0fafc6208d96 tempest-ServerRescueTestJSON-1961905258 tempest-ServerRescueTestJSON-1961905258-project] 10.222.0.27 "GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e" status: 404 len: 111 microversion: 2.1 time: 0.037322 Aug 30 04:32:30.909597 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2374/4662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/5dafb19e-3c3d-49c9-a2da-083173730a4e => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:31.073906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:31.082733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:31.083566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:31.097123 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-973cd1f7-3e58-4f55-8d60-acf9ff2b15df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.273879 Aug 30 04:32:31.097396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.099755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.100326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:31.101293 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2289/4663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:30 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:31.102784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:31.103518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:31.104807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:31.294028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:31.302024 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5774b12-8f3f-4957-87b7-1063a1dbc09e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.224729 Aug 30 04:32:31.303842 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2375/4664] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:31 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:32.120937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:32.122334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:32.138066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.139555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.140012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.143952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.144439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.146895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.324150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:32.324762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:32.336899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.339639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.341473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.342215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:32.342676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:32.344209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:32.453419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.468860 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f1045d8-4c64-422f-ae5b-85b857291539 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.351940 Aug 30 04:32:32.474983 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2290/4665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:32 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:32.620028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:32.633689 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77181d46-adbf-4144-ad01-96ffce906efb tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.314190 Aug 30 04:32:32.646557 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2376/4666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:32 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:33.510504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.512048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.524975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.527107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.527758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.530243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.531725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.535074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.655664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:33.657460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:33.683855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.691966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.701213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.702235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:33.702911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:33.703520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:33.806651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:33.854670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:33.991685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.002865 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f84a75a-0709-4d19-ac12-5b8a79f97859 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.497040 Aug 30 04:32:34.010708 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2291/4667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:33 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:34.309719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:34.350080 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59278f6e-6b20-4719-8546-34c93cde45a3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1507 microversion: 2.1 time: 0.695098 Aug 30 04:32:34.352736 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2377/4668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:33 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1507 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:35.041038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:35.041785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:35.053465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:35.053806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.054461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.055356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.056538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.057119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.058015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.336869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:35.345689 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9065ccb-b4c7-418d-85d5-8efa5eb3ffbe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.309496 Aug 30 04:32:35.349246 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2292/4669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:35 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:35.372572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:35.373204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:35.382448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.382947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.383402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.385004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:35.386918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:35.389987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:35.607341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:35.619369 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c849dbc-e31b-463a-b031-e21c5de13772 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1528 microversion: 2.1 time: 0.250715 Aug 30 04:32:35.633391 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2378/4670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:35 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1528 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:36.368136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:36.369505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:36.387890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.391117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.392500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.395158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.397210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.397887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.644511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:36.645130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:36.662810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.663662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.664391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.665312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.669355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.670218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.698034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:36.708141 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3f5ef5b6-ab20-436c-9059-9bc0106c89a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.345399 Aug 30 04:32:36.710555 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2293/4671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:36 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:36.911961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e09d9e48-210e-4380-9feb-20912058d9d8 req-5166e423-8692-4dcb-9e1c-ecada916b383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9b7611-df0f-4feb-b7e7-1b6f9b95101a", "name": "network-vif-plugged", "status": "completed", "tag": "b73403c0-38a8-46a6-bad4-2f430f458559"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:36.949657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e09d9e48-210e-4380-9feb-20912058d9d8 req-5166e423-8692-4dcb-9e1c-ecada916b383 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:36.952947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e09d9e48-210e-4380-9feb-20912058d9d8 req-5166e423-8692-4dcb-9e1c-ecada916b383 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:36.955040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e09d9e48-210e-4380-9feb-20912058d9d8 req-5166e423-8692-4dcb-9e1c-ecada916b383 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:36.990727 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e09d9e48-210e-4380-9feb-20912058d9d8 req-5166e423-8692-4dcb-9e1c-ecada916b383 service nova] Creating event network-vif-plugged:b73403c0-38a8-46a6-bad4-2f430f458559 for instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a on n-h1-854925-5 Aug 30 04:32:37.008034 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e09d9e48-210e-4380-9feb-20912058d9d8 req-5166e423-8692-4dcb-9e1c-ecada916b383 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096495 Aug 30 04:32:37.009577 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2294/4672] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:37.060133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:37.078470 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-daee6642-33df-4f76-9ea4-c2997c3e7e61 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1528 microversion: 2.1 time: 0.439329 Aug 30 04:32:37.079394 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2379/4673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:36 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1528 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:37.731763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:37.732365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:37.732760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:37.734523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:37.743896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.744561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.746209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.747590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.748334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.748946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.750726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:37.754318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.755574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.757257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.759369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:37.760938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:37.762408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:37.810264 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e41b975-12af-415e-b04e-5f620588189a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/ips" status: 200 len: 150 microversion: 2.1 time: 0.472536 Aug 30 04:32:37.811780 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2295/4674] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:32:37 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/ips => generated 150 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:38.107156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:38.108435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:38.124827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.128606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.129752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.131350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.135877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:38.140470 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d5eff7f-9756-4d7c-8af4-acac5ddff037 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.409533 Aug 30 04:32:38.143102 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2380/4675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:37 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:38.162808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:38.166044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:38.440509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:38.463552 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-099f3588-8bef-44f2-bd73-3a9200120822 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1528 microversion: 2.1 time: 0.364546 Aug 30 04:32:38.466718 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2296/4676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:38 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1528 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:39.046394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1acbd83b-5bc0-4411-9d1f-4d82eb5079cc req-a7f74b81-0c78-4520-9209-c86be225b44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ab824-5282-4e7c-8cfb-ffaa195156c4", "name": "network-vif-plugged", "status": "completed", "tag": "23f42608-02e9-48e3-b5de-c188fa36665e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:39.078331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1acbd83b-5bc0-4411-9d1f-4d82eb5079cc req-a7f74b81-0c78-4520-9209-c86be225b44c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.080522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1acbd83b-5bc0-4411-9d1f-4d82eb5079cc req-a7f74b81-0c78-4520-9209-c86be225b44c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.081077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1acbd83b-5bc0-4411-9d1f-4d82eb5079cc req-a7f74b81-0c78-4520-9209-c86be225b44c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.119379 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1acbd83b-5bc0-4411-9d1f-4d82eb5079cc req-a7f74b81-0c78-4520-9209-c86be225b44c service nova] Creating event network-vif-plugged:23f42608-02e9-48e3-b5de-c188fa36665e for instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 on n-h1-854925-5 Aug 30 04:32:39.131596 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1acbd83b-5bc0-4411-9d1f-4d82eb5079cc req-a7f74b81-0c78-4520-9209-c86be225b44c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089804 Aug 30 04:32:39.133983 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2381/4677] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:39.167447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:39.168723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:39.185086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.188506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.192322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.196767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.198542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.205358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.501214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:39.502578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:39.520707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.528577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.529270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.532631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:39.537359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:39.538019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:39.733230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:39.743632 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-602f8009-c884-453d-93a6-2a324e43e192 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1314 microversion: 2.1 time: 0.580889 Aug 30 04:32:39.757357 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2297/4678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:39 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1314 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:39.844114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:39.854642 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e296909e-427c-452d-b6b9-660645d63160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1528 microversion: 2.1 time: 0.371411 Aug 30 04:32:39.855828 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2382/4679] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:39 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1528 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:40.124088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7740e3ae-5d81-408a-8d94-acd83b5edf38 tempest-ComputeTenantNetworksTest-1321053059 tempest-ComputeTenantNetworksTest-1321053059-project] Calling method '.version_select at 0x7fe9693ef9d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:40.449642 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7740e3ae-5d81-408a-8d94-acd83b5edf38 tempest-ComputeTenantNetworksTest-1321053059 tempest-ComputeTenantNetworksTest-1321053059-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.534126 Aug 30 04:32:40.450722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2298/4680] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 04:32:39 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:40.462750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2c638f5-a087-47f4-ae04-432984c86e47 tempest-ComputeTenantNetworksTest-1321053059 tempest-ComputeTenantNetworksTest-1321053059-project] Calling method '.version_select at 0x7fe96919eca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:40.600409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d2c638f5-a087-47f4-ae04-432984c86e47 tempest-ComputeTenantNetworksTest-1321053059 tempest-ComputeTenantNetworksTest-1321053059-project] 10.222.0.27 "GET /compute/v2.1/os-tenant-networks/a13316f7-de54-4d82-8746-661918766bab" status: 200 len: 139 microversion: 2.1 time: 0.142538 Aug 30 04:32:40.601107 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2383/4681] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:32:40 2022] GET /compute/v2.1/os-tenant-networks/a13316f7-de54-4d82-8746-661918766bab => generated 139 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:40.728628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:40.731610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:40.747410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:40.752252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:40.753064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:40.754818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:40.756657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:40.757390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:40.770402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:40.771280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:40.788200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:40.788949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:40.792530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:40.793974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:40.795613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:40.797607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:40.813232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:41.132117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:41.142285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1beee39b-2567-45db-a857-4f1a9e302220 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1501 microversion: 2.1 time: 0.376531 Aug 30 04:32:41.170428 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2384/4682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:40 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1501 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:41.205839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:41.206880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:41.218022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.220151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.221183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.222280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.223333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.223992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.354934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3563fbab-6827-4ac8-ad55-6d8ed6b86d35 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.630256 Aug 30 04:32:41.356517 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2299/4683] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:32:40 2022] POST /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 194 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:41.424808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:41.434048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:41.464494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.473103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.478223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.478223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:41.478223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:41.485018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:41.596976 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a84f093b-20dc-4e27-bc00-6da293f7c252 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.236063 Aug 30 04:32:41.598963 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2300/4684] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:41 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:41.743527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:41.755499 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9b028d8-3cbc-46e9-b968-95a74743aad4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.583801 Aug 30 04:32:41.756325 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2385/4685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:41 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:42.612493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:42.616595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:42.642477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:42.651825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:42.653082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:42.657479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:42.660711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:42.661951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:42.717811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:42.782435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:42.783202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:42.795326 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-446aa268-334f-4fc1-b8aa-492705efdf84 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.187357 Aug 30 04:32:42.796271 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2301/4686] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:42 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:42.809832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:42.810382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:42.810824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:42.812538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:42.812882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:42.813180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.161568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:43.175996 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b356712f-390a-487d-a59c-4fad0ea5068a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.398058 Aug 30 04:32:43.177196 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2386/4687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:42 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:43.807668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:43.811549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:43.849892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.850590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.851044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:43.851789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:43.852248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:43.852677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.012009 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0be9409d-19c4-4c14-a2be-b9a385ebc0e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.208313 Aug 30 04:32:44.012953 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2302/4688] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:43 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:44.201100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:44.202189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:44.220767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:44.225046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:44.229964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.231277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:44.232932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:44.238859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:44.684693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-58aa065c-abe6-41ad-8d86-8cca45303d20 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Action: 'create', calling method: .version_select at 0x7fe969125b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2113440039"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:44.810975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:44.824712 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cdefca55-07e5-4184-a0f7-b21ea868dd0b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.628283 Aug 30 04:32:44.826041 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2303/4689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:44 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:45.033821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:45.038232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:45.055008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:45.061223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.062873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.064236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.066193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.069092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.070615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.220189 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3f50ad5a-63cf-4fb9-acd9-c55102d72df7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.198784 Aug 30 04:32:45.221440 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2304/4690] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:45 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:32:45.367752 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-58aa065c-abe6-41ad-8d86-8cca45303d20 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.390725 Aug 30 04:32:45.368929 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2387/4691] 10.222.0.27 () {60 vars in 1155 bytes} [Tue Aug 30 04:32:43 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1392 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 04:32:45.382428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fe8e999-39d2-480b-95ad-c0d12b3742a0 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968f6c430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:45.459499 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fe8e999-39d2-480b-95ad-c0d12b3742a0 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 345 microversion: 2.1 time: 0.081038 Aug 30 04:32:45.460283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2305/4692] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:32:45 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:45.850928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:45.852238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:45.862998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.865230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.867477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:45.869038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:45.870957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:45.873288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.234194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:46.236534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:46.261607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.262437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.271718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.272844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:46.276047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:46.276903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:46.387789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:46.397868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e82654e-cf02-4e26-b28b-277129dafaa6 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.551737 Aug 30 04:32:46.416859 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8eb42a93-44a2-44ba-a1ae-b5eecde50b75 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.188721 Aug 30 04:32:46.419418 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2388/4693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:45 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:46.422587 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2306/4694] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:46 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:46.474917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e708ecb-715f-4ce1-909b-b9d3541bb3c3 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe9693daee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:46.555894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e708ecb-715f-4ce1-909b-b9d3541bb3c3 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 345 microversion: 2.1 time: 0.084710 Aug 30 04:32:46.556716 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2389/4695] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:32:46 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:47.437853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.446508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:47.451458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.457184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:47.531862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.533167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.534179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.534888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.535540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.536413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.537228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.539645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.540355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:47.540983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.544200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:47.548192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:47.664721 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c205781-39ae-4e12-8d2e-ba177de30c36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.236830 Aug 30 04:32:47.666020 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2390/4696] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:47 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:47.671958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-acad30fe-f14b-4c50-ad5a-1eb1935bc2b4 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe96919e550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:47.839781 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-acad30fe-f14b-4c50-ad5a-1eb1935bc2b4 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 345 microversion: 2.1 time: 0.172190 Aug 30 04:32:47.840356 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2391/4697] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 345 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:47.861396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:47.871703 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9ed9c7a-44a9-476a-b25a-b28750d1d656 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.445341 Aug 30 04:32:47.872999 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2307/4698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:47 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:48.676831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:48.679429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.691733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.692231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.692671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.710468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.711270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.711878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.861816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b6352b19-7949-4cb0-846f-3060e94876a0 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968fc4d30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.866564 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c2303682-b84b-426b-a2b4-26f03b17aa1c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.193425 Aug 30 04:32:48.867225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2392/4699] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:48 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:48.911511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:48.912238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:48.928672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.929175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.929642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:48.930359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:48.930817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:48.931253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.002372 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b6352b19-7949-4cb0-846f-3060e94876a0 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 346 microversion: 2.1 time: 0.145977 Aug 30 04:32:49.002746 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2308/4700] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 346 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:49.016321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-76a3efbd-c1d5-4230-ad7b-22066b7c7b75 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Action: 'create', calling method: .version_select at 0x7fe969014c10>, body: {"snapshot": {"volume_id": "1be10a37-b525-48af-b752-dd92c0774696", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1757784785"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:49.350472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:49.365422 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b09ae319-aa46-4f40-8378-088a3acfab87 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.470041 Aug 30 04:32:49.366528 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2393/4701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:48 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:49.503966 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-76a3efbd-c1d5-4230-ad7b-22066b7c7b75 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.491867 Aug 30 04:32:49.505034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2309/4702] 10.222.0.27 () {60 vars in 1162 bytes} [Tue Aug 30 04:32:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:49.516947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c1c9dea-e8c2-45c0-a72a-2002d7360a03 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe969121160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.604316 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c1c9dea-e8c2-45c0-a72a-2002d7360a03 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 287 microversion: 2.1 time: 0.092725 Aug 30 04:32:49.605283 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2394/4703] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:49.617837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-33aae463-7e9e-4858-a8b3-52b6800eabd5 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe969934700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.719244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-33aae463-7e9e-4858-a8b3-52b6800eabd5 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.106260 Aug 30 04:32:49.720696 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2310/4704] 10.222.0.27 () {58 vars in 1140 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:49.732414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6d9661c-60be-4710-b47a-cbf5bc986540 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe96955bd30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:49.799530 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6d9661c-60be-4710-b47a-cbf5bc986540 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 287 microversion: 2.1 time: 0.071166 Aug 30 04:32:49.805918 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2395/4705] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:49 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:49.878477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:49.881642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:49.897538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.926142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.926603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:49.927446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:49.927911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:49.932849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.052039 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-43cfd9ba-a0fb-4fae-952c-7dfb434235d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.178644 Aug 30 04:32:50.059496 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2311/4706] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:49 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 04:32:50.392144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:50.392891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:50.408760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.414300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.416450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.417601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:50.420999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:50.427059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:50.766698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:50.777846 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-07c8b547-26e7-44f8-856e-3941eccd0b88 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.390203 Aug 30 04:32:50.794808 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2396/4707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:50 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:50.826319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c4a7249c-9808-4e34-9fef-86d0e53d8f79 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968fddc10>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:50.941707 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c4a7249c-9808-4e34-9fef-86d0e53d8f79 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 287 microversion: 2.1 time: 0.121296 Aug 30 04:32:50.941707 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2312/4708] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:50 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:51.075016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:51.106011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:51.151987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.153494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.156024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.158949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.159698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.164821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.283529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-915aa9b5-a5ba-4797-ab96-04edefb332bd tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.216869 Aug 30 04:32:51.284684 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2397/4709] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:51 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:51.815760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:51.816494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:51.829534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.830012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.830818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.831691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:51.845396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:51.846086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:51.949171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6e2ca0b-4b15-4b38-9058-f28c0ba79d35 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe96955b0d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:52.012409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6e2ca0b-4b15-4b38-9058-f28c0ba79d35 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 287 microversion: 2.1 time: 0.067380 Aug 30 04:32:52.013735 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2398/4710] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:51 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:32:52.316706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:52.319795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:52.340971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.341946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.342812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.344721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:52.345542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:52.346206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:52.388333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:52.404499 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83a3f42d-0a1f-476a-8845-80fe563e2a44 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.593710 Aug 30 04:32:52.422191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2313/4711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:51 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:52.467499 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5fad378-6f07-4d7f-913f-2ec95f1d1601 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 14 microversion: 2.1 time: 0.166507 Aug 30 04:32:52.471647 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2399/4712] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:52 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:32:53.027155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6946e7c4-91d3-4650-ba04-745fee4d1b78 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe96900f0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.086268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6946e7c4-91d3-4650-ba04-745fee4d1b78 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 288 microversion: 2.1 time: 0.063650 Aug 30 04:32:53.099326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-35af7b0a-80ac-4238-a33a-ed26a029559f tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe96955b5e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.102455 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2314/4713] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 288 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:53.221826 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-35af7b0a-80ac-4238-a33a-ed26a029559f tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 202 len: 0 microversion: 2.1 time: 0.126771 Aug 30 04:32:53.223087 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2400/4714] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 30 04:32:53 2022] DELETE /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:53.234344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-565b2fc5-4f5c-4e5f-9eee-55dc64d6e689 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968fc0940>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.363213 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-565b2fc5-4f5c-4e5f-9eee-55dc64d6e689 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 287 microversion: 2.1 time: 0.135945 Aug 30 04:32:53.365377 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2315/4715] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:53.428759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.429897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:53.442566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.443421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.444928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.449415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.450177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.450873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.480508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:53.485134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:53.536544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.539605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.540340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.543853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.544537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.545789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.632099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3eec7b02-ed83-4596-ac60-ce1a9620c2a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action" status: 200 len: 8208 microversion: 2.1 time: 0.156677 Aug 30 04:32:53.633722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2316/4716] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:53 2022] POST /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a/action => generated 8208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:53.645245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:53.646013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:53.664981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.665508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.666963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.669994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:53.672414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:53.673039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:53.809456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:53.820979 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-943b2006-d054-4c93-8056-23b54b3e3136 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.394924 Aug 30 04:32:53.822915 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2401/4717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.036751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.052067 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-820ba812-d141-4e8c-8228-5768e927b21a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.411742 Aug 30 04:32:54.052931 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2317/4718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:53 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:54.083612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.084772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.121041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.121637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.122055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.123547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.124840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.125645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.376004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-359274f8-dc5e-41d3-924e-11420ae9610b tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968f6ce50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.425567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.440893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cce2e585-6341-4116-98a2-92f6062a0730 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.361951 Aug 30 04:32:54.442297 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-359274f8-dc5e-41d3-924e-11420ae9610b tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 287 microversion: 2.1 time: 0.070090 Aug 30 04:32:54.450053 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2318/4719] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:54.467400 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2402/4720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.472517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.473142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.485848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.488253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.494042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.495365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.496328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.497593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.846695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.847375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.861842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.869889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.870469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.871272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.879061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.881424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.924613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:54.938068 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-230f610f-62b7-413a-98e0-8f495d70d4af tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.469943 Aug 30 04:32:54.939217 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2319/4721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:54.965650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:54.966995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:54.974493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.975268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.975913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:54.976682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:54.977082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:54.978163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.593918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.607887 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0ccd075-c6c0-471e-a3b7-83b4d085a9b7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.648128 Aug 30 04:32:55.614140 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2320/4722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:55.626250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd4cb99a-a200-4c82-a4cc-bf010d05359f tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968fc0700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:55.737497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd4cb99a-a200-4c82-a4cc-bf010d05359f tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 200 len: 287 microversion: 2.1 time: 0.121298 Aug 30 04:32:55.738372 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2321/4723] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:55 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:55.743944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:55.744771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:55.761887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.764629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.765809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.768659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:55.770490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:55.771379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:55.827709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:55.842619 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27e4f47c-7c86-4409-9064-0d20235eb86c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 1.000907 Aug 30 04:32:55.847982 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2403/4724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:54 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:32:55.889907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Locking {{(pid=122402) lock /opt/stack/nova/nova/compute/api.py:4843}} Aug 30 04:32:56.109353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ffedeec-0414-4137-97a0-84f67c4ef704 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.367990 Aug 30 04:32:56.114655 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2322/4725] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:55 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:56.121218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.121387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.136397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.136900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.139059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.142931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.143645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.144389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.789956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.791005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:56.799389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.804520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.805199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.806134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:56.806794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:56.807781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:56.881453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:32:56.887941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:56.904219 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-442144b4-c80e-48f1-9ef0-b11d31f39237 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.787259 Aug 30 04:32:56.921946 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2404/4726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:56 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:56.933760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-953154d0-624a-478d-8967-cbf07609d673 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe96e5fc670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:56.987455 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-953154d0-624a-478d-8967-cbf07609d673 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] HTTP exception thrown: Snapshot a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 could not be found. Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-953154d0-624a-478d-8967-cbf07609d673 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Request method failure captured: Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 HTTP/1.1 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZLrW4X9nKdymcNa8rN5TXLIRUARXqMsZaMDsDXUSt3hYoobrbObBFLuL2qWzyst8e1jXZSfGjTq5spnkWuPAOpS0d6XEAbVmF6zFdbAMOBw8k2yxUQyhcmxGhhIYejd4nrg8U-x6NmglRV6lMQdpLJqkhhDIII9f5xw9nuhI3HnpxU Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a476f33315084e18924fbbdc02db3a51", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}] Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4795300a921f48a4b69a364f9cefbc71 Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: exception: Snapshot a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 could not be found. Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9'} Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 could not be found. (HTTP 404) (Request-ID: req-9a6107bb-b9a9-4067-994e-8e081c31bfbf) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:32:56.994783 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 could not be found. Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 could not be found. Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 could not be found. Aug 30 04:32:57.000631 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.007179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-953154d0-624a-478d-8967-cbf07609d673 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Returning 404 to user: Snapshot a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:57.007975 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-953154d0-624a-478d-8967-cbf07609d673 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9" status: 404 len: 111 microversion: 2.1 time: 0.084810 Aug 30 04:32:57.008659 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2405/4727] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 04:32:56 2022] GET /compute/v2.1/os-snapshots/a5fa3dd4-1103-4f27-b2d0-3dbd4febe9f9 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:32:57.013284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.013920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.047515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.048213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.048827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.049810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.050924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.051714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.073269 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-43abe16e-0dc7-4980-9445-be224e3cc242 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 204 len: 0 microversion: 2.32 time: 0.717544 Aug 30 04:32:57.078084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2323/4728] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:32:56 2022] DELETE /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:32:57.087195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:57.102615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.103245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.104002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.182112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:57.215760 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] HTTP exception thrown: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 is locked Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Request method failure captured: Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action HTTP/1.1 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 15 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGpcbhrpGXj-iz0fwZAgXVo33oBdCfx1hxiHH9HRY546J0cCN3001a2fKGj79Y7kkYP6hUynyNXufZ6IxNIPjoHtq3JBamUpEEzVPXkIzkm7q5fFtg0tDhPpYB0EJzr9byLyAjVsXiL8XWY6ISJA4RPk9Lqn-QwSyAY_AQ9May7tII Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20b289bb6f0f45ba9e7137ee45fa2d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}] Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-832097908 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d4d759ef2dc64a5e8ef6e883efc13d68 Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: {"os-stop": {}} Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 is locked Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'f1310d5f-398b-4587-815e-e3ffdecafdf5', 'body': {'os-stop': {}}} Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 is locked Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 is locked Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 is locked Aug 30 04:32:57.217573 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:57.223344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Returning 409 to user: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 is locked {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:57.223344 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-58d221f7-6ce2-4c32-81e4-3e2e430000f2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 409 len: 107 microversion: 2.1 time: 0.142499 Aug 30 04:32:57.223344 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2324/4729] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:57 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 107 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:32:57.234647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7c6ffa6-a05c-4f40-b19a-7f96d88b3e2a tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968f2c790>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.367698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7c6ffa6-a05c-4f40-b19a-7f96d88b3e2a tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 202 len: 0 microversion: 2.1 time: 0.145751 Aug 30 04:32:57.370097 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2325/4730] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:32:57 2022] DELETE /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:57.370622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:57.377620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:57.378758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.391370 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fd7ee914-bbe2-4b96-94e1-9b861d55e68f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.381602 Aug 30 04:32:57.405828 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2406/4731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:57.415720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.416860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.418720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.419653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.420125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.420564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.434097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:57.434829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:57.463211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.467325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.470789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.477971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:57.485125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:57.487228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:57.669892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Unlocking {{(pid=122403) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 04:32:57.893701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:32:57.909277 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10d6fee4-300d-4b5d-ab6c-aa5938989157 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.501978 Aug 30 04:32:57.913577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2407/4732] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:57 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:57.930864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e062465e-63ee-46c8-811b-1a5f2778a515 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe969544a60>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.009068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.024678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.027672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.029253 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a2e5f03-8dcb-43d8-a623-f03857c9174b tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2954 microversion: 2.32 time: 0.657590 Aug 30 04:32:58.031126 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2326/4733] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2954 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:58.036565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7cb947c0-c1c0-467b-b5ff-3f4e36d9911d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:58.044310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cb947c0-c1c0-467b-b5ff-3f4e36d9911d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.045151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cb947c0-c1c0-467b-b5ff-3f4e36d9911d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.045878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cb947c0-c1c0-467b-b5ff-3f4e36d9911d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.124917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7cb947c0-c1c0-467b-b5ff-3f4e36d9911d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Going to try to stop instance {{(pid=122402) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:32:58.339623 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e062465e-63ee-46c8-811b-1a5f2778a515 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 345 microversion: 2.1 time: 0.424280 Aug 30 04:32:58.340890 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2408/4734] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:32:57 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 345 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:58.417906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.418791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.431907 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7cb947c0-c1c0-467b-b5ff-3f4e36d9911d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.398715 Aug 30 04:32:58.433225 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2327/4735] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:32:58 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:32:58.455916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.473476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:58.473861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.473861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.473861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.474181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:58.474498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.476934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.495970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.496587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.497195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.498035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:58.498735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:58.499805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:58.821620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.827815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:58.832233 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3122a486-b613-4532-b9ab-5e3bfb5ea72a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.417258 Aug 30 04:32:58.837120 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2409/4736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:58.839523 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa063b85-9907-45ce-86e5-55215e0e370d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.399002 Aug 30 04:32:58.840568 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2328/4737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:58 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:32:59.060748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.062701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.129913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.143702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.144295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.148469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.149073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.149940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.268191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:32:59.272316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.303348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.303846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.304289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.315072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.316194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.316666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.552515 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Invalid volume: volume 7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14 is already attached to instances: c629df0c-85ca-4656-962c-6c2a89e54371 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments HTTP/1.1 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 74 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: {"volumeAttachment": {"volumeId": "7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14"}} Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid volume: volume 7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14 is already attached to instances: c629df0c-85ca-4656-962c-6c2a89e54371 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': 'c629df0c-85ca-4656-962c-6c2a89e54371', 'body': {'volumeAttachment': {'volumeId': '7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14'}}} Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14 is already attached to instances: c629df0c-85ca-4656-962c-6c2a89e54371 Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:32:59.560485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14 is already attached to instances: c629df0c-85ca-4656-962c-6c2a89e54371 Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14 is already attached to instances: c629df0c-85ca-4656-962c-6c2a89e54371 Aug 30 04:32:59.566220 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:32:59.569498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 400 to user: Invalid volume: volume 7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14 is already attached to instances: c629df0c-85ca-4656-962c-6c2a89e54371 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:32:59.575752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51ab3042-a5d2-4810-8acc-a41bd2c85463 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.312783 Aug 30 04:32:59.582973 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2329/4738] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:32:59 2022] POST /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 174 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:32:59.603830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-80fc94bc-bb65-460e-a0f2-9ea72023489b tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe968f235e0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.675122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.694240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.698705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:32:59.707055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbc87978-5a72-4f40-b62e-07eabca3f5c2 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2954 microversion: 2.32 time: 0.645115 Aug 30 04:32:59.707913 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2410/4739] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2954 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:32:59.740829 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-80fc94bc-bb65-460e-a0f2-9ea72023489b tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 345 microversion: 2.1 time: 0.154991 Aug 30 04:32:59.741652 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2330/4740] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 345 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:32:59.753385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.754089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.762414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.766976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.767708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.769477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.770169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.771310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.855231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:32:59.856289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:32:59.868137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.875105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.875606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.876786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:32:59.877539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:32:59.878207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:32:59.960158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lazy-loading 'services' on Instance uuid c629df0c-85ca-4656-962c-6c2a89e54371 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:33:00.164818 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c0c1abb-454a-4463-99fb-e1fa9735a0c3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments/7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14" status: 202 len: 0 microversion: 2.1 time: 0.409078 Aug 30 04:33:00.168561 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2411/4741] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:32:59 2022] DELETE /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments/7ea8761b-1f6a-48c5-b8c0-2dfa80a42a14 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:00.192530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.197086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.201507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.203215 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59bd8f1f-5f3e-4ab9-a647-5ce24a534daf tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.351733 Aug 30 04:33:00.217426 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2331/4742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:32:59 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:00.223567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.227171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.243314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.249743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.251624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.253361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.254332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.255083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.255707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.265357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.267136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.267962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.268550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.269183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.372134 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc29562d-6183-41dc-9fb6-7430f1479be9 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147872 Aug 30 04:33:00.373574 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2332/4743] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:00.486707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:00.504220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cf77108f-a183-42a4-b7d3-4acdcd2ca0ce tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.332492 Aug 30 04:33:00.506242 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2412/4744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:00.738202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.739012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:00.755284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e60fa1f6-769d-4690-8d62-262bd01815ff tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe969253af0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:00.765486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.770182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.774216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.784723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:00.785744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:00.786302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:00.850447 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e60fa1f6-769d-4690-8d62-262bd01815ff tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 345 microversion: 2.1 time: 0.099002 Aug 30 04:33:00.851291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2413/4745] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 345 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:01.172878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.186034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.187788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.189763 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-33881348-1b30-4ff9-b972-ac019a38aba8 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2954 microversion: 2.32 time: 0.457269 Aug 30 04:33:01.190860 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2333/4746] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:00 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2954 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:01.243094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.244370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.298599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.299404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.300089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.301012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.301722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.302378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.389412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.393161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.409552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.410044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.410482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.411188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.411643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.412066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.469729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c2a5b03f-64df-46b0-8efe-4cca23e90dab tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084971 Aug 30 04:33:01.480816 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2334/4747] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:01.531207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.532176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:01.544854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.546589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.547267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.548240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:01.548941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:01.549696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:01.642163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.672865 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95283d5a-461e-43f8-9c81-45b37b77542d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.431465 Aug 30 04:33:01.684091 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2414/4748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:01.865458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4e48b9c-6eb2-4383-8d7e-1ddd910c2f57 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe969573ee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:01.865784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:01.876058 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07797616-5dfb-45b5-afe3-782fc8ec9771 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.349098 Aug 30 04:33:01.876945 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2335/4749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:01.977318 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4e48b9c-6eb2-4383-8d7e-1ddd910c2f57 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 200 len: 345 microversion: 2.1 time: 0.116365 Aug 30 04:33:01.978428 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2415/4750] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:33:01 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:02.219188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.220063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.244172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.246825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.248206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.250750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.251928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.254228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.482908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.485734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.519086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.519599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.520055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.538494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.538893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.539698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.678698 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-50d8aa7c-6491-49f2-88cf-dd91b32fd6e7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200979 Aug 30 04:33:02.688022 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2416/4751] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:02.705449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:02.706733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:02.736504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.737540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.738327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.744640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.745597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.746574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:02.814172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.824926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.826390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:02.859289 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f2558bd-3bb4-46f8-b7e9-3c43587b67ee tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2954 microversion: 2.32 time: 0.639517 Aug 30 04:33:02.865481 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2336/4752] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2954 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:02.905803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2db6cfef-ea2e-4ec1-a62d-c0c7a63dec31 req-9a166c3f-8c2e-40e1-b21d-9e5b5535cd90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-unplugged", "status": "completed", "tag": "c22d8565-7b2a-4d2b-b452-d9996280f19e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:02.949911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2db6cfef-ea2e-4ec1-a62d-c0c7a63dec31 req-9a166c3f-8c2e-40e1-b21d-9e5b5535cd90 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:02.950383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2db6cfef-ea2e-4ec1-a62d-c0c7a63dec31 req-9a166c3f-8c2e-40e1-b21d-9e5b5535cd90 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:02.963218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2db6cfef-ea2e-4ec1-a62d-c0c7a63dec31 req-9a166c3f-8c2e-40e1-b21d-9e5b5535cd90 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.007887 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2db6cfef-ea2e-4ec1-a62d-c0c7a63dec31 req-9a166c3f-8c2e-40e1-b21d-9e5b5535cd90 service nova] Creating event network-vif-unplugged:c22d8565-7b2a-4d2b-b452-d9996280f19e for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:03.035821 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2db6cfef-ea2e-4ec1-a62d-c0c7a63dec31 req-9a166c3f-8c2e-40e1-b21d-9e5b5535cd90 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162231 Aug 30 04:33:03.038869 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2337/4753] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:03.058648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.061761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.070117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.078507 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-347e8f4e-96a0-41ef-8b67-b6212dcc2528 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.378690 Aug 30 04:33:03.080195 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2417/4754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:02 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:03.086133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a77d25e-e040-4b9f-b3c1-e8204d244205 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe969253670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.087995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.088535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.088990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.089741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.095431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.096059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.122363 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-9a77d25e-e040-4b9f-b3c1-e8204d244205 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] HTTP exception thrown: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a77d25e-e040-4b9f-b3c1-e8204d244205 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Request method failure captured: Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 HTTP/1.1 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZLrW4X9nKdymcNa8rN5TXLIRUARXqMsZaMDsDXUSt3hYoobrbObBFLuL2qWzyst8e1jXZSfGjTq5spnkWuPAOpS0d6XEAbVmF6zFdbAMOBw8k2yxUQyhcmxGhhIYejd4nrg8U-x6NmglRV6lMQdpLJqkhhDIII9f5xw9nuhI3HnpxU Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a476f33315084e18924fbbdc02db3a51", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}] Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4795300a921f48a4b69a364f9cefbc71 Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: exception: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1be10a37-b525-48af-b752-dd92c0774696'} Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. (HTTP 404) (Request-ID: req-97d75c60-cc0e-4546-bd1a-0f244fedf957) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:33:03.125225 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.130034 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.134113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a77d25e-e040-4b9f-b3c1-e8204d244205 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Returning 404 to user: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:03.136257 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a77d25e-e040-4b9f-b3c1-e8204d244205 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 404 len: 109 microversion: 2.1 time: 0.054748 Aug 30 04:33:03.137376 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2418/4755] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:03.149199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4eb2611d-139e-4099-b584-4cb15266dfc2 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe9693da670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.201480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4eb2611d-139e-4099-b584-4cb15266dfc2 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] HTTP exception thrown: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4eb2611d-139e-4099-b584-4cb15266dfc2 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Request method failure captured: Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 HTTP/1.1 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZLrW4X9nKdymcNa8rN5TXLIRUARXqMsZaMDsDXUSt3hYoobrbObBFLuL2qWzyst8e1jXZSfGjTq5spnkWuPAOpS0d6XEAbVmF6zFdbAMOBw8k2yxUQyhcmxGhhIYejd4nrg8U-x6NmglRV6lMQdpLJqkhhDIII9f5xw9nuhI3HnpxU Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a476f33315084e18924fbbdc02db3a51", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}] Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4795300a921f48a4b69a364f9cefbc71 Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: exception: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1be10a37-b525-48af-b752-dd92c0774696'} Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. (HTTP 404) (Request-ID: req-e2660f78-fc77-4238-85ea-841a8dad3139) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:33:03.204522 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.209165 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.215959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4eb2611d-139e-4099-b584-4cb15266dfc2 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Returning 404 to user: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:03.217113 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4eb2611d-139e-4099-b584-4cb15266dfc2 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 404 len: 109 microversion: 2.1 time: 0.072968 Aug 30 04:33:03.218840 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2419/4756] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:33:03 2022] DELETE /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:03.249055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-542e0fc3-6d3c-4138-bda4-c83bb4027e92 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Calling method '.version_select at 0x7fe9693da790>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.330944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-542e0fc3-6d3c-4138-bda4-c83bb4027e92 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] HTTP exception thrown: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-542e0fc3-6d3c-4138-bda4-c83bb4027e92 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Request method failure captured: Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 HTTP/1.1 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZLrW4X9nKdymcNa8rN5TXLIRUARXqMsZaMDsDXUSt3hYoobrbObBFLuL2qWzyst8e1jXZSfGjTq5spnkWuPAOpS0d6XEAbVmF6zFdbAMOBw8k2yxUQyhcmxGhhIYejd4nrg8U-x6NmglRV6lMQdpLJqkhhDIII9f5xw9nuhI3HnpxU Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a476f33315084e18924fbbdc02db3a51", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a476f33315084e18924fbbdc02db3a51"}]}] Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a476f33315084e18924fbbdc02db3a51 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321389061 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4795300a921f48a4b69a364f9cefbc71 Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321389061-project Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: exception: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1be10a37-b525-48af-b752-dd92c0774696'} Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. (HTTP 404) (Request-ID: req-dda35314-a5c0-43b3-9673-aa7bc35b6145) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:33:03.334197 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:03.339714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-542e0fc3-6d3c-4138-bda4-c83bb4027e92 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] Returning 404 to user: Volume 1be10a37-b525-48af-b752-dd92c0774696 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:03.347886 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-542e0fc3-6d3c-4138-bda4-c83bb4027e92 tempest-VolumesSnapshotsTestJSON-321389061 tempest-VolumesSnapshotsTestJSON-321389061-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696" status: 404 len: 109 microversion: 2.1 time: 0.106946 Aug 30 04:33:03.347886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2420/4757] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/os-volumes/1be10a37-b525-48af-b752-dd92c0774696 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:33:03.542284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:03.550739 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b12847bb-a7a5-4a0b-b7d1-def001ddc8eb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.510132 Aug 30 04:33:03.557086 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2338/4758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:03.697243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.700343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.717774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.718320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.718764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.719483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.719937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.727756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.829979 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20646546-b5cd-48c0-ac24-92c72edd420e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137761 Aug 30 04:33:03.839292 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2421/4759] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:03.891790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:03.892455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:03.911571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.926134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.926595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:03.927347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:03.927805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:03.928234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.101588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.102215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.140606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.144771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.147072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.148065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.151521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.153869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.637996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.663635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.665669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.667268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e43bfe7-565b-4825-b74a-435607d5ecb5 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2933 microversion: 2.32 time: 0.781146 Aug 30 04:33:04.669185 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2339/4760] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:03 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2933 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:04.674778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.675666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.692971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.696425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.699850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.701087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.701749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.702978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.736918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:04.745750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19320750-b7da-4102-9602-809e2d092e3d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.648939 Aug 30 04:33:04.762393 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2422/4761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:04.846567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:04.849004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:04.870729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.878529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.880335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:04.882422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:04.882893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:04.883334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.042455 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8dedb968-2c7b-442f-8b9b-cc70327da5ed tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.200258 Aug 30 04:33:05.045680 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2423/4762] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:05.112241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-unplugged", "status": "completed", "tag": "a2f39c69-25f2-4aac-8cf3-37819f843b3a"}, {"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-unplugged", "status": "completed", "tag": "65fedda3-a97f-4c7d-a4a7-bc638e7f590b"}, {"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-unplugged", "status": "completed", "tag": "37b76ba8-1408-4f27-ae51-a8cfb19391a6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:05.136298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.149655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.154301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.217220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] Creating event network-vif-unplugged:a2f39c69-25f2-4aac-8cf3-37819f843b3a for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:05.219380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:05.220245 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] Creating event network-vif-unplugged:65fedda3-a97f-4c7d-a4a7-bc638e7f590b for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:05.220772 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] Creating event network-vif-unplugged:37b76ba8-1408-4f27-ae51-a8cfb19391a6 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:05.230485 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9419bd5c-06a6-4a45-8d01-512b42104087 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.559853 Aug 30 04:33:05.231769 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2340/4763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:04 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:05.240594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-45e0a704-90ef-451a-b4c7-60eaa5905a9c req-34f06973-aaf0-4e95-bebd-daa34c1327ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.133452 Aug 30 04:33:05.261146 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2424/4764] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:05.699105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.700184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.716214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.716856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.717466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.719363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.720170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.721037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.796256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:05.803951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:05.815668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.822074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.823668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:05.824867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:05.825810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:05.826740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.430004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.447264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.454761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.456122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-748de588-5535-4e72-9746-a63c1204ea80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2912 microversion: 2.32 time: 0.761939 Aug 30 04:33:06.465734 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2341/4765] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2912 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:06.482929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.484899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.486610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.497904 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2a4b110d-3cc8-49f5-838c-9f1df7448338 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.730393 Aug 30 04:33:06.501226 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2425/4766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:05 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:06.507655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.508166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.508613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.509358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.515490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.516042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.517570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:06.518717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:06.549490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.550253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.551262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.552336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:06.554004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:06.554741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:06.594658 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b4518e1-da40-4076-ba0b-430ad499aed5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127451 Aug 30 04:33:06.595255 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2342/4767] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:06.846888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:06.864673 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e07762e5-4659-4588-ac56-724a01e624d6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.359696 Aug 30 04:33:06.869886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2426/4768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:06 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:07.414146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ca8eb48d-7449-4e75-9171-b0703df500d1 req-df721946-f1e1-4e80-918d-cff1613ee6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-unplugged", "status": "completed", "tag": "13475dce-cbe1-4768-8aea-e49281d30daf"}, {"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-unplugged", "status": "completed", "tag": "dda5b7e4-c290-4a46-bdaa-376387119bd3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:07.439931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ca8eb48d-7449-4e75-9171-b0703df500d1 req-df721946-f1e1-4e80-918d-cff1613ee6d1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.448334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ca8eb48d-7449-4e75-9171-b0703df500d1 req-df721946-f1e1-4e80-918d-cff1613ee6d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.450972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ca8eb48d-7449-4e75-9171-b0703df500d1 req-df721946-f1e1-4e80-918d-cff1613ee6d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.465111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:07.486945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:07.487851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:07.505593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.507463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.508104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.511965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.512651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.513076 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ca8eb48d-7449-4e75-9171-b0703df500d1 req-df721946-f1e1-4e80-918d-cff1613ee6d1 service nova] Creating event network-vif-unplugged:13475dce-cbe1-4768-8aea-e49281d30daf for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:07.516324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.516861 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ca8eb48d-7449-4e75-9171-b0703df500d1 req-df721946-f1e1-4e80-918d-cff1613ee6d1 service nova] Creating event network-vif-unplugged:dda5b7e4-c290-4a46-bdaa-376387119bd3 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:07.546764 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ca8eb48d-7449-4e75-9171-b0703df500d1 req-df721946-f1e1-4e80-918d-cff1613ee6d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.126733 Aug 30 04:33:07.554676 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2343/4769] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:07.561521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:07.568754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:07.598296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.601419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.602156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:07.604609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:07.607010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:07.607793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.550690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.599622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5c8e1e8-f90f-464c-b948-9597ed10302d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 2.043077 Aug 30 04:33:09.611559 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2344/4770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:07 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:09.613515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.617469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.619908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:09.631691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.636340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:09.641729 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a9421ef-51e9-4db1-b42f-8831d025db21 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2865 microversion: 2.32 time: 2.160262 Aug 30 04:33:09.657768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.657768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.657768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.657768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.657768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.657768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.659924 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2427/4771] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:07 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2865 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:09.675858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:09.681017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:09.695558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=66 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:09.700583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.701361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.702439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.703379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.705971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.706614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.775940 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c528905-5ff8-477a-ac08-8d90fec90cb5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162807 Aug 30 04:33:09.784173 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2345/4772] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:09.797263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-624290e6-52fe-43d5-97be-1cc9a4a38378 req-02f2b095-5e62-43ff-b354-a85a554083bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-deleted", "tag": "37b76ba8-1408-4f27-ae51-a8cfb19391a6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:09.833245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-624290e6-52fe-43d5-97be-1cc9a4a38378 req-02f2b095-5e62-43ff-b354-a85a554083bf service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:09.835488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-624290e6-52fe-43d5-97be-1cc9a4a38378 req-02f2b095-5e62-43ff-b354-a85a554083bf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:09.842343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-624290e6-52fe-43d5-97be-1cc9a4a38378 req-02f2b095-5e62-43ff-b354-a85a554083bf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:09.883040 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-624290e6-52fe-43d5-97be-1cc9a4a38378 req-02f2b095-5e62-43ff-b354-a85a554083bf service nova] Creating event network-vif-deleted:37b76ba8-1408-4f27-ae51-a8cfb19391a6 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:09.912728 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-624290e6-52fe-43d5-97be-1cc9a4a38378 req-02f2b095-5e62-43ff-b354-a85a554083bf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126926 Aug 30 04:33:09.916706 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2346/4773] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:10.130276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:10.144440 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f89b32f9-4609-406b-8a4f-26a1f190271a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1655 microversion: 2.1 time: 0.481442 Aug 30 04:33:10.149397 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2428/4774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:09 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1655 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:10.169671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb638181-566e-4ef6-a96d-009825ac2245 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:10.189528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb638181-566e-4ef6-a96d-009825ac2245 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.191307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb638181-566e-4ef6-a96d-009825ac2245 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.192157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb638181-566e-4ef6-a96d-009825ac2245 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.278768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb638181-566e-4ef6-a96d-009825ac2245 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Going to try to start instance {{(pid=122402) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:33:10.437995 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb638181-566e-4ef6-a96d-009825ac2245 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.250386 Aug 30 04:33:10.437995 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2347/4775] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:10 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:10.438303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:10.438303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.444219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.446007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.448969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.462877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.472100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.472758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.631858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:10.633795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:10.643780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.644677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.646334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:10.647884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:10.649053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:10.650098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.266965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.279783 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b4a483ab-a666-4209-b1f9-f135a9f7ec58 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1523 microversion: 2.1 time: 0.651934 Aug 30 04:33:11.292897 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2348/4776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1523 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:11.299471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.300098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:11.316394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.316970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.318269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.331789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.332016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.332657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.412153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.423729 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6324a8ae-e85c-4003-8fa8-fa283c412f28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1664 microversion: 2.1 time: 0.998887 Aug 30 04:33:11.429545 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2429/4777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:10 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1664 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:11.438172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:11.441320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:11.451129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.451896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.452741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.454393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:11.455078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:11.456007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:11.487204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:11.516603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c771ee5-5258-4f4d-bb1b-90d4cb81e3a1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085560 Aug 30 04:33:11.518047 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2430/4778] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:11 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:11.769383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.805745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.808731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:11.820312 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12948874-0119-480a-817d-b36f116b2d7e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2704 microversion: 2.32 time: 0.530051 Aug 30 04:33:11.826452 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2349/4779] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:11 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2704 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:12.069913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a26ef9ad-4fa5-4450-ac28-e4caa2d01f6d req-e5167ff0-21c9-45d9-b67f-39474aa75a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-deleted", "tag": "13475dce-cbe1-4768-8aea-e49281d30daf"}, {"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-deleted", "tag": "65fedda3-a97f-4c7d-a4a7-bc638e7f590b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:12.115943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a26ef9ad-4fa5-4450-ac28-e4caa2d01f6d req-e5167ff0-21c9-45d9-b67f-39474aa75a48 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.123415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a26ef9ad-4fa5-4450-ac28-e4caa2d01f6d req-e5167ff0-21c9-45d9-b67f-39474aa75a48 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.124967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a26ef9ad-4fa5-4450-ac28-e4caa2d01f6d req-e5167ff0-21c9-45d9-b67f-39474aa75a48 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.169485 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a26ef9ad-4fa5-4450-ac28-e4caa2d01f6d req-e5167ff0-21c9-45d9-b67f-39474aa75a48 service nova] Creating event network-vif-deleted:13475dce-cbe1-4768-8aea-e49281d30daf for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:12.171399 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a26ef9ad-4fa5-4450-ac28-e4caa2d01f6d req-e5167ff0-21c9-45d9-b67f-39474aa75a48 service nova] Creating event network-vif-deleted:65fedda3-a97f-4c7d-a4a7-bc638e7f590b for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:12.186581 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a26ef9ad-4fa5-4450-ac28-e4caa2d01f6d req-e5167ff0-21c9-45d9-b67f-39474aa75a48 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.118134 Aug 30 04:33:12.191186 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2431/4780] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:12.301706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:12.302314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:12.335278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.335892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.336355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.337103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.350080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.350531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.455677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:12.456417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:12.478408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.480508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.483609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:12.484465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:12.491125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:12.491603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.126057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:13.138631 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8858b0d1-c6e2-48bd-bee3-97c7acd114a6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1664 microversion: 2.1 time: 0.689179 Aug 30 04:33:13.144350 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2432/4781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:12 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1664 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:13.160165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:13.170629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:13.193621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.194146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.194595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.197602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.199246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.211880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.349028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-175fef63-2bfb-457a-b9d5-6f5b8d665756 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.201519 Aug 30 04:33:13.365532 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2433/4782] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:13 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:13.391806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:13.392988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:13.417101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.419132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.422945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.423999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:13.425496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:13.433138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:13.501945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:13.509843 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64f6bb7c-8319-456e-abe1-6d89af19bec5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1505 microversion: 2.1 time: 1.213581 Aug 30 04:33:13.510439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2350/4783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:12 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1505 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:14.161635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.162737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.188985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.194235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.197936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.198877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.205007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.205683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.722192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.742044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.746954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:14.751058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-382e9b48-1f15-484c-8f0d-c346cc15be82 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2339 microversion: 2.32 time: 1.382598 Aug 30 04:33:14.766425 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2434/4784] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:13 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2339 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:14.778055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f176e8f8-4888-45db-87bb-5e34a41ac1ca req-57e2bc46-7bb2-4828-b726-3a76aca611f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-deleted", "tag": "a2f39c69-25f2-4aac-8cf3-37819f843b3a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:14.801666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f176e8f8-4888-45db-87bb-5e34a41ac1ca req-57e2bc46-7bb2-4828-b726-3a76aca611f0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.802197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f176e8f8-4888-45db-87bb-5e34a41ac1ca req-57e2bc46-7bb2-4828-b726-3a76aca611f0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.802656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f176e8f8-4888-45db-87bb-5e34a41ac1ca req-57e2bc46-7bb2-4828-b726-3a76aca611f0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.828053 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f176e8f8-4888-45db-87bb-5e34a41ac1ca req-57e2bc46-7bb2-4828-b726-3a76aca611f0 service nova] Creating event network-vif-deleted:a2f39c69-25f2-4aac-8cf3-37819f843b3a for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:14.835748 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f176e8f8-4888-45db-87bb-5e34a41ac1ca req-57e2bc46-7bb2-4828-b726-3a76aca611f0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064913 Aug 30 04:33:14.837089 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2435/4785] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:14.851252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.855452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.866132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.867590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.868313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.869675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.870342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.870962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.933949 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d23dc1a7-5ac9-41e7-bcbf-b50534e57d87 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094654 Aug 30 04:33:14.936089 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2436/4786] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:33:14.942194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:14.943266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:14.951621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.954482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.955401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:14.956639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:14.957932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:14.958670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.179548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.192381 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e944aa09-81aa-4d32-9eed-b437e6664bd9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 1.036819 Aug 30 04:33:15.195135 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2351/4787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:15.210859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fa57c89a-e60a-429a-9d66-66bb15e875c4 req-18621053-6e5a-48a5-bc9c-4bbe87e84be9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ab824-5282-4e7c-8cfb-ffaa195156c4", "name": "network-vif-unplugged", "status": "completed", "tag": "23f42608-02e9-48e3-b5de-c188fa36665e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:15.226870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:15.234215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa57c89a-e60a-429a-9d66-66bb15e875c4 req-18621053-6e5a-48a5-bc9c-4bbe87e84be9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.234215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa57c89a-e60a-429a-9d66-66bb15e875c4 req-18621053-6e5a-48a5-bc9c-4bbe87e84be9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.234622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fa57c89a-e60a-429a-9d66-66bb15e875c4 req-18621053-6e5a-48a5-bc9c-4bbe87e84be9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.249898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fa57c89a-e60a-429a-9d66-66bb15e875c4 req-18621053-6e5a-48a5-bc9c-4bbe87e84be9 service nova] Creating event network-vif-unplugged:23f42608-02e9-48e3-b5de-c188fa36665e for instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 on n-h1-854925-5 Aug 30 04:33:15.259115 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fa57c89a-e60a-429a-9d66-66bb15e875c4 req-18621053-6e5a-48a5-bc9c-4bbe87e84be9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061121 Aug 30 04:33:15.277933 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2352/4788] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:15.287659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.288301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.329927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.330430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.330873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.337429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.339480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.340034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.362226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.372671 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-09c74030-2dd3-43ce-aa44-b41995fd7de2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1505 microversion: 2.1 time: 0.434494 Aug 30 04:33:15.374605 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2437/4789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:14 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:15.379856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.380751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.387675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.388566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.389170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.390130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.390766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.391371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.421608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:15.650273 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21520a2e-2cdc-4b59-b588-0cf5e82d4f21 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 204 len: 0 microversion: 2.1 time: 0.370147 Aug 30 04:33:15.654193 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2353/4790] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:15 2022] DELETE /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:15.673963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.675018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.703132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.707678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.707812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.708606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.709072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.717086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.756172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:15.774264 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3588a701-07df-4135-9375-9fc661520a28 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.398403 Aug 30 04:33:15.781025 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2438/4791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:15 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:15.792190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:15.795178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:15.810169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.812937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.815342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:15.816309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:15.819670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:15.820412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.107311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.122584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.125882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.145162 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-53743ead-abf2-45c5-8916-8fa9df78a809 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 2158 microversion: 2.32 time: 0.357736 Aug 30 04:33:16.154332 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2439/4792] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:15 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 2158 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:16.170201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:16.173310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.179928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.180677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.181501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.182369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.182992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.189956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.219350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:16.249522 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-58517ed1-81bd-4719-b2df-b843321a20ef tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1682 microversion: 2.1 time: 0.592872 Aug 30 04:33:16.250791 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2354/4793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:15 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1682 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:16.332142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Unlocking {{(pid=122403) unlock /opt/stack/nova/nova/compute/api.py:4872}} Aug 30 04:33:16.396997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:16.398788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.418829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.422852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.426674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.429789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.431220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.433643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.517989 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-052e4f5c-a8a7-44cc-a340-3483f16d58e8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.361712 Aug 30 04:33:16.518684 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2440/4794] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:16 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:16.530473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:16.531095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:16.546255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.549588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.550100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:16.550836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:16.551486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:16.553633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.327364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.344536 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b18cc9c9-ef2f-4bba-885a-2f30508133c0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.819312 Aug 30 04:33:17.346369 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2441/4795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:16 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:17.360526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-390ad929-819c-40a7-8fe5-d9261060f991 req-b1d1ad0a-8a5c-443b-be7d-d4be0b7186e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c763bea-31e2-4464-8cbe-b4d7e1dd48d7", "name": "network-vif-deleted", "tag": "dda5b7e4-c290-4a46-bdaa-376387119bd3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:17.395158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.417611 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2d6b622-874a-44ac-ba59-c762d17a6042 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1505 microversion: 2.1 time: 1.022206 Aug 30 04:33:17.418853 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2355/4796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:16 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1505 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:17.419607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-390ad929-819c-40a7-8fe5-d9261060f991 req-b1d1ad0a-8a5c-443b-be7d-d4be0b7186e7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.420121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-390ad929-819c-40a7-8fe5-d9261060f991 req-b1d1ad0a-8a5c-443b-be7d-d4be0b7186e7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.420569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-390ad929-819c-40a7-8fe5-d9261060f991 req-b1d1ad0a-8a5c-443b-be7d-d4be0b7186e7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.429352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:17.439431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:17.450616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.453171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.455352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.456471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.459076 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-390ad929-819c-40a7-8fe5-d9261060f991 req-b1d1ad0a-8a5c-443b-be7d-d4be0b7186e7 service nova] Creating event network-vif-deleted:dda5b7e4-c290-4a46-bdaa-376387119bd3 for instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 on n-h2-854925-5 Aug 30 04:33:17.463657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.465463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.478897 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-390ad929-819c-40a7-8fe5-d9261060f991 req-b1d1ad0a-8a5c-443b-be7d-d4be0b7186e7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129358 Aug 30 04:33:17.481581 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2442/4797] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:17.497573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:17.502957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:17.518261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.521943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.523269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.524904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.526214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.530887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.644634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.660090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.667795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:17.672218 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b92dfd5-b2be-40a6-aec6-4d5d17620ac6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.251238 Aug 30 04:33:17.678034 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2356/4798] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:17 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:17.697597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:17.698457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:17.713257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.714454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.714977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:17.715773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:17.716312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:17.716825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.326174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:18.335360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ff1274f-140a-4b00-ab21-f28fa2d5b7c2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1682 microversion: 2.1 time: 0.850405 Aug 30 04:33:18.346573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2443/4799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:17 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1682 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:18.440914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:18.441592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:18.453211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.454728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.455386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.456595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.457223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.458035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.506820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:18.533292 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d48da330-306f-427b-945e-a51e596b7b3b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.846432 Aug 30 04:33:18.536759 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2357/4800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:17 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:18.560809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:18.562010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:18.588816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.589952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.591948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:18.597103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:18.597860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:18.600024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.043412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.052624 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46233f53-1aa4-48d2-80d1-0036aa4c4c31 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 200 len: 1508 microversion: 2.1 time: 0.617174 Aug 30 04:33:19.053843 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2444/4801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:18 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 1508 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:19.060330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:19.066232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:19.097075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.097580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.098031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.098737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.104294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.104744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.198012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.212007 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-382e5388-70a1-4ed8-9aed-571fe7c19dc6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.656543 Aug 30 04:33:19.212609 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2358/4802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:18 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:19.235651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:19.236056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:19.258488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.258488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.265585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.270700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:19.271207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:19.271653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:19.356346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:19.407743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:33:19.429974 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.api [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Working on deleting snapshot 9ec73894-317e-4af1-b97b-8c0c6104db3f from shelved instance... Aug 30 04:33:19.980977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.991992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.995005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:19.999348 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01a6b341-63ef-474b-b582-1ab324b16d8e tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.941563 Aug 30 04:33:20.008024 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2445/4803] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:19 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:20.023408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:20.026161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.039821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.041872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.043139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.045211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.046593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.048872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.100352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:20.197350 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-314ff795-846f-44ff-a022-2d10f7a19f5a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.185448 Aug 30 04:33:20.199975 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2446/4804] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:20 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:20.215976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:20.218083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:20.238040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.239221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.240230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:20.241746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:20.242376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:20.244352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:21.068125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:21.086360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-579d45a5-4dc3-49a2-9278-ce05ff858f78 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1682 microversion: 2.1 time: 0.881810 Aug 30 04:33:21.090322 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2447/4805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:20 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1682 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:21.103284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:21.105748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:21.123381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:21.127556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:21.128487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:21.131954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:21.132952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:21.133772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:21.365897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Doing local delete in cell ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=122402) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 04:33:21.370440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:21.370961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:21.372580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:21.373038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.api [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 04:33:21.382369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] deallocate_for_instance() {{(pid=122402) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 04:33:22.311826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:22.322027 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b800f027-efdf-49c6-b5fd-199a596b9aa3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1653 microversion: 2.1 time: 1.229959 Aug 30 04:33:22.338542 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2448/4806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:21 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1653 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:22.349681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8f39c209-7fdb-4066-bf6d-31c5834ed04d req-53f5de2b-f4fa-4ad2-bfc8-c6a1e69e5e16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c629df0c-85ca-4656-962c-6c2a89e54371", "name": "network-vif-unplugged", "status": "completed", "tag": "411fafbb-a2ff-422d-8ad8-b1b67d15327d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:22.361620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8f39c209-7fdb-4066-bf6d-31c5834ed04d req-53f5de2b-f4fa-4ad2-bfc8-c6a1e69e5e16 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:22.362377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8f39c209-7fdb-4066-bf6d-31c5834ed04d req-53f5de2b-f4fa-4ad2-bfc8-c6a1e69e5e16 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:22.363030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8f39c209-7fdb-4066-bf6d-31c5834ed04d req-53f5de2b-f4fa-4ad2-bfc8-c6a1e69e5e16 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:22.381203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8f39c209-7fdb-4066-bf6d-31c5834ed04d req-53f5de2b-f4fa-4ad2-bfc8-c6a1e69e5e16 service nova] Creating event network-vif-unplugged:411fafbb-a2ff-422d-8ad8-b1b67d15327d for instance c629df0c-85ca-4656-962c-6c2a89e54371 on n-h1-854925-5 Aug 30 04:33:22.388157 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8f39c209-7fdb-4066-bf6d-31c5834ed04d req-53f5de2b-f4fa-4ad2-bfc8-c6a1e69e5e16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047577 Aug 30 04:33:22.406586 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2449/4807] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:22.414416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:22.415691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:22.425637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:22.427358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:22.427990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:22.429200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:22.430002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:22.430714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:22.922049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:22.942796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:22.948556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:22.952582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5715e0e-d810-4ef3-9fe2-ba5de71e5d46 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.543339 Aug 30 04:33:22.968168 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2450/4808] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:22 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:22.987983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:22.988630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:23.002413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.002935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.003680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.004758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.005599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.006280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.207018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:23.227911 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-34be5f6b-481a-4e2d-9024-9d3bfbe9e51c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 200 len: 1614 microversion: 2.1 time: 0.253048 Aug 30 04:33:23.228419 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2451/4809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:22 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 1614 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:23.246663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:23.247514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:23.254613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.255472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.256346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.258439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.259507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.260649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.454136 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59648076-b86d-4a76-9eb4-3302221591fa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.211054 Aug 30 04:33:23.456202 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2452/4810] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:23 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:23.491433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:23.492181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:23.529567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.530145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.530676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.531400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:23.534070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:23.534661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:23.635751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Updating instance_info_cache with network_info: [] {{(pid=122402) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:33:24.177958 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c00668f-2226-4653-aa65-facf5853f614 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 204 len: 0 microversion: 2.1 time: 4.963799 Aug 30 04:33:24.183664 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2359/4811] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:33:19 2022] DELETE /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 0 bytes in 4966 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:33:24.190509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1dbff2a7-7e0a-46b0-bede-1616c71c523f req-66174228-0a87-4a4f-9e83-5bb45f3a2cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "971ab824-5282-4e7c-8cfb-ffaa195156c4", "name": "network-vif-deleted", "tag": "23f42608-02e9-48e3-b5de-c188fa36665e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:24.213409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1dbff2a7-7e0a-46b0-bede-1616c71c523f req-66174228-0a87-4a4f-9e83-5bb45f3a2cca service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.214177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1dbff2a7-7e0a-46b0-bede-1616c71c523f req-66174228-0a87-4a4f-9e83-5bb45f3a2cca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.215093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1dbff2a7-7e0a-46b0-bede-1616c71c523f req-66174228-0a87-4a4f-9e83-5bb45f3a2cca service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.228791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.server_external_events [req-1dbff2a7-7e0a-46b0-bede-1616c71c523f req-66174228-0a87-4a4f-9e83-5bb45f3a2cca service nova] Unable to find a host for instance 971ab824-5282-4e7c-8cfb-ffaa195156c4. Dropping event network-vif-deleted {{(pid=122402) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 04:33:24.230453 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1dbff2a7-7e0a-46b0-bede-1616c71c523f req-66174228-0a87-4a4f-9e83-5bb45f3a2cca service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.045730 Aug 30 04:33:24.231522 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2360/4812] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 47 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 04:33:24.236287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:24.237106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:24.246224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.248434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.249294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.250498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.251127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.251875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.771536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:24.784341 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38e3494c-1327-4942-ab56-9cb6dc8dc648 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1660 microversion: 2.1 time: 1.305454 Aug 30 04:33:24.784991 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2453/4813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:23 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1660 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:24.791481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:24.794112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:24.852386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.853283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.859124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.859929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:24.866190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:24.867716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:24.933477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 HTTP/1.1 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '971ab824-5282-4e7c-8cfb-ffaa195156c4'} Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:24.935163 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:24.941158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:24.941158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:24.941158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:24.941158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:24.941158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:24.941158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:33:24.941158 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:24.950460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:24.952599 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-389a9830-f896-4cad-bdac-7a0fa926d6af tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 404 len: 111 microversion: 2.1 time: 0.164846 Aug 30 04:33:24.955078 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2454/4814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:24 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:24.995202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:24.995849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:25.036048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:25.036560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:25.045252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.047860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:25.052329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:25.052716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:25.101684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 HTTP/1.1 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c629df0c-85ca-4656-962c-6c2a89e54371'} Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:25.105920 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:25.111297 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:25.111297 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:25.111297 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:25.111297 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:25.111297 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:25.111297 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:33:25.111297 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:25.114436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:25.116840 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47023084-0952-48db-a666-65f01c06739d tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 404 len: 111 microversion: 2.1 time: 0.145844 Aug 30 04:33:25.120402 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2455/4815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:24 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:33:25.132122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c8cac7a-e789-42c5-b786-aaf8f2b52ec0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '.version_select at 0x7fe96919eca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:25.144948 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0c8cac7a-e789-42c5-b786-aaf8f2b52ec0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [8dd2a198-3d7d-4bab-ac63-d9702e11791a] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:33:25.772505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:25.791035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:25.797372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:25.802221 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec89f856-c174-4310-b8e1-cef7aa782363 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 1.568199 Aug 30 04:33:25.803095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2361/4816] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:24 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:25.816051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1202413739", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "2f7235d3-0772-4dc5-b1a3-7959b9c9a850"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:25.951500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] validate_networks() for [('2f7235d3-0772-4dc5-b1a3-7959b9c9a850', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:33:26.154537 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [None req-0c8cac7a-e789-42c5-b786-aaf8f2b52ec0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [8dd2a198-3d7d-4bab-ac63-d9702e11791a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 33452. Aug 30 04:33:26.196653 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c8cac7a-e789-42c5-b786-aaf8f2b52ec0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-722536413" status: 202 len: 0 microversion: 2.1 time: 1.073220 Aug 30 04:33:26.201052 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2456/4817] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:33:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-722536413 => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:26.206401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:26.207035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:26.239079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:26.241514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:26.242475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:26.243682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:26.244341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:26.244974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.042110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:27.062862 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7de6338-5248-4121-8761-fc3efee88c21 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.860793 Aug 30 04:33:27.064116 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2457/4818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:26 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:27.078990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-06dc18de-a7f2-4a6d-b4e1-40933469ed40 req-286be0e0-a49d-419b-886d-e21e917aed3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c629df0c-85ca-4656-962c-6c2a89e54371", "name": "network-vif-deleted", "tag": "411fafbb-a2ff-422d-8ad8-b1b67d15327d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:27.111759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-06dc18de-a7f2-4a6d-b4e1-40933469ed40 req-286be0e0-a49d-419b-886d-e21e917aed3d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.113646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-06dc18de-a7f2-4a6d-b4e1-40933469ed40 req-286be0e0-a49d-419b-886d-e21e917aed3d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.114219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-06dc18de-a7f2-4a6d-b4e1-40933469ed40 req-286be0e0-a49d-419b-886d-e21e917aed3d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.144796 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-06dc18de-a7f2-4a6d-b4e1-40933469ed40 req-286be0e0-a49d-419b-886d-e21e917aed3d service nova] Creating event network-vif-deleted:411fafbb-a2ff-422d-8ad8-b1b67d15327d for instance c629df0c-85ca-4656-962c-6c2a89e54371 on n-h1-854925-5 Aug 30 04:33:27.154252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:33:27.155418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:33:27.156135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:33:27.156561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:33:27.156739 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-06dc18de-a7f2-4a6d-b4e1-40933469ed40 req-286be0e0-a49d-419b-886d-e21e917aed3d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089290 Aug 30 04:33:27.157151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:33:27.158091 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2458/4819] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:27.167347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:27.168762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:27.171618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.172253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.175424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.176945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.178211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.179029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.179969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.181161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.182033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.182721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.186847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.187304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.217230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:33:27.235100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for user 9c91ba9579a24655a2c6842bac6e7034 and project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:33:27.259210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:33:27.261485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:33:27.347992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:27.369645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:27.375591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:27.393279 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c1c45cb-8ee5-46e0-9c49-89f17e3a9b03 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.228725 Aug 30 04:33:27.395670 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c55d5dee-85c7-42e5-bfc9-84673171222b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.587590 Aug 30 04:33:27.398257 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2459/4820] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:27 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:27.405483 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2362/4821] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:33:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:33:27.411357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:27.414421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:27.425950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6cb49c3-48d6-4a7f-b910-7d75572a21ff tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:27.428251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c6cb49c3-48d6-4a7f-b910-7d75572a21ff tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:27.439985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.442717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.444174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.446135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:27.449151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:27.450007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:27.586725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6cb49c3-48d6-4a7f-b910-7d75572a21ff tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:27.598130 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6cb49c3-48d6-4a7f-b910-7d75572a21ff tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1215 microversion: 2.1 time: 0.179644 Aug 30 04:33:27.601272 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2363/4822] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:27 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:27.967524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:27.994083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e90ed84a-8751-4a3d-9a3f-dab8b6e17016 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.594181 Aug 30 04:33:27.995339 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2460/4823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:27 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:28.019050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:28.020250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:28.031849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.032362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.032812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.033583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.034005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.034443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.337958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:28.349598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bceb25b9-c20a-4d09-9f38-dcce58acffff tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.335066 Aug 30 04:33:28.350734 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2364/4824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:28 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:28.378747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:28.379377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:28.388662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.389259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.395603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.396626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.397297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.397762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.428943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:28.429605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:28.441799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.441956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.448494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.457969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.458776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.459414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.714512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:28.732986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:28.738962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:28.746050 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-962032eb-02c3-4290-9090-890e98d93281 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.321240 Aug 30 04:33:28.747330 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2365/4825] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:28 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:28.752717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:28.766670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:28.778917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.782115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.782852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:28.783858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:28.785914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:28.797759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.011536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:29.026595 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-86a55a69-a85b-49bb-9744-612aa1151160 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1211 microversion: 2.1 time: 0.277837 Aug 30 04:33:29.028645 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2366/4826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:28 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1211 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:29.156354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:29.167202 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6455687-7cfb-438e-9dd2-3531fa7d58f7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.792951 Aug 30 04:33:29.183902 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2461/4827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:28 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:29.189221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:29.189942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:29.199278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.199780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.200221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.200934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.201428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.212224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.412124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-242bec97-e8b0-4c9a-ad95-6260fe5bcec3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: .version_select at 0x7fe96a51f820>, body: {"keypair": {"name": "tempest-keypair-444627477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANpM8UoZuSswHHH+bURTunSRE1RUiJ/Y8X8Dh4GkmdrRbirnl5TxLsBpxSZK0cL9nREAyzCLJwr2eLPvuBo82spjtx81YQbgTieGOre6xFSMuayz1UJk/B3T7SZnMOj4A=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:29.434958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-242bec97-e8b0-4c9a-ad95-6260fe5bcec3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:33:29.438567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:29.447965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-242bec97-e8b0-4c9a-ad95-6260fe5bcec3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:33:29.450865 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0f895410-f1f6-4408-b132-5dafbd472c37 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.266388 Aug 30 04:33:29.463049 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2367/4828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:29 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:29.485602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:29.488062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:29.517364 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-242bec97-e8b0-4c9a-ad95-6260fe5bcec3 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.110190 Aug 30 04:33:29.517989 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2462/4829] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:33:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:29.524078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.524078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.524078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.524078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.540670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.541820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.781531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:29.783834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:29.800972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.802220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.803168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.807981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:29.808823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:29.809461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:29.907838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:29.916254 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5cd70ba3-6239-4658-85bb-03e1cad9599e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.445722 Aug 30 04:33:29.916872 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2368/4830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:29 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:30.059874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:30.060834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:30.073122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:30.074289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:30.075692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:30.078762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:30.079955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:30.080931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:30.081785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:30.084291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:30.086124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:30.089299 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c44c84a-10b9-4af6-a117-63658ba8669f tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.313473 Aug 30 04:33:30.090827 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2463/4831] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:29 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:30.230566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:30.240712 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e598376e-8458-49e2-aab9-d0d6994f698d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1285 microversion: 2.1 time: 0.185076 Aug 30 04:33:30.244693 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2369/4832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:30 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1285 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:31.116051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:31.116664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:31.128198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:31.128694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:31.129133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:31.129871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:31.130509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:31.131107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:31.272996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:31.274414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:31.281380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:31.282124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:31.282732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:31.283607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:31.284232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:31.284847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:31.323187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:31.345466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:31.350259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:31.351155 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d256ae7-7479-42ab-98af-7b7771a8d1b0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.239931 Aug 30 04:33:31.352241 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2464/4833] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:31 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:31.380496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:31.389963 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce2a345c-77ac-4eda-a704-a4340f69e5b5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1273 microversion: 2.1 time: 0.122015 Aug 30 04:33:31.391048 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2370/4834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:31 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:32.383661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:32.387714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:32.400374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.402982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.403743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.411789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:32.413123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:32.420830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.421620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.423101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.427820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.431229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.442400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.444040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:32.466092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:32.466712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:32.634450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:32.637988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:32.652577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:32.654426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:32.656922 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91774bdc-ecd0-4f35-bf0e-490f71ec8010 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.278315 Aug 30 04:33:32.665840 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2465/4835] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:32 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:32.889676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:32.909298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:32.922583 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c6567bc-b470-478b-8a22-7653244c955e tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1315 microversion: 2.1 time: 0.514101 Aug 30 04:33:32.922583 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2371/4836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:32 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:33.683757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:33.684376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:33.708205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:33.710886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:33.712038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:33.713520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:33.725249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:33.730244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:33.845072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c049c0c8-bc09-43b3-80c9-ae757103f675 req-dfbbae80-c69d-4441-a528-51d7a6c7ae38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61937213-1174-4ac3-bb1c-15f50da92ca7", "tag": "138dc1c3-8090-42db-931a-d383371e95ba"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:33.854468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:33.869187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:33.870608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:33.875831 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4510a3ea-6aec-45d7-a8f6-57dc04c27467 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.196082 Aug 30 04:33:33.876459 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2466/4837] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:33 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:33.881556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c049c0c8-bc09-43b3-80c9-ae757103f675 req-dfbbae80-c69d-4441-a528-51d7a6c7ae38 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:33.882042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c049c0c8-bc09-43b3-80c9-ae757103f675 req-dfbbae80-c69d-4441-a528-51d7a6c7ae38 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:33.882479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c049c0c8-bc09-43b3-80c9-ae757103f675 req-dfbbae80-c69d-4441-a528-51d7a6c7ae38 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:33.913681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c049c0c8-bc09-43b3-80c9-ae757103f675 req-dfbbae80-c69d-4441-a528-51d7a6c7ae38 service nova] Creating event network-changed:138dc1c3-8090-42db-931a-d383371e95ba for instance 61937213-1174-4ac3-bb1c-15f50da92ca7 on n-h2-854925-5 Aug 30 04:33:33.929658 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c049c0c8-bc09-43b3-80c9-ae757103f675 req-dfbbae80-c69d-4441-a528-51d7a6c7ae38 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083791 Aug 30 04:33:33.933739 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2372/4838] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:33.947570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:33.948484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:33.959208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:33.962875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:33.963575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:33.964531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:33.965159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:33.967353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:34.048438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1126377174", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "18317384-8fd4-47be-a014-e798974b8cdc"}], "security_groups": [{"name": "tempest-securitygroup--306492131"}], "key_name": "tempest-keypair-444627477", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:34.239636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:34.254142 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3bf191cd-da51-4d66-a569-cb18a1d7231c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1315 microversion: 2.1 time: 0.310808 Aug 30 04:33:34.265695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2467/4839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:33 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:34.291304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] validate_networks() for [('18317384-8fd4-47be-a014-e798974b8cdc', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:33:34.900508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:34.901858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:34.921287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:34.922068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:34.922734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:34.923693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:34.924389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:34.925054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:35.092571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:35.111765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:35.113885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:35.115407 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-405f282c-cd72-4db8-98bf-051b6c6d8bae tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.218855 Aug 30 04:33:35.116541 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2468/4840] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:34 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:35.124123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:33:35.124605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:33:35.125009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:33:35.125442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:33:35.125858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:33:35.141170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:35.141695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:35.142138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:35.142875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:35.143332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:35.143761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:35.193024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:33:35.203768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Getting quotas for user f0a5b3212f964ba3b0039e84f933c317 and project 25c9f9ed40704753b7f7e70d5d53b7b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:33:35.250548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:33:35.259308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:33:35.281733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:35.282353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:35.291897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:35.299817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:35.300420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:35.301447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:35.310789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:35.312249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:35.402108 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed28f96a-8a72-4586-b83b-a2b7e1427a88 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.360645 Aug 30 04:33:35.402773 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2373/4841] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:33:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:33:35.429921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ea3db7a-0f85-4640-884f-46ed76e8912f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:35.433533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ea3db7a-0f85-4640-884f-46ed76e8912f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:35.777771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2ea3db7a-0f85-4640-884f-46ed76e8912f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:35.803812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ea3db7a-0f85-4640-884f-46ed76e8912f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1241 microversion: 2.1 time: 0.384662 Aug 30 04:33:35.804658 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2374/4842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:35 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1241 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:35.811285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:35.824587 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a2cd4f15-423a-4862-a620-e98680d7d8df tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1315 microversion: 2.1 time: 0.543716 Aug 30 04:33:35.836832 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2469/4843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:35 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1315 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:36.144372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:36.146144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:36.162383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.163902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.165243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.167956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.168693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.170681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.335638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:36.355705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:36.362093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:36.365273 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e9ff90e-10a6-425c-b498-1b73e73276bb tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.224520 Aug 30 04:33:36.385500 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2375/4844] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:36 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:33:36.824214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:36.825359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:36.840681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.841179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.850792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:36.851876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:36.853433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.854322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.859033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.862002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.872341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.873130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.876129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:36.877732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:36.882218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:36.882902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:37.309868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:37.321240 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e2696ad-dbe4-4046-9c56-b55e3979d05f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1293 microversion: 2.1 time: 0.500941 Aug 30 04:33:37.336216 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2470/4845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:36 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1293 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:37.390541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:37.391348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:37.408953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:37.409690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:37.410298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:37.411186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:37.411758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:37.413045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:37.413701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:37.426651 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e9afdedd-958e-42e2-9477-0f18fe04fe51 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1315 microversion: 2.1 time: 0.581669 Aug 30 04:33:37.428053 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2376/4846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:36 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:37.789842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:37.802400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:37.805078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:37.805867 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ec7cee9-b3e8-4b47-bf4a-cd19f55e1204 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.419436 Aug 30 04:33:37.807713 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2471/4847] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:37 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:38.350735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:38.351911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:38.369930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.370830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.375731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:38.376952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.377676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.378390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:38.448068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:38.448697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:38.453053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:38.465861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.472053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.472778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:38.473795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.474549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.475158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:38.665139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:38.678815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-50e4ff3e-fb55-416c-a7ef-89ac40e284c5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1299 microversion: 2.1 time: 0.333097 Aug 30 04:33:38.693004 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2377/4848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:38 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1299 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:38.838689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:38.839444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:38.843797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:38.855614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.856126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.859071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:38.860183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:38.862000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:38.863994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:38.962109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:38.976589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c447783-338b-4d08-ae58-b38c41a9ec52 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1315 microversion: 2.1 time: 0.532296 Aug 30 04:33:38.993937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2472/4849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:38 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:39.040355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:39.055419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:39.056918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '597f7e8d3d0145019fa489acf03f40d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e9d663de1c740fd8f6b3e94bfcd175b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:39.065022 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be0e2e28-4f06-44eb-8179-67b1ec408180 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 200 len: 1603 microversion: 2.32 time: 0.226692 Aug 30 04:33:39.070543 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2378/4850] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:38 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 1603 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:33:39.700906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:39.702434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:39.706700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:39.716480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:39.725243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:39.725932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:39.726810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:39.727195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:39.727652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:40.007666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:40.008419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:40.068652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:40.070676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:40.073470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:40.082867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:40.083944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:40.090469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:40.259140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:40.281935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71b9a7d3-8799-4783-95f3-538fc4fe8a57 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.585587 Aug 30 04:33:40.283870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2473/4851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:39 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:40.311876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:40.313517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:40.331970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:40.332484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:40.332934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:40.337536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:40.337852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:40.338316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:40.375519 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] HTTP exception thrown: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Request method failure captured: Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 HTTP/1.1 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGTXI9G7jLScdq-BRKmsfmD99K-_f3rmYp1lcLiP_9msbP-98bAXOH8hmx-QCQT8a6R_ffhLZMeJ8GJzgWS5KHcgtrDcL_-zaPjw4Utu6VwUlYm4WXEXVxZUDFdAypJqxSPvIO7ZFu-Knj47Erqa1NpfwUV0y2pYqUI-TgbvsUHSak Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 7e9d663de1c740fd8f6b3e94bfcd175b Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e9d663de1c740fd8f6b3e94bfcd175b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e9d663de1c740fd8f6b3e94bfcd175b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e9d663de1c740fd8f6b3e94bfcd175b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e9d663de1c740fd8f6b3e94bfcd175b"}]}] Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 7e9d663de1c740fd8f6b3e94bfcd175b Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TaggedBootDevicesTest-335125360-project Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 597f7e8d3d0145019fa489acf03f40d7 Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TaggedBootDevicesTest-335125360-project Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '4c763bea-31e2-4464-8cbe-b4d7e1dd48d7'} Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:40.381390 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:40.387399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:40.387399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:40.387399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:40.387399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:40.387399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:40.387399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:40.387399 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:33:40.390025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Returning 404 to user: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:40.391364 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f46b133b-0f69-4a50-ba54-63f7d3506ac0 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 404 len: 111 microversion: 2.32 time: 0.106078 Aug 30 04:33:40.392497 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2474/4852] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:40 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:33:40.404396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c450a5c3-3546-4a6a-a583-c1bf4cf9185c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '.version_select at 0x7fe969573670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:40.446713 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c450a5c3-3546-4a6a-a583-c1bf4cf9185c tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997462772" status: 204 len: 0 microversion: 2.32 time: 0.046709 Aug 30 04:33:40.448050 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2475/4853] 10.222.0.27 () {60 vars in 1262 bytes} [Tue Aug 30 04:33:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997462772 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:33:40.556984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:40.567392 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adeeedc9-dc06-4916-be67-917671602fdd tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1315 microversion: 2.1 time: 0.563712 Aug 30 04:33:40.586813 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2379/4854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:40 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:41.001862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b03f2412-e668-49c8-bd21-8d70c612d6ed req-24fe5cfd-0ef3-4dac-923c-59aca3df49d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61937213-1174-4ac3-bb1c-15f50da92ca7", "name": "network-vif-plugged", "status": "completed", "tag": "138dc1c3-8090-42db-931a-d383371e95ba"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:41.024743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b03f2412-e668-49c8-bd21-8d70c612d6ed req-24fe5cfd-0ef3-4dac-923c-59aca3df49d1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.025386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b03f2412-e668-49c8-bd21-8d70c612d6ed req-24fe5cfd-0ef3-4dac-923c-59aca3df49d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.025936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b03f2412-e668-49c8-bd21-8d70c612d6ed req-24fe5cfd-0ef3-4dac-923c-59aca3df49d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.056777 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b03f2412-e668-49c8-bd21-8d70c612d6ed req-24fe5cfd-0ef3-4dac-923c-59aca3df49d1 service nova] Creating event network-vif-plugged:138dc1c3-8090-42db-931a-d383371e95ba for instance 61937213-1174-4ac3-bb1c-15f50da92ca7 on n-h2-854925-5 Aug 30 04:33:41.071087 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b03f2412-e668-49c8-bd21-8d70c612d6ed req-24fe5cfd-0ef3-4dac-923c-59aca3df49d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074255 Aug 30 04:33:41.073461 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2476/4855] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:41.306082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:41.307236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:41.325836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.330247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.331314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.335013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.340872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.341581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.594210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:41.595282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:41.613036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.613818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.626003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:41.627037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:41.627678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:41.628288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:42.078389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:42.103471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6759524f-a108-4448-b5a4-1b418a8ea8b0 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.801158 Aug 30 04:33:42.104962 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2380/4856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:41 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:42.130792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:42.140621 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b37537a-f8d2-4f13-b8f7-7083ffbc640a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1315 microversion: 2.1 time: 0.550902 Aug 30 04:33:42.141941 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2477/4857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:41 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:33:42.991283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e4644ca4-2a2a-4b60-8195-8f52332e1ce6 req-5a2ccb42-3c1c-480d-b350-14c9864951a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2347a7-538e-475e-9f4a-d33938f016c0", "tag": "67d49d92-cbc5-4916-847e-c4ee1a29e22c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:43.026682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e4644ca4-2a2a-4b60-8195-8f52332e1ce6 req-5a2ccb42-3c1c-480d-b350-14c9864951a3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:43.027552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e4644ca4-2a2a-4b60-8195-8f52332e1ce6 req-5a2ccb42-3c1c-480d-b350-14c9864951a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:43.028171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e4644ca4-2a2a-4b60-8195-8f52332e1ce6 req-5a2ccb42-3c1c-480d-b350-14c9864951a3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:43.047622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e4644ca4-2a2a-4b60-8195-8f52332e1ce6 req-5a2ccb42-3c1c-480d-b350-14c9864951a3 service nova] Creating event network-changed:67d49d92-cbc5-4916-847e-c4ee1a29e22c for instance 4c2347a7-538e-475e-9f4a-d33938f016c0 on n-h1-854925-5 Aug 30 04:33:43.059871 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e4644ca4-2a2a-4b60-8195-8f52332e1ce6 req-5a2ccb42-3c1c-480d-b350-14c9864951a3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074481 Aug 30 04:33:43.062196 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2381/4858] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:43.126984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:43.127608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:43.134637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:43.135342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:43.135901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:43.136289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:43.136753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:43.137192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:43.166319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:43.167290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:43.182268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:43.185109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:43.188666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:43.190102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:43.191072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:43.193585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:44.205290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:44.217820 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19d88975-8736-435f-8243-005590637485 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 1.095089 Aug 30 04:33:44.218620 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2478/4859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:43 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:44.245612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:44.254223 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-feae6347-2ddb-4d99-9ee3-2f1a72c9bb71 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1501 microversion: 2.1 time: 1.094144 Aug 30 04:33:44.263555 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2382/4860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:43 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1501 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:44.275923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-765099c9-ff4c-4247-b800-64a730aae5a0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:44.282919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-765099c9-ff4c-4247-b800-64a730aae5a0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:44.283662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-765099c9-ff4c-4247-b800-64a730aae5a0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:44.284259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-765099c9-ff4c-4247-b800-64a730aae5a0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:44.319348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-765099c9-ff4c-4247-b800-64a730aae5a0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Going to try to stop instance {{(pid=122403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:33:44.387154 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-765099c9-ff4c-4247-b800-64a730aae5a0 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7/action" status: 202 len: 0 microversion: 2.1 time: 0.114811 Aug 30 04:33:44.389638 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2479/4861] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:33:44 2022] POST /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:33:44.403349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:44.404529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:44.419950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:44.421631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:44.422392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:44.426218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:44.428206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:44.430519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:44.801743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:44.826681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84063cd3-7421-4da9-a300-ae56250e0a55 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.432116 Aug 30 04:33:44.836534 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2383/4862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:44 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:45.241360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:45.242233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:45.256420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.256900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.257370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.258098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.258565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.259005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.667011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:45.680033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0a7fcd40-5fbe-4d33-9eda-6b3ae4eaaae7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.444164 Aug 30 04:33:45.682085 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2480/4863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:45 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:45.860720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:45.862252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:45.868890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:45.871474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=16 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:45.874849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.875574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.876199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:45.877088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:45.878164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:45.878839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:46.341450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:46.353546 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-09ab02f1-6a6f-441c-81df-728bd512f84a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.499137 Aug 30 04:33:46.361159 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2384/4864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:45 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:46.705797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:46.707318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:46.729739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:46.734285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:46.734742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:46.735633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:46.736513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:46.736951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:46.988542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:46.989845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:47.001185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.008216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.008967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.010143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.010806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.011248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.027578 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] HTTP exception thrown: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Request method failure captured: Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 HTTP/1.1 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGTXI9G7jLScdq-BRKmsfmD99K-_f3rmYp1lcLiP_9msbP-98bAXOH8hmx-QCQT8a6R_ffhLZMeJ8GJzgWS5KHcgtrDcL_-zaPjw4Utu6VwUlYm4WXEXVxZUDFdAypJqxSPvIO7ZFu-Knj47Erqa1NpfwUV0y2pYqUI-TgbvsUHSak Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7e9d663de1c740fd8f6b3e94bfcd175b Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e9d663de1c740fd8f6b3e94bfcd175b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e9d663de1c740fd8f6b3e94bfcd175b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e9d663de1c740fd8f6b3e94bfcd175b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e9d663de1c740fd8f6b3e94bfcd175b"}]}] Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7e9d663de1c740fd8f6b3e94bfcd175b Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TaggedBootDevicesTest-335125360-project Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 597f7e8d3d0145019fa489acf03f40d7 Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TaggedBootDevicesTest-335125360-project Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '4c763bea-31e2-4464-8cbe-b4d7e1dd48d7'} Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:47.029566 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Returning 404 to user: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1263de9-0694-4276-90e5-c9e67e63d3a6 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 404 len: 111 microversion: 2.32 time: 0.047246 Aug 30 04:33:47.036291 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2385/4865] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:33:46 2022] DELETE /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:33:47.048824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:47.053847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] [instance: 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:47.061788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.062282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.062953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.064136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.064602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.065037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.066414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:47.077228 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9d9f50a4-4d11-44f8-9867-670d68ad2b14 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.376162 Aug 30 04:33:47.081568 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] HTTP exception thrown: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Request method failure captured: Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 HTTP/1.1 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGTXI9G7jLScdq-BRKmsfmD99K-_f3rmYp1lcLiP_9msbP-98bAXOH8hmx-QCQT8a6R_ffhLZMeJ8GJzgWS5KHcgtrDcL_-zaPjw4Utu6VwUlYm4WXEXVxZUDFdAypJqxSPvIO7ZFu-Knj47Erqa1NpfwUV0y2pYqUI-TgbvsUHSak Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.32 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 7e9d663de1c740fd8f6b3e94bfcd175b Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7e9d663de1c740fd8f6b3e94bfcd175b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7e9d663de1c740fd8f6b3e94bfcd175b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e9d663de1c740fd8f6b3e94bfcd175b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7e9d663de1c740fd8f6b3e94bfcd175b"}]}] Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 7e9d663de1c740fd8f6b3e94bfcd175b Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TaggedBootDevicesTest-335125360 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TaggedBootDevicesTest-335125360-project Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 597f7e8d3d0145019fa489acf03f40d7 Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TaggedBootDevicesTest-335125360-project Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '4c763bea-31e2-4464-8cbe-b4d7e1dd48d7'} Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:33:47.083362 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.089040 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:33:47.089040 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:33:47.089040 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:33:47.089040 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:33:47.089040 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:33:47.089040 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. Aug 30 04:33:47.089040 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:33:47.090441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] Returning 404 to user: Instance 4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:33:47.090593 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2481/4866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:46 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:47.091600 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0402930-5d9a-43c1-8e36-b039a3293e80 tempest-TaggedBootDevicesTest-335125360 tempest-TaggedBootDevicesTest-335125360-project] 10.222.0.27 "GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7" status: 404 len: 111 microversion: 2.32 time: 0.055109 Aug 30 04:33:47.092360 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2386/4867] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:33:47 2022] GET /compute/v2.1/servers/4c763bea-31e2-4464-8cbe-b4d7e1dd48d7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:33:47.393953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:47.394835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:47.401804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.402663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.404499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.405560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:47.406209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:47.406846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:47.713246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:47.726653 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64c2d712-a173-4fa6-bc5c-fc8aa6df68ca tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.347979 Aug 30 04:33:47.729908 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2482/4868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:47 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:48.100564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:48.101799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:48.123830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.125251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.125842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.128356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.129552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.130316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.415355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:48.422760 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8874b13a-527c-4d4e-ad98-3404fde4b408 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.326758 Aug 30 04:33:48.423158 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2387/4869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:48 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:48.757912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:48.758576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:48.778524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.778973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.782554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:48.783275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:48.787709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:48.790029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:49.171158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:49.178525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:49.195459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-baa9555d-90e8-447e-bf72-4df0ddc3718f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.443927 Aug 30 04:33:49.196609 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2483/4870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:48 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:49.443879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:49.444567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:49.457828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:49.458333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:49.460636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:49.461619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:49.462104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:49.465481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:49.739757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:49.753587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-351d6cbb-cf64-4474-84d7-a74792ebacf4 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.310493 Aug 30 04:33:49.754239 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2388/4871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:49 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:50.217138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:50.218460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:50.228329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:50.229156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:50.229847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.231114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:50.231828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:50.234734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.447153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:50.460598 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aec3b987-8376-4190-8c26-408834c4acd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.247134 Aug 30 04:33:50.461215 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2484/4872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:50 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:50.778358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:50.780699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:50.797646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:50.799990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:50.803200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.804376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:50.805656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:50.806205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.888282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4e9d5c3d-0782-4850-ac55-5452cfdca4d1 req-3c58c49a-4917-40ca-b18f-12fc3ef6cc07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2347a7-538e-475e-9f4a-d33938f016c0", "name": "network-vif-plugged", "status": "completed", "tag": "67d49d92-cbc5-4916-847e-c4ee1a29e22c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:50.922894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4e9d5c3d-0782-4850-ac55-5452cfdca4d1 req-3c58c49a-4917-40ca-b18f-12fc3ef6cc07 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:50.923723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4e9d5c3d-0782-4850-ac55-5452cfdca4d1 req-3c58c49a-4917-40ca-b18f-12fc3ef6cc07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:50.931895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4e9d5c3d-0782-4850-ac55-5452cfdca4d1 req-3c58c49a-4917-40ca-b18f-12fc3ef6cc07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:50.987462 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4e9d5c3d-0782-4850-ac55-5452cfdca4d1 req-3c58c49a-4917-40ca-b18f-12fc3ef6cc07 service nova] Creating event network-vif-plugged:67d49d92-cbc5-4916-847e-c4ee1a29e22c for instance 4c2347a7-538e-475e-9f4a-d33938f016c0 on n-h1-854925-5 Aug 30 04:33:51.001719 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4e9d5c3d-0782-4850-ac55-5452cfdca4d1 req-3c58c49a-4917-40ca-b18f-12fc3ef6cc07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117290 Aug 30 04:33:51.010861 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2485/4873] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:33:51.126100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:51.137063 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7827316a-46ae-441c-95b6-36d2cb69273f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.365376 Aug 30 04:33:51.138122 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2389/4874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:50 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:51.481919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:51.483636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:51.500000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.501681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.502136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.504085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:51.504559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:51.507973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:51.960986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:51.972461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1fff1485-3d29-451f-8f9b-4a84cf963563 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.494879 Aug 30 04:33:51.973063 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2486/4875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:51 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:52.160672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:52.161931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:52.172768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:52.173690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:52.174442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.175391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:52.176500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:52.177170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:52.416810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:52.429702 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6fd4ad86-5de9-4fcd-9c5f-b292887ff39e tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1366 microversion: 2.1 time: 0.271493 Aug 30 04:33:52.444705 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2390/4876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:52 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:52.999683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:53.001050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:53.011153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.011760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.012955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.014273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.014977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.015582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.195280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:53.206339 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6fbc3243-0be4-453b-af08-0e92fa2b23f7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.213967 Aug 30 04:33:53.221978 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2487/4877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:52 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:53.452605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:53.453444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:53.469943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.470475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.474114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.474878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.475554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.478569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.703704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:53.716526 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d6eb6944-0a29-428c-809f-b5688fd765d8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1556 microversion: 2.1 time: 0.269119 Aug 30 04:33:53.721016 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2391/4878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:53 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1556 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:53.741071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:53.741686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:53.748013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.748759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.749206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.750143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:53.750788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:53.751407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:53.849302 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-339f3ef4-2b11-4b2a-9aa0-481054fa3bc2 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112177 Aug 30 04:33:53.851136 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2488/4879] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:33:53 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:54.228016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:54.228642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:54.236587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:54.237100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:54.237567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:54.238285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:54.238754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:54.239196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:54.476949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:54.487816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:33:54.493360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-13b3e097-7fbe-48a1-8129-50e9c86fa4b8 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.269039 Aug 30 04:33:54.495209 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2392/4880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:54 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:55.517742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:55.518371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:55.540619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.544993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.546785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.550653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.552888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.553850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.776124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-be2ccdba-d150-41ca-ab2a-1981dfe7d09c req-623176ad-be48-41da-a12c-ca0851bad653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c2347a7-538e-475e-9f4a-d33938f016c0", "tag": "67d49d92-cbc5-4916-847e-c4ee1a29e22c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:33:55.809771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be2ccdba-d150-41ca-ab2a-1981dfe7d09c req-623176ad-be48-41da-a12c-ca0851bad653 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:55.810219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be2ccdba-d150-41ca-ab2a-1981dfe7d09c req-623176ad-be48-41da-a12c-ca0851bad653 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:55.811325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be2ccdba-d150-41ca-ab2a-1981dfe7d09c req-623176ad-be48-41da-a12c-ca0851bad653 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:55.866924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-be2ccdba-d150-41ca-ab2a-1981dfe7d09c req-623176ad-be48-41da-a12c-ca0851bad653 service nova] Creating event network-changed:67d49d92-cbc5-4916-847e-c4ee1a29e22c for instance 4c2347a7-538e-475e-9f4a-d33938f016c0 on n-h1-854925-5 Aug 30 04:33:55.879042 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-be2ccdba-d150-41ca-ab2a-1981dfe7d09c req-623176ad-be48-41da-a12c-ca0851bad653 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.356122 Aug 30 04:33:55.881795 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2393/4881] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:33:56.002672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:56.018869 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8ac639e-cac6-4b43-96c3-9d54c5ff137a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.506585 Aug 30 04:33:56.033350 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2489/4882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:55 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:57.047057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:57.047780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:57.055557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.058500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.059633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.060620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:57.062167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:57.062792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:57.496427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:57.522102 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36f2ba1e-a481-4473-9363-e6f828df5959 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.477892 Aug 30 04:33:57.523856 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2394/4883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:57 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:58.554553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:58.555162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:58.565057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:58.565435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:58.565884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:58.566612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:58.574795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:58.575286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:58.933541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:33:58.944115 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9c19dcd6-cfa3-49e8-84be-c3a9f4d130aa tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.393369 Aug 30 04:33:58.963467 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2490/4884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:58 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:33:59.968022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:33:59.969236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:33:59.983803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.986804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.987272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:33:59.992878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:33:59.993858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:33:59.994520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:00.567315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:00.588353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-04c95609-23af-4fc3-99b2-741d3ee1d25b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.623170 Aug 30 04:34:00.601848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2395/4885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:33:59 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:01.610700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:01.613876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:01.628432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.631012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.646179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:01.648237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:01.656381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:01.658464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:02.084818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:02.107308 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b31bc52c-d617-4616-955c-9321c682d12d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.502104 Aug 30 04:34:02.113650 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2491/4886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:01 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:03.134295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:03.134976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:03.155274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:03.156100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:03.156726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:03.157707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:03.158850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:03.159535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:03.625093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:03.634270 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c93477e1-13c7-4f14-93b3-f8c6cd274d76 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.504385 Aug 30 04:34:03.639561 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2396/4887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:03 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:04.667288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:04.669186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:04.679567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.680283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.680834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:04.681893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:04.682472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:04.683012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:05.038153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:05.046876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25b34659-c36d-4c30-ae84-d1534e72fa5d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.386245 Aug 30 04:34:05.061418 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2492/4888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:04 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:06.068036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:06.068663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:06.084178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:06.084691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:06.085450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:06.086185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:06.086654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:06.087096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:06.573977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:06.583266 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b0ccfac-29c8-455c-aed3-048c8f13bca1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.519128 Aug 30 04:34:06.588331 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2397/4889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:06 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:07.614585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:07.615188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:07.643352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:07.643867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:07.644309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:07.648691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:07.649183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:07.649654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:08.409622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:08.421852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8bd617e8-d5e0-42f2-9c2f-1aca4e5b2660 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.811836 Aug 30 04:34:08.444828 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2493/4890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:07 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:09.458667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:09.459468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:09.462966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=40 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:09.472154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:09.472154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:09.472154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:09.472154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:09.472792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:09.473263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:09.939425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:09.948091 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-996683ab-e3b2-47e0-bf75-a50db97e8119 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1511 microversion: 2.1 time: 0.493378 Aug 30 04:34:09.948690 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2398/4891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:09 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1511 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:10.974238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:10.975623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:10.984634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:10.986864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:10.987688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:10.989752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:10.991282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:10.992418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:10.993917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.502767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:11.512203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cf9285b-66b0-4846-9362-843092708556 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1488 microversion: 2.1 time: 0.543449 Aug 30 04:34:11.517391 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2494/4892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:10 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1488 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:11.556145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:11.556986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:11.575462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.579076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.581235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.584039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.592812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.594170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.666614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:11.850623 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dab0dfbc-71d5-46d2-9b03-adfe4924bc78 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 204 len: 0 microversion: 2.1 time: 0.299829 Aug 30 04:34:11.851240 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2399/4893] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:11 2022] DELETE /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:11.861168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:11.861845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:11.883078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.883586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.885953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:11.886751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:11.887238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:11.887682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:12.244282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:12.273796 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98aa943d-ce7a-47b4-a84b-ee6d98bd7cd9 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1494 microversion: 2.1 time: 0.415970 Aug 30 04:34:12.285780 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2495/4894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:11 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1494 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:13.298631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:13.299986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:13.312045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:13.312863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:13.313790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:13.314750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:13.315969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:13.316617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:13.884259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:13.897574 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bedbf1f8-b8c6-4a51-a7cd-d651381b282c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1494 microversion: 2.1 time: 0.601261 Aug 30 04:34:13.898232 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2400/4895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:13 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1494 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:14.918566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:14.919783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:14.931393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.931927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.932367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:14.933087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:14.938106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:14.938818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:15.064480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:15.074746 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79214cc3-189e-4acd-ad3f-10d4e143d7ed tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1452 microversion: 2.1 time: 0.159900 Aug 30 04:34:15.079909 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2496/4896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:14 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:15.340035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b3193058-9f63-4c9b-9c2b-456272cb117d req-f8e74d16-21b2-43ff-bf24-c0d3ffc80823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61937213-1174-4ac3-bb1c-15f50da92ca7", "name": "network-vif-deleted", "tag": "138dc1c3-8090-42db-931a-d383371e95ba"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:15.356189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3193058-9f63-4c9b-9c2b-456272cb117d req-f8e74d16-21b2-43ff-bf24-c0d3ffc80823 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:15.356668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3193058-9f63-4c9b-9c2b-456272cb117d req-f8e74d16-21b2-43ff-bf24-c0d3ffc80823 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:15.359011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b3193058-9f63-4c9b-9c2b-456272cb117d req-f8e74d16-21b2-43ff-bf24-c0d3ffc80823 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:15.386776 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b3193058-9f63-4c9b-9c2b-456272cb117d req-f8e74d16-21b2-43ff-bf24-c0d3ffc80823 service nova] Creating event network-vif-deleted:138dc1c3-8090-42db-931a-d383371e95ba for instance 61937213-1174-4ac3-bb1c-15f50da92ca7 on n-h2-854925-5 Aug 30 04:34:15.398745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b3193058-9f63-4c9b-9c2b-456272cb117d req-f8e74d16-21b2-43ff-bf24-c0d3ffc80823 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062434 Aug 30 04:34:15.399363 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2401/4897] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:16.108038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:16.108772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:16.121684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.124672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.126654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.128357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.129848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.131223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.203137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:16.206015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:16.209513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:16.211449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lazy-loading 'fault' on Instance uuid 61937213-1174-4ac3-bb1c-15f50da92ca7 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:34:16.457812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:16.468079 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-443ba2f9-357d-467f-a243-5461587ea9f5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 200 len: 1305 microversion: 2.1 time: 0.374472 Aug 30 04:34:16.469593 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2497/4898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:16 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 1305 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:17.491409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:17.491999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:17.506427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:17.517709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:17.518340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:17.519177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:17.520400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:17.520895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:17.562393 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 HTTP/1.1 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '61937213-1174-4ac3-bb1c-15f50da92ca7'} Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:17.567245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.575129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:17.575129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:17.575129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:17.575129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:17.575129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:17.575129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:17.575129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:17.599542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:17.600452 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5275e5d2-f322-4658-b759-a579d33f4aab tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 404 len: 111 microversion: 2.1 time: 0.114311 Aug 30 04:34:17.605949 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2402/4899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:17 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:17.824804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-389895710", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "2f7235d3-0772-4dc5-b1a3-7959b9c9a850"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:17.927320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] validate_networks() for [('2f7235d3-0772-4dc5-b1a3-7959b9c9a850', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:34:19.048207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:19.050150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:19.051299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:19.052285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:19.052883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:19.069390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.069909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.070362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.071112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:19.071576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:19.072010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:19.101938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:19.112709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Getting quotas for user 9c91ba9579a24655a2c6842bac6e7034 and project 53adb09bcade46b1871a5312b51bcdb4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:19.140615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:19.145977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:19.232695 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-48941d36-eeb8-44d1-9418-af5e5c5b969f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.411604 Aug 30 04:34:19.233605 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2498/4900] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:34:19.247406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18679890-e446-412b-8e28-7b4b3bfb9c97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:19.248725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18679890-e446-412b-8e28-7b4b3bfb9c97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:19.386586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-18679890-e446-412b-8e28-7b4b3bfb9c97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:19.407158 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18679890-e446-412b-8e28-7b4b3bfb9c97 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1214 microversion: 2.1 time: 0.164696 Aug 30 04:34:19.408283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2403/4901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:19 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:20.429976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:20.431696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:20.447370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.451057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.452798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.455139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:20.457772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:20.458435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:20.475733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=83 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:20.592698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:20.606584 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c0f176a-276b-4957-bff9-bffcc4694d09 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1266 microversion: 2.1 time: 0.181297 Aug 30 04:34:20.608539 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2499/4902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:20 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:21.630101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:21.631196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:21.646910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.647446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.647902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.648631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:21.651225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:21.653408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:21.809396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:21.824637 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d31e8031-0a0d-4506-adf4-25a58cd63090 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1272 microversion: 2.1 time: 0.197361 Aug 30 04:34:21.829040 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2404/4903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:21 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:22.853215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:22.854509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:22.866139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.870052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.870728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:22.871729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:22.872362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:22.873118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:23.582010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:23.598094 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d215d8cc-2f2f-46e9-ae6b-d1e082dbeb1b tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1314 microversion: 2.1 time: 0.749596 Aug 30 04:34:23.598689 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2500/4904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:22 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:24.072626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6f66e623-d773-4d0e-8a7f-5dc47e43c7d1 req-6b38402a-bc67-432e-95bf-bafcadae9645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b40744-6962-4181-982b-046e73659f9f", "tag": "f1e26a57-a3a1-410b-81ab-21a7f043ca63"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:24.091462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6f66e623-d773-4d0e-8a7f-5dc47e43c7d1 req-6b38402a-bc67-432e-95bf-bafcadae9645 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.092226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6f66e623-d773-4d0e-8a7f-5dc47e43c7d1 req-6b38402a-bc67-432e-95bf-bafcadae9645 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.092926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6f66e623-d773-4d0e-8a7f-5dc47e43c7d1 req-6b38402a-bc67-432e-95bf-bafcadae9645 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.105031 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6f66e623-d773-4d0e-8a7f-5dc47e43c7d1 req-6b38402a-bc67-432e-95bf-bafcadae9645 service nova] Creating event network-changed:f1e26a57-a3a1-410b-81ab-21a7f043ca63 for instance c2b40744-6962-4181-982b-046e73659f9f on n-h2-854925-5 Aug 30 04:34:24.112372 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6f66e623-d773-4d0e-8a7f-5dc47e43c7d1 req-6b38402a-bc67-432e-95bf-bafcadae9645 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044334 Aug 30 04:34:24.113017 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2405/4905] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:24.623611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:24.624298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:24.636817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.639372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.642722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.648525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:24.649404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:24.650638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:24.997241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:25.016473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f9b675d5-507f-42e6-8cd8-3ae3a95df123 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1314 microversion: 2.1 time: 0.399945 Aug 30 04:34:25.019785 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2501/4906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:24 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:26.043182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:26.045947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:26.064977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.065557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.066207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.067170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:26.067919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:26.068744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:26.074166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:26.680844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:26.692934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88749ce7-f87c-4e8d-83f9-d050646ade11 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1314 microversion: 2.1 time: 0.656333 Aug 30 04:34:26.696425 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2406/4907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:26 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1314 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:27.722491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:27.723148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:27.743630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.743630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.743981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:27.744706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:27.745293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:27.758016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:28.250504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:28.262806 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b88b70b-5fdf-42c8-8f71-27a3c7d29602 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1314 microversion: 2.1 time: 0.544556 Aug 30 04:34:28.268070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2502/4908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:27 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1314 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:29.296737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:29.297459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:29.315844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.316571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.317027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.317799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:29.318467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:29.321254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:29.412467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:29.828996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:29.842162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4fad923c-5c0d-48fe-857a-229d6868da5f tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1314 microversion: 2.1 time: 0.556924 Aug 30 04:34:29.848076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2407/4909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:29 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:30.878377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:30.879108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:30.886498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:30.887376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:30.890366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.890965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.891527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:30.892627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:30.893236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:30.893700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:31.472681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:31.480378 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be658278-989a-4b5e-a605-0526af24f13a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1314 microversion: 2.1 time: 0.615380 Aug 30 04:34:31.490260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-719989f2-555d-4662-b395-a8a4e3269267 req-11960b70-6e24-426e-8cc1-f43b555c92f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b40744-6962-4181-982b-046e73659f9f", "name": "network-vif-plugged", "status": "completed", "tag": "f1e26a57-a3a1-410b-81ab-21a7f043ca63"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:31.495181 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2503/4910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:30 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:31.512288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-719989f2-555d-4662-b395-a8a4e3269267 req-11960b70-6e24-426e-8cc1-f43b555c92f3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:31.512555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-719989f2-555d-4662-b395-a8a4e3269267 req-11960b70-6e24-426e-8cc1-f43b555c92f3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:31.512975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-719989f2-555d-4662-b395-a8a4e3269267 req-11960b70-6e24-426e-8cc1-f43b555c92f3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:31.547439 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-719989f2-555d-4662-b395-a8a4e3269267 req-11960b70-6e24-426e-8cc1-f43b555c92f3 service nova] Creating event network-vif-plugged:f1e26a57-a3a1-410b-81ab-21a7f043ca63 for instance c2b40744-6962-4181-982b-046e73659f9f on n-h2-854925-5 Aug 30 04:34:31.561650 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-719989f2-555d-4662-b395-a8a4e3269267 req-11960b70-6e24-426e-8cc1-f43b555c92f3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.291545 Aug 30 04:34:31.568126 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2408/4911] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:31.948064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1495189524", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "07b8637c-2989-4774-afe0-abd600116bd3"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:32.025234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] validate_networks() for [('07b8637c-2989-4774-afe0-abd600116bd3', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:34:32.507373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:32.508982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:32.527278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.527781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.528229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.528985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.538480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.538959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.782010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:32.782803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:32.783462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:32.790539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:32.792059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:32.855439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.855942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.857914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.861576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:32.862110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:32.862565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:32.914609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:32.927515 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0eddee0-5322-48d0-beb1-ad09ee779bde tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1314 microversion: 2.1 time: 0.425744 Aug 30 04:34:32.929218 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2409/4912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:32 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:32.956486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Getting quotas for project 5092b392010545d09ad18744a3118b25. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:32.969684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Getting quotas for user 76f8082b67824a259cb92cac315597c9 and project 5092b392010545d09ad18744a3118b25. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:33.002680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:33.015043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:33.142762 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef1746e3-be70-4c60-b5ee-4131c8664132 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367869 Aug 30 04:34:33.150416 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2504/4913] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:34:33.161550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8daf06b-fcaf-4155-953c-43f854ab13a2 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.162445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d8daf06b-fcaf-4155-953c-43f854ab13a2 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.298875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d8daf06b-fcaf-4155-953c-43f854ab13a2 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:33.332125 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8daf06b-fcaf-4155-953c-43f854ab13a2 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1217 microversion: 2.1 time: 0.172658 Aug 30 04:34:33.336200 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2410/4914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:33 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:33.952383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:33.953074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:33.989095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.989715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.990208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:33.990997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:33.991695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:33.992336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.271893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.291023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e8bd339-6a22-4045-89b3-6b6409acd03c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1500 microversion: 2.1 time: 0.343231 Aug 30 04:34:34.291657 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2505/4915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:33 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1500 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:34.317906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:34.318605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:34.343978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.347444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.348553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.350903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.353994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.354737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.365695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:34.367156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:34.390129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.393580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.394062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.394802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.400234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.401593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.457506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lazy-loading 'flavor' on Instance uuid c2b40744-6962-4181-982b-046e73659f9f {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:34:34.587814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:34.598690 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6df95493-1587-454c-bd10-67455e7bc5e0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1269 microversion: 2.1 time: 0.238338 Aug 30 04:34:34.599597 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2506/4916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:34 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1269 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:34.616446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fab34534-d1cf-4ae4-b24f-b0ff1c1b77a2 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "POST /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f/action" status: 202 len: 0 microversion: 2.1 time: 0.302531 Aug 30 04:34:34.617103 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2411/4917] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:34:34 2022] POST /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:34.625998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:34.626625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:34.635521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.636023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.636468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:34.637192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:34.637664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:34.638138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.196170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.207456 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f40af474-0133-436c-8ee8-a93bea03c01a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1508 microversion: 2.1 time: 0.585985 Aug 30 04:34:35.208643 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2507/4918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:34 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1508 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:35.620522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:35.621215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:35.639045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.639542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.639984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.640699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:35.641154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:35.641698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:35.918039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:35.932714 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9128ff92-25d1-40a7-8978-02e0a7adfdb0 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1275 microversion: 2.1 time: 0.313216 Aug 30 04:34:35.938146 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2412/4919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:35 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1275 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:36.232818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.233499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.250902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.251679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.252326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.253230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.253885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.254492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.638421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:36.650747 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-034e1878-f747-42e0-a847-82d4385bdf96 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1491 microversion: 2.1 time: 0.420631 Aug 30 04:34:36.651765 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2508/4920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1491 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:36.679166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.679703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.688319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.688824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.689271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.690017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.690483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.690965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.744675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:36.944435 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6630c14-9985-4f1e-84bf-3aec3c69b243 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 204 len: 0 microversion: 2.1 time: 0.273397 Aug 30 04:34:36.945449 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2413/4921] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:36 2022] DELETE /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:34:36.964028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.965683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.981394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.982744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.983544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:36.985755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:36.987512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:36.988094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:36.988582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:36.989020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.010587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.011098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.011600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.012330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:37.012800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:37.017041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:37.306387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:37.317837 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c481ebbf-e309-400b-b25f-a357a977095c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1317 microversion: 2.1 time: 0.347775 Aug 30 04:34:37.319962 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2414/4922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:37.321688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:37.339771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fdb8ef71-462d-42a0-9d0c-7722591fc22c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1497 microversion: 2.1 time: 0.388711 Aug 30 04:34:37.340769 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2509/4923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:36 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1497 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:38.340500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:38.341202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:38.352694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.353195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.353678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.354396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.359932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.360750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.376162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:38.376824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:38.392884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.398411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.398928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.399680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:38.405395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:38.407451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:38.931635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:38.947142 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8fe9d7fd-5ecb-41f9-8510-cb6659698b5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1317 microversion: 2.1 time: 0.610355 Aug 30 04:34:38.963044 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2415/4924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:38 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:39.001274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:39.027112 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f40b1e3-cc46-458f-945c-4863d2ee0cc4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1497 microversion: 2.1 time: 0.665019 Aug 30 04:34:39.033690 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2510/4925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:38 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1497 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:39.828060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-96213ee6-d792-48ad-8c04-1aba5dbdca9f req-2e5d2d78-1fb0-4aef-ab61-d4d03a169c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29261fef-a192-4c0a-bb22-aeddd2f72f3a", "tag": "229e1134-b7ab-48fe-afc7-3114c08e4f07"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:39.859450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:39.873220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-96213ee6-d792-48ad-8c04-1aba5dbdca9f req-2e5d2d78-1fb0-4aef-ab61-d4d03a169c58 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:39.874306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-96213ee6-d792-48ad-8c04-1aba5dbdca9f req-2e5d2d78-1fb0-4aef-ab61-d4d03a169c58 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:39.875000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-96213ee6-d792-48ad-8c04-1aba5dbdca9f req-2e5d2d78-1fb0-4aef-ab61-d4d03a169c58 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:39.922702 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-96213ee6-d792-48ad-8c04-1aba5dbdca9f req-2e5d2d78-1fb0-4aef-ab61-d4d03a169c58 service nova] Creating event network-changed:229e1134-b7ab-48fe-afc7-3114c08e4f07 for instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a on n-h2-854925-5 Aug 30 04:34:39.952201 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-96213ee6-d792-48ad-8c04-1aba5dbdca9f req-2e5d2d78-1fb0-4aef-ab61-d4d03a169c58 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117675 Aug 30 04:34:39.953182 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2416/4926] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.025883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.050123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:40.050954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:40.065466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.066172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.066629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.079177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:40.079700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:40.080165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:40.244142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c91ba9579a24655a2c6842bac6e7034', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53adb09bcade46b1871a5312b51bcdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.254591 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fbc4dc56-bd79-4c51-ba45-1350fc37980d tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 200 len: 1455 microversion: 2.1 time: 0.208811 Aug 30 04:34:40.255201 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2417/4927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:40 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 1455 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:40.481069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:40.496974 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0cef9c5-7f2f-4b87-9f1b-ba6dc3702a7a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1317 microversion: 2.1 time: 0.530634 Aug 30 04:34:40.499683 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2511/4928] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:39 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:41.277049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.279230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.287700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.288776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.289587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.290672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.291247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.291898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.312254 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f HTTP/1.1 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c2b40744-6962-4181-982b-046e73659f9f'} Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.315717 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.318690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.318690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.318690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.318690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.318690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.318690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.318690 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.323150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.329951 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5378d10e-0f00-4064-beb0-f6181058ca79 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 404 len: 111 microversion: 2.1 time: 0.057163 Aug 30 04:34:41.342286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.343597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.347384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:41.347957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2418/4929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.354638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.355703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.357085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.358392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.359143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.359798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.384570 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f HTTP/1.1 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c2b40744-6962-4181-982b-046e73659f9f'} Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.388701 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.391848 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.393442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.394538 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-583995c8-4ccd-4274-9194-72ef6b46dae5 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 404 len: 111 microversion: 2.1 time: 0.056871 Aug 30 04:34:41.395610 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2512/4930] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:41 2022] DELETE /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.406135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.407071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: c2b40744-6962-4181-982b-046e73659f9f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.415559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.416074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.416523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.417234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.417891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.418490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.440718 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f HTTP/1.1 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c2b40744-6962-4181-982b-046e73659f9f'} Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.442793 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.446250 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.446250 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.446250 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.446250 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.446250 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.446250 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. Aug 30 04:34:41.446250 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.448103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance c2b40744-6962-4181-982b-046e73659f9f could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.449277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d95fd1bf-42bf-410e-96ea-172ea66b7167 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f" status: 404 len: 111 microversion: 2.1 time: 0.049109 Aug 30 04:34:41.452412 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2419/4931] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/c2b40744-6962-4181-982b-046e73659f9f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.459601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.462108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.471561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.472282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.472872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.474630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.475283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.475916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.494922 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 HTTP/1.1 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '61937213-1174-4ac3-bb1c-15f50da92ca7'} Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.496781 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.500765 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.503205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.504802 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0603e179-7901-4c20-8afa-3ea1460f2025 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 404 len: 111 microversion: 2.1 time: 0.049523 Aug 30 04:34:41.505897 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2513/4932] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:41 2022] DELETE /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.519666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.520675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 61937213-1174-4ac3-bb1c-15f50da92ca7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.532156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.532677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.533379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.534452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.535609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.536567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.537226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.541980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.573562 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 HTTP/1.1 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '61937213-1174-4ac3-bb1c-15f50da92ca7'} Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.576058 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.579020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.579020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.579020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.579020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.579020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.579020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. Aug 30 04:34:41.579020 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.583014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 61937213-1174-4ac3-bb1c-15f50da92ca7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.584285 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ef76043-139b-49ec-bc25-d46825e8a3d4 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7" status: 404 len: 111 microversion: 2.1 time: 0.071525 Aug 30 04:34:41.585063 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2420/4933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/61937213-1174-4ac3-bb1c-15f50da92ca7 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.595442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.596076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.603222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.603873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.604938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.605055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.605469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.605916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.606110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.606671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.606777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.607134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.607414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.607558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.626666 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 HTTP/1.1 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '971ab824-5282-4e7c-8cfb-ffaa195156c4'} Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.628504 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.631789 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-53c19a59-3fce-4232-b199-a71b09123e68 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 404 len: 111 microversion: 2.1 time: 0.039755 Aug 30 04:34:41.634440 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2421/4934] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:41 2022] DELETE /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.640270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.641164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 971ab824-5282-4e7c-8cfb-ffaa195156c4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.647922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.648735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.649381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.650275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.650988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.651595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.674538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 HTTP/1.1 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '971ab824-5282-4e7c-8cfb-ffaa195156c4'} Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.676620 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.679814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.679814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.679814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.679814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.679814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.679814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. Aug 30 04:34:41.679814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.681620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 971ab824-5282-4e7c-8cfb-ffaa195156c4 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.683656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5f526477-6ccc-4b52-a8b7-6e52fc1ab7b3 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4" status: 404 len: 111 microversion: 2.1 time: 0.048088 Aug 30 04:34:41.686044 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2422/4935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/971ab824-5282-4e7c-8cfb-ffaa195156c4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.701639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.702415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.731053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.732271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.734452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.740569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.741764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.742386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.768609 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee HTTP/1.1 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '17f02cc8-3a97-4f72-8c1d-3dfb72f305ee'} Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.770484 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.773431 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.776292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.777614 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-39c29bff-cf82-4c49-8fca-55450be3f48a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 404 len: 111 microversion: 2.1 time: 0.086976 Aug 30 04:34:41.781590 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2423/4936] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:41 2022] DELETE /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.789389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.790229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.801424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.802211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.802874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.803800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:41.804487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:41.805272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:41.823338 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee HTTP/1.1 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '17f02cc8-3a97-4f72-8c1d-3dfb72f305ee'} Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.825492 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.828501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.828501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.828501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.828501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.828501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.828501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. Aug 30 04:34:41.828501 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.831015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 17f02cc8-3a97-4f72-8c1d-3dfb72f305ee could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.832309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ebc7ae7a-34bf-46f8-af30-e60f1095d56c tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee" status: 404 len: 111 microversion: 2.1 time: 0.049252 Aug 30 04:34:41.840928 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2424/4937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/17f02cc8-3a97-4f72-8c1d-3dfb72f305ee => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.848312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-704a40ed-ea15-4848-8341-ee5ac0933485 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.849601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-704a40ed-ea15-4848-8341-ee5ac0933485 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.860482 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-704a40ed-ea15-4848-8341-ee5ac0933485 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-704a40ed-ea15-4848-8341-ee5ac0933485 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf HTTP/1.1 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '842b3037-8504-4a9b-bf82-926d7bd94faf'} Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.863205 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.866343 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.866343 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.866343 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.866343 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.866343 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.866343 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.866343 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.868472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-704a40ed-ea15-4848-8341-ee5ac0933485 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.869607 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-704a40ed-ea15-4848-8341-ee5ac0933485 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf" status: 404 len: 111 microversion: 2.1 time: 0.027478 Aug 30 04:34:41.870394 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2425/4938] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:41 2022] DELETE /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:41.893742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7d3c42d-592c-4a79-88b9-b4c5d99eebc7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:41.894710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f7d3c42d-592c-4a79-88b9-b4c5d99eebc7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 842b3037-8504-4a9b-bf82-926d7bd94faf] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:41.924259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f7d3c42d-592c-4a79-88b9-b4c5d99eebc7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7d3c42d-592c-4a79-88b9-b4c5d99eebc7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf HTTP/1.1 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '842b3037-8504-4a9b-bf82-926d7bd94faf'} Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:41.926080 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:41.929126 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:41.929126 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:41.929126 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:41.929126 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. Aug 30 04:34:41.929126 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:41.929126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7d3c42d-592c-4a79-88b9-b4c5d99eebc7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 842b3037-8504-4a9b-bf82-926d7bd94faf could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:41.929126 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f7d3c42d-592c-4a79-88b9-b4c5d99eebc7 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf" status: 404 len: 111 microversion: 2.1 time: 0.047317 Aug 30 04:34:41.931253 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2426/4939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/842b3037-8504-4a9b-bf82-926d7bd94faf => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:42.014811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:42.060837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6e8f1052-5b44-4d7f-b019-f15b81fcfa36 req-4a2956ce-5bee-4c5e-ab1b-021750483848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b40744-6962-4181-982b-046e73659f9f", "name": "network-vif-deleted", "tag": "f1e26a57-a3a1-410b-81ab-21a7f043ca63"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:42.075427 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-421b3fed-5fd5-49a0-a158-b447276bdab3 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1317 microversion: 2.1 time: 0.545761 Aug 30 04:34:42.077647 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2514/4940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:41 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:42.104266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6e8f1052-5b44-4d7f-b019-f15b81fcfa36 req-4a2956ce-5bee-4c5e-ab1b-021750483848 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:42.107896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6e8f1052-5b44-4d7f-b019-f15b81fcfa36 req-4a2956ce-5bee-4c5e-ab1b-021750483848 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:42.112602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6e8f1052-5b44-4d7f-b019-f15b81fcfa36 req-4a2956ce-5bee-4c5e-ab1b-021750483848 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:42.163690 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6e8f1052-5b44-4d7f-b019-f15b81fcfa36 req-4a2956ce-5bee-4c5e-ab1b-021750483848 service nova] Creating event network-vif-deleted:f1e26a57-a3a1-410b-81ab-21a7f043ca63 for instance c2b40744-6962-4181-982b-046e73659f9f on n-h2-854925-5 Aug 30 04:34:42.169080 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6e8f1052-5b44-4d7f-b019-f15b81fcfa36 req-4a2956ce-5bee-4c5e-ab1b-021750483848 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114785 Aug 30 04:34:42.170893 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2427/4941] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:43.101782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:43.103154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:43.121633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:43.128245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:43.134663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.135242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.139621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.142242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:43.144020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:43.144465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:43.687037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:43.701893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c37c2d0f-da08-47b4-8772-93018cd9e3df tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1317 microversion: 2.1 time: 0.603978 Aug 30 04:34:43.703359 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2515/4942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:43 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:44.118411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:44.124202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:44.135450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:44.155020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.160066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.160625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.162077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.162663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.163280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.337215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:44.377225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c736c59b-52e9-44f9-b23b-3e25e315617b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.260157 Aug 30 04:34:44.378685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2428/4943] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:34:44 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:44.388403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:44.389136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:44.396229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.396843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.397597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.398732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.399398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.400049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.724910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:44.725788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:44.737203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.738175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.742246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.743151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:44.752063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:44.752645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:44.804053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:44.824776 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e42d3e74-0295-45ef-ae0c-e9bce005694f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1670 microversion: 2.1 time: 0.441957 Aug 30 04:34:44.825936 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2516/4944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:44 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1670 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:45.158652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:45.168860 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2257feb4-1d95-4708-8756-306e80c17076 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1317 microversion: 2.1 time: 0.448530 Aug 30 04:34:45.174427 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2429/4945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:44 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:45.380810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-75c0c97b-e525-4c18-a52e-bb5bd5b63a0a req-c0c7288a-e111-4382-8ddb-8afd0faf532f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29261fef-a192-4c0a-bb22-aeddd2f72f3a", "name": "network-vif-plugged", "status": "completed", "tag": "229e1134-b7ab-48fe-afc7-3114c08e4f07"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:45.432344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-75c0c97b-e525-4c18-a52e-bb5bd5b63a0a req-c0c7288a-e111-4382-8ddb-8afd0faf532f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.433655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-75c0c97b-e525-4c18-a52e-bb5bd5b63a0a req-c0c7288a-e111-4382-8ddb-8afd0faf532f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.434298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-75c0c97b-e525-4c18-a52e-bb5bd5b63a0a req-c0c7288a-e111-4382-8ddb-8afd0faf532f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.467540 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-75c0c97b-e525-4c18-a52e-bb5bd5b63a0a req-c0c7288a-e111-4382-8ddb-8afd0faf532f service nova] Creating event network-vif-plugged:229e1134-b7ab-48fe-afc7-3114c08e4f07 for instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a on n-h2-854925-5 Aug 30 04:34:45.477904 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-75c0c97b-e525-4c18-a52e-bb5bd5b63a0a req-c0c7288a-e111-4382-8ddb-8afd0faf532f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102094 Aug 30 04:34:45.481880 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2517/4946] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:45.847232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:45.848171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:45.859552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.862620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.863336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:45.864729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:45.865901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:45.866805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.077139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.093138 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84557707-6820-447e-93c3-ddc28502fff5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1670 microversion: 2.1 time: 0.246248 Aug 30 04:34:46.105349 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2430/4947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:45 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:46.198977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:46.200188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:46.209651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.213136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.213812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.214736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:46.215392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:46.216062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:46.269865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:46.599011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:46.617175 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-751795de-84d0-4ea1-83ce-a1b783bc938f tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1317 microversion: 2.1 time: 0.423868 Aug 30 04:34:46.619208 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2518/4948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:46 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:47.119701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.120490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.130083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.138704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.138704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.138704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.138704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.138704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.320127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.329297 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-032e9535-0d7a-4757-a807-a93355f87ac7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1675 microversion: 2.1 time: 0.213709 Aug 30 04:34:47.330536 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2431/4949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:47 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:47.645580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.649413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.669645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.671486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.672272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.673368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.674919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.675977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.745462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1066309086", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:47.847588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] validate_networks() for None {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:34:47.940562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:47.953660 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c36f0e88-2d27-4b10-9907-ec6c4ec5a5c4 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1505 microversion: 2.1 time: 0.312107 Aug 30 04:34:47.957006 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2519/4950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:47 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:47.968178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:47.969046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:47.982074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.983628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.984321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:47.985256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:47.986020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:47.986816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.014519 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 HTTP/1.1 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '17b56463-5681-406f-b7f3-f53c84d1eee1'} Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:48.017923 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.020943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:48.025883 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8089c8c6-26af-40a9-a2da-e34e7f7bc07a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 404 len: 111 microversion: 2.1 time: 0.066276 Aug 30 04:34:48.026471 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2520/4951] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:47 2022] DELETE /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:48.034603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.035413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.042617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.043345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.044804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.045696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.046447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.047025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.085095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:48.086791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23b87235-9fa8-4d3f-bb17-416f335e628a tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a/os-instance-actions/req-ef1746e3-be70-4c60-b5ee-4131c8664132" status: 200 len: 313 microversion: 2.1 time: 0.059384 Aug 30 04:34:48.097947 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2521/4952] 10.222.0.27 () {58 vars in 1419 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a/os-instance-actions/req-ef1746e3-be70-4c60-b5ee-4131c8664132 => generated 313 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:48.110321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.110945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: 17b56463-5681-406f-b7f3-f53c84d1eee1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.122471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.123344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.126299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.127083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.127566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.128065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.149079 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 HTTP/1.1 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '17b56463-5681-406f-b7f3-f53c84d1eee1'} Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.151299 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance 17b56463-5681-406f-b7f3-f53c84d1eee1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:48.156006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c45ad57-936a-4685-b4ca-fe585cea9180 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1" status: 404 len: 111 microversion: 2.1 time: 0.056323 Aug 30 04:34:48.156625 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2522/4953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/17b56463-5681-406f-b7f3-f53c84d1eee1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:48.165590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:48.167927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.174599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.175110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.175560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.176340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.176725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.177161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.198002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:34:48.199034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:34:48.199695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:34:48.200277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:34:48.200773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:34:48.211042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.211649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.212165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.212971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.213481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.213926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.248500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Getting quotas for project 878873e8f1f34009a594347fe4da4555. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:34:48.257213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Getting quotas for user 0704c83db62b4ebe931492820cb8387a and project 878873e8f1f34009a594347fe4da4555. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:34:48.273371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:34:48.277281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:34:48.296473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc64fc81-e60a-408f-bde7-887933743489 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "POST /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a/action" status: 202 len: 0 microversion: 2.1 time: 0.132236 Aug 30 04:34:48.301351 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2523/4954] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:34:48 2022] POST /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:34:48.315094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.317837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.345294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.345667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.346121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.346839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.347301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.354341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.364232 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07b342ea-fb0f-40c2-a020-194770cf9333 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618790 Aug 30 04:34:48.368799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2432/4955] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:34:48.377526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.377851 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.379617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a HTTP/1.1 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'dcba77df-7855-4317-b51b-54e773b19f2a'} Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:48.382440 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.385514 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.390223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:48.392407 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e427cea0-dd6a-4f7b-b3f8-6b51d26a931a tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 404 len: 111 microversion: 2.1 time: 0.091016 Aug 30 04:34:48.392690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.394156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.394774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.395693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.397061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.397694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.400954 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2524/4956] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:48 2022] DELETE /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:48.405988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.406606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.423723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.424508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.425132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.426109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.426779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.427654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.656706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:48.670438 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e7f2f3f7-0a63-4290-8b64-f6c795e63066 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1507 microversion: 2.1 time: 0.298132 Aug 30 04:34:48.671864 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2433/4957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1507 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:48.684886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:48.685549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3982e5b-ec46-43ea-9069-156ee2ef65df tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.685549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b3982e5b-ec46-43ea-9069-156ee2ef65df tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.691201 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b7f54543-008c-4d96-b394-b1c9ecdcef7c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1675 microversion: 2.1 time: 0.289055 Aug 30 04:34:48.691735 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2525/4958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1675 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:48.698901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:48.702381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] [instance: dcba77df-7855-4317-b51b-54e773b19f2a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:48.719993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.720748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.724317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.725283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:48.726080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:48.726693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:48.744370 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] HTTP exception thrown: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Request method failure captured: Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a HTTP/1.1 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZI6oNmBb3Si4bnJPBWlBTJSMG43Hzp3I-RnFRQ9tvOAfzZ3tJSeiZcyfOnEmWjTzRzHg3v5NjMwXLV7cI10gnDZBkT9yW1IS4S_gCrCB1adsf-9poYYMNgvhvrfiBvXK2U9AnnH1f5EI_iWEU_mRp58roo5pwNh2KbnDIXInxoOsOg Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_53adb09bcade46b1871a5312b51bcdb4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/53adb09bcade46b1871a5312b51bcdb4"}]}] Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 53adb09bcade46b1871a5312b51bcdb4 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-799139384 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9c91ba9579a24655a2c6842bac6e7034 Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-799139384-project Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'dcba77df-7855-4317-b51b-54e773b19f2a'} Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:48.746556 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.750276 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:48.750276 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:48.750276 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:48.750276 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:48.750276 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:48.750276 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. Aug 30 04:34:48.750276 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:48.752253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] Returning 404 to user: Instance dcba77df-7855-4317-b51b-54e773b19f2a could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:48.753651 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ffd0220d-14e8-4d38-a5cb-3823548a67d1 tempest-DeleteServersTestJSON-799139384 tempest-DeleteServersTestJSON-799139384-project] 10.222.0.27 "GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a" status: 404 len: 111 microversion: 2.1 time: 0.059501 Aug 30 04:34:48.755386 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2526/4959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/dcba77df-7855-4317-b51b-54e773b19f2a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:34:48.790883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3982e5b-ec46-43ea-9069-156ee2ef65df tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:48.802021 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3982e5b-ec46-43ea-9069-156ee2ef65df tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1215 microversion: 2.1 time: 0.128936 Aug 30 04:34:48.803462 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2434/4960] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:48 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:49.693439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:49.694078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:49.702743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:49.703526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:49.704149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:49.705001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:49.705632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:49.707019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:49.714414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:49.715112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:49.723880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:49.724651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:49.725303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:49.726247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:49.726893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:49.727507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:49.986712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:49.996367 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52b72335-e3d0-4be4-a26f-9bd6043b0267 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1507 microversion: 2.1 time: 0.308220 Aug 30 04:34:49.998075 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2527/4961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:49 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1507 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:50.003911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:50.004782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:50.013231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.014025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.014689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.015633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:50.016351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:50.017050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:50.039575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.053419 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-458a7cc1-3898-45ae-a85f-1dfd14115889 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1675 microversion: 2.1 time: 0.342041 Aug 30 04:34:50.056345 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2435/4962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:49 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1675 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:50.110703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:50.122767 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce4c8c8a-f6ae-417b-9519-fae22849476a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1267 microversion: 2.1 time: 0.122677 Aug 30 04:34:50.123899 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2528/4963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:49 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:51.022037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.024086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.032432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.033155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.033930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.036648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.036648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.036648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.080501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.081279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.094447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.095191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.095701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.098917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.099433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.100187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.378305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:51.387810 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45f57629-ce41-4b0d-b207-7c472bf9bae8 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1505 microversion: 2.1 time: 0.370288 Aug 30 04:34:51.402342 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2436/4964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:51.410823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.411762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.425310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.426150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.426791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.427706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.428974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.429651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.470451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:51.486752 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8955fab-3cb0-4735-820d-f24ba046873a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1675 microversion: 2.1 time: 0.410058 Aug 30 04:34:51.488512 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2529/4965] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1675 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:51.496220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '.version_select at 0x7fe969a35280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.498897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.507543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.508124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.508663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.509475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.510023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.510523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.547695 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-accc757a-1700-4076-98b1-df9ad387b1b7 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.057296 Aug 30 04:34:51.548722 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2530/4966] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a/os-instance-actions => generated 611 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:51.560803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:51.562642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.563209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.570428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.571120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.571569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.572889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.573691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.574579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.577201 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d847a99-922c-442f-8b07-6c3ed0a77771 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1273 microversion: 2.1 time: 0.173300 Aug 30 04:34:51.578554 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2437/4967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:51.611455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:34:51.748031 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b75cb32a-2de8-463d-95ae-d0e45c92f791 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "DELETE /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 204 len: 0 microversion: 2.1 time: 0.188691 Aug 30 04:34:51.750867 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2531/4968] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:34:51 2022] DELETE /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:34:51.765203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:51.773872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:51.782292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.783057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.783797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.784971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:51.785613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:51.786197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:51.974975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:51.982848 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7fbf35bc-ab7b-441a-a924-f0057d15f6d6 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1511 microversion: 2.1 time: 0.228700 Aug 30 04:34:51.983601 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2438/4969] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:51 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:52.518529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:52.520440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:52.553380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.553966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.554415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.555177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.555610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.556113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.604984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:52.607067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:52.632165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.632663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.633105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:52.633881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:52.634344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:52.634791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.022924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:53.034473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b619f828-a9e0-4082-912a-bd232a2ad4a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.525667 Aug 30 04:34:53.037206 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2532/4970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:52 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:53.038224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:53.047635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:53.048581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:53.048705 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a0266a5-f1de-46c4-93c2-249ca74ca03b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.450280 Aug 30 04:34:53.049290 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2439/4971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:52 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:53.062437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:53.063231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:53.063692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.064783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:53.065523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:53.066249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:53.240922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:53.249127 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-afdcfe10-f7f0-4d34-a2ed-365f6067bf5c tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1511 microversion: 2.1 time: 0.209723 Aug 30 04:34:53.250341 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2533/4972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:53 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:54.071163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:54.072383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:54.080349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.081120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.081771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.082681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.083345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.083917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.270964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:54.272706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:54.284709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.285210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.285678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.286388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:54.286844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:54.287285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:54.343309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:54.351512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-924c5d86-b83f-4048-b80b-1e06db608d28 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.284267 Aug 30 04:34:54.352312 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2440/4973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:54 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:54.529271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:54.545975 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-093d0c04-cf01-48cb-a311-a5e42b28bd5d tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1511 microversion: 2.1 time: 0.279293 Aug 30 04:34:54.546580 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2534/4974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:54 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:55.136226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-53534b75-4936-4164-b81e-37ee6dd6afe6 req-0a5e73a2-b822-4391-80ef-6b09ea3801e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79a61fcb-226c-4218-a283-e10ccdc8bd0a", "tag": "ae94c0d5-4ecd-4f57-bd04-9c7af7f1569c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:55.180100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-53534b75-4936-4164-b81e-37ee6dd6afe6 req-0a5e73a2-b822-4391-80ef-6b09ea3801e3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.180622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-53534b75-4936-4164-b81e-37ee6dd6afe6 req-0a5e73a2-b822-4391-80ef-6b09ea3801e3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.185432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-53534b75-4936-4164-b81e-37ee6dd6afe6 req-0a5e73a2-b822-4391-80ef-6b09ea3801e3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.215469 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-53534b75-4936-4164-b81e-37ee6dd6afe6 req-0a5e73a2-b822-4391-80ef-6b09ea3801e3 service nova] Creating event network-changed:ae94c0d5-4ecd-4f57-bd04-9c7af7f1569c for instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a on n-h2-854925-5 Aug 30 04:34:55.242503 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-53534b75-4936-4164-b81e-37ee6dd6afe6 req-0a5e73a2-b822-4391-80ef-6b09ea3801e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110561 Aug 30 04:34:55.245398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2441/4975] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:34:55.374173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:55.375343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:55.385650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.386535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.387117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.388755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.389437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.394831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.408170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:55.569910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:55.571099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:55.582011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.585318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.587767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.589309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.591154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.593044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.708597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:55.715269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:55.716419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:55.719777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lazy-loading 'fault' on Instance uuid 29261fef-a192-4c0a-bb22-aeddd2f72f3a {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:34:56.242852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76f8082b67824a259cb92cac315597c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5092b392010545d09ad18744a3118b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:56.251421 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-066dd08a-1153-4ff3-8f84-65214d64dea5 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 200 len: 1307 microversion: 2.1 time: 0.687386 Aug 30 04:34:56.254028 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2442/4976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:55 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 1307 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:56.351115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:56.361952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9d0cf417-9d17-42d2-9552-dceac805f48a tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.993329 Aug 30 04:34:56.363276 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2535/4977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:55 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:34:57.280846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.282656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] [instance: 29261fef-a192-4c0a-bb22-aeddd2f72f3a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.291795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.293188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.294530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.295718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.296326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.296914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a9c46f80-5b93-4df1-a076-37f216e239f5 req-276b1522-0d54-4bb5-9ba9-c54c04825de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29261fef-a192-4c0a-bb22-aeddd2f72f3a", "name": "network-vif-deleted", "tag": "229e1134-b7ab-48fe-afc7-3114c08e4f07"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:57.297444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.321821 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] HTTP exception thrown: Instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a could not be found. Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Request method failure captured: Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a HTTP/1.1 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZNXBENqXYgG_Cho4-S07WIN9vXei5hDW5c6C7zlcxdfP9cSQbyT7SvAiqO3WkijQC5pjNuTIP7orumB0WGwDq-STDBdoeyBZ-A-jbtSkGUmIjupkEtXSsCRHVed_X--zzQMZva64Jd_mZgH47HDhJnPnDiXd_zLS1Op-8c6Ozlnicg Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 5092b392010545d09ad18744a3118b25 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-InstanceActionsTestJSON-1071702926 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5092b392010545d09ad18744a3118b25", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5092b392010545d09ad18744a3118b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5092b392010545d09ad18744a3118b25"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5092b392010545d09ad18744a3118b25"}]}] Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-InstanceActionsTestJSON-1071702926 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 5092b392010545d09ad18744a3118b25 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1071702926 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-InstanceActionsTestJSON-1071702926-project Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 76f8082b67824a259cb92cac315597c9 Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-InstanceActionsTestJSON-1071702926-project Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a could not be found. Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '29261fef-a192-4c0a-bb22-aeddd2f72f3a'} Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a could not be found. Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a could not be found. Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:57.325635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:57.330359 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:57.330359 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:57.330359 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:57.330359 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:57.330359 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:57.330359 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a could not be found. Aug 30 04:34:57.330359 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:57.332247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] Returning 404 to user: Instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:57.333288 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4d311d54-88f3-49af-bd0a-ff4652917574 tempest-InstanceActionsTestJSON-1071702926 tempest-InstanceActionsTestJSON-1071702926-project] 10.222.0.27 "GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a" status: 404 len: 111 microversion: 2.1 time: 0.062535 Aug 30 04:34:57.334420 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2443/4978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:57 2022] GET /compute/v2.1/servers/29261fef-a192-4c0a-bb22-aeddd2f72f3a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:34:57.344900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a9c46f80-5b93-4df1-a076-37f216e239f5 req-276b1522-0d54-4bb5-9ba9-c54c04825de0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.345431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a9c46f80-5b93-4df1-a076-37f216e239f5 req-276b1522-0d54-4bb5-9ba9-c54c04825de0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.349125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a9c46f80-5b93-4df1-a076-37f216e239f5 req-276b1522-0d54-4bb5-9ba9-c54c04825de0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.384174 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a9c46f80-5b93-4df1-a076-37f216e239f5 req-276b1522-0d54-4bb5-9ba9-c54c04825de0 service nova] Creating event network-vif-deleted:229e1134-b7ab-48fe-afc7-3114c08e4f07 for instance 29261fef-a192-4c0a-bb22-aeddd2f72f3a on n-h2-854925-5 Aug 30 04:34:57.386298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:57.387336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:57.394057 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a9c46f80-5b93-4df1-a076-37f216e239f5 req-276b1522-0d54-4bb5-9ba9-c54c04825de0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102045 Aug 30 04:34:57.398712 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2536/4979] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:34:57.399675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.400190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.400657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.401707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:57.402174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:57.402609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:57.793063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:57.811512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae8b3fec-ba6f-47ac-b775-5ed6f2639564 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.430132 Aug 30 04:34:57.812907 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2444/4980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:57 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:34:58.232061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23761efc-56b0-4c23-8504-8f119e67b4ba tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-405143105", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.236114 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-23761efc-56b0-4c23-8504-8f119e67b4ba tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] HTTP exception thrown: min_count must be <= max_count Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23761efc-56b0-4c23-8504-8f119e67b4ba tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Request method failure captured: Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 183 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZNxKUBVNe4QLlJ8YjShTk_0RvVM8xrQgQaPdjMNY9ojtYm1HHTRRGldNWnIMYItvNSshCBPrDQeEj_Aes_VKW0y2pa2zyRpiW2ZBd4vENnWJbHJYXhaw7W9Vhezazem8FbWg3J_UJSBYFzCOrFMstxummW8hFfrJmk1czP-gwyghJE Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1981b0eaeb6e4e7988cf31b20969a86d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}] Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0cd3a42498fb476d9be3c968301da968 Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-405143105", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: exception: min_count must be <= max_count Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-405143105', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 30 04:34:58.238037 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.243557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23761efc-56b0-4c23-8504-8f119e67b4ba tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Returning 400 to user: min_count must be <= max_count {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:58.245050 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23761efc-56b0-4c23-8504-8f119e67b4ba tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.188596 Aug 30 04:34:58.246077 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2537/4981] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/servers => generated 74 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:34:58.312147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:58.320388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a40ba4c-6b08-4a1f-9c41-1721fa5bfb16 tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-172563775", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "max_count": 0}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a40ba4c-6b08-4a1f-9c41-1721fa5bfb16 tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Request method failure captured: Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 167 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZNxKUBVNe4QLlJ8YjShTk_0RvVM8xrQgQaPdjMNY9ojtYm1HHTRRGldNWnIMYItvNSshCBPrDQeEj_Aes_VKW0y2pa2zyRpiW2ZBd4vENnWJbHJYXhaw7W9Vhezazem8FbWg3J_UJSBYFzCOrFMstxummW8hFfrJmk1czP-gwyghJE Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1981b0eaeb6e4e7988cf31b20969a86d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}] Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0cd3a42498fb476d9be3c968301da968 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-172563775", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "max_count": 0}} Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-172563775', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'max_count': 0}}} Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 0 Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:34:58.327005 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a40ba4c-6b08-4a1f-9c41-1721fa5bfb16 tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2a40ba4c-6b08-4a1f-9c41-1721fa5bfb16 tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018771 Aug 30 04:34:58.333478 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2445/4982] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:34:58.392063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-230fc187-d11d-4984-808d-10965bd9adab tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-708442852", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "max_count": 2.5}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-230fc187-d11d-4984-808d-10965bd9adab tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Request method failure captured: Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 169 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZNxKUBVNe4QLlJ8YjShTk_0RvVM8xrQgQaPdjMNY9ojtYm1HHTRRGldNWnIMYItvNSshCBPrDQeEj_Aes_VKW0y2pa2zyRpiW2ZBd4vENnWJbHJYXhaw7W9Vhezazem8FbWg3J_UJSBYFzCOrFMstxummW8hFfrJmk1czP-gwyghJE Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1981b0eaeb6e4e7988cf31b20969a86d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}] Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0cd3a42498fb476d9be3c968301da968 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-708442852", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "max_count": 2.5}} Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-708442852', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'max_count': 2.5}}} Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:34:58.398194 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-230fc187-d11d-4984-808d-10965bd9adab tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-230fc187-d11d-4984-808d-10965bd9adab tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.013962 Aug 30 04:34:58.403332 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2538/4983] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:34:58.459269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-803d8d92-78d6-4f25-a05c-530730d0805c tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1323110346", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 0}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-803d8d92-78d6-4f25-a05c-530730d0805c tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Request method failure captured: Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 168 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZNxKUBVNe4QLlJ8YjShTk_0RvVM8xrQgQaPdjMNY9ojtYm1HHTRRGldNWnIMYItvNSshCBPrDQeEj_Aes_VKW0y2pa2zyRpiW2ZBd4vENnWJbHJYXhaw7W9Vhezazem8FbWg3J_UJSBYFzCOrFMstxummW8hFfrJmk1czP-gwyghJE Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1981b0eaeb6e4e7988cf31b20969a86d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}] Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0cd3a42498fb476d9be3c968301da968 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1323110346", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 0}} Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1323110346', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'min_count': 0}}} Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 0 Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:34:58.469840 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-803d8d92-78d6-4f25-a05c-530730d0805c tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-803d8d92-78d6-4f25-a05c-530730d0805c tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016791 Aug 30 04:34:58.478814 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2446/4984] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:34:58.538205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5aff3459-55f9-4d2a-92cd-31caea465eaf tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-530814343", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 2.5}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5aff3459-55f9-4d2a-92cd-31caea465eaf tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Request method failure captured: Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 169 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZNxKUBVNe4QLlJ8YjShTk_0RvVM8xrQgQaPdjMNY9ojtYm1HHTRRGldNWnIMYItvNSshCBPrDQeEj_Aes_VKW0y2pa2zyRpiW2ZBd4vENnWJbHJYXhaw7W9Vhezazem8FbWg3J_UJSBYFzCOrFMstxummW8hFfrJmk1czP-gwyghJE Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1981b0eaeb6e4e7988cf31b20969a86d", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1981b0eaeb6e4e7988cf31b20969a86d"}]}] Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 1981b0eaeb6e4e7988cf31b20969a86d Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1751690593 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 0cd3a42498fb476d9be3c968301da968 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1751690593-project Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-530814343", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "min_count": 2.5}} Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-530814343', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'min_count': 2.5}}} Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 2.5 Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:34:58.542720 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 30 04:34:58.547558 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:34:58.549883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5aff3459-55f9-4d2a-92cd-31caea465eaf tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:34:58.551054 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5aff3459-55f9-4d2a-92cd-31caea465eaf tempest-MultipleCreateNegativeTestJSON-1751690593 tempest-MultipleCreateNegativeTestJSON-1751690593-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.017637 Aug 30 04:34:58.551855 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2539/4985] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:34:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:34:58.834726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:34:58.839425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:34:58.840293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:34:58.848054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.848842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.849827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:58.850880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:34:58.851739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:34:58.852390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:34:59.153736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:34:59.165535 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-136a3eb2-d68a-4077-a48a-631a35d5aa42 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.332282 Aug 30 04:34:59.166863 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2447/4986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:34:58 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:00.188343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:00.190029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:00.202409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.203564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.204344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.205285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:00.206400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:00.207252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:00.611708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:00.621376 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-318e7fd9-d086-483a-914b-f899eac14b8b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.438167 Aug 30 04:35:00.623963 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2540/4987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:00 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:01.646651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:01.647290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:01.664022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:01.664526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:01.665033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:01.665917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:01.666551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:01.668895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:02.045284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:02.053790 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-619ff809-5cdd-4123-8a3e-7ad4143acd5f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.411176 Aug 30 04:35:02.054392 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2448/4988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:01 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:03.075506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:03.076139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:03.086585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.087168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.087511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.090777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.094330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.095266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.347550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a07f5de3-63f4-4bb3-b330-e3405f734deb req-4bec0e68-8be2-4dd0-bf38-fd92ef89ef35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a61fcb-226c-4218-a283-e10ccdc8bd0a", "name": "network-vif-plugged", "status": "completed", "tag": "ae94c0d5-4ecd-4f57-bd04-9c7af7f1569c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:03.375798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a07f5de3-63f4-4bb3-b330-e3405f734deb req-4bec0e68-8be2-4dd0-bf38-fd92ef89ef35 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:03.376717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a07f5de3-63f4-4bb3-b330-e3405f734deb req-4bec0e68-8be2-4dd0-bf38-fd92ef89ef35 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:03.377415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a07f5de3-63f4-4bb3-b330-e3405f734deb req-4bec0e68-8be2-4dd0-bf38-fd92ef89ef35 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:03.402382 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a07f5de3-63f4-4bb3-b330-e3405f734deb req-4bec0e68-8be2-4dd0-bf38-fd92ef89ef35 service nova] Creating event network-vif-plugged:ae94c0d5-4ecd-4f57-bd04-9c7af7f1569c for instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a on n-h2-854925-5 Aug 30 04:35:03.408607 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a07f5de3-63f4-4bb3-b330-e3405f734deb req-4bec0e68-8be2-4dd0-bf38-fd92ef89ef35 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065534 Aug 30 04:35:03.409595 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2449/4989] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:03.414974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:03.439171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c3952169-8bfe-4d9b-a726-d07c2581abf7 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.368175 Aug 30 04:35:03.461482 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2541/4990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:03 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:04.484554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:04.485547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:04.504317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.505597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.506255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.507184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:04.508115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:04.508752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:04.548255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:04.911161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:04.927048 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-75e736f9-ed68-43bf-a4e1-d43fde59f32b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1315 microversion: 2.1 time: 0.460383 Aug 30 04:35:04.928427 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2450/4991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:04 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1315 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:05.951272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:05.954035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:05.964981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.966960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.967676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:05.969796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:05.970631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:05.971574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.347223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:06.363066 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea2a0727-3f12-491a-a3bc-41f4b1628cf9 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1465 microversion: 2.1 time: 0.417977 Aug 30 04:35:06.363637 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2542/4992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:05 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1465 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:06.429165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:06.431954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:06.456907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:06.459572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:06.461434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.465344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:06.470560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:06.471182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.529281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:06.640601 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e15568b6-c417-49da-ba70-769126ec3d8f tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "DELETE /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 204 len: 0 microversion: 2.1 time: 0.218537 Aug 30 04:35:06.644957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2451/4993] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:06 2022] DELETE /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:06.650545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:06.651235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:06.657775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:06.660494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:06.661169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:06.662952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:06.664190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:06.664725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:07.470487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:07.486059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-03efc35e-bc67-4fde-82b4-3ce3575fd500 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1471 microversion: 2.1 time: 0.838375 Aug 30 04:35:07.488480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2543/4994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:06 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1471 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:08.522461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:08.524860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:08.540895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.541704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.542406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.543327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:08.544028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:08.544832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:08.885429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:08.950414 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef8a187b-329c-4d6d-8f96-ff21ce0f88f6 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1471 microversion: 2.1 time: 0.443211 Aug 30 04:35:08.951000 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2452/4995] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:08 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1471 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:09.770664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c56f591a-4a90-47aa-8490-21c11257e2fd req-99e9de4d-e0d5-4443-982c-0fe63d983407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79a61fcb-226c-4218-a283-e10ccdc8bd0a", "name": "network-vif-deleted", "tag": "ae94c0d5-4ecd-4f57-bd04-9c7af7f1569c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:09.803202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c56f591a-4a90-47aa-8490-21c11257e2fd req-99e9de4d-e0d5-4443-982c-0fe63d983407 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.803753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c56f591a-4a90-47aa-8490-21c11257e2fd req-99e9de4d-e0d5-4443-982c-0fe63d983407 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:09.811305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c56f591a-4a90-47aa-8490-21c11257e2fd req-99e9de4d-e0d5-4443-982c-0fe63d983407 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:09.830642 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c56f591a-4a90-47aa-8490-21c11257e2fd req-99e9de4d-e0d5-4443-982c-0fe63d983407 service nova] Creating event network-vif-deleted:ae94c0d5-4ecd-4f57-bd04-9c7af7f1569c for instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a on n-h2-854925-5 Aug 30 04:35:09.850183 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c56f591a-4a90-47aa-8490-21c11257e2fd req-99e9de4d-e0d5-4443-982c-0fe63d983407 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084780 Aug 30 04:35:09.850845 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2544/4996] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:09.977377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:09.978606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:09.998819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:09.999552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.000142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.001191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.002360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.005693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.093958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:10.094462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:10.095092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:10.095374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lazy-loading 'fault' on Instance uuid 79a61fcb-226c-4218-a283-e10ccdc8bd0a {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:10.217955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0704c83db62b4ebe931492820cb8387a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '878873e8f1f34009a594347fe4da4555', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:10.232729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21669f87-874b-4b5d-a5a1-119b5ab0baa3 tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 200 len: 1305 microversion: 2.1 time: 0.259978 Aug 30 04:35:10.235340 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2453/4997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:09 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 1305 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:10.319420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-863707786", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "aa53ebc9-fe7c-44a6-ae04-4ba9ef1bb9dd"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:10.401017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] validate_networks() for [('aa53ebc9-fe7c-44a6-ae04-4ba9ef1bb9dd', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:35:11.261540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:11.264533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] [instance: 79a61fcb-226c-4218-a283-e10ccdc8bd0a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:11.275985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:11.279004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.280520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.281186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.282328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.283240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.284719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.334615 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] HTTP exception thrown: Instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a could not be found. Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Request method failure captured: Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a HTTP/1.1 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZNkR-SsZ3Uzy6cDU0QWzje6iknMTDvcaR-ZreIw4vuIgpJwnICrrP5jQdccVauR8BWBVCSAOBfYhYEGWR68wLdPxsBjXHiVz82Pt0mbTapi8temd19f4EwP_rlQO58tvpvPEjPKoy94olis1SeRXhWP_ilZzgnL9Km3aHq6gb2DGxs Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 878873e8f1f34009a594347fe4da4555 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesNegativeTest-1609428603 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_878873e8f1f34009a594347fe4da4555", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/878873e8f1f34009a594347fe4da4555"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/878873e8f1f34009a594347fe4da4555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/878873e8f1f34009a594347fe4da4555"}]}] Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesNegativeTest-1609428603 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 878873e8f1f34009a594347fe4da4555 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesNegativeTest-1609428603 Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesNegativeTest-1609428603-project Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 0704c83db62b4ebe931492820cb8387a Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesNegativeTest-1609428603-project Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a could not be found. Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '79a61fcb-226c-4218-a283-e10ccdc8bd0a'} Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a could not be found. Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a could not be found. Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:11.337437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:11.340888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:11.340888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:11.340888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:11.340888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:11.340888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:11.340888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a could not be found. Aug 30 04:35:11.340888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:11.346266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] Returning 404 to user: Instance 79a61fcb-226c-4218-a283-e10ccdc8bd0a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:11.347031 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b827f4ec-10c9-4fc0-adf0-e9face7ee16b tempest-VolumesNegativeTest-1609428603 tempest-VolumesNegativeTest-1609428603-project] 10.222.0.27 "GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a" status: 404 len: 111 microversion: 2.1 time: 0.093777 Aug 30 04:35:11.352984 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2454/4998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:11 2022] GET /compute/v2.1/servers/79a61fcb-226c-4218-a283-e10ccdc8bd0a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:11.438512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:35:11.438958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:35:11.439414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:35:11.439828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:35:11.440241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:35:11.447429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:11.466207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.466629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.467505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.468232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:11.468685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:11.469089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:11.503449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Getting quotas for project 544e3d72dcda4872839e6b6d3da3f59f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:35:11.514625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Getting quotas for user fbbd0406b61047efa76052a52a1896ad and project 544e3d72dcda4872839e6b6d3da3f59f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:35:11.542551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:35:11.549090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:35:11.657617 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-02f08545-b932-46e9-a501-7218ff3d2803 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.564251 Aug 30 04:35:11.663831 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2545/4999] 10.222.0.27 () {62 vars in 1188 bytes} [Tue Aug 30 04:35:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 04:35:11.685436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-244ae58b-ca1c-494a-9804-aa66805aa65b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:11.686218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-244ae58b-ca1c-494a-9804-aa66805aa65b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:11.786252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-244ae58b-ca1c-494a-9804-aa66805aa65b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:11.795033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-244ae58b-ca1c-494a-9804-aa66805aa65b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:11.795880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-244ae58b-ca1c-494a-9804-aa66805aa65b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:11.797048 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-244ae58b-ca1c-494a-9804-aa66805aa65b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1261 microversion: 2.26 time: 0.126536 Aug 30 04:35:11.806121 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2455/5000] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:11 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1261 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:12.829189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:12.830024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:12.849271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:12.855556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:12.858500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:12.859522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:12.862794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:12.864592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:13.095594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:13.104319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:13.105807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:13.118346 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a01b3795-bf5c-463f-a48a-fe0fec94191a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1265 microversion: 2.26 time: 0.294175 Aug 30 04:35:13.121477 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2546/5001] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:12 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:14.144943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:14.148456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:14.165831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.167847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.169650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.170647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:14.173536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:14.175011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:14.605605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:14.620991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:14.625184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:14.630974 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cbb3dc48-a174-457c-b6a1-876dc959f3d7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1331 microversion: 2.26 time: 0.490454 Aug 30 04:35:14.632835 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2456/5002] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:14 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1331 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:15.656644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:15.657413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:15.674578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:15.675480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:15.676459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:15.677607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:15.681121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:15.681926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:16.696366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:16.708986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:16.729199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:16.738380 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23c10b30-31ed-43e8-a565-a48051ae202e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1361 microversion: 2.26 time: 1.085891 Aug 30 04:35:16.739792 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2547/5003] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:15 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1361 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:17.764508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:17.765228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:17.787338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:17.787841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:17.788280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:17.789177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:17.789698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:17.790143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:17.986712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1640562045", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "d9203614-b6e9-4d9b-8e79-4bd0befd8823"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:18.125892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] validate_networks() for [('d9203614-b6e9-4d9b-8e79-4bd0befd8823', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:35:18.824622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:18.840512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:18.842916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:18.844846 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fee6513d-6858-477a-8b81-d4877c377e52 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1361 microversion: 2.26 time: 1.086556 Aug 30 04:35:18.846304 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2548/5004] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:17 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1361 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:18.852756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-200c6e67-ab05-4b6c-af4a-b5529efdcf39 req-7ad586c1-be5d-41aa-a794-71313e7bd865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b58ef4b-e004-4d2d-8d71-26f6d4e174e0", "tag": "d429544d-a027-4c09-8cf4-4406caf7a37d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:18.865245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-200c6e67-ab05-4b6c-af4a-b5529efdcf39 req-7ad586c1-be5d-41aa-a794-71313e7bd865 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:18.865865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-200c6e67-ab05-4b6c-af4a-b5529efdcf39 req-7ad586c1-be5d-41aa-a794-71313e7bd865 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:18.866315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-200c6e67-ab05-4b6c-af4a-b5529efdcf39 req-7ad586c1-be5d-41aa-a794-71313e7bd865 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:18.896710 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-200c6e67-ab05-4b6c-af4a-b5529efdcf39 req-7ad586c1-be5d-41aa-a794-71313e7bd865 service nova] Creating event network-changed:d429544d-a027-4c09-8cf4-4406caf7a37d for instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 on n-h2-854925-5 Aug 30 04:35:18.904553 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-200c6e67-ab05-4b6c-af4a-b5529efdcf39 req-7ad586c1-be5d-41aa-a794-71313e7bd865 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056517 Aug 30 04:35:18.905462 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2549/5005] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:19.165191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:35:19.166157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:35:19.167030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:35:19.167821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:35:19.168637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:35:19.234239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:19.235128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:19.235930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:19.237250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:19.238122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:19.238926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:19.298595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Getting quotas for project fae781dd2b4445af931c5016e285b5fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:35:19.311112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Getting quotas for user 16a6ac7ebc5145b4941b2f2e91d47628 and project fae781dd2b4445af931c5016e285b5fa. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:35:19.336579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:35:19.342802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:35:19.454169 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-823cc909-dcd9-4579-a65b-08fa84af868a tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770314 Aug 30 04:35:19.466405 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2457/5006] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:35:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:35:19.472925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5fd417c1-cc79-4f1a-942e-d599f1ed7276 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:19.474865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5fd417c1-cc79-4f1a-942e-d599f1ed7276 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:19.607082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5fd417c1-cc79-4f1a-942e-d599f1ed7276 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:19.617984 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5fd417c1-cc79-4f1a-942e-d599f1ed7276 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1225 microversion: 2.1 time: 0.149304 Aug 30 04:35:19.619565 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2550/5007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:19 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:19.869920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:19.870900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:19.884888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:19.885638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:19.886342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:19.887302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:19.888033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:19.888696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:20.191214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:20.202766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:20.204380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:20.210788 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-87263ec0-0d52-4f0d-8c7c-13bcd261872c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1361 microversion: 2.26 time: 0.344795 Aug 30 04:35:20.212169 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2458/5008] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:19 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:20.649013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:20.649648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:20.671446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:20.672829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:20.675621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:20.677737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:20.680292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:20.682700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:20.876578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:20.892687 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-abb22214-2fd2-4040-b579-1fab60110312 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1221 microversion: 2.1 time: 0.255758 Aug 30 04:35:20.894801 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2551/5009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:20 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1221 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:21.243298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:21.244739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:21.264018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:21.266287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:21.268178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:21.269384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:21.272544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:21.273568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:21.783700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:21.792372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:21.802551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:21.804264 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c80b07e5-1a5e-4e80-931f-0737ec430743 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1361 microversion: 2.26 time: 0.566732 Aug 30 04:35:21.806245 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2459/5010] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:21 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1361 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:21.923860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:21.925179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:21.927643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:21.985307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:21.985969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:21.990063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:22.011749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:22.014036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:22.016023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:22.322569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:22.339082 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-89afd4ef-02fb-456a-9da6-c81eca8e5553 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1283 microversion: 2.1 time: 0.427478 Aug 30 04:35:22.339648 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2552/5011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:21 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1283 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:22.828465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:22.829963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:22.846327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:22.847164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:22.849257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:22.850220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:22.853640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:22.855826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.362441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:23.363066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:23.379660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.380619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.382150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.383081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:23.386118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:23.386785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:23.826799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:23.844644 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff74da43-1c31-4a5b-870f-83a9371c7a85 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1283 microversion: 2.1 time: 0.482891 Aug 30 04:35:23.860995 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2553/5012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:23 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1283 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:24.015514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:24.053648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:24.055875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:24.057342 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce6b0994-4da8-4d83-87de-b6d2568666ed tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1361 microversion: 2.26 time: 1.233144 Aug 30 04:35:24.058948 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2460/5013] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:22 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1361 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:24.701305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:24.703281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:24.719467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.721117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.722763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.723600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.724951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.726846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.803651 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da1cfd6c-8d3e-45eb-b829-ae571623404a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/ips" status: 200 len: 149 microversion: 2.1 time: 0.107057 Aug 30 04:35:24.810444 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2554/5014] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:35:24 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/ips => generated 149 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:24.869969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:24.871461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:24.896809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.897835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.901125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:24.907218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:24.907771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:24.908446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:25.088517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:25.089703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:25.099963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:25.101842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:25.104904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:25.106489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:25.107554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:25.110702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:25.566269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:25.576739 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83f41a3e-9c86-481d-a68e-1801e317ce7d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.711611 Aug 30 04:35:25.588396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:25.589823 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2461/5015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:24 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:25.592928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=82 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:25.604670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:25.612246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:25.615038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c61d17fc-9304-451d-a5d3-7f3f1f6afb62 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1361 microversion: 2.26 time: 0.534422 Aug 30 04:35:25.618975 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2555/5016] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:25 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1361 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:26.107534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2e18b07c-3235-4b02-a7a5-fed761f8d2a5 req-253175bb-8b47-4942-858e-1969f54e3545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b58ef4b-e004-4d2d-8d71-26f6d4e174e0", "name": "network-vif-plugged", "status": "completed", "tag": "d429544d-a027-4c09-8cf4-4406caf7a37d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:26.126697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2e18b07c-3235-4b02-a7a5-fed761f8d2a5 req-253175bb-8b47-4942-858e-1969f54e3545 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.127571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2e18b07c-3235-4b02-a7a5-fed761f8d2a5 req-253175bb-8b47-4942-858e-1969f54e3545 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.128194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2e18b07c-3235-4b02-a7a5-fed761f8d2a5 req-253175bb-8b47-4942-858e-1969f54e3545 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.145319 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2e18b07c-3235-4b02-a7a5-fed761f8d2a5 req-253175bb-8b47-4942-858e-1969f54e3545 service nova] Creating event network-vif-plugged:d429544d-a027-4c09-8cf4-4406caf7a37d for instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 on n-h2-854925-5 Aug 30 04:35:26.152691 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2e18b07c-3235-4b02-a7a5-fed761f8d2a5 req-253175bb-8b47-4942-858e-1969f54e3545 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051711 Aug 30 04:35:26.154493 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2462/5017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:26.617944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:26.619179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:26.642481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.642992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.643439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.644173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.644637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.645080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.647785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:26.649130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:26.679454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.681183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.682667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:26.686375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:26.687226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:26.687874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:27.203676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:27.212000 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e4118df-d2fc-4aff-972d-7d66ccc3c5bb tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.613844 Aug 30 04:35:27.227315 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2556/5018] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:26 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:27.232106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:27.243597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:27.245675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:27.247812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3eae4e4-3c13-4878-9a1a-652c35267d1e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1361 microversion: 2.26 time: 0.605924 Aug 30 04:35:27.248931 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2463/5019] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:26 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1361 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:27.608104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-eae036eb-c90d-434c-8141-233e622ae4e6 req-e3fe5bda-7b9c-4c55-8385-0c657ef90fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0521eb20-b961-468e-b22f-878973aa0a3c", "tag": "1bea0cd3-0c4b-4439-8f4a-039f92cadb58"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:27.622927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eae036eb-c90d-434c-8141-233e622ae4e6 req-e3fe5bda-7b9c-4c55-8385-0c657ef90fe5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:27.625675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eae036eb-c90d-434c-8141-233e622ae4e6 req-e3fe5bda-7b9c-4c55-8385-0c657ef90fe5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:27.626380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eae036eb-c90d-434c-8141-233e622ae4e6 req-e3fe5bda-7b9c-4c55-8385-0c657ef90fe5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:27.641962 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-eae036eb-c90d-434c-8141-233e622ae4e6 req-e3fe5bda-7b9c-4c55-8385-0c657ef90fe5 service nova] Creating event network-changed:1bea0cd3-0c4b-4439-8f4a-039f92cadb58 for instance 0521eb20-b961-468e-b22f-878973aa0a3c on n-h1-854925-5 Aug 30 04:35:27.647924 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-eae036eb-c90d-434c-8141-233e622ae4e6 req-e3fe5bda-7b9c-4c55-8385-0c657ef90fe5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.431466 Aug 30 04:35:27.648543 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2557/5020] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:27.759578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23c68b6-28ab-49f8-b613-57bf6664e0be"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:27.762815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:27.769485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:27.770036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:27.770641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:27.771434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:27.772081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:27.773731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.237101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:28.238140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:28.245268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.245791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.247005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.248018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.248654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.249246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.487938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:28.497094 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-87efd59d-b202-487d-b709-8378757e97d4 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.265844 Aug 30 04:35:28.497713 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2558/5021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:28 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:28.516386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:28.517028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:28.523913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.524392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.525170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.526050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.526523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.526963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.722668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:28.739254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:28.741234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:28.742832 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40dd8881-6f15-4597-a012-9d0d1c40c355 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1544 microversion: 2.26 time: 0.239813 Aug 30 04:35:28.743635 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2559/5022] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:28 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1544 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:28.768703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a8fe160>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:28.783712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.784202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.786200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.787528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:28.798368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.799759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.800379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.801059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.801571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.802174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.850119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.850620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.851244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.877540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.877540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.877540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.916178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:28.940257 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-700be556-2691-4be4-95fc-bfe8481701ca tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-517256781" status: 201 len: 0 microversion: 2.26 time: 0.176893 Aug 30 04:35:28.947502 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2560/5023] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Aug 30 04:35:28 2022] PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-517256781 => generated 0 bytes in 185 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 30 04:35:28.953922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1aaa51dd-718d-43b5-afb9-e0b3df1a397b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe969bc1f70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:28.962924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aaa51dd-718d-43b5-afb9-e0b3df1a397b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.963536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aaa51dd-718d-43b5-afb9-e0b3df1a397b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.963987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aaa51dd-718d-43b5-afb9-e0b3df1a397b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.976776 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1aaa51dd-718d-43b5-afb9-e0b3df1a397b tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-517256781" status: 204 len: 0 microversion: 2.26 time: 0.027922 Aug 30 04:35:28.977444 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2561/5024] 10.222.0.27 () {60 vars in 1358 bytes} [Tue Aug 30 04:35:28 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-517256781 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:35:28.986982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a52bf70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:28.995211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:28.995708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:28.996400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:28.997115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.004484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.005270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.005924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.006838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.007492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.008116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.036152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.036895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.037558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.056352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:29.073924 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f09912e-5122-4c5b-95be-6cc3d8b5bd5a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 204 len: 0 microversion: 2.26 time: 0.091301 Aug 30 04:35:29.079383 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2562/5025] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Aug 30 04:35:28 2022] DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:35:29.085710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b00dd3d4-4e68-46d0-b34c-cee0dc3adebd tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a44aca0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.095411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b00dd3d4-4e68-46d0-b34c-cee0dc3adebd tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.095959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b00dd3d4-4e68-46d0-b34c-cee0dc3adebd tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.096655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b00dd3d4-4e68-46d0-b34c-cee0dc3adebd tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.107437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b00dd3d4-4e68-46d0-b34c-cee0dc3adebd tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 200 len: 12 microversion: 2.26 time: 0.026597 Aug 30 04:35:29.108068 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2563/5026] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 04:35:29 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:29.118391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe969bc1430>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.128221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.128715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.129161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.129664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.135299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.135787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.136255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.137780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.138335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.138787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.168114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.169164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.169639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.180175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.180658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.181109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.206791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:29.226124 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c87d3ecb-1c45-4936-a4fe-9be38fa49aab tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-258093695" status: 201 len: 0 microversion: 2.26 time: 0.111639 Aug 30 04:35:29.229519 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2564/5027] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Aug 30 04:35:29 2022] PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-258093695 => generated 0 bytes in 116 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 30 04:35:29.239054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db696084-b439-48e8-a5ff-fb331454966a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a41a820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.247025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db696084-b439-48e8-a5ff-fb331454966a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.247613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db696084-b439-48e8-a5ff-fb331454966a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.248358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db696084-b439-48e8-a5ff-fb331454966a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.257516 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db696084-b439-48e8-a5ff-fb331454966a tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 200 len: 35 microversion: 2.26 time: 0.023449 Aug 30 04:35:29.263812 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2565/5028] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 04:35:29 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 35 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:29.269787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:29.271845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a9df5e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.283411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.284157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.284791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.285515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.291868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.292308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.292744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.294013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.294467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.294899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.320516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.321021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.321487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.325877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:29.353045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:29.381265 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8681a536-9cc0-4c60-8cf6-b2fd797aa25f tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-258093695" status: 204 len: 0 microversion: 2.26 time: 0.115509 Aug 30 04:35:29.382192 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2566/5029] 10.222.0.27 () {60 vars in 1361 bytes} [Tue Aug 30 04:35:29 2022] DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-258093695 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:35:29.391672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c760a83-c849-4702-9345-1bb395dba5a7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a8b4dc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.407679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c760a83-c849-4702-9345-1bb395dba5a7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.408196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c760a83-c849-4702-9345-1bb395dba5a7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.408649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c760a83-c849-4702-9345-1bb395dba5a7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.429747 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c760a83-c849-4702-9345-1bb395dba5a7 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 200 len: 12 microversion: 2.26 time: 0.042501 Aug 30 04:35:29.432039 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2567/5030] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 04:35:29 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:29.445696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a9df040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.457030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.457998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.458694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.459329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.468324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.469010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.469659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.470641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.471280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.471891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.499795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.500468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.501163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.512674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:29.530005 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3f760bd4-1ffe-4979-8a75-48d8978dee88 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 204 len: 0 microversion: 2.26 time: 0.089489 Aug 30 04:35:29.530944 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2568/5031] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Aug 30 04:35:29 2022] DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:35:29.536614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.537254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.544208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.545192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.545681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.546408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.546874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.547316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.564016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:29.611931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:29.757731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:29.766989 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5361384-63ca-434c-82ac-945f747439bd tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.235220 Aug 30 04:35:29.767575 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2569/5032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:29 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:29.772362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a3bc1f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.789957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.790450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.790896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.791385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.798550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.799205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.799926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.801023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.801160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.801538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.832553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.833048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.833523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.842841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.843320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.843933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.873890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:29.892005 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-50ac0995-91ee-428e-a69c-46093811aee3 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-871367711" status: 201 len: 0 microversion: 2.26 time: 0.123300 Aug 30 04:35:29.892555 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2570/5033] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Aug 30 04:35:29 2022] PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-871367711 => generated 0 bytes in 124 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 30 04:35:29.902592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe969ce7280>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:29.914061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.914733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.915186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.915673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:29.921743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.922450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.923081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.923974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.924785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.925429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.967770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.968262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.968705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:29.986173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:29.986677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:29.987131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.019285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:30.038093 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6b7eb685-b39d-4649-84a1-3f944ae8b7a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-1129125281" status: 201 len: 0 microversion: 2.26 time: 0.139940 Aug 30 04:35:30.039278 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2571/5034] 10.222.0.27 () {62 vars in 1380 bytes} [Tue Aug 30 04:35:29 2022] PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-1129125281 => generated 0 bytes in 142 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 30 04:35:30.050465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96e6554c0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.059867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.060500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.061039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.061650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.068703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.069494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.070059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.070847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.071349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.071758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.099529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.100022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.100468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.116538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:30.143471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b8b39d85-7577-43f4-8f66-69cb46e3c6b8 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 204 len: 0 microversion: 2.26 time: 0.098217 Aug 30 04:35:30.144268 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2572/5035] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Aug 30 04:35:30 2022] DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:35:30.155366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01308d27-f7c0-4dd2-881b-3ba6ca4959a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a8b4670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.164154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01308d27-f7c0-4dd2-881b-3ba6ca4959a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.164814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01308d27-f7c0-4dd2-881b-3ba6ca4959a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.165256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01308d27-f7c0-4dd2-881b-3ba6ca4959a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.177135 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01308d27-f7c0-4dd2-881b-3ba6ca4959a4 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 200 len: 12 microversion: 2.26 time: 0.028252 Aug 30 04:35:30.181555 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2573/5036] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 04:35:30 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 12 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:30.191016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a3bce50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.200223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.201028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.203442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.203442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.211749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.212297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.212680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.213401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.213858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.214435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.257859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.265263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.290928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.321251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:30.339893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76417969-3c01-476a-b5e5-f4b4087fa754 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 204 len: 0 microversion: 2.26 time: 0.153819 Aug 30 04:35:30.341361 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2574/5037] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Aug 30 04:35:30 2022] DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:35:30.352399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a53b670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.363503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.364269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.364724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.365221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.371499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.371993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.372444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.373160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.373651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.374141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.403556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.404053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.404503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.414090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.414579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.415028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.447015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:30.466372 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c0f9a36-dc98-4e78-ad10-8e8d2025cc80 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-496978329" status: 201 len: 0 microversion: 2.26 time: 0.119409 Aug 30 04:35:30.467393 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2575/5038] 10.222.0.27 () {62 vars in 1377 bytes} [Tue Aug 30 04:35:30 2022] PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-496978329 => generated 0 bytes in 121 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Aug 30 04:35:30.485923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96b0c8670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.503465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.503982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.504491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.504997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.513056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.514091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.514851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.515803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.516270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.516701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.548774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.549349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.549841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.583464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.590772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.590772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.628029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:30.679700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a9174db-4712-4c14-b286-f08ed0ae6850 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-1899782202" status: 201 len: 0 microversion: 2.26 time: 0.203443 Aug 30 04:35:30.682010 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2576/5039] 10.222.0.27 () {62 vars in 1380 bytes} [Tue Aug 30 04:35:30 2022] PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags/tempest-tag-1899782202 => generated 0 bytes in 209 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 30 04:35:30.705489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Action: 'update_all', calling method: .version_select at 0x7fe96a9df040>, body: {"tags": ["tempest-tag-1407748547", "tempest-tag-2137445739"]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:30.709713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:30.716566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.717062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.725652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.726244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.734388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.734885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.735330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.736043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.736486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.736919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.803173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.803927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.804149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.830957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4,nova_cell1:DELETE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:30.860745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:30.905372 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7efd68d-f369-4177-9aff-20fc09d1d790 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 200 len: 62 microversion: 2.26 time: 0.213871 Aug 30 04:35:30.905372 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2577/5040] 10.222.0.27 () {62 vars in 1312 bytes} [Tue Aug 30 04:35:30 2022] PUT /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 62 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:30.915840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:30.920226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:30.938115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.938609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.943289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:30.944081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:30.944557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:30.944998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.004512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a0fc66d-06c1-429e-8821-1aa3934441d5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "POST /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.247044 Aug 30 04:35:31.007635 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2464/5041] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:35:27 2022] POST /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 194 bytes in 3253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:31.028665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9929227-6183-444f-8b2a-594aff5b050c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe969fccf70>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.064783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9929227-6183-444f-8b2a-594aff5b050c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.067214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9929227-6183-444f-8b2a-594aff5b050c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.067921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9929227-6183-444f-8b2a-594aff5b050c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.108085 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c9929227-6183-444f-8b2a-594aff5b050c tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 200 len: 62 microversion: 2.26 time: 0.098201 Aug 30 04:35:31.111769 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2465/5042] 10.222.0.27 () {60 vars in 1292 bytes} [Tue Aug 30 04:35:31 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 62 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:31.127170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '.version_select at 0x7fe96a368280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.153699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.154497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.156984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.158008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:31.175471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.176220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.179394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.181137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.182810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.185200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.257430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.258216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.261361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.274424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:31.331675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'flavor' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:31.413203 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d52254c-a2ad-4eae-b7f5-1dd5b2b40088 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags" status: 204 len: 0 microversion: 2.26 time: 0.294274 Aug 30 04:35:31.425163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2466/5043] 10.222.0.27 () {60 vars in 1295 bytes} [Tue Aug 30 04:35:31 2022] DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0/tags => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 30 04:35:31.445958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.446686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:31.473936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.474718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.475186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.483500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.487997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.488669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.495507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:31.506066 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-831cebdc-88a5-4fa1-aa4a-af7b3735dd04 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.597714 Aug 30 04:35:31.506977 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2578/5044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:30 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:31.521651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:31.678284 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-24bea6a5-a5a9-4d5d-9df7-2107ecbe3eba tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 204 len: 0 microversion: 2.26 time: 0.244222 Aug 30 04:35:31.678932 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2467/5045] 10.222.0.27 () {60 vars in 1280 bytes} [Tue Aug 30 04:35:31 2022] DELETE /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 04:35:31.688431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:31.690086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:31.706835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.707441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.707982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.708808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:31.709391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:31.710338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:31.972639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:31.982694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:31.984146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:31.985400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-481b2f81-7137-475d-aca9-f45f0354e779 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1550 microversion: 2.26 time: 0.302151 Aug 30 04:35:31.986246 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2579/5046] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:31 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1550 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 04:35:32.531822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:32.532853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:32.551383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.552397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.554589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.555320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:32.555791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:32.556226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:32.807335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:32.816232 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-724685c6-003c-4649-81ab-74d6454c7e9f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.291497 Aug 30 04:35:32.817061 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2468/5047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:32 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:33.009537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:33.010187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:33.018501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.018962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.019409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.020117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.020991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.021444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.256918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:33.270977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:33.278089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:33.280828 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf26344e-afa3-496d-9692-a83484265e48 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1550 microversion: 2.26 time: 0.276369 Aug 30 04:35:33.284064 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2580/5048] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:33 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1550 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:33.634190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1f0527f0-82a7-4328-9cf9-a674b0678ded req-2a528068-8491-4c4e-9a59-876d43900388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0521eb20-b961-468e-b22f-878973aa0a3c", "name": "network-vif-plugged", "status": "completed", "tag": "1bea0cd3-0c4b-4439-8f4a-039f92cadb58"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:33.687082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1f0527f0-82a7-4328-9cf9-a674b0678ded req-2a528068-8491-4c4e-9a59-876d43900388 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.688019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1f0527f0-82a7-4328-9cf9-a674b0678ded req-2a528068-8491-4c4e-9a59-876d43900388 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.688496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1f0527f0-82a7-4328-9cf9-a674b0678ded req-2a528068-8491-4c4e-9a59-876d43900388 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.729757 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1f0527f0-82a7-4328-9cf9-a674b0678ded req-2a528068-8491-4c4e-9a59-876d43900388 service nova] Creating event network-vif-plugged:1bea0cd3-0c4b-4439-8f4a-039f92cadb58 for instance 0521eb20-b961-468e-b22f-878973aa0a3c on n-h1-854925-5 Aug 30 04:35:33.740663 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1f0527f0-82a7-4328-9cf9-a674b0678ded req-2a528068-8491-4c4e-9a59-876d43900388 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114584 Aug 30 04:35:33.742356 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2469/5049] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:33.846623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:33.851002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:33.866706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.867822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.869860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.872577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.876586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.879104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:33.966501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0f858f4c-8932-42b5-864d-9d50a3b96c70 req-ad7d6737-e649-4bfc-8b70-94bd32da2b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b58ef4b-e004-4d2d-8d71-26f6d4e174e0", "name": "network-vif-deleted", "tag": "d429544d-a027-4c09-8cf4-4406caf7a37d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:33.984490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0f858f4c-8932-42b5-864d-9d50a3b96c70 req-ad7d6737-e649-4bfc-8b70-94bd32da2b33 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:33.985362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0f858f4c-8932-42b5-864d-9d50a3b96c70 req-ad7d6737-e649-4bfc-8b70-94bd32da2b33 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:33.998602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0f858f4c-8932-42b5-864d-9d50a3b96c70 req-ad7d6737-e649-4bfc-8b70-94bd32da2b33 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.039855 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0f858f4c-8932-42b5-864d-9d50a3b96c70 req-ad7d6737-e649-4bfc-8b70-94bd32da2b33 service nova] Creating event network-vif-deleted:d429544d-a027-4c09-8cf4-4406caf7a37d for instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 on n-h2-854925-5 Aug 30 04:35:34.056024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0f858f4c-8932-42b5-864d-9d50a3b96c70 req-ad7d6737-e649-4bfc-8b70-94bd32da2b33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092482 Aug 30 04:35:34.063436 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2470/5050] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:35:34.310026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:34.310967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:34.332358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.333719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.335404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.338368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.341396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.342821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.368580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:34.378273 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c42fc3f-aa23-442d-95eb-a439aa949105 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.545142 Aug 30 04:35:34.384465 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2581/5051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:33 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:34.430973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:34.431588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:34.432426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:34.433115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lazy-loading 'fault' on Instance uuid 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:34.495766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:34.508334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:34.510782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbbd0406b61047efa76052a52a1896ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '544e3d72dcda4872839e6b6d3da3f59f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:34.514356 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3d1c62f-9537-4d00-88e3-7baf8ae33c67 tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 200 len: 1351 microversion: 2.26 time: 0.210077 Aug 30 04:35:34.516189 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2471/5052] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:34 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 1351 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 04:35:35.407521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:35.408892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:35.417876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.418570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.419200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.420113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.420723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.421308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.546079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:35.549792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] [instance: 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:35.570872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.572440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.573514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.574343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:35.575008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:35.576011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:35.597629 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] HTTP exception thrown: Instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 could not be found. Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Request method failure captured: Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 HTTP/1.1 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZN9CeQckXS7vQqhpWHdCU_gAapZ9AlSPRA5NmG88r3MD9OLK-v2H0sQ8-HkMfPmIXoTka-v8bGPXqoMce_BhbpP1e7zTYeAg0y37baBwumAiZTWXbEJWmkVH_TBk9SHkCWGFsFx6mGrvwEkJw6FdIa7MkDXgNnTuV_E5vQciyxe6bM Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Openstack-Nova-Api-Version: 2.26 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 544e3d72dcda4872839e6b6d3da3f59f Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerTagsTestJSON-1990049633 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_544e3d72dcda4872839e6b6d3da3f59f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/544e3d72dcda4872839e6b6d3da3f59f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/544e3d72dcda4872839e6b6d3da3f59f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/544e3d72dcda4872839e6b6d3da3f59f"}]}] Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerTagsTestJSON-1990049633 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 544e3d72dcda4872839e6b6d3da3f59f Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerTagsTestJSON-1990049633 Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerTagsTestJSON-1990049633-project Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: fbbd0406b61047efa76052a52a1896ad Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerTagsTestJSON-1990049633-project Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 could not be found. Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0b58ef4b-e004-4d2d-8d71-26f6d4e174e0'} Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 could not be found. Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 could not be found. Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:35.600724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:35.604371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:35.604371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:35.604371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:35.604371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:35.604371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:35.604371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 could not be found. Aug 30 04:35:35.604371 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:35.606133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] Returning 404 to user: Instance 0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:35.607295 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-87febc15-6352-406a-a97f-89892811484e tempest-ServerTagsTestJSON-1990049633 tempest-ServerTagsTestJSON-1990049633-project] 10.222.0.27 "GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0" status: 404 len: 111 microversion: 2.26 time: 0.070928 Aug 30 04:35:35.608722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2472/5053] 10.222.0.27 () {60 vars in 1277 bytes} [Tue Aug 30 04:35:35 2022] GET /compute/v2.1/servers/0b58ef4b-e004-4d2d-8d71-26f6d4e174e0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:35:35.694699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:35.711463 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb27e34f-3bb5-48a3-8c84-ce05dd9727c6 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1325 microversion: 2.1 time: 0.308420 Aug 30 04:35:35.712591 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2582/5054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:35 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:36.733870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:36.734657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:36.747642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.754097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.754665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:36.756400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:36.757156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:36.757830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.054207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:37.070538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e857aae-ac77-4e86-ab0e-3e41a74da13d tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1522 microversion: 2.1 time: 0.340016 Aug 30 04:35:37.081543 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2473/5055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:36 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:37.096627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.097979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.109822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.113587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.114229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.116235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.117453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.119546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.226946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] HTTP exception thrown: Action 999 not found Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Request method failure captured: Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c/os-instance-actions/999 HTTP/1.1 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOF9tLoQUfk9dF1G6uCds1NnDsuWgfBWlLVSZuKk9zaNECfxdHiDqrTL43ppbPSwUyNKqgiZ1oCntGfjc4Y9z8me6VBJn6che3Q6AKJAxYx4bDgLQaGNOHkELtbIHJqrPs34YsPuZbP4kjQpJmA3BnuEwWoCFCgGPCW9m99iTO7jSw Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: fae781dd2b4445af931c5016e285b5fa Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fae781dd2b4445af931c5016e285b5fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fae781dd2b4445af931c5016e285b5fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fae781dd2b4445af931c5016e285b5fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fae781dd2b4445af931c5016e285b5fa"}]}] Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: fae781dd2b4445af931c5016e285b5fa Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-InstanceActionsNegativeTestJSON-809905908-project Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 16a6ac7ebc5145b4941b2f2e91d47628 Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-809905908-project Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: exception: Action 999 not found Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': '0521eb20-b961-468e-b22f-878973aa0a3c', 'id': '999'} Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 30 04:35:37.232808 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.237799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Returning 404 to user: Action 999 not found {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:37.249700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ddfb1cff-4ee9-44cd-8ece-b32592e1c702 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.158039 Aug 30 04:35:37.253630 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2583/5056] 10.222.0.27 () {58 vars in 1308 bytes} [Tue Aug 30 04:35:37 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c/os-instance-actions/999 => generated 66 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:35:37.264131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d386e0b8-d3ed-4121-b5ea-0b1b6924e9d1 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '.version_select at 0x7fe96940d430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.264722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d386e0b8-d3ed-4121-b5ea-0b1b6924e9d1 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: d8c1a3a2-1805-4662-8530-4a1c56cbb6d7] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.279538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-d386e0b8-d3ed-4121-b5ea-0b1b6924e9d1 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] HTTP exception thrown: Instance d8c1a3a2-1805-4662-8530-4a1c56cbb6d7 could not be found. Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d386e0b8-d3ed-4121-b5ea-0b1b6924e9d1 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Request method failure captured: Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/d8c1a3a2-1805-4662-8530-4a1c56cbb6d7/os-instance-actions HTTP/1.1 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOF9tLoQUfk9dF1G6uCds1NnDsuWgfBWlLVSZuKk9zaNECfxdHiDqrTL43ppbPSwUyNKqgiZ1oCntGfjc4Y9z8me6VBJn6che3Q6AKJAxYx4bDgLQaGNOHkELtbIHJqrPs34YsPuZbP4kjQpJmA3BnuEwWoCFCgGPCW9m99iTO7jSw Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: fae781dd2b4445af931c5016e285b5fa Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fae781dd2b4445af931c5016e285b5fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fae781dd2b4445af931c5016e285b5fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fae781dd2b4445af931c5016e285b5fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fae781dd2b4445af931c5016e285b5fa"}]}] Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: fae781dd2b4445af931c5016e285b5fa Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-InstanceActionsNegativeTestJSON-809905908-project Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 16a6ac7ebc5145b4941b2f2e91d47628 Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-809905908-project Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: method: Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance d8c1a3a2-1805-4662-8530-4a1c56cbb6d7 could not be found. Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': 'd8c1a3a2-1805-4662-8530-4a1c56cbb6d7'} Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8c1a3a2-1805-4662-8530-4a1c56cbb6d7 could not be found. Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:37.281466 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8c1a3a2-1805-4662-8530-4a1c56cbb6d7 could not be found. Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8c1a3a2-1805-4662-8530-4a1c56cbb6d7 could not be found. Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d386e0b8-d3ed-4121-b5ea-0b1b6924e9d1 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Returning 404 to user: Instance d8c1a3a2-1805-4662-8530-4a1c56cbb6d7 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:37.285757 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d386e0b8-d3ed-4121-b5ea-0b1b6924e9d1 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/d8c1a3a2-1805-4662-8530-4a1c56cbb6d7/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024349 Aug 30 04:35:37.292490 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2474/5057] 10.222.0.27 () {58 vars in 1296 bytes} [Tue Aug 30 04:35:37 2022] GET /compute/v2.1/servers/d8c1a3a2-1805-4662-8530-4a1c56cbb6d7/os-instance-actions => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:37.305408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.306131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.318261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.319091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.321780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.322742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.323376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.332031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.370249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:37.515885 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e7b17e7-ef8a-4d88-9bf0-649cf24d564e tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 204 len: 0 microversion: 2.1 time: 0.214881 Aug 30 04:35:37.516940 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2584/5058] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:37 2022] DELETE /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:37.525099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:37.525974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:37.540766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.544351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.544839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.545773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:37.546259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:37.546703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:37.750504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:37.775676 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ccd89201-a291-43f9-9602-39897df606db tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1528 microversion: 2.1 time: 0.253433 Aug 30 04:35:37.778715 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2475/5059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:37 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1528 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:38.800534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:38.801250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:38.812843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:38.815929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:38.816499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:38.819635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:38.819635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:38.819635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:39.412409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:39.426673 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-82d8eba6-6b02-48b9-8898-60950f472dc8 tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1528 microversion: 2.1 time: 0.630427 Aug 30 04:35:39.428826 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2585/5060] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:38 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1528 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:40.450698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:40.452350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:40.474566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.475228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.475852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:40.479390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:40.480189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:40.483511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:41.327841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a6ac7ebc5145b4941b2f2e91d47628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fae781dd2b4445af931c5016e285b5fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:41.341586 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06081a5f-bf11-46a9-8eb0-629e2e6964cf tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 200 len: 1528 microversion: 2.1 time: 0.896564 Aug 30 04:35:41.354837 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2476/5061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:40 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 1528 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:41.435705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5f733fb1-daba-49c2-bc11-87dc4ae41282 req-69f2a0d0-26bc-419a-87a6-328417fc1f3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0521eb20-b961-468e-b22f-878973aa0a3c", "name": "network-vif-deleted", "tag": "1bea0cd3-0c4b-4439-8f4a-039f92cadb58"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:41.488403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5f733fb1-daba-49c2-bc11-87dc4ae41282 req-69f2a0d0-26bc-419a-87a6-328417fc1f3b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:41.488932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5f733fb1-daba-49c2-bc11-87dc4ae41282 req-69f2a0d0-26bc-419a-87a6-328417fc1f3b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:41.496405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5f733fb1-daba-49c2-bc11-87dc4ae41282 req-69f2a0d0-26bc-419a-87a6-328417fc1f3b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:41.527297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5f733fb1-daba-49c2-bc11-87dc4ae41282 req-69f2a0d0-26bc-419a-87a6-328417fc1f3b service nova] Creating event network-vif-deleted:1bea0cd3-0c4b-4439-8f4a-039f92cadb58 for instance 0521eb20-b961-468e-b22f-878973aa0a3c on n-h1-854925-5 Aug 30 04:35:41.549452 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5f733fb1-daba-49c2-bc11-87dc4ae41282 req-69f2a0d0-26bc-419a-87a6-328417fc1f3b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118968 Aug 30 04:35:41.550100 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2586/5062] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:42.364142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:42.364791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] [instance: 0521eb20-b961-468e-b22f-878973aa0a3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:42.368931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:42.393066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.401566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.405875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.407688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:42.408660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:42.409120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:42.479054 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] HTTP exception thrown: Instance 0521eb20-b961-468e-b22f-878973aa0a3c could not be found. Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Request method failure captured: Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c HTTP/1.1 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOF9tLoQUfk9dF1G6uCds1NnDsuWgfBWlLVSZuKk9zaNECfxdHiDqrTL43ppbPSwUyNKqgiZ1oCntGfjc4Y9z8me6VBJn6che3Q6AKJAxYx4bDgLQaGNOHkELtbIHJqrPs34YsPuZbP4kjQpJmA3BnuEwWoCFCgGPCW9m99iTO7jSw Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: fae781dd2b4445af931c5016e285b5fa Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_fae781dd2b4445af931c5016e285b5fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/fae781dd2b4445af931c5016e285b5fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fae781dd2b4445af931c5016e285b5fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/fae781dd2b4445af931c5016e285b5fa"}]}] Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: fae781dd2b4445af931c5016e285b5fa Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-809905908 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-InstanceActionsNegativeTestJSON-809905908-project Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 16a6ac7ebc5145b4941b2f2e91d47628 Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-809905908-project Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0521eb20-b961-468e-b22f-878973aa0a3c could not be found. Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0521eb20-b961-468e-b22f-878973aa0a3c'} Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0521eb20-b961-468e-b22f-878973aa0a3c could not be found. Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0521eb20-b961-468e-b22f-878973aa0a3c could not be found. Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:42.490792 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0521eb20-b961-468e-b22f-878973aa0a3c could not be found. Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:35:42.494364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] Returning 404 to user: Instance 0521eb20-b961-468e-b22f-878973aa0a3c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:35:42.497354 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44329f0e-91b7-46a9-9cdb-b0c422ddf15f tempest-InstanceActionsNegativeTestJSON-809905908 tempest-InstanceActionsNegativeTestJSON-809905908-project] 10.222.0.27 "GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c" status: 404 len: 111 microversion: 2.1 time: 0.136252 Aug 30 04:35:42.499470 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2477/5063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:42 2022] GET /compute/v2.1/servers/0521eb20-b961-468e-b22f-878973aa0a3c => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:35:46.009184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.010545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:46.021675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.023209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.023897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.025120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.025837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.026577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.212113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lazy-loading 'services' on Instance uuid 4c2347a7-538e-475e-9f4a-d33938f016c0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:35:46.405283 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29ced017-ffed-4dae-ba48-4bdadd694f1c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments/b23c68b6-28ab-49f8-b613-57bf6664e0be" status: 202 len: 0 microversion: 2.1 time: 0.396559 Aug 30 04:35:46.406477 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2587/5064] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:35:46 2022] DELETE /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments/b23c68b6-28ab-49f8-b613-57bf6664e0be => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:35:46.421295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:46.423459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:46.457569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.458390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.458834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.459685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:46.460146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:46.460622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:46.533508 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-575db75a-0260-4d98-9176-c537631641fb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122154 Aug 30 04:35:46.538622 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2478/5065] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:46 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:47.548400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:47.553126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:47.573456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.575120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.578012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.578976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:47.579813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:47.582511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:47.678203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a4ea5607-88e6-4962-84be-f836cda65387 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134453 Aug 30 04:35:47.685760 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2588/5066] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:47 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:48.692837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:48.695276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:48.723187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.723718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.732541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.733675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:48.735615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:48.736374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:48.865909 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c5c7cc9-f98a-4b8b-be9f-d810e8264d89 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177469 Aug 30 04:35:48.867082 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2479/5067] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:48 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:49.887182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:49.891418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:49.909228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.912245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.914420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:49.916530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:49.920524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:49.921664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:50.029158 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1e4fd1d3-799d-4b8c-b129-491435a012ca tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154262 Aug 30 04:35:50.034435 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2589/5068] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:49 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:51.045357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:51.049606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:51.074837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.077133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.078675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.082024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:51.082822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:51.088499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:51.197824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ef7e6eb-c103-4098-8c12-96f81d697299 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158978 Aug 30 04:35:51.217420 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2480/5069] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:51 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:52.215522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:52.218226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:52.246747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.250255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.254518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.255532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:52.256191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:52.256823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:52.347046 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f8b5572-a364-4c11-8d9a-8940f337de2c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136312 Aug 30 04:35:52.355873 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2590/5070] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:52 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:53.365269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:53.367773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:53.406089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.407167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.410099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.411512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:53.413840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:53.414925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:53.536752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-00aa91ea-8f42-4c70-a47e-1bc5ca6e5ab5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177565 Aug 30 04:35:53.539272 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2481/5071] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:53 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:54.551542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:54.556825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:54.588469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.588871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.593894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.595417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:54.597030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:54.599700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:54.638963 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-450e8fef-15d7-40bf-ae6c-9b683571da69 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092054 Aug 30 04:35:54.644717 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2591/5072] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:54 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:55.663403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:55.667329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:55.688269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:55.688757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.689631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:55.691467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.693677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.695305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.695791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.696235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.709491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.710225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.710817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.711980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:55.718624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:55.721214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:55.788817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:55.885571 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3a4144b4-8f07-413a-82ae-6fc120bccd4b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233225 Aug 30 04:35:55.890718 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2482/5073] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:55 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:56.174953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:56.192001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6f51aa03-fb0e-444f-86a7-1a430868575e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.512495 Aug 30 04:35:56.205352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2592/5074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:55 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:56.221689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:56.222326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:56.239617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.242298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.244006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.248838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.252801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.255557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.779095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:56.789971 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-52f89f5f-ea5e-41e5-8328-dcb4b6a34598 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.573369 Aug 30 04:35:56.804095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2483/5075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:56 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:56.825251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:56.826645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:56.851630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.853304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.857251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.858293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.858954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.861776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.900643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:56.903442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:56.926342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.927170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.929404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:56.930360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:56.931299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:56.934062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.029870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:DELETE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:35:57.038401 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cfce4f41-7bb0-4ee0-9424-6e3b32d194b5 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136818 Aug 30 04:35:57.044765 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2484/5076] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:56 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:57.471660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:57.485217 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b29096ab-dc3d-4623-8770-e753cd2c5b5c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.664313 Aug 30 04:35:57.495810 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2593/5077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:56 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:35:57.517803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:57.518566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:57.528805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.530879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.532044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.540243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:57.541032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:57.542088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:57.575854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f99824c8-91d8-4ee0-aef7-de797f75d416 tempest-ExtensionsTest-282096174 tempest-ExtensionsTest-282096174-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:57.577998 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f99824c8-91d8-4ee0-aef7-de797f75d416 tempest-ExtensionsTest-282096174 tempest-ExtensionsTest-282096174-project] 10.222.0.27 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.346313 Aug 30 04:35:57.579076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2485/5078] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 04:35:57 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:35:57.600107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1fbfe383-0f8c-405e-b946-fa9783217dcc tempest-ExtensionsTest-282096174 tempest-ExtensionsTest-282096174-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:57.611745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1fbfe383-0f8c-405e-b946-fa9783217dcc tempest-ExtensionsTest-282096174 tempest-ExtensionsTest-282096174-project] 10.222.0.27 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.025170 Aug 30 04:35:57.615636 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2486/5079] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 30 04:35:57 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:35:58.070083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:58.079558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:58.105024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.106775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.110352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.111600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.112318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.113113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.203707 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b96f5132-09de-4cd1-a30a-f19ad14a8402 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.155418 Aug 30 04:35:58.204922 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2487/5080] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:35:58 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0/os-volume_attachments => generated 25 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:35:58.383306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:58.385157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:58.420011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.425522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.430978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.434055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.436022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.441471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.531408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:58.548975 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef13b792-da8c-434e-958c-1d1aa716a30d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 1.033159 Aug 30 04:35:58.550396 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2594/5081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:57 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:35:58.553072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:35:58.778265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c0ffdfc-b3f0-410d-80c3-feb36ea96e39 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 204 len: 0 microversion: 2.1 time: 0.396875 Aug 30 04:35:58.781263 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2488/5082] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:35:58 2022] DELETE /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:35:58.788391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:35:58.789015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:35:58.798963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.799464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.799903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.814234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:35:58.814833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:35:58.815296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:35:58.818949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1134008069", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "9e030e97-f3bc-405c-9a73-9eb51ff4d48e"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:35:58.959755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] validate_networks() for [('9e030e97-f3bc-405c-9a73-9eb51ff4d48e', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:35:59.454944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:35:59.468508 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8c4a5017-0d0f-40e4-bd91-e7edbdd78135 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1680 microversion: 2.1 time: 0.683899 Aug 30 04:35:59.490279 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2595/5083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:35:58 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1680 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:00.043563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:00.044067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:00.044517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:00.044934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:00.045376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:00.067435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.077696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.084559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.085510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.086166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.087111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.161773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:00.175047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for user d4d759ef2dc64a5e8ef6e883efc13d68 and project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:00.224925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:00.231402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:00.395375 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e74456c3-9b9c-4ca9-99da-efdbbd85bf13 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582001 Aug 30 04:36:00.403283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2489/5084] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:36:00.414655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e08ebdef-efd7-462c-9149-e7e92b88ba4f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:00.415969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e08ebdef-efd7-462c-9149-e7e92b88ba4f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:00.507948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:00.508999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:00.536193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.539979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.542189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.552913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:00.555910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:00.558863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:00.804646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e08ebdef-efd7-462c-9149-e7e92b88ba4f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:00.824158 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e08ebdef-efd7-462c-9149-e7e92b88ba4f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1215 microversion: 2.1 time: 0.415897 Aug 30 04:36:00.833152 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2596/5085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:00 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1215 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:01.239059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:01.255785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aebb1c4e-7a59-43bc-9491-3d6be93a0705 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1680 microversion: 2.1 time: 0.754178 Aug 30 04:36:01.257529 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2490/5086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:00 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1680 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:01.851805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:01.852438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:01.874700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:01.882396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.882938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.883328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:01.912519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:01.918086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:01.921917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:02.289196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:02.289855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:02.317057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:02.318467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:02.320359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:02.322969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:02.323629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:02.364565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:02.375757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:02.387507 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b74c5edd-385b-40fb-9ef6-a55d94f8a15c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1211 microversion: 2.1 time: 0.539572 Aug 30 04:36:02.389598 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2597/5087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:01 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1211 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:03.429438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:03.442299 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f09a1e18-09fe-4f16-ad0c-6b58e18a425c tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1680 microversion: 2.1 time: 1.163669 Aug 30 04:36:03.442933 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2491/5088] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:02 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1680 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:03.467635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:03.468261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:03.500863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:03.501417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:03.501897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:03.502632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:03.503091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:03.503519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:03.924917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:03.937395 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf2a9440-c810-4f2f-9bfb-66527b04aa14 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1273 microversion: 2.1 time: 0.489316 Aug 30 04:36:03.939376 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2492/5089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:03 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1273 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:04.227489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1776151060", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "a0a4d258-2d11-4ff7-b044-1fe1ab70ff46"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:04.387522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:36:04.468019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:04.468640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:04.487394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:04.495289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:04.495979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:04.496908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:04.498916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:04.503771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:05.458882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:05.478170 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-52b76882-cdde-4172-b4a2-0341bba43634 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1613 microversion: 2.1 time: 1.014832 Aug 30 04:36:05.479274 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2493/5090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:04 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1613 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:05.484318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:05.490202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:05.508520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:05.509166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:05.509728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:05.510570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:05.511130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:05.511757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:05.787039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:05.795943 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-860e4544-3184-4d6f-afc3-dcd772dc7fad tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1273 microversion: 2.1 time: 0.315470 Aug 30 04:36:05.796550 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2494/5091] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:05 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1273 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:06.509923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:06.514785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:06.535831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.536877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.540072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.541075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.541865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.542542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.658327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.660344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.660997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.662701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lazy-loading 'fault' on Instance uuid 4c2347a7-538e-475e-9f4a-d33938f016c0 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:36:06.670611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:06.675125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:06.683775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:06.686647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:06.690381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:06.770035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.770287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.772402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.774075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:06.778022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:06.778815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:06.810841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:06.824362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:06.849242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:06.854062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:06.974546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a5b3212f964ba3b0039e84f933c317', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c9f9ed40704753b7f7e70d5d53b7b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:06.983257 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-001a3cd3-de40-44a8-a22e-d0f757515e5b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 200 len: 1331 microversion: 2.1 time: 0.484642 Aug 30 04:36:06.983860 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2495/5092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:06 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 1331 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:07.006059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-960f3a59-0fb2-4e96-afaf-d40f3fc73dc7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.001546 Aug 30 04:36:07.007676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2598/5093] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:36:07.012118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7e41ff0a-8e08-4374-a072-4e0b71491a3e req-00e2edd9-4679-40ca-aef3-80b046c36288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c2347a7-538e-475e-9f4a-d33938f016c0", "name": "network-vif-deleted", "tag": "67d49d92-cbc5-4916-847e-c4ee1a29e22c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:07.018451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:07.019597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:07.057977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e41ff0a-8e08-4374-a072-4e0b71491a3e req-00e2edd9-4679-40ca-aef3-80b046c36288 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:07.060503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e41ff0a-8e08-4374-a072-4e0b71491a3e req-00e2edd9-4679-40ca-aef3-80b046c36288 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:07.061151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e41ff0a-8e08-4374-a072-4e0b71491a3e req-00e2edd9-4679-40ca-aef3-80b046c36288 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:07.069272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:07.070111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:07.070673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:07.071517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:07.072035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:07.072485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:07.123656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7e41ff0a-8e08-4374-a072-4e0b71491a3e req-00e2edd9-4679-40ca-aef3-80b046c36288 service nova] Creating event network-vif-deleted:67d49d92-cbc5-4916-847e-c4ee1a29e22c for instance 4c2347a7-538e-475e-9f4a-d33938f016c0 on n-h1-854925-5 Aug 30 04:36:07.144284 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7e41ff0a-8e08-4374-a072-4e0b71491a3e req-00e2edd9-4679-40ca-aef3-80b046c36288 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149729 Aug 30 04:36:07.160583 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2496/5094] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:07.197678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b070a7fe-b82e-4cde-9607-41dd5d7b4830 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:07.198489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b070a7fe-b82e-4cde-9607-41dd5d7b4830 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:07.523824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b070a7fe-b82e-4cde-9607-41dd5d7b4830 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:07.540141 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b070a7fe-b82e-4cde-9607-41dd5d7b4830 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1193 microversion: 2.1 time: 0.373164 Aug 30 04:36:07.542399 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2497/5095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:07 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1193 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:07.756583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:07.766529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79776cb7-fa7d-4082-b1d3-be3968a88fc5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 0.757364 Aug 30 04:36:07.772876 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2599/5096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:07 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:08.012318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:08.013774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:08.026967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.030697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.031408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.033593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.034331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.035733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.070898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 HTTP/1.1 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '4c2347a7-538e-475e-9f4a-d33938f016c0'} Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:08.075595 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:08.080565 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:08.080565 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:08.080565 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:08.080565 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:08.080565 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:08.080565 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:08.080565 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:08.082683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:08.085058 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df7a30c4-5320-465e-8eac-5b6b2aad1b1b tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 404 len: 111 microversion: 2.1 time: 0.078843 Aug 30 04:36:08.088086 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2498/5097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:08 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:08.097569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8416185a-688c-4136-828b-fdb42a031a2f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '.version_select at 0x7fe969cf71f0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:08.149755 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8416185a-688c-4136-828b-fdb42a031a2f tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-444627477" status: 202 len: 0 microversion: 2.1 time: 0.056675 Aug 30 04:36:08.150895 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2600/5098] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-444627477 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:36:08.561912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:08.563005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:08.583191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.583919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.585274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.586212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.587112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.587932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.795845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:08.796468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:08.805464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.812787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.813526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:08.814602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:08.815272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:08.815711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:09.092595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:09.106785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-def0d189-6a6c-4315-995e-cc550e15cd6b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1189 microversion: 2.1 time: 0.545382 Aug 30 04:36:09.108305 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2499/5099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:08 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1189 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:09.290877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-85e21dc3-a3d9-4a9d-a644-0eaf77b591df req-5c6aa564-4b9a-46ef-8a8f-4a182bead4b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1e26d1-2939-40cc-9d11-cb83e40ce3e0", "tag": "be5d78ec-8943-40a7-952a-27f27bb5e0cf"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:09.315156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-85e21dc3-a3d9-4a9d-a644-0eaf77b591df req-5c6aa564-4b9a-46ef-8a8f-4a182bead4b0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:09.315985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-85e21dc3-a3d9-4a9d-a644-0eaf77b591df req-5c6aa564-4b9a-46ef-8a8f-4a182bead4b0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:09.319203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-85e21dc3-a3d9-4a9d-a644-0eaf77b591df req-5c6aa564-4b9a-46ef-8a8f-4a182bead4b0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:09.363111 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-85e21dc3-a3d9-4a9d-a644-0eaf77b591df req-5c6aa564-4b9a-46ef-8a8f-4a182bead4b0 service nova] Creating event network-changed:be5d78ec-8943-40a7-952a-27f27bb5e0cf for instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 on n-h2-854925-5 Aug 30 04:36:09.397182 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-85e21dc3-a3d9-4a9d-a644-0eaf77b591df req-5c6aa564-4b9a-46ef-8a8f-4a182bead4b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109197 Aug 30 04:36:09.399889 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2500/5100] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:09.725442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:09.735707 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e3d81db3-eb0c-4756-9349-eeb2691cf5f1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 0.944830 Aug 30 04:36:09.759375 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2601/5101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:08 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:10.146290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:10.147095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:10.150263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:10.159166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.159997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.160784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.162158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.162875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.163517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.391112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:10.405561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c8e4d7bf-6e07-4a2c-8d81-8067eb9a2eaf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1251 microversion: 2.1 time: 0.271093 Aug 30 04:36:10.407868 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2501/5102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:10 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1251 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:10.767973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:10.768676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:10.788596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.789110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.789595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:10.790335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:10.790787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:10.792876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.430362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:11.431093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:11.448260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:11.448955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:11.449573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.450484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:11.450959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:11.451403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:11.747696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:11.760022 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1dc28b8c-62a4-4115-be79-72eb324c6d5b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1251 microversion: 2.1 time: 0.334439 Aug 30 04:36:11.760976 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2502/5103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:11 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1251 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:11.781118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:11.829467 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41e0e21d-6920-4338-9413-d913d770a963 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 1.056722 Aug 30 04:36:11.830502 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2602/5104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:10 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:12.784495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:12.792364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:12.840646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:12.845237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:12.846446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:12.851353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:12.852313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:12.853448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:12.859362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:12.860006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:12.900712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:12.904493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:12.905004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:12.905811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:12.907422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:12.908130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:13.515639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:13.532692 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7dcb35b2-c71e-4e28-b212-945f394fe0e2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1251 microversion: 2.1 time: 0.750124 Aug 30 04:36:13.534855 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2503/5105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:12 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1251 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:14.075149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:14.087032 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-61b25cb3-e09f-4b07-9025-779297a4f274 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 1.234478 Aug 30 04:36:14.107621 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2603/5106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:12 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:14.559219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:14.559847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:14.571301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:14.575798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:14.577899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:14.578905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:14.581947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:14.585095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:14.759447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:14.776472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-150609da-6284-41a8-b4a7-cacb0a4033bf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1251 microversion: 2.1 time: 0.219903 Aug 30 04:36:14.778821 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2504/5107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:14 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1251 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:15.115531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:15.116463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:15.153207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.154330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.157023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.158102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.168570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.171100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.508458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:15.519372 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7dade87-8329-44ba-a8da-363579a26797 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 0.410252 Aug 30 04:36:15.528953 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2604/5108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:15 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:15.803084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:15.804307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:15.815927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.820663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.822182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.823129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:15.827340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:15.827989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:15.843545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:16.484983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:16.498477 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-13c18821-2d75-4266-931f-d21351327ab9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 0.699547 Aug 30 04:36:16.504469 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2505/5109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:15 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:16.553017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:16.553710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:16.561706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.562166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.579984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:16.580832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:16.581318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:16.581773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:16.796240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:16.843022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:16.969522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:16.978006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-89a10623-79ba-43b9-9167-eea1c790bfb3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 0.429217 Aug 30 04:36:16.982355 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2605/5110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:16 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:17.523880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:17.524611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:17.535165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:17.540946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:17.542733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:17.543850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:17.544596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:17.545622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:17.546939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:17.547759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:17.793149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:17.804564 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d8acfa9-e1cb-4674-8f21-b376e2275d20 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 0.285086 Aug 30 04:36:17.809067 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2506/5111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:17 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:18.006652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:18.007838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:18.023067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.023902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.024647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.025978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.028342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.028996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.265470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:18.275246 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6eb20f31-d20c-42e5-be8c-6d4d0c39ec69 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 0.272540 Aug 30 04:36:18.278704 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2606/5112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:18 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:18.765000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-196d9fcb-eb1c-474e-a375-b3def8d2ae27 req-e9087078-4274-439c-b94a-2d5e3e7daf73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1e26d1-2939-40cc-9d11-cb83e40ce3e0", "name": "network-vif-plugged", "status": "completed", "tag": "be5d78ec-8943-40a7-952a-27f27bb5e0cf"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:18.792191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-196d9fcb-eb1c-474e-a375-b3def8d2ae27 req-e9087078-4274-439c-b94a-2d5e3e7daf73 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.793779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-196d9fcb-eb1c-474e-a375-b3def8d2ae27 req-e9087078-4274-439c-b94a-2d5e3e7daf73 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.795625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-196d9fcb-eb1c-474e-a375-b3def8d2ae27 req-e9087078-4274-439c-b94a-2d5e3e7daf73 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.832672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:18.833485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:18.853988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-196d9fcb-eb1c-474e-a375-b3def8d2ae27 req-e9087078-4274-439c-b94a-2d5e3e7daf73 service nova] Creating event network-vif-plugged:be5d78ec-8943-40a7-952a-27f27bb5e0cf for instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 on n-h2-854925-5 Aug 30 04:36:18.854768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.858066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.860028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.862236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:18.865733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:18.867471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:18.878658 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-196d9fcb-eb1c-474e-a375-b3def8d2ae27 req-e9087078-4274-439c-b94a-2d5e3e7daf73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117702 Aug 30 04:36:18.893980 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2507/5113] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:19.297179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:19.297959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:19.311210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:19.311991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:19.317225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:19.318427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:19.320875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:19.321533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:19.674110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:19.690792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be5bdcf1-e3cb-4445-adef-8cccea2c3267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 0.863835 Aug 30 04:36:19.694089 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2607/5114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:18 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:20.064798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-80726b6c-431f-44d2-a4d0-ca5a3c609720 req-53fce93c-f195-446d-813f-e0ee3b28f946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1499755-e615-4a00-912c-e088f93da875", "tag": "4efbce0d-f1b9-4644-a1ad-ea1bae9cded0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:20.083860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:20.096166 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d22cdfb-02d5-4550-8f5d-e43ebfc859da tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 0.803638 Aug 30 04:36:20.096932 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2508/5115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:19 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:20.110432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-80726b6c-431f-44d2-a4d0-ca5a3c609720 req-53fce93c-f195-446d-813f-e0ee3b28f946 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:20.110432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-80726b6c-431f-44d2-a4d0-ca5a3c609720 req-53fce93c-f195-446d-813f-e0ee3b28f946 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:20.110432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-80726b6c-431f-44d2-a4d0-ca5a3c609720 req-53fce93c-f195-446d-813f-e0ee3b28f946 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.128577 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-80726b6c-431f-44d2-a4d0-ca5a3c609720 req-53fce93c-f195-446d-813f-e0ee3b28f946 service nova] Creating event network-changed:4efbce0d-f1b9-4644-a1ad-ea1bae9cded0 for instance e1499755-e615-4a00-912c-e088f93da875 on n-h1-854925-5 Aug 30 04:36:20.141532 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-80726b6c-431f-44d2-a4d0-ca5a3c609720 req-53fce93c-f195-446d-813f-e0ee3b28f946 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080253 Aug 30 04:36:20.142564 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2608/5116] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:20.717244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:20.718079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:20.730790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:20.734870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:20.737153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.739589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:20.741558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:20.744664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.853885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:20.855709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:20.869299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:20.873557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:20.874492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.875473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:20.876794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:20.879511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:20.916045 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 HTTP/1.1 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '4c2347a7-538e-475e-9f4a-d33938f016c0'} Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:20.937175 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:20.940826 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:20.949197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:20.950543 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-243f37f9-a116-4135-abbf-a1f1c29bec86 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 404 len: 111 microversion: 2.1 time: 0.101913 Aug 30 04:36:20.951149 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2609/5117] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:36:20 2022] DELETE /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:36:20.998442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:20.999327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: 4c2347a7-538e-475e-9f4a-d33938f016c0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:21.006036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.010067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.030146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.030931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.031420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.031867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.067104 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 HTTP/1.1 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '4c2347a7-538e-475e-9f4a-d33938f016c0'} Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:21.070354 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:21.075139 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:21.075139 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:21.075139 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:21.075139 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:21.075139 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:21.075139 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. Aug 30 04:36:21.075139 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:21.076864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance 4c2347a7-538e-475e-9f4a-d33938f016c0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:21.083578 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1333b393-76a4-46ef-9f9c-454619206bd7 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0" status: 404 len: 111 microversion: 2.1 time: 0.118114 Aug 30 04:36:21.084648 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2610/5118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:20 2022] GET /compute/v2.1/servers/4c2347a7-538e-475e-9f4a-d33938f016c0 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:21.118064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:21.118960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:21.132258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.132948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.133848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.139013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:21.141064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:21.141744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:21.646924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:21.658551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5152f55a-6cfa-4f44-8585-282a6a60c97a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 0.943514 Aug 30 04:36:21.662969 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2509/5119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:20 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:22.243791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:22.254498 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbd00405-0c70-4bf1-aa95-6ae528974b4a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1315 microversion: 2.1 time: 1.140702 Aug 30 04:36:22.255202 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2611/5120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:21 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1315 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:22.680761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:22.682512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:22.706108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:22.707390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:22.713003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:22.722184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:22.727183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:22.728172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:23.279465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:23.280246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:23.326389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:23.329473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:23.330611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:23.332767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:23.336595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:23.338719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:24.086395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:24.111216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e60d33a8-4707-4b16-92c9-b58cbb8c4f10 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1502 microversion: 2.1 time: 0.838235 Aug 30 04:36:24.119099 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2612/5121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:23 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1502 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:24.146601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:24.147952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:24.163062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:24.163935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:24.168344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:24.169873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:24.171474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:24.172093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:24.242790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:24.262085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:24.271075 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7ca92c4-4c0f-46af-9d20-ec7d606a7c33 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 1.595152 Aug 30 04:36:24.278229 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2510/5122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:22 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:24.620986 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Removing security group 5d5a360f-de30-4dc9-a122-b61929a18236 from port be5d78ec-8943-40a7-952a-27f27bb5e0cf Aug 30 04:36:25.304440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:25.306061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:25.320868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:25.322377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:25.326774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:25.329158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:25.331411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:25.332227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.378307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:26.395849 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f309589d-e46c-4a0d-b1be-7b5011f60df0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 1.107389 Aug 30 04:36:26.415703 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2511/5123] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:25 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:26.602491 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a42ddb4-9968-4990-95a3-7328cab7d978 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0/action" status: 202 len: 0 microversion: 2.1 time: 2.462886 Aug 30 04:36:26.604397 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2613/5124] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:36:24 2022] POST /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0/action => generated 0 bytes in 2466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:36:26.614972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:26.620295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:26.641141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.644113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.645219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.646297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.651715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.652755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.766543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-96611078-96b7-47a6-9229-db8687a889a1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'create', calling method: .version_select at 0x7fe96a2598b0>, body: {"keypair": {"name": "tempest-keypair-1125665654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3WCcihzhKaV7JMaLXMYJgceA53M5/ieatLgB3xGX4hdL0t8O79NFyLIJteknefIOD+gx6RUC5WRW25sr0ysOjySashm2i2/rG3Z8fvSyQmwwdP9ZhKhltbxZSbDhOrFQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:26.805122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-96611078-96b7-47a6-9229-db8687a889a1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for project 855330321e2d47029d650db5ea542865. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:26.827342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-96611078-96b7-47a6-9229-db8687a889a1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for user 90dd2d52d02f4777add5570b1c7bc175 and project 855330321e2d47029d650db5ea542865. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:26.854040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:26.866222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f95a877-5867-47a3-b84d-54a5dcadc095 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1460 microversion: 2.1 time: 0.254859 Aug 30 04:36:26.869433 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2614/5125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:26 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1460 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:26.880233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4a7fad01-19a9-4521-b1f1-38fd145f6db7 req-5af91f8d-de06-4753-8855-9d9a8408cb24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1e26d1-2939-40cc-9d11-cb83e40ce3e0", "tag": "be5d78ec-8943-40a7-952a-27f27bb5e0cf"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:26.892014 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-96611078-96b7-47a6-9229-db8687a889a1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.474852 Aug 30 04:36:26.896785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4a7fad01-19a9-4521-b1f1-38fd145f6db7 req-5af91f8d-de06-4753-8855-9d9a8408cb24 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.897400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4a7fad01-19a9-4521-b1f1-38fd145f6db7 req-5af91f8d-de06-4753-8855-9d9a8408cb24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.898159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4a7fad01-19a9-4521-b1f1-38fd145f6db7 req-5af91f8d-de06-4753-8855-9d9a8408cb24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.902642 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2512/5126] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:36:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:26.914364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:26.921137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:26.941119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.941666 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4a7fad01-19a9-4521-b1f1-38fd145f6db7 req-5af91f8d-de06-4753-8855-9d9a8408cb24 service nova] Creating event network-changed:be5d78ec-8943-40a7-952a-27f27bb5e0cf for instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 on n-h2-854925-5 Aug 30 04:36:26.943124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.943815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.949304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:26.950243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:26.951019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:26.951408 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4a7fad01-19a9-4521-b1f1-38fd145f6db7 req-5af91f8d-de06-4753-8855-9d9a8408cb24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078984 Aug 30 04:36:26.953452 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2615/5127] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:27.422576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:27.424507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:27.438270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:27.449720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.450241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.450696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:27.452687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee9cd82e-75ec-4be7-a66b-d5563ef4d555 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.548533 Aug 30 04:36:27.456434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.456887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.457413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:27.458445 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2513/5128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:26 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:27.497731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:27.503518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:27.532063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.535993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.536702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:27.541504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:27.542568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:27.543717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.242057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:28.257250 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adcc4049-0da3-4ef4-aaa6-924caacd76f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.774633 Aug 30 04:36:28.261827 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2514/5129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:27 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:28.275448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:28.286864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:28.288412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:28.294064 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9b8526d-c368-4510-bbae-9df51113d32e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 0.877439 Aug 30 04:36:28.297806 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2616/5130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:27 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:28.310793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.312514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.315710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.318712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.325536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.327177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.883748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:28.909291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ec1cc9d-a9ec-4ffe-b26d-81c2e3190686 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.612499 Aug 30 04:36:28.914102 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2515/5131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:28 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:28.938037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:28.938657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:28.960634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.961522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.962581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:28.963906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:28.965296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:28.972690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.319993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:29.321025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:29.334788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:29.335639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:29.339444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:29.343639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.344674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:29.345407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:29.345519 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-412ee693-bb94-4338-aaa9-cc70faa3479f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.412392 Aug 30 04:36:29.346051 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2617/5132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:28 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:29.346430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:29.623679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-495442569", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "9e030e97-f3bc-405c-9a73-9eb51ff4d48e"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:29.700329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] validate_networks() for [('9e030e97-f3bc-405c-9a73-9eb51ff4d48e', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:36:30.163935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:30.181601 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-780a7852-c77b-451c-83c9-6de257cf01b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 0.865512 Aug 30 04:36:30.184153 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2516/5133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:29 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:31.205167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:31.205855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:31.223704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:31.229106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:31.236587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:31.237680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:31.246610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:31.247332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.198132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:32.199808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:32.200500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:32.201099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:32.201902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:32.204816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:32.225468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.226369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.226974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.227856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.228459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.229037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.276710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:32.295365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Getting quotas for user d4d759ef2dc64a5e8ef6e883efc13d68 and project 20b289bb6f0f45ba9e7137ee45fa2d6b. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:32.331988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:32.334703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:32.340828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:32.362471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2bed72ac-ab97-477e-83fd-087a4e39fcad tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 1.161304 Aug 30 04:36:32.366861 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2517/5134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:31 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:32.379031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c0d6b520-7c05-49ee-a30f-8a99d6850354 req-2e0905aa-4fd4-48ac-8cdb-fa45dffdd9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1499755-e615-4a00-912c-e088f93da875", "name": "network-vif-plugged", "status": "completed", "tag": "4efbce0d-f1b9-4644-a1ad-ea1bae9cded0"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:32.414247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c0d6b520-7c05-49ee-a30f-8a99d6850354 req-2e0905aa-4fd4-48ac-8cdb-fa45dffdd9d0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.414971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c0d6b520-7c05-49ee-a30f-8a99d6850354 req-2e0905aa-4fd4-48ac-8cdb-fa45dffdd9d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.415707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c0d6b520-7c05-49ee-a30f-8a99d6850354 req-2e0905aa-4fd4-48ac-8cdb-fa45dffdd9d0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.444217 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c0d6b520-7c05-49ee-a30f-8a99d6850354 req-2e0905aa-4fd4-48ac-8cdb-fa45dffdd9d0 service nova] Creating event network-vif-plugged:4efbce0d-f1b9-4644-a1ad-ea1bae9cded0 for instance e1499755-e615-4a00-912c-e088f93da875 on n-h1-854925-5 Aug 30 04:36:32.460620 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c0d6b520-7c05-49ee-a30f-8a99d6850354 req-2e0905aa-4fd4-48ac-8cdb-fa45dffdd9d0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087315 Aug 30 04:36:32.465023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1908f193-87e3-4523-bc03-9f7744e494b0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.847048 Aug 30 04:36:32.473861 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2618/5135] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:36:32.479829 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2518/5136] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:32.487262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-649145209", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbd3160-1732-4dba-93a5-81342c620573"}], "security_groups": [{"name": "tempest-securitygroup--916486885"}], "key_name": "tempest-keypair-1125665654", "user_data": "}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:32.493281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d749f802-d85b-4676-bd57-dce41d438132 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:32.494019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d749f802-d85b-4676-bd57-dce41d438132 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:32.644609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d749f802-d85b-4676-bd57-dce41d438132 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:32.652571 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d749f802-d85b-4676-bd57-dce41d438132 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1214 microversion: 2.1 time: 0.170330 Aug 30 04:36:32.653179 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2519/5137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:32 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:32.669360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:32.669898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:32.692261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.692754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.693196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.693930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.694384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.694813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.751309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 HTTP/1.1 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c629df0c-85ca-4656-962c-6c2a89e54371'} Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:32.753044 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.757046 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.764683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:32.766094 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-851087b3-bc15-47ec-a361-367b7dd3ebb8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 404 len: 111 microversion: 2.1 time: 0.107072 Aug 30 04:36:32.769138 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2520/5138] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:36:32 2022] DELETE /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:32.791082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:32.791719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: c629df0c-85ca-4656-962c-6c2a89e54371] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:32.827771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] validate_networks() for [('1fbd3160-1732-4dba-93a5-81342c620573', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:36:32.832824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.833763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.834934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.835683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.836153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.836588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.876500 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 HTTP/1.1 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c629df0c-85ca-4656-962c-6c2a89e54371'} Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:32.878111 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance c629df0c-85ca-4656-962c-6c2a89e54371 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:32.882367 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0db6cc9c-a4f0-46e4-994f-003d7ee34ad8 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371" status: 404 len: 111 microversion: 2.1 time: 0.105067 Aug 30 04:36:32.899451 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2521/5139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:32 2022] GET /compute/v2.1/servers/c629df0c-85ca-4656-962c-6c2a89e54371 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:32.920684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:32.921204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:32.938732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.941078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.943910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.949957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:32.950929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:32.951563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:32.978437 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc HTTP/1.1 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'cdd3bde7-3a79-454c-ab18-3aa36a5293dc'} Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:32.991430 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:32.995675 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8bfa9f61-59f2-423a-bc73-3dbd9eb96872 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 404 len: 111 microversion: 2.1 time: 0.091155 Aug 30 04:36:33.000270 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2522/5140] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:36:32 2022] DELETE /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:33.008980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:33.023342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: cdd3bde7-3a79-454c-ab18-3aa36a5293dc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:33.046059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.046562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:33.049174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:33.050040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.050535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:33.054729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:33.107540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc HTTP/1.1 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'cdd3bde7-3a79-454c-ab18-3aa36a5293dc'} Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:33.109874 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:33.113401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance cdd3bde7-3a79-454c-ab18-3aa36a5293dc could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:33.114194 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af40e235-b4b2-481e-a5b9-15bf608422bb tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc" status: 404 len: 111 microversion: 2.1 time: 0.112861 Aug 30 04:36:33.130997 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2523/5141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:33 2022] GET /compute/v2.1/servers/cdd3bde7-3a79-454c-ab18-3aa36a5293dc => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:33.392184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:33.392818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:33.401312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.402348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:33.403037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:33.404150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.404964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:33.405632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:33.959762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:33.961878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:33.962721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:33.963149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:33.963976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:33.997691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:33.998209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:34.001301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:34.002579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:34.003069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:34.004848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:34.092167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for project 855330321e2d47029d650db5ea542865. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:34.115922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for user 90dd2d52d02f4777add5570b1c7bc175 and project 855330321e2d47029d650db5ea542865. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:34.151171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:34.158652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:34.177535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:34.195404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e54700b-62fa-4eda-a473-0a0d35bfa527 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1293 microversion: 2.1 time: 0.807226 Aug 30 04:36:34.197936 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2524/5142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:33 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1293 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:34.209238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:34.230485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:34.263010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:34.264452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:34.270820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:34.275837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:34.277976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:34.280711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:34.363504 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-70788e07-6a69-480e-8cb7-b6c210021389 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.887832 Aug 30 04:36:34.369968 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2619/5143] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 1895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:36:34.404926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0bc1bc0-0227-46b4-881e-51f2bb7cefb0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:34.407394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f0bc1bc0-0227-46b4-881e-51f2bb7cefb0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:34.687510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:34.699336 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23b28e7b-2e1f-46fb-b1e4-2a2eef022a2f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1210 microversion: 2.1 time: 0.493933 Aug 30 04:36:34.704766 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2525/5144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:34 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1210 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:34.805229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f0bc1bc0-0227-46b4-881e-51f2bb7cefb0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:34.822197 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f0bc1bc0-0227-46b4-881e-51f2bb7cefb0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1237 microversion: 2.1 time: 0.445037 Aug 30 04:36:34.827944 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2620/5145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:34 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1237 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:35.224510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:35.225141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:35.236808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.240145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.241868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:35.245794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.247296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.248296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:35.739361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:35.739361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:35.756269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.759957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.763362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:35.765483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:35.767664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:35.771334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:36.262956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:36.277516 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a28b94c-72d5-4824-8dce-a2a8e5e75822 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1266 microversion: 2.1 time: 0.550069 Aug 30 04:36:36.285056 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2621/5146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:35 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1266 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:36.303898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:36.310072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:36.329557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:36.330062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:36.330511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:36.331242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:36.331707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:36.333741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:36.458577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:36.495161 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73bc3cb4-332c-4adb-867a-2f473901e615 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1473 microversion: 2.1 time: 1.275254 Aug 30 04:36:36.526178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2526/5147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:35 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1473 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:36.590141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:36.619684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00f06b3d-26cc-4272-9d8e-a5864109bb72 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1289 microversion: 2.1 time: 0.330865 Aug 30 04:36:36.631168 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2622/5148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:36 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1289 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:36.856725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-597912826", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:37.008110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:36:37.303781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:37.305589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:37.317069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:37.322448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:37.327311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:37.328136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:37.328620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:37.329062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:37.570290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:37.611039 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e9d5bd2e-18cb-4592-be94-9c221c00cfa2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1272 microversion: 2.1 time: 0.305815 Aug 30 04:36:37.614038 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2623/5149] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:37 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1272 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:37.657005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:37.657750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:37.665610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:37.666715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:37.668366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:37.669276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:37.680148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:37.681745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.164254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:38.179618 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91881117-c663-4ed6-a034-ced6fee7a78d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1307 microversion: 2.1 time: 0.522815 Aug 30 04:36:38.193390 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2624/5150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:37 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1307 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:38.634465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:38.635114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:38.651394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.684498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.691329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.702871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.705938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.706469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.731186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:38.731752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:38.732314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:38.732486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:38.733102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:38.766756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.772160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.772931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.775678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:38.776407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:38.777855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:38.857958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:38.878976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:38.920771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:38.940148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a8d4e78c-50c5-4840-909f-09752604c2eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:39.070673 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c591493-07e8-404a-a1e1-2379aad2cbc4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.220106 Aug 30 04:36:39.085806 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2527/5151] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:36:39.105739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d96f8e91-5fca-455e-bf2a-b08a4fe4e12c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:39.106511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d96f8e91-5fca-455e-bf2a-b08a4fe4e12c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a8d4e78c-50c5-4840-909f-09752604c2eb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:39.156879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d96f8e91-5fca-455e-bf2a-b08a4fe4e12c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a8d4e78c-50c5-4840-909f-09752604c2eb] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:36:39.489117 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d96f8e91-5fca-455e-bf2a-b08a4fe4e12c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb" status: 204 len: 0 microversion: 2.1 time: 0.400739 Aug 30 04:36:39.494730 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2528/5152] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:36:39 2022] DELETE /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:36:39.508514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:39.510524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:39.531101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:39.532148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:39.532699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:39.534150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:39.535530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:39.536340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:39.537926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:39.543121 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33d8729f-30e8-4990-8eef-32ee113ad73f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 0.911947 Aug 30 04:36:39.555454 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2625/5153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:38 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:39.582898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-555f7e82-a0e9-418c-a022-fbaeda3308bd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:39.591119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-555f7e82-a0e9-418c-a022-fbaeda3308bd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a8d4e78c-50c5-4840-909f-09752604c2eb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:39.615378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:39.660757 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-555f7e82-a0e9-418c-a022-fbaeda3308bd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-555f7e82-a0e9-418c-a022-fbaeda3308bd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb HTTP/1.1 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'a8d4e78c-50c5-4840-909f-09752604c2eb'} Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance a8d4e78c-50c5-4840-909f-09752604c2eb Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:39.677160 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:36:39.683203 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:36:39.688341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-555f7e82-a0e9-418c-a022-fbaeda3308bd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:39.689791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-555f7e82-a0e9-418c-a022-fbaeda3308bd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb" status: 404 len: 111 microversion: 2.1 time: 0.129763 Aug 30 04:36:39.711882 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2626/5154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:39 2022] GET /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:39.829925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-429281942", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "a0a4d258-2d11-4ff7-b044-1fe1ab70ff46"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:40.051939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:36:41.201841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:41.282908 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bccc568a-da6b-43ab-9c0f-8b1e5e6f8e6e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1362 microversion: 2.1 time: 1.779856 Aug 30 04:36:41.285162 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2529/5155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:39 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1362 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:41.327405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:41.331429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:41.396386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:41.396894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:41.397362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:41.412910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:41.413459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:41.423546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.302714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:42.317747 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f63f1bf5-d5f3-4f91-b4df-ce651a67412e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 1.026111 Aug 30 04:36:42.335275 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2530/5156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:41 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:42.354365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:42.355143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:42.367785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.368816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.369523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.371002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.372202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.373115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.411449 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 HTTP/1.1 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'ab72fe9b-dcf6-43a8-aede-9ff12153d8b8'} Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:42.416202 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:42.420276 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:42.431004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:42.436251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-077b79a9-b28e-41d8-8bba-c52543bfdc4a tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 404 len: 111 microversion: 2.1 time: 0.099290 Aug 30 04:36:42.437460 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2531/5157] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:36:42 2022] DELETE /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:42.443468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7bc0b9cd-3682-4a82-9aae-d0fee4a459bf req-751a4a32-1ef0-47d5-87bf-51e94df03413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f97b7270-6031-45c5-899e-49bb678ea711", "tag": "d67848d5-bf47-41fc-959f-a1f15a3d4f67"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:42.491044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7bc0b9cd-3682-4a82-9aae-d0fee4a459bf req-751a4a32-1ef0-47d5-87bf-51e94df03413 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.492769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7bc0b9cd-3682-4a82-9aae-d0fee4a459bf req-751a4a32-1ef0-47d5-87bf-51e94df03413 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.501052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7bc0b9cd-3682-4a82-9aae-d0fee4a459bf req-751a4a32-1ef0-47d5-87bf-51e94df03413 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.581820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7bc0b9cd-3682-4a82-9aae-d0fee4a459bf req-751a4a32-1ef0-47d5-87bf-51e94df03413 service nova] Creating event network-changed:d67848d5-bf47-41fc-959f-a1f15a3d4f67 for instance f97b7270-6031-45c5-899e-49bb678ea711 on n-h2-854925-5 Aug 30 04:36:42.599091 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7bc0b9cd-3682-4a82-9aae-d0fee4a459bf req-751a4a32-1ef0-47d5-87bf-51e94df03413 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156946 Aug 30 04:36:42.601091 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2532/5158] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:42.633578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:42.634750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:42.656993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.661472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.662277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:42.663652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:42.664357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:42.665052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.122090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:36:43.122533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:36:43.131387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:36:43.139087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:36:43.141046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:36:43.210519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:43.218268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:43.221188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.223530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:43.224727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:43.226793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.306905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:36:43.314094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:43.315241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:36:43.333128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:36:43.336484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:36:43.340914 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31d608cd-c611-4ba8-bef6-0f0d243385ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1362 microversion: 2.1 time: 0.734330 Aug 30 04:36:43.341624 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2533/5159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:42 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1362 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:43.364973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:43.365641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] [instance: ab72fe9b-dcf6-43a8-aede-9ff12153d8b8] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:43.382710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:43.383214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:43.383654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.384371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:43.384827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:43.388762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.431983 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] HTTP exception thrown: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Request method failure captured: Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 HTTP/1.1 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZF2CP4Ebw06_IpQ24eX2vBy3VbTX9osccmkm7H7GpZZnJrLoO1CpqZs-JmOOcyIak3AF1q-njN6u7YqZBNYlYio4TRW22-L4sD_2PzFKUXyJYFVdH_1fpWHDH9ZcqnXGcuP701_ygXfBAc6QOxTfkiA70MKL2pJu_dEW_oXWtFed4U Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_25c9f9ed40704753b7f7e70d5d53b7b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/25c9f9ed40704753b7f7e70d5d53b7b9"}]}] Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 25c9f9ed40704753b7f7e70d5d53b7b9 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1296795629 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: f0a5b3212f964ba3b0039e84f933c317 Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeNegativeTest-1296795629-project Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'ab72fe9b-dcf6-43a8-aede-9ff12153d8b8'} Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:36:43.437277 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:43.441699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:36:43.441699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:36:43.441699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:36:43.441699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:36:43.441699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:36:43.441699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. Aug 30 04:36:43.441699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:36:43.442162 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-02706a32-5613-4bed-869f-8a3ee4d46d1e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.616986 Aug 30 04:36:43.447685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] Returning 404 to user: Instance ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:36:43.448826 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9983d51-0676-4a4e-8b3c-578f7038cdb1 tempest-AttachVolumeNegativeTest-1296795629 tempest-AttachVolumeNegativeTest-1296795629-project] 10.222.0.27 "GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8" status: 404 len: 111 microversion: 2.1 time: 0.106255 Aug 30 04:36:43.450462 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2534/5160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:43 2022] GET /compute/v2.1/servers/ab72fe9b-dcf6-43a8-aede-9ff12153d8b8 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:36:43.453299 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2627/5161] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:36:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:36:43.459135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:43.459951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:43.464916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f41e29c-0c06-460c-8db4-46ac029e2019 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:43.465689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f41e29c-0c06-460c-8db4-46ac029e2019 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:43.470518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:43.478179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:43.480054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.481494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:43.483042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:43.483634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:43.724425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f41e29c-0c06-460c-8db4-46ac029e2019 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:43.734552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f41e29c-0c06-460c-8db4-46ac029e2019 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1220 microversion: 2.1 time: 0.279971 Aug 30 04:36:43.737480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2628/5162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:43 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1220 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:44.382237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:44.382873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:44.398504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.400887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.402478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.403407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.407648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.408546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.577979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:44.599282 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0dbe260c-4356-4938-bcf9-06281d7dc5ca tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 1.147419 Aug 30 04:36:44.604106 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2535/5163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:43 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:44.677219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1098a6c7-d345-4a49-b143-6b8a1d8157b9 req-20e73211-ed5f-4197-8578-1c05af13d23d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a01c5f1-b0cc-41ff-9a7a-5a419509f558", "tag": "08b3bdf5-f483-43b1-95f9-bf8fd827caa9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:44.688254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:44.697096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1098a6c7-d345-4a49-b143-6b8a1d8157b9 req-20e73211-ed5f-4197-8578-1c05af13d23d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.697988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1098a6c7-d345-4a49-b143-6b8a1d8157b9 req-20e73211-ed5f-4197-8578-1c05af13d23d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.699431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1098a6c7-d345-4a49-b143-6b8a1d8157b9 req-20e73211-ed5f-4197-8578-1c05af13d23d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.738178 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1098a6c7-d345-4a49-b143-6b8a1d8157b9 req-20e73211-ed5f-4197-8578-1c05af13d23d service nova] Creating event network-changed:08b3bdf5-f483-43b1-95f9-bf8fd827caa9 for instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 on n-h2-854925-5 Aug 30 04:36:44.750443 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1098a6c7-d345-4a49-b143-6b8a1d8157b9 req-20e73211-ed5f-4197-8578-1c05af13d23d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076962 Aug 30 04:36:44.751788 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2536/5164] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:44.759814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:44.766118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:44.781814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.782825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.783542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:44.786243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:44.787007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:44.793305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:45.060132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:45.074417 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed2e214c-e096-4812-a1b4-eb3722aac847 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1224 microversion: 2.1 time: 0.312880 Aug 30 04:36:45.079468 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2537/5165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:44 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1224 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:45.124232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:45.133904 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f07718a1-4563-4c3f-8462-8870f3d27665 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1362 microversion: 2.1 time: 0.774934 Aug 30 04:36:45.153792 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2629/5166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:44 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1362 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:45.626821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:45.628056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:45.643240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:45.646565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:45.649155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:45.651925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:45.656817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:45.658286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.100133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:46.101608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:46.109933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.110672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.111312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.112376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.113178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.113812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.267270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:46.282538 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e603e79-8f8a-4da0-9183-ac78370b01cf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1290 microversion: 2.1 time: 0.186321 Aug 30 04:36:46.309567 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2630/5167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:46 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1290 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:46.323157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:46.324806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:46.334037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.334837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.341350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.346897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:46.351699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:46.352128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:46.419390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:46.447663 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3941142d-9bfc-445a-b7d5-551aa23a1c2e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 0.806885 Aug 30 04:36:46.466785 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2538/5168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:45 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:47.308701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:47.309651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:47.329910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:47.332925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:47.333636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:47.335637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:47.337573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:47.338337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:47.492230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:47.523298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:47.537184 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de6fccc1-82a9-4fd4-ae6a-de7e6b7d2404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1278 microversion: 2.1 time: 0.233511 Aug 30 04:36:47.538699 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a8553aa-7d9e-46f1-831e-8ece2d1612b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1362 microversion: 2.1 time: 1.227416 Aug 30 04:36:47.539321 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2631/5169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:46 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1362 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:47.542138 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2539/5170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:47 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:47.544045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:47.544651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:47.564946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:47.566533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:47.566983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:47.567701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:47.568163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:47.568598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:47.875913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:47.888455 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1fd864d4-9366-418e-a248-26b1148e18b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 0.348037 Aug 30 04:36:47.892168 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2632/5171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:47 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:48.565191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:48.566412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:48.568170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:48.571780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:48.576381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.581830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.587915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.592382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.593106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.593747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.604065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.606510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.610230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.613254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.615412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.618079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.813672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:48.853886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:48.872270 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9061ff6e-5fe7-4323-80a5-2e14ff2cab52 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1278 microversion: 2.1 time: 0.311378 Aug 30 04:36:48.889907 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2633/5172] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:48 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1278 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:48.897198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-25234e14-340c-4c2d-827c-0498de480b8f req-11942fc5-e70c-4764-a7ac-7f62781d2024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a01c5f1-b0cc-41ff-9a7a-5a419509f558", "name": "network-vif-plugged", "status": "completed", "tag": "08b3bdf5-f483-43b1-95f9-bf8fd827caa9"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:48.927480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-25234e14-340c-4c2d-827c-0498de480b8f req-11942fc5-e70c-4764-a7ac-7f62781d2024 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:48.928375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-25234e14-340c-4c2d-827c-0498de480b8f req-11942fc5-e70c-4764-a7ac-7f62781d2024 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:48.929042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-25234e14-340c-4c2d-827c-0498de480b8f req-11942fc5-e70c-4764-a7ac-7f62781d2024 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:48.959761 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-25234e14-340c-4c2d-827c-0498de480b8f req-11942fc5-e70c-4764-a7ac-7f62781d2024 service nova] Creating event network-vif-plugged:08b3bdf5-f483-43b1-95f9-bf8fd827caa9 for instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 on n-h2-854925-5 Aug 30 04:36:48.975185 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-25234e14-340c-4c2d-827c-0498de480b8f req-11942fc5-e70c-4764-a7ac-7f62781d2024 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083426 Aug 30 04:36:48.976878 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2634/5173] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:48.988779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:48.991774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:49.017695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:49.019026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:49.023744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:49.025750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:49.026616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:49.031125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:49.271073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=14 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:49.908195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:49.959540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-17891eca-e9fe-4993-8b86-b831312e5bca tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1362 microversion: 2.1 time: 1.400250 Aug 30 04:36:49.980599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2540/5174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:48 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1362 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:49.992784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:49.993484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:50.015729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:50.019431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:50.021439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:50.022322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:50.024441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:50.028779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:50.055222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:50.064348 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06ee9c11-f2b4-487b-b703-0801d3362e94 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 1.085946 Aug 30 04:36:50.067271 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2635/5175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:48 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:50.353058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:50.378324 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0c27dfd-b964-406c-9a2b-0859da1580ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.395117 Aug 30 04:36:50.381316 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2541/5176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:49 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:50.985094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:50.986139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:51.006852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.010150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.012400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.013592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.015118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.015752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.088778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:51.089699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:51.109069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.111372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.114115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.115052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.117029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.117686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.478069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:51.488259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0933ac9d-4ffa-47e0-9466-bdc85e7b9e6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 0.404233 Aug 30 04:36:51.490135 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2542/5177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:51 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:51.496013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:51.496960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:51.503977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.504843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.505372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.506210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:51.506827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:51.507478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:51.751723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:51.757693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:51.758344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:51.766044 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1dd9353f-0ed8-473b-9050-415d45a050e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1362 microversion: 2.1 time: 0.784333 Aug 30 04:36:51.767254 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2636/5178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:50 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1362 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:51.776781 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63099bda-0e34-4582-9fc8-0f645b2fe637 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.284177 Aug 30 04:36:51.777139 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2543/5179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:51 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:52.455565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83602649-dfeb-4b62-b881-32bb38cf0d1d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1441812524", "availability_zone": "foo_zone"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:52.459394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.aggregate [None req-83602649-dfeb-4b62-b881-32bb38cf0d1d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Generated uuid 21b3171f-3ce2-4970-8608-c5ca5bc8aaf2 for aggregate {{(pid=122403) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 30 04:36:52.493080 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83602649-dfeb-4b62-b881-32bb38cf0d1d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.270774 Aug 30 04:36:52.494381 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2637/5180] 10.222.0.27 () {60 vars in 1164 bytes} [Tue Aug 30 04:36:52 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:52.507660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-90406a34-642e-42ef-a676-c91e84eb102b tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:52.530146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:52.534404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:52.561863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.562835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.563432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.566689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.567799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.575325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.586794 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-90406a34-642e-42ef-a676-c91e84eb102b tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.084471 Aug 30 04:36:52.587587 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2544/5181] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:36:52 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:52.613529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:52.637638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.641421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.643644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.646009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.650111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.655208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.769362 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-751513a7-07c6-4142-a94a-6b8014e6196d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.161175 Aug 30 04:36:52.769362 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2545/5182] 10.222.0.27 () {58 vars in 1176 bytes} [Tue Aug 30 04:36:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:52.792780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11e3b393-b9b7-48a5-a6e3-766a88d67c3e tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:52.809279 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11e3b393-b9b7-48a5-a6e3-766a88d67c3e tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.025413 Aug 30 04:36:52.813820 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2546/5183] 10.222.0.27 () {58 vars in 1143 bytes} [Tue Aug 30 04:36:52 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:52.831297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:52.832559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:52.861562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.862235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.864404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:52.865320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:52.869485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:52.870171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.103849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.119840 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a4a5276f-c6c0-4e5b-8f8f-a1607d0cdbe4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1314 microversion: 2.1 time: 0.602659 Aug 30 04:36:53.125859 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2638/5184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:52 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:53.146407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:53.148366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:53.178502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.178950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.179412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.185376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.191489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.191981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.264001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.272593 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-39d6c6b4-01b2-4650-9eaf-2641affb8b60 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1548 microversion: 2.1 time: 0.457645 Aug 30 04:36:53.273197 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2547/5185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:52 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1548 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:53.302272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e50c462f-513b-4979-bf66-ab331cc8b56a tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:53.322947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:53.323428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e50c462f-513b-4979-bf66-ab331cc8b56a tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.323973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e50c462f-513b-4979-bf66-ab331cc8b56a tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.324468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e50c462f-513b-4979-bf66-ab331cc8b56a tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.600480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:53.624643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-beb3ff4a-255d-4725-99a7-a0df391b0b86 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.493744 Aug 30 04:36:53.638295 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2639/5186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:53 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:53.638295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-af1db9fd-f278-49d1-bee1-2449963f76c6 req-ff7d62cd-f4bb-478c-a121-f335eab3e064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552511e8-e2bd-4e61-b71f-67bee0adee64", "tag": "99c23d96-173a-4ef5-9057-982d320d4ba0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:53.643017 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e50c462f-513b-4979-bf66-ab331cc8b56a tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.344489 Aug 30 04:36:53.643633 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2548/5187] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:36:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:53.645205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:53.648625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af1db9fd-f278-49d1-bee1-2449963f76c6 req-ff7d62cd-f4bb-478c-a121-f335eab3e064 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.649173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af1db9fd-f278-49d1-bee1-2449963f76c6 req-ff7d62cd-f4bb-478c-a121-f335eab3e064 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.649755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-af1db9fd-f278-49d1-bee1-2449963f76c6 req-ff7d62cd-f4bb-478c-a121-f335eab3e064 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.665962 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-af1db9fd-f278-49d1-bee1-2449963f76c6 req-ff7d62cd-f4bb-478c-a121-f335eab3e064 service nova] Creating event network-changed:99c23d96-173a-4ef5-9057-982d320d4ba0 for instance 552511e8-e2bd-4e61-b71f-67bee0adee64 on n-h1-854925-5 Aug 30 04:36:53.679308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d4767811-49ce-4b36-80fa-60c86d5a23c7 req-1ae6aa81-7d16-457d-bab0-4e8b293ab385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97b7270-6031-45c5-899e-49bb678ea711", "name": "network-vif-plugged", "status": "completed", "tag": "d67848d5-bf47-41fc-959f-a1f15a3d4f67"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:53.697364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d4767811-49ce-4b36-80fa-60c86d5a23c7 req-1ae6aa81-7d16-457d-bab0-4e8b293ab385 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.697773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d4767811-49ce-4b36-80fa-60c86d5a23c7 req-1ae6aa81-7d16-457d-bab0-4e8b293ab385 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.698243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d4767811-49ce-4b36-80fa-60c86d5a23c7 req-1ae6aa81-7d16-457d-bab0-4e8b293ab385 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.698501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-af1db9fd-f278-49d1-bee1-2449963f76c6 req-ff7d62cd-f4bb-478c-a121-f335eab3e064 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066740 Aug 30 04:36:53.700559 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2640/5188] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:53.713540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:53.719543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:53.724733 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d4767811-49ce-4b36-80fa-60c86d5a23c7 req-1ae6aa81-7d16-457d-bab0-4e8b293ab385 service nova] Creating event network-vif-plugged:d67848d5-bf47-41fc-959f-a1f15a3d4f67 for instance f97b7270-6031-45c5-899e-49bb678ea711 on n-h2-854925-5 Aug 30 04:36:53.733236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.733894 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d4767811-49ce-4b36-80fa-60c86d5a23c7 req-1ae6aa81-7d16-457d-bab0-4e8b293ab385 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088561 Aug 30 04:36:53.736938 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2549/5189] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:53.737367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.738694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.742120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf6dda69-c91b-464c-9964-beb594959b12 tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:53.753306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:53.756795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:53.761668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:53.762733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=22 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:53.769937 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf6dda69-c91b-464c-9964-beb594959b12 tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.031620 Aug 30 04:36:53.771324 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2550/5190] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:36:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:53.782507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dce2ee38-6a4f-43eb-9ecf-a9b8f273379c tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-906056879", "availability_zone": "foo_zone"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:53.891686 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dce2ee38-6a4f-43eb-9ecf-a9b8f273379c tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.112825 Aug 30 04:36:53.892825 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2551/5191] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Aug 30 04:36:53 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:53.904671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ecd53897-f999-414d-9c07-db5a31699942 tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:53.967483 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ecd53897-f999-414d-9c07-db5a31699942 tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.067173 Aug 30 04:36:53.968548 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2552/5192] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:36:53 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:53.981866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-09368d53-6b4e-4822-a452-ec5885b8e50d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:54.004055 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-09368d53-6b4e-4822-a452-ec5885b8e50d tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.028349 Aug 30 04:36:54.012882 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2553/5193] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:36:53 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:54.020534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a99c333-a1d3-4ea3-bc0c-aceeb24252fb tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-854925-5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:54.089698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a99c333-a1d3-4ea3-bc0c-aceeb24252fb tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.092799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a99c333-a1d3-4ea3-bc0c-aceeb24252fb tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.093838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a99c333-a1d3-4ea3-bc0c-aceeb24252fb tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.242615 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-50c2d843-fc50-4d19-bcfa-4f20f6b1b4c8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.539364 Aug 30 04:36:54.243716 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2641/5194] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:36:53 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-interface => generated 284 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:54.249839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:54.251014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:54.289192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.293906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.302719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.305532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.306275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.308159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.502729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a99c333-a1d3-4ea3-bc0c-aceeb24252fb tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.488332 Aug 30 04:36:54.504641 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2554/5195] 10.222.0.27 () {60 vars in 1194 bytes} [Tue Aug 30 04:36:54 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:36:54.517462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4161e013-e7a1-406d-bff6-765b751c97e8 tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:54.599369 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4161e013-e7a1-406d-bff6-765b751c97e8 tempest-TestAggregatesBasicOps-1140384095 tempest-TestAggregatesBasicOps-1140384095-project-admin] 10.222.0.27 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.086322 Aug 30 04:36:54.599979 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2555/5196] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:36:54 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 30 04:36:54.649878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:54.653526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:54.666424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.667871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.668569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.669555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:54.670170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:54.670759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:54.839855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:54.858707 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01df208d-996b-412e-891c-18f721bee419 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1318 microversion: 2.1 time: 0.613706 Aug 30 04:36:54.859508 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2642/5197] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:54 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:55.081806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:55.097677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18872671-2d2b-44bb-87b9-4b5fd56be773 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.447054 Aug 30 04:36:55.097677 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2556/5198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:54 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:55.882124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:55.883930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:55.902957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:55.903458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:55.903903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:55.904720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:55.905064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:55.908902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.130328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:56.131050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:56.157472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.160469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.164666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.165539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.166084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.168012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.373840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:56.383671 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ffcc5da-475d-4cfd-acf0-35a99cb28aaa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1501 microversion: 2.1 time: 0.506858 Aug 30 04:36:56.395131 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2643/5199] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:55 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1501 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:56.417718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:56.418563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:56.434421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.435160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.440456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.441465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.442102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.442718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.572546 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d105f883-c6d7-463f-9ea5-3841d7a927ac tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711/action" status: 202 len: 0 microversion: 2.1 time: 0.158589 Aug 30 04:36:56.574221 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2644/5200] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:36:56 2022] POST /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:36:56.589681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:56.590949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:56.608459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.609004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.610586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:56.611546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:56.614186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:56.616106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:57.687149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:57.709949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:57.712893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:36:57.715796 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21aeb6f2-48fe-4fc8-b806-253fa5283c4b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 1.599666 Aug 30 04:36:57.716403 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2557/5201] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:56 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 1602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:36:57.729518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80f69c76-55a0-4865-bf2a-ec8281fd74c1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1506 microversion: 2.1 time: 1.150860 Aug 30 04:36:57.738293 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2645/5202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:56 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1506 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:57.749647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5cbfaa92-9bde-409a-b5c1-1c82b93658a5 req-cb2f799c-a773-40f0-94b5-4a6f43056a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a01c5f1-b0cc-41ff-9a7a-5a419509f558", "tag": "08b3bdf5-f483-43b1-95f9-bf8fd827caa9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:57.757365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5cbfaa92-9bde-409a-b5c1-1c82b93658a5 req-cb2f799c-a773-40f0-94b5-4a6f43056a0a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:57.757852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5cbfaa92-9bde-409a-b5c1-1c82b93658a5 req-cb2f799c-a773-40f0-94b5-4a6f43056a0a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:57.758283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5cbfaa92-9bde-409a-b5c1-1c82b93658a5 req-cb2f799c-a773-40f0-94b5-4a6f43056a0a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:57.791417 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5cbfaa92-9bde-409a-b5c1-1c82b93658a5 req-cb2f799c-a773-40f0-94b5-4a6f43056a0a service nova] Creating event network-changed:08b3bdf5-f483-43b1-95f9-bf8fd827caa9 for instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 on n-h2-854925-5 Aug 30 04:36:57.802615 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5cbfaa92-9bde-409a-b5c1-1c82b93658a5 req-cb2f799c-a773-40f0-94b5-4a6f43056a0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084916 Aug 30 04:36:57.805760 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2558/5203] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:36:58.738575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:58.740078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:58.755875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:58.756606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:58.761266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:58.762725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:58.764128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:58.765300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:58.766582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:58.767233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:58.778551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:58.782139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:58.782839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:58.783892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:58.786935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:58.787610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:59.229897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:59.244394 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-612859a4-ad0c-47e8-a3eb-bef15eb89dfc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.510779 Aug 30 04:36:59.245373 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2646/5204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:58 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:59.324574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:36:59.356661 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6b32bfdb-58e5-42fe-983c-a2c0165b6bdb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1486 microversion: 2.1 time: 0.594301 Aug 30 04:36:59.358217 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2559/5205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:58 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1486 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:36:59.377217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:36:59.378069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:59.391961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:59.392721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:59.393367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:59.394909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:59.395552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:59.396152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:59.443854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lazy-loading 'flavor' on Instance uuid f97b7270-6031-45c5-899e-49bb678ea711 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:36:59.900791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0aa5d114-0de1-42bf-844f-98749c43df60 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711/action" status: 202 len: 0 microversion: 2.1 time: 0.527563 Aug 30 04:36:59.906388 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2647/5206] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:36:59 2022] POST /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711/action => generated 0 bytes in 534 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:36:59.918525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:36:59.919152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:36:59.939641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:59.940317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:59.941079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:36:59.941985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:36:59.942952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:36:59.945136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:00.243761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:00.254100 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6852f1dd-996b-4e97-84da-f65bd334128f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1492 microversion: 2.1 time: 0.345512 Aug 30 04:37:00.255913 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2560/5207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:36:59 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1492 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:00.278062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:00.278970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:00.294199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:00.294696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:00.295125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:00.297031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:00.299172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:00.300258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:00.706547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:00.731795 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a615134-8f02-49a6-96bf-13fa7cb616b8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.453979 Aug 30 04:37:00.742252 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2648/5208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:00 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:01.283847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:01.284756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:01.299601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.302078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.304438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:01.306343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.310606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.311945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:01.504960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:01.517163 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9749f7b0-b655-4353-820d-aa7afafbcaf0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1513 microversion: 2.1 time: 0.238375 Aug 30 04:37:01.518635 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2561/5209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:01 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:01.765467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:01.766152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:01.782475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.783042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.783603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:01.785784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:01.786341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:01.789235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:02.226841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:02.242125 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c770f24-84e7-49a8-bb7e-51e8d92c6f2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.481809 Aug 30 04:37:02.244264 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2649/5210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:01 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:02.330269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-850893a9-6d2b-49b3-a578-07a0a03256f0 req-dd2566b6-c036-418c-9384-db9f5cc7ceb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552511e8-e2bd-4e61-b71f-67bee0adee64", "name": "network-vif-plugged", "status": "completed", "tag": "99c23d96-173a-4ef5-9057-982d320d4ba0"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:02.356111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-850893a9-6d2b-49b3-a578-07a0a03256f0 req-dd2566b6-c036-418c-9384-db9f5cc7ceb5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:02.356600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-850893a9-6d2b-49b3-a578-07a0a03256f0 req-dd2566b6-c036-418c-9384-db9f5cc7ceb5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:02.357035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-850893a9-6d2b-49b3-a578-07a0a03256f0 req-dd2566b6-c036-418c-9384-db9f5cc7ceb5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:02.383277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-850893a9-6d2b-49b3-a578-07a0a03256f0 req-dd2566b6-c036-418c-9384-db9f5cc7ceb5 service nova] Creating event network-vif-plugged:99c23d96-173a-4ef5-9057-982d320d4ba0 for instance 552511e8-e2bd-4e61-b71f-67bee0adee64 on n-h1-854925-5 Aug 30 04:37:02.402277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-850893a9-6d2b-49b3-a578-07a0a03256f0 req-dd2566b6-c036-418c-9384-db9f5cc7ceb5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075658 Aug 30 04:37:02.404824 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2562/5211] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:02.546503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:02.548268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:02.595401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:02.595928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:02.596390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:02.597131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:02.597630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:02.610204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.130462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:03.144225 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5774e282-8381-455d-ae4d-1cc5cbfe4740 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1513 microversion: 2.1 time: 0.606899 Aug 30 04:37:03.147942 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2650/5212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:02 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1513 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:03.261651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:03.266069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:03.266964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:03.282804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.284408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.286041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.288694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:03.289173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:03.290125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:03.776889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:03.790794 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ec115c1-9277-4c83-be53-7c04af110ff1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1320 microversion: 2.1 time: 0.530317 Aug 30 04:37:03.791888 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2563/5213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:03 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1320 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:04.170543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:04.171640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:04.187064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:04.188511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:04.190518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:04.192755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:04.193481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:04.194534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:04.436632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fec5ba7d-bfb1-4236-bf00-2a714145b416 req-8440d785-f7ab-4da6-b04c-9d88905ca21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97b7270-6031-45c5-899e-49bb678ea711", "name": "network-vif-plugged", "status": "completed", "tag": "d67848d5-bf47-41fc-959f-a1f15a3d4f67"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:04.453644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fec5ba7d-bfb1-4236-bf00-2a714145b416 req-8440d785-f7ab-4da6-b04c-9d88905ca21f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:04.454671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fec5ba7d-bfb1-4236-bf00-2a714145b416 req-8440d785-f7ab-4da6-b04c-9d88905ca21f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:04.455491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fec5ba7d-bfb1-4236-bf00-2a714145b416 req-8440d785-f7ab-4da6-b04c-9d88905ca21f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:04.494057 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fec5ba7d-bfb1-4236-bf00-2a714145b416 req-8440d785-f7ab-4da6-b04c-9d88905ca21f service nova] Creating event network-vif-plugged:d67848d5-bf47-41fc-959f-a1f15a3d4f67 for instance f97b7270-6031-45c5-899e-49bb678ea711 on n-h2-854925-5 Aug 30 04:37:04.515203 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fec5ba7d-bfb1-4236-bf00-2a714145b416 req-8440d785-f7ab-4da6-b04c-9d88905ca21f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073674 Aug 30 04:37:04.517768 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2564/5214] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:04.659374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a10193b9-8851-49fd-b88f-7ab521fe8c6b tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe9693c5e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:04.799266 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a10193b9-8851-49fd-b88f-7ab521fe8c6b tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4a25a3a2-fc9a-4ef7-9dd9-baba2e074be1" status: 200 len: 351 microversion: 2.1 time: 0.148012 Aug 30 04:37:04.805257 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2565/5215] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:04 2022] GET /compute/v2.1/os-volumes/4a25a3a2-fc9a-4ef7-9dd9-baba2e074be1 => generated 351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:04.848925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:04.858098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:04.896558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:04.904475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:04.912985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:04.917786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:04.924299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:04.927020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.012798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:05.023289 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-450167a7-00e6-4e95-bb8a-5d4eebffd677 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.856668 Aug 30 04:37:05.032456 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2651/5216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:04 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:05.477971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:05.486771 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21479f2f-c3e1-49af-bd81-d220f0e7d375 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1501 microversion: 2.1 time: 0.674358 Aug 30 04:37:05.491175 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2566/5217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:04 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1501 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:05.512383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:05.516494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:05.525441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.534621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.535874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.538183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.539433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.540097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.622032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:05.914827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:05.939402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a9ff0d20-f415-4c38-a804-b17245e6f821 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1501 microversion: 2.1 time: 0.433251 Aug 30 04:37:05.940002 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2652/5218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:05 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1501 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:05.968626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:05.969743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:05.982162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.983699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.984323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:05.985205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:05.985845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:05.986456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:06.024219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:37:06.065037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:06.068178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:06.081782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:06.082551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:06.083233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:06.084291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:06.085049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:06.085665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:06.264869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:06.287648 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-027007a0-f365-480b-bf9a-177e3a495fb4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 204 len: 0 microversion: 2.1 time: 0.319032 Aug 30 04:37:06.296148 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2567/5219] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:05 2022] DELETE /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:37:06.304119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:06.305159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:06.342229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:06.349097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:06.349847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:06.353254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:06.353773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:06.354841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:06.701007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:06.725967 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d00e7539-9d60-4463-b7b3-a5b6155d68ec tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.661954 Aug 30 04:37:06.727772 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2653/5220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:06 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:07.019429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:07.028460 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a528aab1-9790-4ace-81b1-f48d42185c6e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1507 microversion: 2.1 time: 0.730440 Aug 30 04:37:07.034576 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2568/5221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:06 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1507 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:07.719210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-345b72e2-724e-499c-a4ab-bee25f5f43e9 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe969385040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:07.750373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:07.751725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:07.784562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:07.785249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:07.790342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:07.790986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:07.791466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:07.792487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:07.933216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-345b72e2-724e-499c-a4ab-bee25f5f43e9 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/377d102d-a996-4a4f-aaac-9740279bf2c9" status: 200 len: 351 microversion: 2.1 time: 0.219401 Aug 30 04:37:07.934383 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2654/5222] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:07 2022] GET /compute/v2.1/os-volumes/377d102d-a996-4a4f-aaac-9740279bf2c9 => generated 351 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:08.059831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:08.061138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:08.098307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:08.099605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:08.101119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:08.103800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:08.105209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:08.106973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:08.373071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:08.403237 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-94991fa3-af1f-4f65-b704-ef3856e3cbe5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.650781 Aug 30 04:37:08.408832 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2569/5223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:07 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:08.494665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:08.503846 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b0cd8a56-fe0d-47ed-9490-51d575291f3d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1507 microversion: 2.1 time: 0.449455 Aug 30 04:37:08.508213 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2655/5224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:08 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1507 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:09.438888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:09.440162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:09.469734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.473851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.474723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.477366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.483021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.483752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.533287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:09.534508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:09.578610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.578896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.594079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.603396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:09.604575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:09.605064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:09.919981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:09.934400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5af4909-b1ec-4fd7-80cc-d9fc7f67034e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1465 microversion: 2.1 time: 0.405372 Aug 30 04:37:09.939526 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2656/5225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:09 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1465 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:10.056929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9902ff8c-aa3f-41a9-9c00-b27eb8996ae7 req-86c0f68c-19eb-4180-a696-249f5b90c7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552511e8-e2bd-4e61-b71f-67bee0adee64", "name": "network-vif-deleted", "tag": "99c23d96-173a-4ef5-9057-982d320d4ba0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:10.082108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9902ff8c-aa3f-41a9-9c00-b27eb8996ae7 req-86c0f68c-19eb-4180-a696-249f5b90c7d5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:10.086138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9902ff8c-aa3f-41a9-9c00-b27eb8996ae7 req-86c0f68c-19eb-4180-a696-249f5b90c7d5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:10.095201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9902ff8c-aa3f-41a9-9c00-b27eb8996ae7 req-86c0f68c-19eb-4180-a696-249f5b90c7d5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:10.120250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9902ff8c-aa3f-41a9-9c00-b27eb8996ae7 req-86c0f68c-19eb-4180-a696-249f5b90c7d5 service nova] Creating event network-vif-deleted:99c23d96-173a-4ef5-9057-982d320d4ba0 for instance 552511e8-e2bd-4e61-b71f-67bee0adee64 on n-h1-854925-5 Aug 30 04:37:10.158722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9902ff8c-aa3f-41a9-9c00-b27eb8996ae7 req-86c0f68c-19eb-4180-a696-249f5b90c7d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105987 Aug 30 04:37:10.162590 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2657/5226] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:10.527514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:10.557616 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-660d632b-d516-44ab-af40-93551f4de3d5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 1.128648 Aug 30 04:37:10.558448 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2570/5227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:09 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:10.976585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:10.977312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:11.035390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:11.035907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:11.036355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:11.037088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:11.037579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:11.038017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:11.061817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2841c805-41b0-4883-8fb5-16d02bc50df1 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe96e47f430>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:11.222017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:11.222982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:11.230385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:11.230907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lazy-loading 'fault' on Instance uuid 552511e8-e2bd-4e61-b71f-67bee0adee64 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:37:11.256918 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2841c805-41b0-4883-8fb5-16d02bc50df1 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/6fd7d4cf-b1e6-4093-81e7-1d558c090321" status: 200 len: 351 microversion: 2.1 time: 0.198905 Aug 30 04:37:11.258888 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2571/5228] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:37:11 2022] GET /compute/v2.1/os-volumes/6fd7d4cf-b1e6-4093-81e7-1d558c090321 => generated 351 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:11.283493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2426ae39-9d4e-4205-a526-2c92c4619301 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe96a1f7040>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:11.390164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:11.407749 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-82fcf2a1-03f9-420f-9df2-674513a2bc53 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 200 len: 1310 microversion: 2.1 time: 0.444710 Aug 30 04:37:11.408341 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2658/5229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:10 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 1310 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:11.555894 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2426ae39-9d4e-4205-a526-2c92c4619301 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.279486 Aug 30 04:37:11.571869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f73c4bf4-b887-4722-bd19-1ff89fffc854 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe96947c550>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:11.572829 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2572/5230] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 30 04:37:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:11.579531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:11.580150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:11.599198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:11.601418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:11.601953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:11.602775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:11.603248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:11.603686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:11.847462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:11.852048 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f73c4bf4-b887-4722-bd19-1ff89fffc854 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.284968 Aug 30 04:37:11.852957 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2659/5231] 10.222.0.27 () {58 vars in 1149 bytes} [Tue Aug 30 04:37:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:11.861235 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5f3b200-100b-4f4d-9c99-b6a7fe28550e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.284539 Aug 30 04:37:11.863180 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2573/5232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:11 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:11.866966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3768e036-e235-4f2e-9f07-135772745cf2 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe96a83a9d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.020633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3768e036-e235-4f2e-9f07-135772745cf2 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.157680 Aug 30 04:37:12.028795 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2660/5233] 10.222.0.27 () {58 vars in 1134 bytes} [Tue Aug 30 04:37:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:12.036639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa02f597-9b64-4eed-a54b-049c48585bc2 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe96a1f7e50>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.180558 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa02f597-9b64-4eed-a54b-049c48585bc2 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.149832 Aug 30 04:37:12.192117 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2574/5234] 10.222.0.27 () {58 vars in 1167 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:12.207038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9310883d-dbc3-4019-8ed5-1dc34dbf0ca8 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe969385af0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.433651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.436772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:12.438232 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9310883d-dbc3-4019-8ed5-1dc34dbf0ca8 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.244570 Aug 30 04:37:12.439430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2661/5235] 10.222.0.27 () {58 vars in 1170 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:12.455705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d77a455-42f0-4bdc-8e4f-156edbf3a10b tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe96947cee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.495294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.495924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.496377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:12.497213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.498510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.503647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:12.552615 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 HTTP/1.1 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '552511e8-e2bd-4e61-b71f-67bee0adee64'} Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:12.554600 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:12.559331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:12.559331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:12.559331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:12.559331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:12.559331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:12.559331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:37:12.559331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:12.561095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:12.567117 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f031f10-3249-4db7-856b-9a886d5cb25c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 404 len: 111 microversion: 2.1 time: 0.137165 Aug 30 04:37:12.568470 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2575/5236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:12.581675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a78e4a67-bdb2-4889-95f1-a86d40688392 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: .version_select at 0x7fe96a4ea700>, body: {"keypair": {"name": "tempest-key-2031404563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEuHHqWY48vIETAgmArzMTGiaDAl1SjanTG1pZs92zHF6H7asfpY2nbijM6YlcbsBkwIlXC2gsyDY+c++BDYZ7svPNhI87xkUjSbjg7mlmFtzGWKwle8h6Qbj9Uv4VtiVA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:12.617922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a78e4a67-bdb2-4889-95f1-a86d40688392 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:12.639151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a78e4a67-bdb2-4889-95f1-a86d40688392 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:12.693040 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a78e4a67-bdb2-4889-95f1-a86d40688392 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.115532 Aug 30 04:37:12.694286 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2576/5237] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:37:12 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:12.705256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51930963-a6fc-4c1a-9a76-e33ed2ee4502 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '.version_select at 0x7fe96a1621f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.709469 n-d-854925-5 devstack@n-api.service[122402]: WARNING oslo_db.sqlalchemy.utils [None req-51930963-a6fc-4c1a-9a76-e33ed2ee4502 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 30 04:37:12.731865 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51930963-a6fc-4c1a-9a76-e33ed2ee4502 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.030729 Aug 30 04:37:12.732481 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2577/5238] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:12.880740 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9d77a455-42f0-4bdc-8e4f-156edbf3a10b tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.430361 Aug 30 04:37:12.885510 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2662/5239] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:12.888264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.888887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:12.894123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-67996f8a-a001-4eaf-a445-13f9109d2043 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe9692d6820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:12.896024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.897008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.898304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:12.900613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:12.904290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:12.910524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:13.138631 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-67996f8a-a001-4eaf-a445-13f9109d2043 tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.248158 Aug 30 04:37:13.140065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2663/5240] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:13.146428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-328018327", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-key-2031404563", "networks": [{"uuid": "a0a4d258-2d11-4ff7-b044-1fe1ab70ff46"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:13.303548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:37:13.369742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:13.401431 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5f1329f-c98a-43f0-8619-b4246b630696 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.517065 Aug 30 04:37:13.419394 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2578/5241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:12 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:13.442852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-606cb872-ddf4-4d9c-83bc-637cdd44590e tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] Calling method '.version_select at 0x7fe96a078820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:13.688225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-606cb872-ddf4-4d9c-83bc-637cdd44590e tempest-VolumesTestJSON-49874038 tempest-VolumesTestJSON-49874038-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.267297 Aug 30 04:37:13.688833 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2579/5242] 10.222.0.27 () {58 vars in 1155 bytes} [Tue Aug 30 04:37:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:14.426956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:14.427847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:14.448830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:14.450164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:14.450164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:14.456686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:14.456686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:14.456686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:14.858129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:37:14.867828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:37:14.867828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:37:14.867828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:37:14.867828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:37:14.905167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:14.905167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:14.905167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:14.923033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:14.923918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:14.924564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:14.975501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:15.022825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:15.068627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:37:15.076330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:37:15.118463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:15.128920 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d8bdb5b-85a5-4dd4-bca2-496ae3c8decb tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.705986 Aug 30 04:37:15.144215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2580/5243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:14 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:15.161226 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2590e6fe-7eb1-4a4d-9a30-8cbb25fe419e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.018910 Aug 30 04:37:15.162569 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2664/5244] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:37:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:37:15.176827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08d5c131-94ce-4377-a1ec-9b69e97d5c5d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:15.177496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08d5c131-94ce-4377-a1ec-9b69e97d5c5d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:15.377733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08d5c131-94ce-4377-a1ec-9b69e97d5c5d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:15.395856 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08d5c131-94ce-4377-a1ec-9b69e97d5c5d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1228 microversion: 2.1 time: 0.218048 Aug 30 04:37:15.396521 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2581/5245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:15 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1228 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:16.159594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:16.160231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:16.197652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:16.198986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:16.201305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:16.204264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:16.211449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:16.218683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:16.419440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:16.420229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:16.432840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:16.444680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:16.446062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:16.447318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:16.453104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:16.454508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:16.688432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:16.699886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-309ff0ab-8218-4f5f-9e5c-4947685ca266 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1224 microversion: 2.1 time: 0.285788 Aug 30 04:37:16.718347 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2582/5246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:16 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1224 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:16.755952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:16.765635 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f18ce55d-a577-407f-bcde-282dd6e66f2c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.617622 Aug 30 04:37:16.770287 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2665/5247] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:16 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:17.726948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:17.728420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:17.748571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.749074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.749543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.759522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:17.763040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:17.766798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:17.975426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9da351f6-3f8b-4949-ad57-18525aae8b53 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: .version_select at 0x7fe96a1d5430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-488562152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBC8P6upLoKPP5zdoRENQOwcIAMstnjB3vaqOAWkXLQOzUO8Gx9fI/iiIjwRH5cVBnk6tXFDJrwi9rEGopMWHFdLvNkWFlqqXT/BSs1faVeYNklwfGLCK8YPw+26SjQnQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:17.996124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9da351f6-3f8b-4949-ad57-18525aae8b53 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:18.005240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9da351f6-3f8b-4949-ad57-18525aae8b53 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:18.041001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:18.050357 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9da351f6-3f8b-4949-ad57-18525aae8b53 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.596716 Aug 30 04:37:18.051009 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2583/5248] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:37:17 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:18.055868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d8a0c003-cecb-4f0b-b787-80769a84b87e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1298 microversion: 2.1 time: 0.333173 Aug 30 04:37:18.056473 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2666/5249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:17 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1298 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:18.060954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:18.070477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:18.084349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.084861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.085311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.086136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:18.086533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:18.086970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:18.124360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:18.460551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:18.479779 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6528e228-006e-4731-9938-4c9fcff76b9b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.427539 Aug 30 04:37:18.489464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2584/5250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:18 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:19.083581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:19.084359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:19.109600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.111759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.114538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.115687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.118014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.118802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.500487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:19.501827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:19.513991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.514869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.515635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.516582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:19.520278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:19.521085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:19.613806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:19.627062 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6781c62b-5299-4bca-ba4f-779a53127792 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 0.547220 Aug 30 04:37:19.632475 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2667/5251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:19 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:20.029609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:20.057482 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de08b6cb-1920-4b34-95d7-7431b837ce64 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.561037 Aug 30 04:37:20.061390 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2585/5252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:19 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:20.658809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:20.660201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:20.700122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:20.704921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:20.707599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:20.713905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:20.716027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:20.717723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.526640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:21.536554 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64318fa8-81dc-48f5-a623-31385fb180e0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 0.882245 Aug 30 04:37:21.537161 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2668/5253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:20 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:21.554718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-eb47944f-5827-4ed5-8535-d49d323f29f7 req-c792f6cf-e2bd-4b48-99b9-03a7bed65799 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a72cf0f6-e68b-4dba-924c-40c1ef2d0b34", "tag": "61c4b5d2-c733-4c85-ae4f-62732238fe08"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:21.569930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:21.570684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:21.592463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:21.593025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:21.596329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eb47944f-5827-4ed5-8535-d49d323f29f7 req-c792f6cf-e2bd-4b48-99b9-03a7bed65799 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:21.596823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eb47944f-5827-4ed5-8535-d49d323f29f7 req-c792f6cf-e2bd-4b48-99b9-03a7bed65799 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:21.597266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eb47944f-5827-4ed5-8535-d49d323f29f7 req-c792f6cf-e2bd-4b48-99b9-03a7bed65799 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.599136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.602680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:21.607429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:21.607992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:21.651059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-eb47944f-5827-4ed5-8535-d49d323f29f7 req-c792f6cf-e2bd-4b48-99b9-03a7bed65799 service nova] Creating event network-changed:61c4b5d2-c733-4c85-ae4f-62732238fe08 for instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 on n-h1-854925-5 Aug 30 04:37:21.678134 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-eb47944f-5827-4ed5-8535-d49d323f29f7 req-c792f6cf-e2bd-4b48-99b9-03a7bed65799 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127393 Aug 30 04:37:21.678773 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2669/5254] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:22.148260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:22.159080 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6808d813-f03a-421e-a31e-e06f4bae1f36 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 1.080558 Aug 30 04:37:22.172450 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2586/5255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:21 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:22.567779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:22.568738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:22.581449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.582197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.582795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.592487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:22.593102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:22.593867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:22.998226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:23.010688 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4918c14-7577-44f4-a0b8-96b04f2ed17f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 0.448120 Aug 30 04:37:23.012031 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2670/5256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:22 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:23.190391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:23.191268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:23.207150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:23.208766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:23.209360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:23.214180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:23.214944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:23.215606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:23.545832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:23.555144 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4188ac85-c42a-412c-a3b8-d8d0c2479bc0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.370936 Aug 30 04:37:23.566802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2587/5257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:23 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:24.042433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:24.043266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:24.046542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:24.065746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:24.066523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:24.069583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:24.070745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:24.071377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:24.072649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:24.378738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:24.414544 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c1264210-10ea-473a-82a5-97f2bf404765 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 0.371068 Aug 30 04:37:24.415116 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2671/5258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:24 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:24.598547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:24.599589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:24.632879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:24.634273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:24.636724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:24.637653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:24.641837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:24.642474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:24.936904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:24.945224 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-051158a6-aa78-4c28-9982-f6e24ca8f26e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.352573 Aug 30 04:37:24.945850 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2588/5259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:24 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:25.442307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:25.443694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:25.445875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:25.448019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:25.477795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:25.482644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:25.486391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:25.490757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:25.491470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:25.492722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:25.826392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:25.840220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26c9aebd-9097-4bb7-b4e9-15e1b546f325 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 0.402342 Aug 30 04:37:25.842225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2672/5260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:25 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:25.971129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:25.972681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:25.987031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:25.987867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:25.990260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:25.993639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:25.996518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:25.997840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:26.355380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:26.370804 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30b7b5ee-e317-43df-81aa-c1a53be94f2b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.402000 Aug 30 04:37:26.373432 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2589/5261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:25 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:26.870442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:26.871700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:26.905424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:26.906407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:26.907107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:26.908043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:26.913900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:26.916597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.332854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:27.344989 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b30c7f68-3c3f-49fa-b009-5e8c88993c55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 0.486969 Aug 30 04:37:27.362020 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2673/5262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:26 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:27.398602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:27.399905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:27.421618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:27.422312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:27.423028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.426561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:27.434549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:27.435307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:27.820327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:27.840183 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11be41ec-a15f-4604-b5cf-ba79d5013b19 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.445386 Aug 30 04:37:27.856529 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2590/5263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:27 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:28.377101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:28.378976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:28.396953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.402164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.403130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.404497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.405531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.418258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.757389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:28.775409 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8aafe72f-2da6-4f5e-a9fc-0a99244d8915 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 0.403222 Aug 30 04:37:28.777745 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2674/5264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:28 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:28.864262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:28.866024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:28.868541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=10 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:28.888205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.890982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.893050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:28.895967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:28.898353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:28.899061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:29.284871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:29.314673 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7ba31da-c6f7-425c-b966-19a9d1982863 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1508 microversion: 2.1 time: 0.435759 Aug 30 04:37:29.314673 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2591/5265] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:28 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1508 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:29.799480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:29.800713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:29.821414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:29.825176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:29.826122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:29.830187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:29.831609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:29.832731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:29.864672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-bb6646b7-fbe9-450e-9344-6c428cd62de1 req-8281e353-5096-4658-a104-816f35c976df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72cf0f6-e68b-4dba-924c-40c1ef2d0b34", "name": "network-vif-plugged", "status": "completed", "tag": "61c4b5d2-c733-4c85-ae4f-62732238fe08"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:29.901694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bb6646b7-fbe9-450e-9344-6c428cd62de1 req-8281e353-5096-4658-a104-816f35c976df service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:29.902209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bb6646b7-fbe9-450e-9344-6c428cd62de1 req-8281e353-5096-4658-a104-816f35c976df service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:29.906086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bb6646b7-fbe9-450e-9344-6c428cd62de1 req-8281e353-5096-4658-a104-816f35c976df service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:29.955404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-bb6646b7-fbe9-450e-9344-6c428cd62de1 req-8281e353-5096-4658-a104-816f35c976df service nova] Creating event network-vif-plugged:61c4b5d2-c733-4c85-ae4f-62732238fe08 for instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 on n-h1-854925-5 Aug 30 04:37:30.014374 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-bb6646b7-fbe9-450e-9344-6c428cd62de1 req-8281e353-5096-4658-a104-816f35c976df service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138309 Aug 30 04:37:30.015073 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2592/5266] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:30.028820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:30.030928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:30.077720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:30.100164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:30.106812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.114132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:30.115019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:30.115689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.224777 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-618d70b5-6467-43fa-95a7-d27e1755300c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/ips" status: 200 len: 146 microversion: 2.1 time: 0.203110 Aug 30 04:37:30.226687 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2593/5267] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:37:30 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/ips => generated 146 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:30.329225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:30.330823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:30.351400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:30.353129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:30.358305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.359814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:30.363956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:30.364906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:30.840136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:30.856885 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ccdee68f-c574-4df3-8d4d-0848061b6854 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1505 microversion: 2.1 time: 0.534873 Aug 30 04:37:30.871611 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2594/5268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:30 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:30.915149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:30.927024 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6b5d3ede-4f77-406a-a2f5-ad9859c361d9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 1.132694 Aug 30 04:37:30.928098 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2675/5269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:29 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:31.892585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:31.894091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:31.917201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.941044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.948565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:31.950077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:31.951701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:31.955158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.955821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.956584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:31.961856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.969698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.970796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:31.974770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:31.976951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:31.977682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:32.984922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:32.999121 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f1df0f5-6afa-430e-a7e7-4963f8dce969 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1505 microversion: 2.1 time: 1.120626 Aug 30 04:37:33.003995 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2595/5270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:31 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1505 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:33.007320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:33.015775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:33.026431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41892d93-ed29-48c8-9fb6-db1f19008d81 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1328 microversion: 2.1 time: 1.079718 Aug 30 04:37:33.031577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2676/5271] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:31 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1328 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:33.085501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7c687bff-f2cf-41aa-a834-e0b9b061c72a req-a450a046-47e5-417a-958f-ad7ca5a789d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97b7270-6031-45c5-899e-49bb678ea711", "name": "network-vif-unplugged", "status": "completed", "tag": "d67848d5-bf47-41fc-959f-a1f15a3d4f67"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:33.108753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7c687bff-f2cf-41aa-a834-e0b9b061c72a req-a450a046-47e5-417a-958f-ad7ca5a789d7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:33.111376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7c687bff-f2cf-41aa-a834-e0b9b061c72a req-a450a046-47e5-417a-958f-ad7ca5a789d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:33.112070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7c687bff-f2cf-41aa-a834-e0b9b061c72a req-a450a046-47e5-417a-958f-ad7ca5a789d7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:33.161291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7c687bff-f2cf-41aa-a834-e0b9b061c72a req-a450a046-47e5-417a-958f-ad7ca5a789d7 service nova] Creating event network-vif-unplugged:d67848d5-bf47-41fc-959f-a1f15a3d4f67 for instance f97b7270-6031-45c5-899e-49bb678ea711 on n-h2-854925-5 Aug 30 04:37:33.191247 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7c687bff-f2cf-41aa-a834-e0b9b061c72a req-a450a046-47e5-417a-958f-ad7ca5a789d7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110565 Aug 30 04:37:33.196822 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2596/5272] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:34.031168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:34.032287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:34.044494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:34.044989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:34.054991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:34.056255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:34.064120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:34.071113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:34.073614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:34.083478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:34.084001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:34.084429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:34.085142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:34.086121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:34.109430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:34.109946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:34.905109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:34.919981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be2f723c-99ac-4bdd-b481-877f236933a9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1505 microversion: 2.1 time: 0.893002 Aug 30 04:37:34.924122 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2677/5273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:34 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1505 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:34.997025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:35.028200 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-50d0611e-7db4-46ca-a1b3-ffa504fee27c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1509 microversion: 2.1 time: 0.977069 Aug 30 04:37:35.028831 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2597/5274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:34 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1509 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:35.052772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:35.053530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:35.066897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.067851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.069254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:35.070054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.070523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.070959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:35.384190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5887c6c-0f03-4923-987f-03db297e91f5"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:35.388039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:35.421613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.423557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.428234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:35.430460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.433686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.434391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:35.567057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:35.578601 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8805e51b-9b3d-4f85-9bbb-3fd5c36024d1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1509 microversion: 2.1 time: 0.529957 Aug 30 04:37:35.587783 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2678/5275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:35 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1509 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:35.616316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:35.616841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:35.646554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.647925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.662122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:35.664431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.665223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.666363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:35.763912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:37:35.954887 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6779a3c6-d4a7-4ec7-9918-aaa1732bfa4c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 204 len: 0 microversion: 2.1 time: 0.353196 Aug 30 04:37:35.955682 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2679/5276] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:37:35 2022] DELETE /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:37:35.961398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:35.966891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:35.988216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.994670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.996384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:35.997157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:35.997652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:35.998777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:36.074279 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e0188db2-f17d-4e16-924c-f536cbb392de tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.701422 Aug 30 04:37:36.074866 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2598/5277] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:37:35 2022] POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-volume_attachments => generated 194 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:36.098067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:36.098925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:36.108392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:36.108965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:36.109578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:36.113284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:36.113877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:36.114435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:36.899904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:36.918370 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-abd47c28-99b7-458d-aa29-e61116db14a2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 200 len: 1448 microversion: 2.1 time: 0.959814 Aug 30 04:37:36.920985 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2680/5278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:35 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 1448 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:36.935382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-823577555", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "f3ac4121-5fb7-4bfb-8dd8-c79d47073092"}], "key_name": "tempest-TestNetworkAdvancedServerOps-488562152", "security_groups": [{"name": "tempest-secgroup-smoke-38745981"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:36.977492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:37.002456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-caaa9761-e7d3-45ec-bca8-e11baedc3751 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1515 microversion: 2.1 time: 0.926214 Aug 30 04:37:37.002941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2599/5279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:36 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1515 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:37.023302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:37.043046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:37.066557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:37.068085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:37.068584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:37.072725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:37.081760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:37.085320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:37.086051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:37.183691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] validate_networks() for [('f3ac4121-5fb7-4bfb-8dd8-c79d47073092', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:37:38.232352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:38.240536 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b1800eb-0c2b-4d17-b829-5a3fc0c0f9b3 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 1.227448 Aug 30 04:37:38.241380 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2600/5280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:37 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:38.266892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:38.271678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:38.288266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:38.299283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:38.300399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:38.301357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:38.302180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:38.302767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:38.377320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:38.699488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:38.707964 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b864ef95-2405-49be-880e-84abe9d2f8db tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1515 microversion: 2.1 time: 0.461559 Aug 30 04:37:38.713748 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2601/5281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:38 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1515 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:38.726180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:38.731330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:38.755111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:38.755627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:38.756076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:38.756799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:38.757259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:38.757727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.036496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:37:39.037822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:37:39.038761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:37:39.041753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:37:39.043700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:37:39.076196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.077777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.081042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.082883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.086827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.087856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.199612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:39.228235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:39.271534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:37:39.295132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:37:39.407928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:39.419622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f7a81015-7c3f-4a5f-bcd1-90a575d32b95 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.697129 Aug 30 04:37:39.420377 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2602/5282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:38 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:39.448731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d5d74348-282c-427e-ab34-3f083c5c05a3 req-6b93e2c6-12c9-4525-ac4f-233cdcdc1d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a72cf0f6-e68b-4dba-924c-40c1ef2d0b34", "name": "network-vif-deleted", "tag": "61c4b5d2-c733-4c85-ae4f-62732238fe08"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:39.488025 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21749050-339e-43d9-a402-a0a7c67cf59a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.563364 Aug 30 04:37:39.489791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d5d74348-282c-427e-ab34-3f083c5c05a3 req-6b93e2c6-12c9-4525-ac4f-233cdcdc1d5a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.491912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d5d74348-282c-427e-ab34-3f083c5c05a3 req-6b93e2c6-12c9-4525-ac4f-233cdcdc1d5a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.493003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d5d74348-282c-427e-ab34-3f083c5c05a3 req-6b93e2c6-12c9-4525-ac4f-233cdcdc1d5a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.517384 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2681/5283] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:37:36 2022] POST /compute/v2.1/servers => generated 404 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:37:39.567464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:39.568115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:39.593578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.595414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.601658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.604884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.605750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.607028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.645604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d5d74348-282c-427e-ab34-3f083c5c05a3 req-6b93e2c6-12c9-4525-ac4f-233cdcdc1d5a service nova] Creating event network-vif-deleted:61c4b5d2-c733-4c85-ae4f-62732238fe08 for instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 on n-h1-854925-5 Aug 30 04:37:39.662476 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d5d74348-282c-427e-ab34-3f083c5c05a3 req-6b93e2c6-12c9-4525-ac4f-233cdcdc1d5a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236170 Aug 30 04:37:39.665537 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2603/5284] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:39.684452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d174669-9078-4c1c-8ddf-b48d115ab720 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:39.685651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d174669-9078-4c1c-8ddf-b48d115ab720 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:39.942530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d174669-9078-4c1c-8ddf-b48d115ab720 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:39.966646 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d174669-9078-4c1c-8ddf-b48d115ab720 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1265 microversion: 2.1 time: 0.297180 Aug 30 04:37:39.970061 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2604/5285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:39 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:39.974975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:39.975521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:39.983500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.984228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.984857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:39.985774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:39.986392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:39.986981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:40.042764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:40.043181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:40.043805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:40.044430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lazy-loading 'fault' on Instance uuid a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:37:40.152281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:40.164043 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-593222e1-d001-4db3-bc13-1961d3b31d2f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 200 len: 1318 microversion: 2.1 time: 0.189910 Aug 30 04:37:40.169924 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2605/5286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:39 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:40.223042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:40.256014 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9647ce5a-b3b9-4aec-997e-608d2933245b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.720597 Aug 30 04:37:40.258674 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2682/5287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:39 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:40.283231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:40.284023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:40.305067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:40.305976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:40.306601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:40.310495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:40.317034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:40.318145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:40.757696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:40.770385 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-827625da-a1b2-4547-bd77-aefa88f1fa55 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.490995 Aug 30 04:37:40.771550 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2606/5288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:40 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:40.799722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d96e09b-be81-4b00-871a-fe743db15441 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:40.819975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d96e09b-be81-4b00-871a-fe743db15441 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:40.820749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d96e09b-be81-4b00-871a-fe743db15441 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:40.822077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d96e09b-be81-4b00-871a-fe743db15441 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:40.892933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d96e09b-be81-4b00-871a-fe743db15441 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Going to try to stop instance {{(pid=122403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:37:40.988259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:40.988884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:41.009502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:41.010788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:41.011249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:41.012062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:41.012526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:41.012962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:41.148670 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d96e09b-be81-4b00-871a-fe743db15441 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.352797 Aug 30 04:37:41.151749 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2683/5289] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:37:40 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:41.192112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:41.196736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:41.197854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:41.200791 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ee1aa97-fb00-464f-a1c2-d2b3df22a9d2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1261 microversion: 2.1 time: 0.216355 Aug 30 04:37:41.214416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2607/5290] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:40 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:41.219384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:41.220003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:41.223021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:41.225386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:41.227567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:41.228567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:41.231262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:41.231959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:41.246834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:41.260690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:41.261158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:41.261943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:41.262490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:41.275352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:41.354701 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 HTTP/1.1 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a72cf0f6-e68b-4dba-924c-40c1ef2d0b34'} Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:37:41.370742 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:37:41.374943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:37:41.376500 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3593bbc4-4ff6-48e9-b9bd-ded9a8b9337a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 404 len: 111 microversion: 2.1 time: 0.160937 Aug 30 04:37:41.378632 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2608/5291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:41 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:37:41.405383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31432fb2-e579-4ad0-bd1e-6d7e09ff6c9b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '.version_select at 0x7fe96a078a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:41.461270 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31432fb2-e579-4ad0-bd1e-6d7e09ff6c9b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-key-2031404563" status: 202 len: 0 microversion: 2.1 time: 0.072870 Aug 30 04:37:41.462783 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2609/5292] 10.222.0.27 () {58 vars in 1209 bytes} [Tue Aug 30 04:37:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2031404563 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:41.546741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:41.559933 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19b9b3ea-9d17-46b0-9d7f-079f6cbe68a0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.396788 Aug 30 04:37:41.561053 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2684/5293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:41 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:41.792674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-855349750", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "a0a4d258-2d11-4ff7-b044-1fe1ab70ff46"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:41.952250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:37:42.234392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:42.235164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:42.250088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:42.250984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:42.255085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:42.256037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:42.257568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:42.258122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:42.471819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:42.486040 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-781038df-0fd2-496d-aa5b-7cc5d3db977e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1335 microversion: 2.1 time: 0.257682 Aug 30 04:37:42.487185 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2685/5294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:42 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1335 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:42.582181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:42.582850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:42.595526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:42.596182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:42.598195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:42.599103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:42.599749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:42.602892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:43.126742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:43.138993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1eb2f214-79ea-4a11-9f2f-449a1b49d6ea tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.560639 Aug 30 04:37:43.143717 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2686/5295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:42 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:43.207010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:37:43.207625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:37:43.208153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:37:43.208642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:37:43.209115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:37:43.225557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:43.230250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:43.232015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:43.233307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:43.233828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:43.234266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:43.261645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:37:43.270726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:37:43.313030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:37:43.316513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:37:43.440225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5f267f7d-2439-46fb-b1d4-345ca855c247 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.654034 Aug 30 04:37:43.449342 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2610/5296] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:37:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:37:43.453918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38782582-4412-4707-aa20-ae44543c0a10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:43.454546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38782582-4412-4707-aa20-ae44543c0a10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:43.509211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:43.510247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:43.518981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:43.520257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:43.520911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:43.521918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:43.522558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:43.523940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:43.608088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-38782582-4412-4707-aa20-ae44543c0a10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:43.615118 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38782582-4412-4707-aa20-ae44543c0a10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1208 microversion: 2.1 time: 0.165075 Aug 30 04:37:43.617084 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2687/5297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:43 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1208 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:43.671044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:43.681640 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0f2d1786-d75c-407c-924c-fd544349f343 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1323 microversion: 2.1 time: 0.177216 Aug 30 04:37:43.697942 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2611/5298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:43 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:44.169946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:44.171183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:44.199801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:44.215837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:44.217313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:44.218316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:44.220037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:44.221466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:44.642740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:44.643897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:44.651487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:44.652294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:44.652936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:44.653921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:44.654585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:44.655216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:44.827147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:44.849727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:44.855567 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db695c33-79fd-45fc-81d3-a1d0ab378b6d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.691042 Aug 30 04:37:44.865420 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2688/5299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:44 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:44.865718 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5c05af0d-7549-41bc-9f3f-6106baae97a9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1204 microversion: 2.1 time: 0.220763 Aug 30 04:37:44.865885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:44.873730 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2612/5300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:44 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1204 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:44.877045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:44.898021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:44.899292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:44.899935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:44.900928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:44.901604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:44.902222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:45.267441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:45.280843 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bfbb25e8-3ea1-4679-82c4-903388e1e786 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1389 microversion: 2.1 time: 0.423265 Aug 30 04:37:45.285541 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2689/5301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:44 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1389 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:45.574519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2a0fee64-d166-4bd1-8f84-04bc7cd1861b req-c4a9ffa7-b1ed-4ea8-b330-d3a2913c028f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:45.593707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2a0fee64-d166-4bd1-8f84-04bc7cd1861b req-c4a9ffa7-b1ed-4ea8-b330-d3a2913c028f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:45.595669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2a0fee64-d166-4bd1-8f84-04bc7cd1861b req-c4a9ffa7-b1ed-4ea8-b330-d3a2913c028f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:45.598426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2a0fee64-d166-4bd1-8f84-04bc7cd1861b req-c4a9ffa7-b1ed-4ea8-b330-d3a2913c028f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:45.627757 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2a0fee64-d166-4bd1-8f84-04bc7cd1861b req-c4a9ffa7-b1ed-4ea8-b330-d3a2913c028f service nova] Creating event network-changed:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h2-854925-5 Aug 30 04:37:45.637666 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2a0fee64-d166-4bd1-8f84-04bc7cd1861b req-c4a9ffa7-b1ed-4ea8-b330-d3a2913c028f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067146 Aug 30 04:37:45.641237 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2613/5302] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:45.880200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:45.881050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:45.883965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:45.884265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:45.895723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:45.896215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:45.896656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:45.897420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:45.900541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:45.903433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:45.922280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:45.923025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:45.924138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:45.926751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:45.932254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:45.932993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:46.063945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:46.075253 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e004295-6a10-4d59-9cc7-d3d86a416831 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1266 microversion: 2.1 time: 0.197695 Aug 30 04:37:46.075996 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2614/5303] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:45 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:46.315531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:46.316278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:46.329773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:46.330196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:46.330635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:46.331352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:46.331837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:46.335595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:46.555531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:46.565898 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af932831-f3eb-4c67-86d0-bb6fae04c17a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.690831 Aug 30 04:37:46.584604 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2690/5304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:45 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:46.686830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:46.696886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6ac3f62b-ca93-415a-86e6-731c436c359d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1389 microversion: 2.1 time: 0.394483 Aug 30 04:37:46.701712 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2615/5305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:46 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1389 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:47.097952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:47.098666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:47.107794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.108379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.108891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.109745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.110404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.110958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.438433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:47.451899 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea05e7fd-99aa-4cbf-b60c-f6f67dc73679 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.357787 Aug 30 04:37:47.468005 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2691/5306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:47 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:47.593315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:47.593993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:47.605640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.606136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.606574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.611038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.611578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.612030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.724844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:47.725712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:47.738887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.739389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.742243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.744758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:47.745350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:47.747059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:47.812659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:48.161821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:48.205235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:48.231611 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f7c903a-5f07-4d08-91c3-cbede7a5a95b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1389 microversion: 2.1 time: 0.509236 Aug 30 04:37:48.233106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d35b003-99d8-4c1f-9971-f705af66e770 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.644287 Aug 30 04:37:48.251219 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2692/5307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:47 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1389 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:48.251817 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2616/5308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:47 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:48.473984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:48.474754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:48.483591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:48.488187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:48.488648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:48.493441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:48.494241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:48.494891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:48.852428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-607d19fd-bdc0-46d6-9ded-5cae3aae71c7 req-bf5ee6fb-083a-4492-a8b1-69feb94e296f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010dd0eb-3a66-47a1-adea-743a8fc880df", "tag": "3dfd7fb6-3ddb-4772-b548-0e3f6ba919cb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:48.877201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-607d19fd-bdc0-46d6-9ded-5cae3aae71c7 req-bf5ee6fb-083a-4492-a8b1-69feb94e296f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:48.879330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-607d19fd-bdc0-46d6-9ded-5cae3aae71c7 req-bf5ee6fb-083a-4492-a8b1-69feb94e296f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:48.879781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-607d19fd-bdc0-46d6-9ded-5cae3aae71c7 req-bf5ee6fb-083a-4492-a8b1-69feb94e296f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:48.920415 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-607d19fd-bdc0-46d6-9ded-5cae3aae71c7 req-bf5ee6fb-083a-4492-a8b1-69feb94e296f service nova] Creating event network-changed:3dfd7fb6-3ddb-4772-b548-0e3f6ba919cb for instance 010dd0eb-3a66-47a1-adea-743a8fc880df on n-h1-854925-5 Aug 30 04:37:48.931075 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-607d19fd-bdc0-46d6-9ded-5cae3aae71c7 req-bf5ee6fb-083a-4492-a8b1-69feb94e296f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083694 Aug 30 04:37:48.937132 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2617/5309] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:37:49.147603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:49.167742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:49.179781 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b343457-396a-4bac-a4c4-374e83e148fc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.709574 Aug 30 04:37:49.196150 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2693/5310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:48 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:49.257013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:49.257871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:49.271004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:49.271235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:49.271832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:49.272179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:49.275594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:49.276399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:49.276939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:49.279500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:49.279918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:49.280332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:49.280521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:49.281025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:49.293818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:49.294381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:49.615833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:49.629703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:49.630718 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-87e0d472-8b67-4313-8b4f-ba59ec4985e4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.379007 Aug 30 04:37:49.643325 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2618/5311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:49 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:49.653634 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27ec2d6f-6c37-4c3d-a379-402ec437e37e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1389 microversion: 2.1 time: 0.386353 Aug 30 04:37:49.655959 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2694/5312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:49 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1389 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:50.205407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:50.206962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:50.216422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:50.217112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:50.217781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:50.218813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:50.220204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:50.220823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:50.439224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:50.451624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-060848fe-5401-4dcd-80e1-f5c1dc34e181 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.249955 Aug 30 04:37:50.466927 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2619/5313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:50 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:50.659095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:50.660336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:50.675707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:50.676329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:50.682417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:50.682911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:50.683354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:50.689593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:50.690802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:50.691553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:50.700895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:50.702553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:50.703970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:50.705801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:50.706735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:50.707426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:51.042127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:51.052199 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-95c5c83b-3283-493c-874b-f3dd5e4eea30 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1389 microversion: 2.1 time: 0.380342 Aug 30 04:37:51.057482 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2620/5314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:50 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1389 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:51.106467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:51.115702 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ae31970-6ead-49e4-8875-e8faaf02327e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.462963 Aug 30 04:37:51.117094 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2695/5315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:50 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:51.474527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:51.475254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:51.484935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:51.485791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:51.486430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:51.487328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:51.487978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:51.488603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:51.652174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:51.661923 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f1bff07-e2f7-440e-bcf3-d23850d500c8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.191158 Aug 30 04:37:51.662982 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2621/5316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:51 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:52.084028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:52.084658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:52.097045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.097591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.098026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.098752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.099217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.099656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.141716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:52.147860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:52.161165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.161165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.161165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.169520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.170132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.170649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.321155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:52.332470 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47851b92-fbe3-49e0-aabb-ca47d57718fd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1389 microversion: 2.1 time: 0.252271 Aug 30 04:37:52.333750 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2696/5317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:52 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1389 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:52.416969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:52.427165 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dd8cbb79-601d-44b2-b2e1-6faf7dd1e799 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1678 microversion: 2.1 time: 0.292279 Aug 30 04:37:52.427950 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2622/5318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:52 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:52.456391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-68952866-6fcb-437b-8025-23390a55f108 req-19d011a5-4f6f-4c4d-b311-192b923752f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "name": "network-vif-plugged", "status": "completed", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:52.471131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-68952866-6fcb-437b-8025-23390a55f108 req-19d011a5-4f6f-4c4d-b311-192b923752f8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.471828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-68952866-6fcb-437b-8025-23390a55f108 req-19d011a5-4f6f-4c4d-b311-192b923752f8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.472274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-68952866-6fcb-437b-8025-23390a55f108 req-19d011a5-4f6f-4c4d-b311-192b923752f8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.487332 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-68952866-6fcb-437b-8025-23390a55f108 req-19d011a5-4f6f-4c4d-b311-192b923752f8 service nova] Creating event network-vif-plugged:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h2-854925-5 Aug 30 04:37:52.493717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-68952866-6fcb-437b-8025-23390a55f108 req-19d011a5-4f6f-4c4d-b311-192b923752f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041792 Aug 30 04:37:52.495005 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2697/5319] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:52.684846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:52.685548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:52.697031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.697031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.697031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.701988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:52.702674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:52.703334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:52.709552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:52.912791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:52.927617 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-291e422e-d335-4223-a575-34c8c28d275b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.247351 Aug 30 04:37:52.928801 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2623/5320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:52 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:53.356159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:53.360567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:53.369106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:53.369847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:53.370255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:53.371096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:53.371615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:53.372102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:53.456288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:53.461089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:53.468277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:53.470060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:53.482275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:53.483805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:53.488217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:53.489463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:53.490623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:53.491954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:53.587352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:53.599528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d2e47734-94e8-4b52-ab26-b6606fd293de tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1389 microversion: 2.1 time: 0.248075 Aug 30 04:37:53.600307 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2698/5321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:53 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1389 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:53.870951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:53.880038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac62a1a8-a3eb-4fd0-a81f-21507f850423 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1655 microversion: 2.1 time: 0.430737 Aug 30 04:37:53.891665 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2624/5322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:53 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1655 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:53.927150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-acd68275-f736-4d20-b65a-c2c2db82888a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:53.934725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:53.936761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acd68275-f736-4d20-b65a-c2c2db82888a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:53.937749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acd68275-f736-4d20-b65a-c2c2db82888a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:53.940459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-acd68275-f736-4d20-b65a-c2c2db82888a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:53.952162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:53.952981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:53.977667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-acd68275-f736-4d20-b65a-c2c2db82888a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Going to try to start instance {{(pid=122403) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:37:53.997936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:53.999882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.000346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.001145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.003622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.004077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.075317 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-acd68275-f736-4d20-b65a-c2c2db82888a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.163409 Aug 30 04:37:54.076257 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2699/5323] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:37:53 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:54.104462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:54.105546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:54.133237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:54.135844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.136464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.137155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.138094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.138703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.139292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.278022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:54.287058 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5e1a5a99-fde6-49f6-b438-2ac91c710766 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.340912 Aug 30 04:37:54.300616 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2625/5324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:53 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:54.407367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:54.420501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3dc7c825-499d-4ec8-a5c8-0399caa68a0a tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1664 microversion: 2.1 time: 0.337907 Aug 30 04:37:54.425873 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2700/5325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:54 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1664 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:54.621435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:54.622053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:54.633566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.634059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.635242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:54.636138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:54.638073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:54.638742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.005804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:55.016739 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a58f602-2653-4360-9296-90c488adf1e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1560 microversion: 2.1 time: 0.397748 Aug 30 04:37:55.018836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2626/5326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:54 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1560 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:55.040241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:55.040982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:55.051213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.051900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.052635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.053805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.054509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.055236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.192224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-031a89e4-daf1-4afa-bbbb-ed6ef9adc6ec tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:55.213799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-031a89e4-daf1-4afa-bbbb-ed6ef9adc6ec tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.216442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-031a89e4-daf1-4afa-bbbb-ed6ef9adc6ec tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.217177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-031a89e4-daf1-4afa-bbbb-ed6ef9adc6ec tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.281954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-031a89e4-daf1-4afa-bbbb-ed6ef9adc6ec tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Going to try to stop instance {{(pid=122402) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:37:55.342378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:55.359931 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a30747c-003d-40e2-85fd-f42bd88720a0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1560 microversion: 2.1 time: 0.325759 Aug 30 04:37:55.361014 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2701/5327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:55 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1560 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:55.366522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:55.367149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:55.374549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.375041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.375597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.378222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.378701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.379376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.403586 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-031a89e4-daf1-4afa-bbbb-ed6ef9adc6ec tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action" status: 202 len: 0 microversion: 2.1 time: 0.221614 Aug 30 04:37:55.404214 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2627/5328] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:37:55 2022] POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:55.425526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:55.436387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:55.461816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.462313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.462753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.463770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.464215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.470224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.642678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:55.658037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5aafbce-953f-4a52-821d-088398e35e35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.295577 Aug 30 04:37:55.659240 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2702/5329] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:55 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:55.666072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:55.666693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:55.683346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.687412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.688164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.690160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:55.692103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:55.693483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:55.805456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:55.816871 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-94ebff61-da7e-4664-856e-3f9c5ca7ed40 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.406677 Aug 30 04:37:55.826212 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2628/5330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:55 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:55.918514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:55.932923 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5302e12-1dad-4868-87a7-9eda80080d7b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1664 microversion: 2.1 time: 0.272640 Aug 30 04:37:55.934301 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2703/5331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:55 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1664 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:56.690192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:56.694533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:56.724998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.729578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.743104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:56.746696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.747784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.748243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:56.847767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:56.858509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:56.879922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.881048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.881758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:56.883174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:56.889267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:56.890144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.138035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:57.149737 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9dd45099-3bd2-4f62-b692-959063ad40fd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.472273 Aug 30 04:37:57.150940 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2629/5332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:56 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:57.171953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:57.173816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:57.191049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.193851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.194618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.199072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.199890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.202007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.353547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:57.365077 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8da20f05-b44d-49c1-910a-311a48f4ad14 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.525791 Aug 30 04:37:57.365717 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2704/5333] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:56 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:37:57.579242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:57.592631 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c2594d8-7d38-4b65-8093-ecd80029c12f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.428478 Aug 30 04:37:57.593914 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2630/5334] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:57 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:57.613017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:57.613950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:57.626432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.630056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.630769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.632440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.633107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.633885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.683298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ef009128-6754-4860-8716-8b127c48012c req-379d9b17-e934-41e4-a65e-d9c50e4d689b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010dd0eb-3a66-47a1-adea-743a8fc880df", "name": "network-vif-plugged", "status": "completed", "tag": "3dfd7fb6-3ddb-4772-b548-0e3f6ba919cb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:57.725033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef009128-6754-4860-8716-8b127c48012c req-379d9b17-e934-41e4-a65e-d9c50e4d689b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.725653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef009128-6754-4860-8716-8b127c48012c req-379d9b17-e934-41e4-a65e-d9c50e4d689b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.726083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef009128-6754-4860-8716-8b127c48012c req-379d9b17-e934-41e4-a65e-d9c50e4d689b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:57.762496 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ef009128-6754-4860-8716-8b127c48012c req-379d9b17-e934-41e4-a65e-d9c50e4d689b service nova] Creating event network-vif-plugged:3dfd7fb6-3ddb-4772-b548-0e3f6ba919cb for instance 010dd0eb-3a66-47a1-adea-743a8fc880df on n-h1-854925-5 Aug 30 04:37:57.769138 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ef009128-6754-4860-8716-8b127c48012c req-379d9b17-e934-41e4-a65e-d9c50e4d689b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105415 Aug 30 04:37:57.770285 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2631/5335] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:57.935760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:57.946711 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36107343-94fe-4dbb-99a8-57ea3c8d9163 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.337441 Aug 30 04:37:57.948339 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2705/5336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:57 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:57.982257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:57.983016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:57.997789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:57.998296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:57.999865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.001859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.003053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.003505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.171442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:58.172206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:58.182947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.183445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.183888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.184618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.185070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.192479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.257357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:58.275398 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82e51a79-7894-4bfd-9f55-fbad4c305d54 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.298414 Aug 30 04:37:58.276650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2632/5337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:57 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:58.300867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:58.301595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:58.327016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.327580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.328286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.329689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.330318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.330764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.554069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:58.569149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-50ad2eba-9988-4223-bd4a-62390882bad7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.401841 Aug 30 04:37:58.573640 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2706/5338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:58 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:58.584461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:58.586232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:58.600878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.601769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.602396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.603886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.605943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.606802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.675138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:58.691750 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1089c209-4e24-4ba1-959e-4392ca322a91 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.395493 Aug 30 04:37:58.694433 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2633/5339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:58 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:58.717460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:58.718485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:58.737163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.738784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.739622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.740816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:58.741288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:58.741751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:58.966306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:58.987427 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd9a36e1-501e-4f36-8235-118804cbb0f5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.411347 Aug 30 04:37:58.989511 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2707/5340] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:58 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:59.004769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:59.020397 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-40bd1b8e-e3aa-425b-bfe1-37b0f9b01e56 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.308280 Aug 30 04:37:59.023349 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2634/5341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:58 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:59.044537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:59.045576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:59.056448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.057019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.062523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.063652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.064140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.068803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.119471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lazy-loading 'flavor' on Instance uuid f1310d5f-398b-4587-815e-e3ffdecafdf5 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:37:59.132550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:37:59.147938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:59.148713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:59.174354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.174875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.180194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.183890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.184388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.193314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.342013 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ef33d7e-caa5-4dc3-856d-2636c1c439e6 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.303568 Aug 30 04:37:59.344026 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2708/5342] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:37:59 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:37:59.355877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cda7f508-c864-4b98-897c-a855a9d875ae req-7bfb46a8-db88-4907-bbfc-bcc643d066e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:37:59.379756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cda7f508-c864-4b98-897c-a855a9d875ae req-7bfb46a8-db88-4907-bbfc-bcc643d066e2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.381127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cda7f508-c864-4b98-897c-a855a9d875ae req-7bfb46a8-db88-4907-bbfc-bcc643d066e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.382607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cda7f508-c864-4b98-897c-a855a9d875ae req-7bfb46a8-db88-4907-bbfc-bcc643d066e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.400221 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cda7f508-c864-4b98-897c-a855a9d875ae req-7bfb46a8-db88-4907-bbfc-bcc643d066e2 service nova] Creating event network-changed:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h2-854925-5 Aug 30 04:37:59.409469 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cda7f508-c864-4b98-897c-a855a9d875ae req-7bfb46a8-db88-4907-bbfc-bcc643d066e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062642 Aug 30 04:37:59.411227 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2709/5343] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:37:59.443107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:59.445072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:59.456094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.457118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.457853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.459872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.461492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.462282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.541830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:59.553943 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b5f990dc-d638-466b-ac70-b3860e4590dd tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1560 microversion: 2.1 time: 0.410494 Aug 30 04:37:59.554840 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2635/5344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:59 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1560 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:59.592211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:37:59.592841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:37:59.607392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.607892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.608339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.609058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:37:59.609637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:37:59.610295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:37:59.941552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:59.954391 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6ec07b7-f48b-434b-8f2b-31080f2b2097 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1676 microversion: 2.1 time: 0.541550 Aug 30 04:37:59.955012 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2710/5345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:59 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1676 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:37:59.981746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:37:59.992965 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6596c38b-a085-47f3-aa71-dadd81842d68 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1308 microversion: 2.1 time: 0.403491 Aug 30 04:37:59.993904 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2636/5346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:37:59 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:00.011616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:00.012884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:00.048905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:00.052926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:00.056021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:00.057128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:00.058349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:00.059383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:00.502865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:00.533744 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b8284277-741b-4392-aecb-35ee6659a838 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.526997 Aug 30 04:38:00.549898 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2711/5347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:00 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:00.980976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:00.985146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:01.006481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.007058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.007417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.018850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:01.021651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:01.037466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.038126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.041739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.046391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.049447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.049925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.054676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.055445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.059625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.543304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:01.554587 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32df154f-6814-43ad-b56c-03f9a7221549 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1676 microversion: 2.1 time: 0.578995 Aug 30 04:38:01.555447 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2637/5348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:00 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1676 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:01.568043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:01.568847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:01.582609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.583104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.583542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.584250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:01.584700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:01.588136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:01.591280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:01.616187 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f120f80e-04e2-4f9d-a87d-f7ccab238bae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1488 microversion: 2.1 time: 0.599627 Aug 30 04:38:01.617451 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2712/5349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:01 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1488 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:01.850275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-855349750", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "a0a4d258-2d11-4ff7-b044-1fe1ab70ff46"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:01.874390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:01.888196 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-60e9e637-79e2-40c3-b454-5ce7b37b92e5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.323627 Aug 30 04:38:01.889008 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2638/5350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:01 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:01.968106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:38:02.581268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:02.582505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:02.584870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:38:02.585304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:38:02.589461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:38:02.589809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:38:02.590237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:38:02.595403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.596209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.596935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.598010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.598683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.599580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.607780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.609121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.609940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.611193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.612162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.612598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.630196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:02.654316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:02.663448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:02.688197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:38:02.691047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:38:02.758417 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dbf643b8-4d52-4b06-a3a7-f805d9a8f233 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.912616 Aug 30 04:38:02.759470 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2713/5351] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:38:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:38:02.772871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7efe3f4f-a90b-4623-ba58-8ad689dee140 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:02.775133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7efe3f4f-a90b-4623-ba58-8ad689dee140 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:02.833119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:02.845956 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e15622ef-86e0-4a04-9c1b-e04cd89928df tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1659 microversion: 2.1 time: 0.272069 Aug 30 04:38:02.861424 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2639/5352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:02 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1659 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:02.868335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:02.869742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:02.883534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:02.885343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.889668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.890167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.890924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.891397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.892195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.917837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7efe3f4f-a90b-4623-ba58-8ad689dee140 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:02.928950 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7efe3f4f-a90b-4623-ba58-8ad689dee140 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1208 microversion: 2.1 time: 0.162312 Aug 30 04:38:02.930526 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2714/5353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:02 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1208 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:02.943269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:02.945518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:02.965365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.965840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.969756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:02.971551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:02.972772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:02.973985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.119327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12f24eda-fb66-41a4-a6d6-1034d2d3751c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action" status: 202 len: 0 microversion: 2.1 time: 0.253874 Aug 30 04:38:03.123620 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2640/5354] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:38:02 2022] POST /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:38:03.139312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:03.143271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:03.170599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.176642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.177100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.177880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.178343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.178773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.361660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:03.375554 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-de3265f1-5f63-4c9c-9d0a-ab0d6e9742cd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.441718 Aug 30 04:38:03.387762 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2715/5355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:02 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:03.615401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:03.629757 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fe7cc918-f02c-4d3c-9415-4c10b1f93e20 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1665 microversion: 2.1 time: 0.504159 Aug 30 04:38:03.631182 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2641/5356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:03 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1665 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:03.962332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:03.963069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:03.977561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.978550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.979460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:03.982045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:03.983314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:03.985244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.083168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:04.095518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4ba1153-adc5-415b-82f0-5e3ec313dc35 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1204 microversion: 2.1 time: 0.138568 Aug 30 04:38:04.098244 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2716/5357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:03 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1204 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:04.401901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:04.402648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:04.423016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.424567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.427512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.428716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.429953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.430417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.655622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:04.656647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:04.672834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.674303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.675148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.677270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:04.680355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:04.681038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:04.827504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:04.842825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-29958090-ab4b-4d9a-86e6-2cf19a120703 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.445164 Aug 30 04:38:04.859599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2642/5358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:04 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:05.012814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:05.028135 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-15d353c3-3673-4393-b7e8-dc05fcf351f5 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1665 microversion: 2.1 time: 0.379839 Aug 30 04:38:05.029540 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2717/5359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:04 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1665 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:05.124892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:05.125925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:05.137627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.138903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.142877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.145213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.146535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.147241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.302720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:05.314564 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45101dc7-183c-4e27-8857-d8fa29e14b9c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1278 microversion: 2.1 time: 0.193812 Aug 30 04:38:05.325986 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2643/5360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:05 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:05.871289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:05.872304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:05.884542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.894049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.906331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:05.913841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:05.915669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:05.919959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.052019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:06.052709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:06.071302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.071805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.072791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.073526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.073984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.074407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.300329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:06.316624 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f39cb383-a296-43c4-9da2-f53d6d0cd373 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.450042 Aug 30 04:38:06.317891 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2718/5361] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:05 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:06.344976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:06.345908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:06.352744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.354071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.354680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.355537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.356335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.356945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.611547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:06.623026 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1ec6546-c115-4e16-837e-93428fce0fc2 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.576169 Aug 30 04:38:06.624113 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2644/5362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:06 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:06.646729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:06.647748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:06.657878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.658557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.659154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.660180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.660792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.661626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.689937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:06.700024 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7dac8856-602b-43a5-86f3-7780ae97d9da tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.358548 Aug 30 04:38:06.714853 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2719/5363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:06 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:06.893959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:06.924203 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0d7da21c-0531-4be8-981d-dedee3ecc986 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1668 microversion: 2.1 time: 0.283800 Aug 30 04:38:06.938561 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2645/5364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:06 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1668 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:06.948883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:06.949651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:06.961248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.962024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.963139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.964342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:06.964952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:06.965584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:06.995545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:07.002755 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.compute.api [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Working on deleting snapshot 7842aee2-a858-4c99-929b-dbbba19f0f44 from shelved instance... Aug 30 04:38:07.343294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:07.343911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:07.351920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.352410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.355429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.356488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.359929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.360381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.658867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:07.667950 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d0ef72b5-1f4e-45eb-9dff-ec09ea021bb5 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.328440 Aug 30 04:38:07.671654 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2646/5365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:07 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:07.689071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6c1373d1-8839-42eb-81e3-3c085ec0790b req-107a29af-6334-4b68-b8aa-877b26f4b6ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973", "tag": "bf48ebbf-0367-465a-be6c-453e334b1b1e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:07.701446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6c1373d1-8839-42eb-81e3-3c085ec0790b req-107a29af-6334-4b68-b8aa-877b26f4b6ab service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.704938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6c1373d1-8839-42eb-81e3-3c085ec0790b req-107a29af-6334-4b68-b8aa-877b26f4b6ab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.704938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6c1373d1-8839-42eb-81e3-3c085ec0790b req-107a29af-6334-4b68-b8aa-877b26f4b6ab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.721890 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6c1373d1-8839-42eb-81e3-3c085ec0790b req-107a29af-6334-4b68-b8aa-877b26f4b6ab service nova] Creating event network-changed:bf48ebbf-0367-465a-be6c-453e334b1b1e for instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 on n-h2-854925-5 Aug 30 04:38:07.728574 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6c1373d1-8839-42eb-81e3-3c085ec0790b req-107a29af-6334-4b68-b8aa-877b26f4b6ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053241 Aug 30 04:38:07.729654 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2647/5366] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:07.735158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:07.736068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:07.744940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.746011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.747067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:07.748196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:07.748883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:07.749501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.114031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Doing local delete in cell ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) {{(pid=122403) _delete /opt/stack/nova/nova/compute/api.py:2546}} Aug 30 04:38:08.115681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.116337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.121383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.122314 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.compute.api [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 30 04:38:08.131232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] deallocate_for_instance() {{(pid=122403) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Aug 30 04:38:08.462130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:08.475378 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b8306eac-57c1-4c10-bb19-bf923085104c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.744128 Aug 30 04:38:08.488733 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2648/5367] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:07 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:08.695030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:08.696378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:08.707410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.708234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.708859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:08.710185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:08.710860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:08.711496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.000957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:09.011343 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba6d0c82-ffe0-4859-a283-0107badb90d4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.322983 Aug 30 04:38:09.022669 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2649/5368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:08 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:09.121991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Updating instance_info_cache with network_info: [] {{(pid=122403) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Aug 30 04:38:09.499153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:09.500441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:09.508532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.509282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.510011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.511153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.512531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.513279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.646781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=14,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:09.688540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:09.688654 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9ef2836-9ce9-4f35-b2b3-3cccc4fea9b8 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 204 len: 0 microversion: 2.1 time: 2.741543 Aug 30 04:38:09.691766 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2720/5369] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:06 2022] DELETE /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 0 bytes in 2743 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:09.698289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:09.699047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f97b7270-6031-45c5-899e-49bb678ea711] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:09.704171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ffacba1d-1116-44bc-882f-7f2eebc2adf6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.211480 Aug 30 04:38:09.706651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.707416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.708072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.708992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.709696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.710348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.710633 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2650/5370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:09 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:09.726200 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] HTTP exception thrown: Instance f97b7270-6031-45c5-899e-49bb678ea711 could not be found. Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Request method failure captured: Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 HTTP/1.1 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGpcbhrpGXj-iz0fwZAgXVo33oBdCfx1hxiHH9HRY546J0cCN3001a2fKGj79Y7kkYP6hUynyNXufZ6IxNIPjoHtq3JBamUpEEzVPXkIzkm7q5fFtg0tDhPpYB0EJzr9byLyAjVsXiL8XWY6ISJA4RPk9Lqn-QwSyAY_AQ9May7tII Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20b289bb6f0f45ba9e7137ee45fa2d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}] Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d4d759ef2dc64a5e8ef6e883efc13d68 Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance f97b7270-6031-45c5-899e-49bb678ea711 could not be found. Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'f97b7270-6031-45c5-899e-49bb678ea711'} Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f97b7270-6031-45c5-899e-49bb678ea711 could not be found. Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f97b7270-6031-45c5-899e-49bb678ea711 could not be found. Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:09.727989 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f97b7270-6031-45c5-899e-49bb678ea711 could not be found. Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Returning 404 to user: Instance f97b7270-6031-45c5-899e-49bb678ea711 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40e0bcd3-075c-4093-ad86-28c619a9cf42 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711" status: 404 len: 111 microversion: 2.1 time: 0.037722 Aug 30 04:38:09.734802 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2721/5371] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:09 2022] GET /compute/v2.1/servers/f97b7270-6031-45c5-899e-49bb678ea711 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:09.740593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:09.741293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:09.747687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.748553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.749287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.750183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.750827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.751499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.783735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:09.873717 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7d2a87c-6d39-4b1c-8562-723658fa7d8b tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 204 len: 0 microversion: 2.1 time: 0.136404 Aug 30 04:38:09.879083 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2651/5372] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:09 2022] DELETE /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:09.885728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:09.886578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:09.896176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.896879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.897653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:09.898575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:09.899235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:09.900744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.009821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:10.020057 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-928ce07d-187d-41a0-8170-31f3997189e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1466 microversion: 2.1 time: 0.138906 Aug 30 04:38:10.036108 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2722/5373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:09 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1466 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:10.042015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:10.042946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:10.050103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.050603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.051051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.051956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.052646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.053252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.169857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d1028ba5-d1dc-4806-adcb-2360a8f11060 req-91193753-d2a5-4d8d-8096-30d83dee6f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f97b7270-6031-45c5-899e-49bb678ea711", "name": "network-vif-deleted", "tag": "d67848d5-bf47-41fc-959f-a1f15a3d4f67"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:10.185849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d1028ba5-d1dc-4806-adcb-2360a8f11060 req-91193753-d2a5-4d8d-8096-30d83dee6f05 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.186419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d1028ba5-d1dc-4806-adcb-2360a8f11060 req-91193753-d2a5-4d8d-8096-30d83dee6f05 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.187074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d1028ba5-d1dc-4806-adcb-2360a8f11060 req-91193753-d2a5-4d8d-8096-30d83dee6f05 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.213828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.compute.server_external_events [req-d1028ba5-d1dc-4806-adcb-2360a8f11060 req-91193753-d2a5-4d8d-8096-30d83dee6f05 service nova] Unable to find a host for instance f97b7270-6031-45c5-899e-49bb678ea711. Dropping event network-vif-deleted {{(pid=122403) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 04:38:10.215661 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d1028ba5-d1dc-4806-adcb-2360a8f11060 req-91193753-d2a5-4d8d-8096-30d83dee6f05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.049797 Aug 30 04:38:10.217067 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2723/5374] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 52 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 04:38:10.226838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:10.236690 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f865001-3c40-41c6-bd42-5d25d1d3f9ea tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.204671 Aug 30 04:38:10.237284 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2652/5375] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:10 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:10.730951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:10.731675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:10.739520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.740088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.740703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.741433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:10.741889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:10.742318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:10.893634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:10.904125 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b787301-9bab-4fe6-b30a-3ad289ef6f7b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.177170 Aug 30 04:38:10.917918 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2724/5376] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:10 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:11.042344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:11.043108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:11.050213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.050928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.051368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.052068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.052514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.053106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.162739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:11.172693 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0e02d43a-4e4c-4f42-a6ae-fdebca879f76 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1466 microversion: 2.1 time: 0.134270 Aug 30 04:38:11.185732 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2653/5377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:11 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1466 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:11.257803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:11.258423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:11.266476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.267345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.268013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.268713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.269443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.270065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.489167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:11.500956 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6468df9-6f44-42ff-9337-b25a17e800ce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.246882 Aug 30 04:38:11.502357 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2725/5378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:11 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:11.926971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:11.927806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:11.935851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.936602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.937231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.938308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:11.939193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:11.939812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:11.944807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:12.136680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:12.148139 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f619bcd6-b3e2-4dd2-8865-8b3fa753c404 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.225811 Aug 30 04:38:12.149286 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2654/5379] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:11 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:12.194405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:12.195349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c33fcff1-fd3d-4222-90ab-c82939564938 req-47b66d41-c9b7-43e9-ab33-a45c8fb2023e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1e26d1-2939-40cc-9d11-cb83e40ce3e0", "name": "network-vif-deleted", "tag": "be5d78ec-8943-40a7-952a-27f27bb5e0cf"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:12.195688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:12.208854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.210860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.211718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.213188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.214114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.214859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.233233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c33fcff1-fd3d-4222-90ab-c82939564938 req-47b66d41-c9b7-43e9-ab33-a45c8fb2023e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.233774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c33fcff1-fd3d-4222-90ab-c82939564938 req-47b66d41-c9b7-43e9-ab33-a45c8fb2023e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.236785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c33fcff1-fd3d-4222-90ab-c82939564938 req-47b66d41-c9b7-43e9-ab33-a45c8fb2023e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.263222 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c33fcff1-fd3d-4222-90ab-c82939564938 req-47b66d41-c9b7-43e9-ab33-a45c8fb2023e service nova] Creating event network-vif-deleted:be5d78ec-8943-40a7-952a-27f27bb5e0cf for instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 on n-h2-854925-5 Aug 30 04:38:12.272555 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c33fcff1-fd3d-4222-90ab-c82939564938 req-47b66d41-c9b7-43e9-ab33-a45c8fb2023e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081663 Aug 30 04:38:12.273656 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2655/5380] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:12.319691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:12.329627 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5410ef3-3ce0-4cdb-a8f0-d4910fab9452 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 200 len: 1466 microversion: 2.1 time: 0.138759 Aug 30 04:38:12.333894 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2726/5381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:12 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 1466 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:12.526423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:12.528433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:12.542088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.542585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.543636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.544348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:12.544812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:12.545247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:12.740219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:12.751043 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-717f93fe-1b98-4787-a9af-c31bcce55dbc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.229025 Aug 30 04:38:12.752093 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2656/5382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:12 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:13.170473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.171211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.173273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:13.174143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:13.183781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.183781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.183781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.183781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.183781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.183781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.351332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.351953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.362995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:13.368034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.369247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.370602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.372137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.372810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.373477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfe20fa4-5a23-4b65-b49c-06e0c07b670e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.207376 Aug 30 04:38:13.373748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.374721 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2727/5383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:13 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:13.394327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] HTTP exception thrown: Instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 could not be found. Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Request method failure captured: Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 HTTP/1.1 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGpcbhrpGXj-iz0fwZAgXVo33oBdCfx1hxiHH9HRY546J0cCN3001a2fKGj79Y7kkYP6hUynyNXufZ6IxNIPjoHtq3JBamUpEEzVPXkIzkm7q5fFtg0tDhPpYB0EJzr9byLyAjVsXiL8XWY6ISJA4RPk9Lqn-QwSyAY_AQ9May7tII Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20b289bb6f0f45ba9e7137ee45fa2d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}] Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d4d759ef2dc64a5e8ef6e883efc13d68 Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 could not be found. Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0d1e26d1-2939-40cc-9d11-cb83e40ce3e0'} Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 could not be found. Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 could not be found. Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:13.396138 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 could not be found. Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Returning 404 to user: Instance 0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:13.400672 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f7fa8d8-b689-4579-adeb-1ef8815cafb7 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0" status: 404 len: 111 microversion: 2.1 time: 0.050658 Aug 30 04:38:13.402432 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2657/5384] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:13 2022] GET /compute/v2.1/servers/0d1e26d1-2939-40cc-9d11-cb83e40ce3e0 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:13.406798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.407432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.415369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.415369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.415369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.415640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.415908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.416498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.445894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:13.571437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5311723-0928-4f62-8413-45261aa411c4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 204 len: 0 microversion: 2.1 time: 0.168066 Aug 30 04:38:13.575182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2728/5385] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:13 2022] DELETE /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:13.584144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.584844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.596605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.597500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.598189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.599112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.599810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.600451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.773119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:13.783055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:13.788426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:13.789804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.790487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.791749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.792842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:13.793489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:13.794081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:13.799165 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44bab707-5355-4bc9-bc71-f02afd9038ae tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1507 microversion: 2.1 time: 0.218861 Aug 30 04:38:13.813074 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2658/5386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:13 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1507 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:13.983183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:13.992343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b891a45f-2694-4890-b6eb-26455b17eb5d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.223826 Aug 30 04:38:14.002870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2729/5387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:13 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:14.409223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:14.411866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:14.429458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.432146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.433236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.435846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.437753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.440557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.573171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-14c6482d-82ea-45de-979f-6409e549c2f7 req-63990470-8927-4d1a-a8ab-3f02f4c4b39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973", "name": "network-vif-plugged", "status": "completed", "tag": "bf48ebbf-0367-465a-be6c-453e334b1b1e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:14.602901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-14c6482d-82ea-45de-979f-6409e549c2f7 req-63990470-8927-4d1a-a8ab-3f02f4c4b39c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.603513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-14c6482d-82ea-45de-979f-6409e549c2f7 req-63990470-8927-4d1a-a8ab-3f02f4c4b39c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.604260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-14c6482d-82ea-45de-979f-6409e549c2f7 req-63990470-8927-4d1a-a8ab-3f02f4c4b39c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.625900 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-14c6482d-82ea-45de-979f-6409e549c2f7 req-63990470-8927-4d1a-a8ab-3f02f4c4b39c service nova] Creating event network-vif-plugged:bf48ebbf-0367-465a-be6c-453e334b1b1e for instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 on n-h2-854925-5 Aug 30 04:38:14.631951 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-14c6482d-82ea-45de-979f-6409e549c2f7 req-63990470-8927-4d1a-a8ab-3f02f4c4b39c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063462 Aug 30 04:38:14.633938 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2730/5388] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:14.668126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:14.683560 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c73e0afb-f80a-49cb-9707-afb9233dc93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.281026 Aug 30 04:38:14.694758 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2659/5389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:14 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:14.823390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:14.825493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:14.880635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.881153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.885727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:14.886682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:14.887293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:14.887799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.019930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:15.021083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:15.048711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.049885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.052117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.053015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.053506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.054095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:15.054407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.066156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7d6be80-0503-4bd5-a3b7-a765fb513ec4 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1507 microversion: 2.1 time: 0.246910 Aug 30 04:38:15.066771 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2731/5390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:14 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:15.230363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:15.241709 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea13f747-2776-479c-8f18-ef757a27f12f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1723 microversion: 2.1 time: 0.230877 Aug 30 04:38:15.242695 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2660/5391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:15 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:15.352694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7c50f55a-c3dd-4b9d-aa21-e6d42b2fdf56 req-353daffa-69cb-4c21-812a-1181f95c85b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d9b7611-df0f-4feb-b7e7-1b6f9b95101a", "name": "network-vif-deleted", "tag": "b73403c0-38a8-46a6-bad4-2f430f458559"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:15.364745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7c50f55a-c3dd-4b9d-aa21-e6d42b2fdf56 req-353daffa-69cb-4c21-812a-1181f95c85b1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.365520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7c50f55a-c3dd-4b9d-aa21-e6d42b2fdf56 req-353daffa-69cb-4c21-812a-1181f95c85b1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.366308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7c50f55a-c3dd-4b9d-aa21-e6d42b2fdf56 req-353daffa-69cb-4c21-812a-1181f95c85b1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.383346 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7c50f55a-c3dd-4b9d-aa21-e6d42b2fdf56 req-353daffa-69cb-4c21-812a-1181f95c85b1 service nova] Creating event network-vif-deleted:b73403c0-38a8-46a6-bad4-2f430f458559 for instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a on n-h1-854925-5 Aug 30 04:38:15.391164 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7c50f55a-c3dd-4b9d-aa21-e6d42b2fdf56 req-353daffa-69cb-4c21-812a-1181f95c85b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044751 Aug 30 04:38:15.396922 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2732/5392] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:15.708317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:15.709101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:15.718234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.720037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.720540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.721273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:15.721763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:15.725411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:15.929809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:15.939699 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b2d46c5-8388-4a23-9722-9b3bdbc13de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1308 microversion: 2.1 time: 0.236777 Aug 30 04:38:15.940305 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2661/5393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:15 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:16.093751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:16.098392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:16.106261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.106754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.107195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.108217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.108848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.109282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.145899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.146416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.147497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.148128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lazy-loading 'fault' on Instance uuid 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:38:16.207378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:16.219703 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2e0260f-e665-4e4e-934b-d74a7378eb2d tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 200 len: 1304 microversion: 2.1 time: 0.133041 Aug 30 04:38:16.220293 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2733/5394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:16 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:16.265512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:16.268914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:16.280877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.281447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.281889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.282617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.283665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.284267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.469539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:16.479256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d6e23ff8-4683-4773-ac1a-87317e0db160 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1700 microversion: 2.1 time: 0.218898 Aug 30 04:38:16.479928 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2662/5395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:16 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1700 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:16.500396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b94f37d-59a4-43f3-853b-2b257149d30a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:16.502600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:16.507494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b94f37d-59a4-43f3-853b-2b257149d30a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.508265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b94f37d-59a4-43f3-853b-2b257149d30a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.508980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b94f37d-59a4-43f3-853b-2b257149d30a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.541353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b94f37d-59a4-43f3-853b-2b257149d30a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Going to try to start instance {{(pid=122403) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:38:16.598912 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b94f37d-59a4-43f3-853b-2b257149d30a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action" status: 202 len: 0 microversion: 2.1 time: 0.102103 Aug 30 04:38:16.599519 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2734/5396] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:38:16 2022] POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:16.609104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:16.610034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:16.619263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.620340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.621584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.622854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.623623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.624465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.836245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:16.852741 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c576506-bef9-4864-a123-20c942027def tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1709 microversion: 2.1 time: 0.248688 Aug 30 04:38:16.859835 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2663/5397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:16 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1709 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:16.967341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:16.968054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:16.977018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.977547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.978045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:16.980240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:16.980883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:16.981516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.149944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:17.160010 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd4edc84-9542-46e7-9112-eeda61ecd5e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1488 microversion: 2.1 time: 0.198864 Aug 30 04:38:17.174573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2735/5398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:16 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1488 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:17.184069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.185026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.192058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.192959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.193667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.194840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.195501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.196132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.242025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.242643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.252058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.252564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.253928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.255955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.256397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.260640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.281376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:DELETE=2,nova_cell1:SELECT=90,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:17.282756 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] HTTP exception thrown: Instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a could not be found. Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Request method failure captured: Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a HTTP/1.1 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGpcbhrpGXj-iz0fwZAgXVo33oBdCfx1hxiHH9HRY546J0cCN3001a2fKGj79Y7kkYP6hUynyNXufZ6IxNIPjoHtq3JBamUpEEzVPXkIzkm7q5fFtg0tDhPpYB0EJzr9byLyAjVsXiL8XWY6ISJA4RPk9Lqn-QwSyAY_AQ9May7tII Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20b289bb6f0f45ba9e7137ee45fa2d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}] Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d4d759ef2dc64a5e8ef6e883efc13d68 Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a could not be found. Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9d9b7611-df0f-4feb-b7e7-1b6f9b95101a'} Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a could not be found. Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a could not be found. Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:17.286919 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a could not be found. Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Returning 404 to user: Instance 9d9b7611-df0f-4feb-b7e7-1b6f9b95101a could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81c10615-d87e-41f2-8f95-8c4f00b466fe tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a" status: 404 len: 111 microversion: 2.1 time: 0.050481 Aug 30 04:38:17.290819 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2736/5399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/9d9b7611-df0f-4feb-b7e7-1b6f9b95101a => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:17.308080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.320875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.336378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.342952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.343842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.344610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.345073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.347417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.401292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:17.409577 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de929271-f6f2-459b-a161-a4ea4a563f83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1488 microversion: 2.1 time: 0.230669 Aug 30 04:38:17.411530 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2664/5400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1488 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:17.420731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:17.432231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.433457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.440588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.441710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.442988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.443979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.444648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.445452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.530037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0aa33db4-97ca-4f09-91c2-026cfa0f38cf tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 204 len: 0 microversion: 2.1 time: 0.232288 Aug 30 04:38:17.533842 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2737/5401] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:17 2022] DELETE /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:17.540131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.541009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.548600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.549185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.549718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.550497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.557540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.558583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.661038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:17.673232 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3483961-bdd0-466d-b207-11addc561894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1488 microversion: 2.1 time: 0.246192 Aug 30 04:38:17.674671 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2665/5402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1488 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:17.695465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.696100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.703566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.704231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.704680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.705478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.705933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.706400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.740830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:17.767995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:17.777216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1af4a504-530a-4f7a-a6b6-488501fc39b1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1495 microversion: 2.1 time: 0.241369 Aug 30 04:38:17.777890 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2738/5403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1495 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:17.836904 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae6784c5-90a3-416b-aa90-cb7670d1403a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 204 len: 0 microversion: 2.1 time: 0.145064 Aug 30 04:38:17.837752 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2666/5404] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:17 2022] DELETE /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:38:17.851447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.852138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.863925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.864520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.865029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.865892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.866457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.866959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.884617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:17.885594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:17.898245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.900500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.901214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:17.909236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:17.910915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:17.911367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.123384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:18.135993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99956bce-d132-4313-95e9-54933cc89894 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1494 microversion: 2.1 time: 0.292681 Aug 30 04:38:18.147277 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2739/5405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1494 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:18.158288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:18.168098 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ce1eb10-17f8-431b-9ef0-b73afed153e2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1709 microversion: 2.1 time: 0.289876 Aug 30 04:38:18.168695 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2667/5406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:17 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1709 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:18.818253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:18.818817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:18.825175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.825614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.826055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:18.826750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:18.827199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:18.842685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.012209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:19.019944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19d9fedd-b813-4667-95fa-b690a482b2d1 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1495 microversion: 2.1 time: 0.219242 Aug 30 04:38:19.020867 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2740/5407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:18 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1495 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:19.160828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:19.161908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:19.170727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.171440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.172290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.173285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.174136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.174824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.189213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:19.190364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:19.198551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.199234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.199828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.200695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:19.201394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:19.202017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:19.450556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:19.468188 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ec4d516-0cc0-45d3-8b01-e763eb4bc287 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1494 microversion: 2.1 time: 0.310456 Aug 30 04:38:19.469502 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2668/5408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:19 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1494 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:19.508965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:19.520528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3438764a-670c-4e73-85fd-aa513d2acc52 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1709 microversion: 2.1 time: 0.335169 Aug 30 04:38:19.526069 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2741/5409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:19 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1709 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:20.043875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:20.044672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:20.058538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-50d1dd70-fc7c-433f-9e3c-e0ff85969668 req-2b35ff63-a288-417c-adb1-8018776c24e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2a98ffe-aaba-46a4-85f3-cb46d351ecb2", "name": "network-vif-deleted", "tag": "100bb0f7-03a4-4af9-996e-ef98d871afa6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:20.072401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.075470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.076442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.079898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.081549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.083662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.086018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-50d1dd70-fc7c-433f-9e3c-e0ff85969668 req-2b35ff63-a288-417c-adb1-8018776c24e2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.087594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-50d1dd70-fc7c-433f-9e3c-e0ff85969668 req-2b35ff63-a288-417c-adb1-8018776c24e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.088201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-50d1dd70-fc7c-433f-9e3c-e0ff85969668 req-2b35ff63-a288-417c-adb1-8018776c24e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.117297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-50d1dd70-fc7c-433f-9e3c-e0ff85969668 req-2b35ff63-a288-417c-adb1-8018776c24e2 service nova] Creating event network-vif-deleted:100bb0f7-03a4-4af9-996e-ef98d871afa6 for instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 on n-h2-854925-5 Aug 30 04:38:20.128493 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-50d1dd70-fc7c-433f-9e3c-e0ff85969668 req-2b35ff63-a288-417c-adb1-8018776c24e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075016 Aug 30 04:38:20.129384 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2742/5410] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:20.227042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:20.240391 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8e353d06-6972-442d-b09d-212fdc1692e0 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 200 len: 1286 microversion: 2.1 time: 0.201773 Aug 30 04:38:20.270288 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2669/5411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:20 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 1286 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:20.427634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-eede986c-1239-4aa9-b906-cc9af8eef2a1 req-e15b084c-2346-4e68-be26-567610584a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973", "name": "network-vif-deleted", "tag": "bf48ebbf-0367-465a-be6c-453e334b1b1e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:20.455620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eede986c-1239-4aa9-b906-cc9af8eef2a1 req-e15b084c-2346-4e68-be26-567610584a97 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.456137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eede986c-1239-4aa9-b906-cc9af8eef2a1 req-e15b084c-2346-4e68-be26-567610584a97 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.456578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-eede986c-1239-4aa9-b906-cc9af8eef2a1 req-e15b084c-2346-4e68-be26-567610584a97 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.489144 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-eede986c-1239-4aa9-b906-cc9af8eef2a1 req-e15b084c-2346-4e68-be26-567610584a97 service nova] Creating event network-vif-deleted:bf48ebbf-0367-465a-be6c-453e334b1b1e for instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 on n-h2-854925-5 Aug 30 04:38:20.492884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:20.494354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:20.495301 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-eede986c-1239-4aa9-b906-cc9af8eef2a1 req-e15b084c-2346-4e68-be26-567610584a97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077251 Aug 30 04:38:20.496664 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2743/5412] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:20.505760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.506261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.506848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.507569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.508355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.508796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.537455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:20.546407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:20.547595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:20.561818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.562395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.562854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.563607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:20.564069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:20.565695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:20.647405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:20.659514 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6830587-a32a-49fe-9c11-d78c2271241f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 200 len: 1293 microversion: 2.1 time: 0.172090 Aug 30 04:38:20.661603 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2670/5413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:20 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 1293 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:20.800763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:20.810852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1063f27-1fe2-4244-ab37-bb0152e0ee88 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1713 microversion: 2.1 time: 0.269789 Aug 30 04:38:20.812387 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2744/5414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:20 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1713 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:21.261967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.263532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: a2a98ffe-aaba-46a4-85f3-cb46d351ecb2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.278531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.279273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.280921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.281966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.282580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.283161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.307005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] HTTP exception thrown: Instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 could not be found. Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Request method failure captured: Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 HTTP/1.1 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZGpcbhrpGXj-iz0fwZAgXVo33oBdCfx1hxiHH9HRY546J0cCN3001a2fKGj79Y7kkYP6hUynyNXufZ6IxNIPjoHtq3JBamUpEEzVPXkIzkm7q5fFtg0tDhPpYB0EJzr9byLyAjVsXiL8XWY6ISJA4RPk9Lqn-QwSyAY_AQ9May7tII Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20b289bb6f0f45ba9e7137ee45fa2d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}] Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d4d759ef2dc64a5e8ef6e883efc13d68 Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 could not be found. Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a2a98ffe-aaba-46a4-85f3-cb46d351ecb2'} Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 could not be found. Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 could not be found. Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:21.309285 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.313439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:21.313439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:21.313439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:21.313439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:21.313439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:21.313439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 could not be found. Aug 30 04:38:21.313439 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.315542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Returning 404 to user: Instance a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:21.316762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-94570934-1a58-40d3-9634-fb317323058e tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2" status: 404 len: 111 microversion: 2.1 time: 0.059614 Aug 30 04:38:21.317312 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2671/5415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:21 2022] GET /compute/v2.1/servers/a2a98ffe-aaba-46a4-85f3-cb46d351ecb2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:21.325177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.325660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.331867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.332365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.332806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.333979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.334395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.334815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.369119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:21.460458 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e10cc9a2-86c3-46c0-9f7e-8dcb5f3ed47c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 204 len: 0 microversion: 2.1 time: 0.138451 Aug 30 04:38:21.461584 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2745/5416] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:21 2022] DELETE /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:21.471835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.472632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.479145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.479642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.480087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.480790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.481252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.481861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.637276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:21.645963 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fecc5d9b-b07b-4af0-a596-6a557039a858 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1674 microversion: 2.1 time: 0.179055 Aug 30 04:38:21.646535 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2672/5417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:21 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:21.680509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.681259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.687146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.687641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.688081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.689014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.689613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.690122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.704650 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 HTTP/1.1 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973'} Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:21.706503 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.710497 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:21.710497 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:21.710497 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:21.710497 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:21.710497 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:21.710497 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:38:21.710497 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:21.713387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:21.714638 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce87f286-ffc5-4500-9b11-7e9124d7d38c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 404 len: 111 microversion: 2.1 time: 0.038369 Aug 30 04:38:21.715309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2746/5418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:21 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:21.724111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.724815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.731495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.732099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.732544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.733232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.733718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.734211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.761031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:21.850111 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a215d47-7c82-42b2-b3df-8b70d2cf8613 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 204 len: 0 microversion: 2.1 time: 0.129646 Aug 30 04:38:21.850807 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2673/5419] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:21 2022] DELETE /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:21.859996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:21.861527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:21.870303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.870791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.871452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:21.872313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:21.873279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:21.873421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.015853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:22.024560 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d2f8365e-62e1-4b01-b1f6-7da0e22c9175 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1494 microversion: 2.1 time: 0.168695 Aug 30 04:38:22.026053 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2747/5420] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:21 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1494 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:22.359169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:22.361611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:22.368853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.369890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.370328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.371024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.371470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.371901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.436940 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-52d0f8ab-c4e1-46de-ae6b-d087c883cd03 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action" status: 200 len: 24571 microversion: 2.1 time: 0.086046 Aug 30 04:38:22.437987 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2674/5421] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:38:22 2022] POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action => generated 24571 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:38:22.667511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:22.668186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:22.675082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.675809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.676340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.677021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:22.677669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:22.678097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:22.836454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:22.845658 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5e7afbb-d9f2-4a1b-8a94-f81deac64664 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1674 microversion: 2.1 time: 0.181972 Aug 30 04:38:22.860066 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2748/5422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:22 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:23.047538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:23.048249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:23.055255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.055736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.057011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.057976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.058515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.059025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.207327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:23.222659 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-209dd908-c415-4c98-82f4-295d5f10f166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1494 microversion: 2.1 time: 0.178921 Aug 30 04:38:23.223704 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2675/5423] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:23 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1494 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:23.868321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:23.869700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:23.876937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.877718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.878209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:23.879205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:23.879672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:23.880107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.092499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:24.100669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-629e0f64-9d3b-4ba4-98bf-698975ff0887 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1674 microversion: 2.1 time: 0.236277 Aug 30 04:38:24.102008 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2749/5424] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:23 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1674 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:24.249267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:24.251062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:24.259665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:24.260173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:24.260610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.261535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:24.262155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:24.262750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:24.412320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:24.422412 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2c4e7e1-d900-4db1-b6d0-addfadeb960f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1494 microversion: 2.1 time: 0.176985 Aug 30 04:38:24.423133 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2676/5425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:24 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1494 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:25.124710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:25.125509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:25.133511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.134020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.135168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.140128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.140609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.141054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.450886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:25.451509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:25.469372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.469895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.470346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.481011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:25.481651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:25.482121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:25.862328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:25.876976 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8369618a-fe66-4751-a962-a77b8a7de95f tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1674 microversion: 2.1 time: 0.754994 Aug 30 04:38:25.888980 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2750/5426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:25 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1674 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:26.244151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c892c15a-a1e5-4fa2-a138-b191e5293ac3 req-4525de0e-f78a-4f77-beae-748561613987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010dd0eb-3a66-47a1-adea-743a8fc880df", "name": "network-vif-deleted", "tag": "3dfd7fb6-3ddb-4772-b548-0e3f6ba919cb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:26.279524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:26.288159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c892c15a-a1e5-4fa2-a138-b191e5293ac3 req-4525de0e-f78a-4f77-beae-748561613987 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:26.288649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c892c15a-a1e5-4fa2-a138-b191e5293ac3 req-4525de0e-f78a-4f77-beae-748561613987 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:26.289090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c892c15a-a1e5-4fa2-a138-b191e5293ac3 req-4525de0e-f78a-4f77-beae-748561613987 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:26.292407 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-189d0cb9-97bd-48e1-ada6-535f0203e00c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1494 microversion: 2.1 time: 0.847235 Aug 30 04:38:26.298056 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2677/5427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:25 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1494 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:26.319897 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c892c15a-a1e5-4fa2-a138-b191e5293ac3 req-4525de0e-f78a-4f77-beae-748561613987 service nova] Creating event network-vif-deleted:3dfd7fb6-3ddb-4772-b548-0e3f6ba919cb for instance 010dd0eb-3a66-47a1-adea-743a8fc880df on n-h1-854925-5 Aug 30 04:38:26.347542 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c892c15a-a1e5-4fa2-a138-b191e5293ac3 req-4525de0e-f78a-4f77-beae-748561613987 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107078 Aug 30 04:38:26.348448 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2751/5428] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:26.605220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-470f3bf6-bc7a-463c-9294-6dca26db382c req-990e2d4e-24b8-4770-879a-12443d87d905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1310d5f-398b-4587-815e-e3ffdecafdf5", "name": "network-vif-deleted", "tag": "4cec9a62-b2e8-437c-87de-8ecb2f985beb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:26.635682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-470f3bf6-bc7a-463c-9294-6dca26db382c req-990e2d4e-24b8-4770-879a-12443d87d905 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:26.636510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-470f3bf6-bc7a-463c-9294-6dca26db382c req-990e2d4e-24b8-4770-879a-12443d87d905 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:26.637023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-470f3bf6-bc7a-463c-9294-6dca26db382c req-990e2d4e-24b8-4770-879a-12443d87d905 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:26.669780 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-470f3bf6-bc7a-463c-9294-6dca26db382c req-990e2d4e-24b8-4770-879a-12443d87d905 service nova] Creating event network-vif-deleted:4cec9a62-b2e8-437c-87de-8ecb2f985beb for instance f1310d5f-398b-4587-815e-e3ffdecafdf5 on n-h1-854925-5 Aug 30 04:38:26.677098 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-470f3bf6-bc7a-463c-9294-6dca26db382c req-990e2d4e-24b8-4770-879a-12443d87d905 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079688 Aug 30 04:38:26.679191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2678/5429] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:26.906529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:26.907976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:26.921052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:26.922411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:26.923800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:26.925162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:26.926244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:26.927295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:27.006305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:27.007464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:27.008574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:27.010472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lazy-loading 'fault' on Instance uuid f1310d5f-398b-4587-815e-e3ffdecafdf5 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:38:27.021380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:27.116477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4d759ef2dc64a5e8ef6e883efc13d68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b289bb6f0f45ba9e7137ee45fa2d6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:27.139829 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-32281aa9-62d6-43a2-a2f7-fee0b9013ba9 tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 200 len: 1328 microversion: 2.1 time: 0.234869 Aug 30 04:38:27.142616 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2752/5430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:26 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 1328 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:27.320989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:27.322103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:27.333316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:27.339604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:27.341512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:27.342569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:27.343238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:27.344529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:27.406946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:27.407449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:27.407891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:27.408350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lazy-loading 'fault' on Instance uuid 010dd0eb-3a66-47a1-adea-743a8fc880df {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:38:27.460249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:27.469243 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-831162bc-5984-4c73-bb9f-ed2f0dbb40a4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 200 len: 1298 microversion: 2.1 time: 0.153401 Aug 30 04:38:27.469828 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2679/5431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:27 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:28.161640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:28.162290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] [instance: f1310d5f-398b-4587-815e-e3ffdecafdf5] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:28.169450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:28.169939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:28.170386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:28.171077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:28.171727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:28.172322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:28.187501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] HTTP exception thrown: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 could not be found. Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Request method failure captured: Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 HTTP/1.1 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZGpcbhrpGXj-iz0fwZAgXVo33oBdCfx1hxiHH9HRY546J0cCN3001a2fKGj79Y7kkYP6hUynyNXufZ6IxNIPjoHtq3JBamUpEEzVPXkIzkm7q5fFtg0tDhPpYB0EJzr9byLyAjVsXiL8XWY6ISJA4RPk9Lqn-QwSyAY_AQ9May7tII Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_20b289bb6f0f45ba9e7137ee45fa2d6b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/20b289bb6f0f45ba9e7137ee45fa2d6b"}]}] Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 20b289bb6f0f45ba9e7137ee45fa2d6b Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-832097908 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d4d759ef2dc64a5e8ef6e883efc13d68 Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-832097908-project Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 could not be found. Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'f1310d5f-398b-4587-815e-e3ffdecafdf5'} Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 could not be found. Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 could not be found. Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:28.189547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 could not be found. Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Returning 404 to user: Instance f1310d5f-398b-4587-815e-e3ffdecafdf5 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7425711f-003c-44f8-80d1-97c6270e71aa tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5" status: 404 len: 111 microversion: 2.1 time: 0.033324 Aug 30 04:38:28.196590 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2753/5432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:28 2022] GET /compute/v2.1/servers/f1310d5f-398b-4587-815e-e3ffdecafdf5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:28.202299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45dc0040-6633-4bc3-847f-e8730c121a0c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] Calling method '.version_select at 0x7fe96925fa60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:28.210802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:28.227785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45dc0040-6633-4bc3-847f-e8730c121a0c tempest-ServerActionsTestJSON-832097908 tempest-ServerActionsTestJSON-832097908-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204819063" status: 202 len: 0 microversion: 2.1 time: 0.028126 Aug 30 04:38:28.228646 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2680/5433] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 04:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204819063 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:28.493462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:28.495158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:28.506025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:28.507021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:28.507656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:28.508750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:28.509427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:28.510087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:28.528242 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df HTTP/1.1 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '010dd0eb-3a66-47a1-adea-743a8fc880df'} Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:28.529912 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.534613 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:28.534613 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:28.534613 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:28.534613 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:28.534613 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:28.534613 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:38:28.534613 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:38:28.535757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:28.536768 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dcf6b9c9-a241-4b01-ad57-b764ce1e58ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 404 len: 111 microversion: 2.1 time: 0.049822 Aug 30 04:38:28.537993 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2754/5434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:28 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:28.671837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1028219388", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "a0a4d258-2d11-4ff7-b044-1fe1ab70ff46"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:28.744883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:38:29.677590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:38:29.678856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:38:29.679766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:38:29.680449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:38:29.681033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:38:29.713545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:29.714347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:29.714800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:29.715616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:29.716074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:29.716498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:29.767498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:29.773037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:29.787212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:38:29.790118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:38:29.842461 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9268f0fb-60db-478c-94e3-ffe25ae9dc12 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.176135 Aug 30 04:38:29.849358 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2681/5435] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:38:29.855713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a8fe111-af66-4b80-a1e2-6d87322bd75c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:29.856605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a8fe111-af66-4b80-a1e2-6d87322bd75c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:29.954242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a8fe111-af66-4b80-a1e2-6d87322bd75c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:29.966834 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a8fe111-af66-4b80-a1e2-6d87322bd75c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1209 microversion: 2.1 time: 0.116193 Aug 30 04:38:29.967915 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2755/5436] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:29 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1209 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:30.989030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:30.990316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:30.998588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:30.999300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:30.999890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:31.000815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:31.001445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:31.002058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:31.082692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:31.092173 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-53ec9a31-5474-48af-ac32-a6be6ecdd93b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1261 microversion: 2.1 time: 0.108059 Aug 30 04:38:31.093359 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2682/5437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:30 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1261 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:32.114325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:32.114951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:32.131098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:32.132417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:32.133279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:32.135391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:32.138049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:32.139591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:32.268910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:32.282184 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-562a9ba4-8f65-43a4-afc6-c7cbf1c284c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1267 microversion: 2.1 time: 0.172150 Aug 30 04:38:32.284743 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2756/5438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:32 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:33.305673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:33.307927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:33.316239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.316889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.317534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.318385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.318988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.319695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.367989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:33.368985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:33.381214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.382596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.383096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.384528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.385195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.385645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.603985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:33.615899 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-418bf241-6de2-4043-ac6c-58637bc99aa2 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.316155 Aug 30 04:38:33.618090 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2683/5439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:33 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:33.806451 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6240e64f-d23e-4862-b270-6d8e0c38685c tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1830 microversion: 2.1 time: 0.443784 Aug 30 04:38:33.808481 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2757/5440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:33 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1830 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:33.837137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:33.847471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:33.862757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.863247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.870678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:33.871798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:33.872586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:33.873207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.084758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:34.093780 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-055ff2b5-ebae-4a8d-bdfb-5e3f89bab98e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1679 microversion: 2.1 time: 0.260599 Aug 30 04:38:34.095240 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2684/5441] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:33 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1679 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:34.313406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:34.315819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:34.331423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:34.333073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:34.335027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.337097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:34.339854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:34.340864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.439615 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ca317906-d217-4b94-baa3-4bddf459f301 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action" status: 200 len: 32643 microversion: 2.1 time: 0.131380 Aug 30 04:38:34.440291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2758/5442] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:38:34 2022] POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action => generated 32643 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:38:34.601651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:34.602240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:34.613422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:34.614555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:34.615141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.616159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:34.621925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:34.624200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.640299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:34.641013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:34.652541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:34.670528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:34.671121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.675906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:34.676677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:34.677775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:34.789804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5583b1acea8e4acab71c1c036549325d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2724aba0657492e86610b2426a7dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:34.790748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] flavor_id is None. Assuming migration. {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 04:38:34.791562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:38:35.143299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:35.159101 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e47f692-ab70-439a-8dab-2a7a3577cc18 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.523334 Aug 30 04:38:35.160324 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2759/5443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:34 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:35.166580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-53ca4d15-7be3-4cfe-827d-536b5a81b14b req-7b63fe7c-c85e-4bfe-88b0-cc8332c2db07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7915c0c-c620-45c5-8cd6-d95cad21f94a", "tag": "e8e66205-25d3-4218-bf4a-2df18dd006ce"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:35.176869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-53ca4d15-7be3-4cfe-827d-536b5a81b14b req-7b63fe7c-c85e-4bfe-88b0-cc8332c2db07 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:35.177627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-53ca4d15-7be3-4cfe-827d-536b5a81b14b req-7b63fe7c-c85e-4bfe-88b0-cc8332c2db07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:35.178435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-53ca4d15-7be3-4cfe-827d-536b5a81b14b req-7b63fe7c-c85e-4bfe-88b0-cc8332c2db07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:35.192528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-53ca4d15-7be3-4cfe-827d-536b5a81b14b req-7b63fe7c-c85e-4bfe-88b0-cc8332c2db07 service nova] Creating event network-changed:e8e66205-25d3-4218-bf4a-2df18dd006ce for instance e7915c0c-c620-45c5-8cd6-d95cad21f94a on n-h1-854925-5 Aug 30 04:38:35.200561 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-53ca4d15-7be3-4cfe-827d-536b5a81b14b req-7b63fe7c-c85e-4bfe-88b0-cc8332c2db07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038554 Aug 30 04:38:35.203681 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2760/5444] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:35.265622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b94a68e8-9f1f-46ce-abbb-27784202a520 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action" status: 202 len: 0 microversion: 2.1 time: 0.668703 Aug 30 04:38:35.268118 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2685/5445] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:38:34 2022] POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:35.275793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:35.276516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:35.296028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:35.296535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:35.296980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:35.297724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:35.298177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:35.298600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:35.535506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:35.555643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d039b89b-5125-4a6d-b197-ee9d68367a32 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1688 microversion: 2.1 time: 0.284870 Aug 30 04:38:35.578194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2761/5446] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:35 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1688 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:36.180810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:36.182144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:36.190516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:36.192532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:36.194754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:36.195990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:36.198398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:36.200789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:36.378619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:36.388890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:36.395195 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6ed8bc1a-1aeb-426e-b238-06f6bdbb22c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.217975 Aug 30 04:38:36.406999 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2686/5447] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:36 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:36.583484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:36.585345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:36.598258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:36.598842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:36.599475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:36.600498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:36.601116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:36.601624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:36.872090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:36.886660 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c387520b-3e67-45be-8c91-6041cf779996 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1688 microversion: 2.1 time: 0.306779 Aug 30 04:38:36.897722 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2762/5448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:36 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1688 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:37.419799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:37.420408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:37.428513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:37.429127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:37.429771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:37.430460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:37.431157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:37.431579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:37.603688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:37.612561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c9865b38-f4fa-4652-bb59-bfb2974793bc tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.197114 Aug 30 04:38:37.613163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2687/5449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:37 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:37.907180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:37.908387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:37.916536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:37.917979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:37.918596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:37.919471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:37.920018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:37.920427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:38.100903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:38.111594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d31a35fa-cf19-4f35-927a-d071ae9b6b50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1688 microversion: 2.1 time: 0.208151 Aug 30 04:38:38.112464 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2763/5450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:37 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1688 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:38.633357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:38.634646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:38.645763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:38.646511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:38.647111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:38.648139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:38.648754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:38.649370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:38.998861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:39.007162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ce7ad86-c729-4e87-a00d-b6630dded330 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.378234 Aug 30 04:38:39.012321 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2688/5451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:38 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:39.136397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:39.137165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:39.161171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:39.161727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:39.162177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:39.164639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:39.165144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:39.165658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:39.966652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:40.012520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:40.033997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:40.035520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:40.035754 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd93adad-1535-4011-ba47-95dcb3be2250 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1688 microversion: 2.1 time: 0.903816 Aug 30 04:38:40.040003 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2764/5452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:39 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1688 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:40.056503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:40.059282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:40.077483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:40.078228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:40.078837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:40.080057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:40.081742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:40.082830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:40.741755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:40.751986 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01f1259b-0b48-44c1-af72-7197a501654a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.722128 Aug 30 04:38:40.760166 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2689/5453] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:40 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:41.059407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:41.059407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:41.071903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:41.072397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:41.072836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:41.078383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:41.079087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:41.079697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:41.539802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:41.558080 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af64080c-1071-4e8d-9063-cea6380a8c39 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1688 microversion: 2.1 time: 0.503671 Aug 30 04:38:41.567386 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2765/5454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:41 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1688 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:41.777609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:41.779634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:41.799488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:41.800872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:41.801671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:41.807922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:41.808763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:41.809456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:42.079850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:42.095200 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4dfedef-b191-4088-afbf-362a11611401 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.321389 Aug 30 04:38:42.098098 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2690/5455] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:41 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:42.584064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:42.584947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:42.598297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:42.603453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:42.604132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:42.605432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:42.606055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:42.606680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:42.951899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:42.962881 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e893fb1b-478f-48d2-b8a8-ceefcf9e5d56 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.381867 Aug 30 04:38:42.964866 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2766/5456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:42 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:43.115969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:43.117215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:43.126746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:43.127247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:43.127682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:43.136035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:43.137644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:43.138256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:43.803739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-83b175f3-84dd-4f9b-bac6-ad205f889ca8 req-9e0e9895-24ee-4697-aa0c-898bbe1e031c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7915c0c-c620-45c5-8cd6-d95cad21f94a", "name": "network-vif-plugged", "status": "completed", "tag": "e8e66205-25d3-4218-bf4a-2df18dd006ce"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:43.827204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-83b175f3-84dd-4f9b-bac6-ad205f889ca8 req-9e0e9895-24ee-4697-aa0c-898bbe1e031c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:43.829882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-83b175f3-84dd-4f9b-bac6-ad205f889ca8 req-9e0e9895-24ee-4697-aa0c-898bbe1e031c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:43.830579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-83b175f3-84dd-4f9b-bac6-ad205f889ca8 req-9e0e9895-24ee-4697-aa0c-898bbe1e031c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:43.856820 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-83b175f3-84dd-4f9b-bac6-ad205f889ca8 req-9e0e9895-24ee-4697-aa0c-898bbe1e031c service nova] Creating event network-vif-plugged:e8e66205-25d3-4218-bf4a-2df18dd006ce for instance e7915c0c-c620-45c5-8cd6-d95cad21f94a on n-h1-854925-5 Aug 30 04:38:43.867037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-83b175f3-84dd-4f9b-bac6-ad205f889ca8 req-9e0e9895-24ee-4697-aa0c-898bbe1e031c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068864 Aug 30 04:38:43.870188 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2767/5457] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:43.924036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:43.951015 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-27abc3d2-6b7d-461a-adbc-3df28e9d373d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.831179 Aug 30 04:38:43.967929 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2691/5458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:43 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:43.984999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:43.985750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:43.992877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:43.993966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:43.994744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:43.995740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:43.996737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:43.997514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:44.255214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:44.267320 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d03dfe2f-be1a-4f9c-bd08-529628e54fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.286653 Aug 30 04:38:44.268326 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2768/5459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:43 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:44.979542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:44.981827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:44.993083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:45.003484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:45.003484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:45.003484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:45.003484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:45.003484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:45.294401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:45.295545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:45.303614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:45.304329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:45.304773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:45.305595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:45.306570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:45.307006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:45.531422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:45.540192 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eba779e8-02c2-4230-8f16-daed2362de7d tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1309 microversion: 2.1 time: 0.567030 Aug 30 04:38:45.553335 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2692/5460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:44 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1309 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:45.621889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:45.632024 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea45b798-cc12-4d98-9a57-e5485b921d2c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.341833 Aug 30 04:38:45.633103 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2769/5461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:45 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:46.305539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c99f2a05-064f-4cac-be0f-0de637d71f07 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Action: 'create', calling method: .version_select at 0x7fe9691b6940>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-35918734", "policies": ["affinity"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:46.354180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c99f2a05-064f-4cac-be0f-0de637d71f07 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:46.376389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c99f2a05-064f-4cac-be0f-0de637d71f07 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:46.433559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c99f2a05-064f-4cac-be0f-0de637d71f07 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:46.440363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c99f2a05-064f-4cac-be0f-0de637d71f07 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:46.461143 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c99f2a05-064f-4cac-be0f-0de637d71f07 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 182 microversion: 2.1 time: 0.483238 Aug 30 04:38:46.462466 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2693/5462] 10.222.0.27 () {60 vars in 1174 bytes} [Tue Aug 30 04:38:45 2022] POST /compute/v2.1/os-server-groups => generated 182 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:46.475682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ecb67bbe-d16b-4816-8ee4-725275814b22 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Action: 'create', calling method: .version_select at 0x7fe9690fb820>, body: {"server_group": {"name": "tempest-server-group-2077390962", "policies": ["affinity"]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:46.502844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ecb67bbe-d16b-4816-8ee4-725275814b22 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:46.513818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ecb67bbe-d16b-4816-8ee4-725275814b22 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:46.536635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:46.563131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:46.564024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:46.572613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:46.573793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:46.574859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:46.576250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:46.576544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:46.577269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:46.617768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ecb67bbe-d16b-4816-8ee4-725275814b22 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:46.632837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ecb67bbe-d16b-4816-8ee4-725275814b22 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:46.647789 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ecb67bbe-d16b-4816-8ee4-725275814b22 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.178333 Aug 30 04:38:46.649067 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2770/5463] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Aug 30 04:38:46 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:46.662274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:46.662899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:46.682993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:46.683713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:46.685305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:46.686059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:46.686829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:46.689035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:46.853199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:46.864996 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5f4a429-d885-4581-8cb3-0206f4640de9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1489 microversion: 2.1 time: 0.306645 Aug 30 04:38:46.866685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2694/5464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:46 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1489 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:46.892957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-188832c9-f83d-44cf-9f3c-d53926ed7f97 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Action: 'create', calling method: .version_select at 0x7fe9698fb820>, body: {"server_group": {"name": "tempest-server-group-2077390962", "policies": ["affinity"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:46.923513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:46.930211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-188832c9-f83d-44cf-9f3c-d53926ed7f97 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:46.933191 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5508cbb9-155b-4a2e-b560-23e88f684c66 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.276352 Aug 30 04:38:46.933820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2771/5465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:46 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:46.945715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-188832c9-f83d-44cf-9f3c-d53926ed7f97 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:46.950944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:46.952572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:46.968147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:46.968643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:46.970032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:46.970032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:46.970390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:46.970759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:46.988275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-188832c9-f83d-44cf-9f3c-d53926ed7f97 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:46.997199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-188832c9-f83d-44cf-9f3c-d53926ed7f97 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:47.012925 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-188832c9-f83d-44cf-9f3c-d53926ed7f97 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.144699 Aug 30 04:38:47.013623 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2695/5466] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Aug 30 04:38:46 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:47.024232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f98271ca-1017-4797-9a37-3002570f115e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.026378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:47.059966 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f98271ca-1017-4797-9a37-3002570f115e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/415436a0-c7b7-419d-ac6a-8794ceec3260" status: 204 len: 0 microversion: 2.1 time: 0.039720 Aug 30 04:38:47.063847 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2696/5467] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:38:47 2022] DELETE /compute/v2.1/os-server-groups/415436a0-c7b7-419d-ac6a-8794ceec3260 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:38:47.069698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4060ed86-d000-47aa-8450-06d1b94ccb9b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.082058 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4060ed86-d000-47aa-8450-06d1b94ccb9b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.016361 Aug 30 04:38:47.083234 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2697/5468] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:47.086431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c94cd8ab-e595-4b4d-a2a7-c22aff9723e1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "PUT /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1084 microversion: 2.1 time: 0.151524 Aug 30 04:38:47.087292 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2772/5469] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:38:46 2022] PUT /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1084 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:47.105546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fe5b53fb-d2ba-4a02-a690-7671bfc14e83 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.110532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.111272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:47.119444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.120270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.120926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.121958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.122630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.123271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.136642 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fe5b53fb-d2ba-4a02-a690-7671bfc14e83 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/cd23c362-b853-4d24-9ca0-59da24063cb0" status: 204 len: 0 microversion: 2.1 time: 0.035851 Aug 30 04:38:47.138170 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2698/5470] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:38:47 2022] DELETE /compute/v2.1/os-server-groups/cd23c362-b853-4d24-9ca0-59da24063cb0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:47.147920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b32218e-8789-4e7e-aeb0-a19b6d373b92 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.155705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:47.162326 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b32218e-8789-4e7e-aeb0-a19b6d373b92 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.018787 Aug 30 04:38:47.164090 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2699/5471] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:47.183125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5e0b959-9586-4c20-af8a-e2fba6a647fe tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Action: 'create', calling method: .version_select at 0x7fe9692d0670>, body: {"server_group": {"name": "tempest-server-group-11943347", "policies": ["affinity"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:47.208384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f5e0b959-9586-4c20-af8a-e2fba6a647fe tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:47.219267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f5e0b959-9586-4c20-af8a-e2fba6a647fe tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:47.276522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f5e0b959-9586-4c20-af8a-e2fba6a647fe tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:47.284204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f5e0b959-9586-4c20-af8a-e2fba6a647fe tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:47.301886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f5e0b959-9586-4c20-af8a-e2fba6a647fe tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.123617 Aug 30 04:38:47.303623 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2700/5472] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Aug 30 04:38:47 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:47.316360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:47.320382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-037968db-2e32-48bc-8543-cae8d4e1421a tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.325550 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3005c177-791b-4d17-9094-737f9059e73c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1510 microversion: 2.1 time: 0.219000 Aug 30 04:38:47.341166 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2773/5473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:47.346138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.346702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:47.353413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.354297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.354746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.355456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.355911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.356500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.387193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-037968db-2e32-48bc-8543-cae8d4e1421a tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/290246a1-8220-40a2-b90d-5d0e3fedf70e" status: 204 len: 0 microversion: 2.1 time: 0.074471 Aug 30 04:38:47.389565 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2701/5474] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:38:47 2022] DELETE /compute/v2.1/os-server-groups/290246a1-8220-40a2-b90d-5d0e3fedf70e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:47.397566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1010dc2b-06f1-4f5e-b033-8f769fd78ff4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.420912 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1010dc2b-06f1-4f5e-b033-8f769fd78ff4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.020741 Aug 30 04:38:47.420912 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2702/5475] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:47.429914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63ec18ea-0f36-4818-975a-83c144d3a7f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Action: 'create', calling method: .version_select at 0x7fe9692d0670>, body: {"server_group": {"name": "tempest-server-group-1466866567", "policies": ["anti-affinity"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:47.459031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-63ec18ea-0f36-4818-975a-83c144d3a7f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:47.467601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-63ec18ea-0f36-4818-975a-83c144d3a7f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:47.523429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-63ec18ea-0f36-4818-975a-83c144d3a7f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:47.529483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-63ec18ea-0f36-4818-975a-83c144d3a7f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_groups'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:47.545876 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63ec18ea-0f36-4818-975a-83c144d3a7f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.123510 Aug 30 04:38:47.547228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2703/5476] 10.222.0.27 () {60 vars in 1173 bytes} [Tue Aug 30 04:38:47 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:47.558763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14456bf6-5d30-4bf4-b77f-0c00964419c8 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.560971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:47.573219 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-132569ae-906a-4afa-8fa5-de57b7d77836 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1510 microversion: 2.1 time: 0.230889 Aug 30 04:38:47.573933 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2774/5477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:47.595365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.596108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:47.596245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14456bf6-5d30-4bf4-b77f-0c00964419c8 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/87fb44f4-e6e7-49ae-88e7-a7207efc9662" status: 204 len: 0 microversion: 2.1 time: 0.041927 Aug 30 04:38:47.596862 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2704/5478] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:38:47 2022] DELETE /compute/v2.1/os-server-groups/87fb44f4-e6e7-49ae-88e7-a7207efc9662 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:38:47.603014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.603694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.604420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.605425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.606076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.606579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.613433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ccc2e922-d2ce-4e3a-8d27-3f2db7a9be3a tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.627635 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ccc2e922-d2ce-4e3a-8d27-3f2db7a9be3a tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.018480 Aug 30 04:38:47.641352 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2705/5479] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:47.650401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:38:47.793025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1259201293", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "d5908128-3307-4107-9c24-ccc8af14c687"}]}, "os:scheduler_hints": {"group": "ea66a000-70bc-425b-801b-496985a74396"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:47.798093 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ac20f2a8-c2da-4348-9faa-ec39000371af tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 204 len: 0 microversion: 2.1 time: 0.206453 Aug 30 04:38:47.798698 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2775/5480] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:38:47 2022] DELETE /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:38:47.808117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:47.808839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:47.826017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.826648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.827088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.827803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:47.828259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:47.828690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:47.871641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] validate_networks() for [('d5908128-3307-4107-9c24-ccc8af14c687', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:38:48.127632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:48.137639 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d168691-56a7-49e2-86b0-84d124cadfbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1516 microversion: 2.1 time: 0.334411 Aug 30 04:38:48.138155 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2776/5481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:47 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:48.156618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:48.157234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:48.169589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:48.169932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:48.170387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:48.174152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:48.174451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:48.174857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:48.493691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:48.509353 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1cfde5b2-9f0b-41f2-a173-ff33010b3c2f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.370095 Aug 30 04:38:48.510369 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2777/5482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:48 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:48.536199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:38:48.536812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:38:48.538079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:38:48.538762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:38:48.539425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:38:48.558968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:48.560150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:48.560810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:48.561944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:48.562634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:48.563306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:48.581811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:48.591450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:48.607053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:48.627286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:38:48.630258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:38:48.672575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122402) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 30 04:38:48.700676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_group_members'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:48.709247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_group_members'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:48.782850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_group_members'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:48.792957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Getting quotas for user c77c5b13289445378e7808f3f720a6c1 and project 0ed39068e4e3415696e57dac018e2c57. Resources: {'server_group_members'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:48.827360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ffd0a7b7-d498-4739-b0fe-486b5984cc0b tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041985 Aug 30 04:38:48.828200 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2706/5483] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:38:48.847249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a66a6105-be7f-485c-ac0b-bb3604f80209 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:48.847889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a66a6105-be7f-485c-ac0b-bb3604f80209 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:48.943879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a66a6105-be7f-485c-ac0b-bb3604f80209 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:48.966684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a66a6105-be7f-485c-ac0b-bb3604f80209 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1213 microversion: 2.1 time: 0.128986 Aug 30 04:38:48.967277 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2778/5484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:48 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:49.160737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:49.161582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:49.175152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:49.176434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:49.178428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:49.179943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:49.181882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:49.184241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:49.475568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:49.487624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a013696c-b58f-492f-8069-a38ecc950166 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1516 microversion: 2.1 time: 0.331040 Aug 30 04:38:49.488558 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2707/5485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:49 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:49.532017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:49.532797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:49.544933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:49.545795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:49.546579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:49.547462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:49.548079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:49.548674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:49.795044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:49.808147 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aaf3d217-19bb-4953-806b-10edad755646 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.280373 Aug 30 04:38:49.809226 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2779/5486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:49 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:49.988950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:49.989647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:50.001055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.001839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.004877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.005929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.006881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.007511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.126151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:50.136638 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c3daaf60-8bad-481d-93aa-df80f4629d75 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1209 microversion: 2.1 time: 0.153030 Aug 30 04:38:50.137228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2708/5487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:49 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1209 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:50.515121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:50.523807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:50.539385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.544102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.544662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.547257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.548005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.552709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.576843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-43f1e31a-9454-41aa-9ec4-50db638566af req-846f41a1-7dbd-4921-85d5-607fc04722e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7915c0c-c620-45c5-8cd6-d95cad21f94a", "name": "network-vif-deleted", "tag": "e8e66205-25d3-4218-bf4a-2df18dd006ce"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:50.616392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-43f1e31a-9454-41aa-9ec4-50db638566af req-846f41a1-7dbd-4921-85d5-607fc04722e4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.621087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-43f1e31a-9454-41aa-9ec4-50db638566af req-846f41a1-7dbd-4921-85d5-607fc04722e4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.621673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-43f1e31a-9454-41aa-9ec4-50db638566af req-846f41a1-7dbd-4921-85d5-607fc04722e4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.673462 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-43f1e31a-9454-41aa-9ec4-50db638566af req-846f41a1-7dbd-4921-85d5-607fc04722e4 service nova] Creating event network-vif-deleted:e8e66205-25d3-4218-bf4a-2df18dd006ce for instance e7915c0c-c620-45c5-8cd6-d95cad21f94a on n-h1-854925-5 Aug 30 04:38:50.681214 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-43f1e31a-9454-41aa-9ec4-50db638566af req-846f41a1-7dbd-4921-85d5-607fc04722e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110296 Aug 30 04:38:50.682679 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2709/5488] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:50.818205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:50.830670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:50.831399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:50.834813 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a3e7160f-35c4-4658-ab22-73028c5d40d0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 200 len: 1474 microversion: 2.1 time: 0.323472 Aug 30 04:38:50.836339 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2780/5489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:50 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 1474 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:50.859974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.860496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.863504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:50.864271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:50.865118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:50.865597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:51.158863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:51.160658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:51.176001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:51.176483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:51.180314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:51.182324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:51.185501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:51.186005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:51.227369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:51.236371 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6de1cbb3-51cb-45c4-a60a-7cfbcb1e9f9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.409923 Aug 30 04:38:51.240363 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2710/5490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:50 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:51.338570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:51.352274 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b280968a-64ca-4304-8359-5fd95e8936f3 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1283 microversion: 2.1 time: 0.198007 Aug 30 04:38:51.354133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2781/5491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:51 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:51.861059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:51.862061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:51.902652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:51.913867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:51.914415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:51.915233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:51.916207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:51.919003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:51.944604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a HTTP/1.1 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e7915c0c-c620-45c5-8cd6-d95cad21f94a'} Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:38:51.951974 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:38:51.955931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:38:51.957313 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c5b989eb-f3d0-4e38-acef-9b5617718b83 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 404 len: 111 microversion: 2.1 time: 0.100077 Aug 30 04:38:51.960166 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2711/5492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:51 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:38:52.113105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1796340437", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "a0a4d258-2d11-4ff7-b044-1fe1ab70ff46"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:52.220438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] validate_networks() for [('a0a4d258-2d11-4ff7-b044-1fe1ab70ff46', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:38:52.264620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:52.265586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:52.279128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:52.279886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:52.280649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:52.282221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:52.283028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:52.283899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:52.628092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:52.643595 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5e6619d-51ca-4c6d-b808-fb08da3da890 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1693 microversion: 2.1 time: 0.378075 Aug 30 04:38:52.644229 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2712/5493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:52 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1693 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:52.650557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:52.651351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:52.657468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:52.658139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:52.658741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:52.659594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:52.660218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:52.660801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:52.987386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:52.999109 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cfc8fa5f-1f7e-4cca-8c1e-0bcb64c49898 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1313 microversion: 2.1 time: 0.352320 Aug 30 04:38:53.000037 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2713/5494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:52 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:53.099837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:38:53.100561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:38:53.101041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:38:53.101530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:38:53.102119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:38:53.115574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:53.116968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:53.117467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:53.119039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:53.119673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:53.120251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:53.144020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:38:53.153038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Getting quotas for user b5b607da903e47b2a43b4b40f41ac300 and project 922f018cfdc3480ab4a766a8bcbbc8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:38:53.173241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:38:53.176033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:38:53.254813 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af58725e-acd7-4d45-a1d7-f92a1addf220 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.145550 Aug 30 04:38:53.256301 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2782/5495] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:38:53.274726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4bc814ad-05d8-4a75-b77c-f9efcbeb9bcf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:53.279276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4bc814ad-05d8-4a75-b77c-f9efcbeb9bcf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:53.286563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-caeab3d1-de9c-4781-8d4f-814f313a8f92 req-b578bb7c-687f-409c-9df1-b700f4b93692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6259119f-80b2-43f5-8a75-145d484649cb", "tag": "17fd7a57-22bb-4bf7-8399-c2b91d60c02c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:53.299566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-caeab3d1-de9c-4781-8d4f-814f313a8f92 req-b578bb7c-687f-409c-9df1-b700f4b93692 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:53.300350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-caeab3d1-de9c-4781-8d4f-814f313a8f92 req-b578bb7c-687f-409c-9df1-b700f4b93692 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:53.301403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-caeab3d1-de9c-4781-8d4f-814f313a8f92 req-b578bb7c-687f-409c-9df1-b700f4b93692 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:53.314720 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-caeab3d1-de9c-4781-8d4f-814f313a8f92 req-b578bb7c-687f-409c-9df1-b700f4b93692 service nova] Creating event network-changed:17fd7a57-22bb-4bf7-8399-c2b91d60c02c for instance 6259119f-80b2-43f5-8a75-145d484649cb on n-h2-854925-5 Aug 30 04:38:53.320524 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-caeab3d1-de9c-4781-8d4f-814f313a8f92 req-b578bb7c-687f-409c-9df1-b700f4b93692 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038484 Aug 30 04:38:53.321730 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2783/5496] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:53.481952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4bc814ad-05d8-4a75-b77c-f9efcbeb9bcf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:53.490226 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4bc814ad-05d8-4a75-b77c-f9efcbeb9bcf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1209 microversion: 2.1 time: 0.226155 Aug 30 04:38:53.491357 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2714/5497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:53 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1209 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:53.675058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:53.676397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:53.725181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:53.729584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:53.733453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:53.735267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:53.735959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:53.738546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.027886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:54.036051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:54.070244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:54.075271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.075716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.076164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.077123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.077885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.078477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.086471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1e0bc329-89b0-4cb9-8fe9-b1f1b9ad2d37 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1692 microversion: 2.1 time: 0.416677 Aug 30 04:38:54.088421 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2784/5498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:53 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1692 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:54.232349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:54.233040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:54.242224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.243634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.246280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.247004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.247474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.250218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.296182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:54.314929 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-37daebab-2003-4a19-b953-7d295d92def6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1313 microversion: 2.1 time: 0.293761 Aug 30 04:38:54.318615 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2715/5499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:54 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:54.398483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lazy-loading 'services' on Instance uuid 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:38:54.436369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d639b804-3c22-4733-a1c7-3742738f7f39 req-67edab56-93c8-4e34-85ef-86a2067476c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "name": "network-vif-unplugged", "status": "completed", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:54.451553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d639b804-3c22-4733-a1c7-3742738f7f39 req-67edab56-93c8-4e34-85ef-86a2067476c0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.452533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d639b804-3c22-4733-a1c7-3742738f7f39 req-67edab56-93c8-4e34-85ef-86a2067476c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.453576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d639b804-3c22-4733-a1c7-3742738f7f39 req-67edab56-93c8-4e34-85ef-86a2067476c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.468847 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d639b804-3c22-4733-a1c7-3742738f7f39 req-67edab56-93c8-4e34-85ef-86a2067476c0 service nova] Creating event network-vif-unplugged:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h1-854925-5 Aug 30 04:38:54.480065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-d639b804-3c22-4733-a1c7-3742738f7f39 req-67edab56-93c8-4e34-85ef-86a2067476c0 service nova] Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:38:54.495042 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d639b804-3c22-4733-a1c7-3742738f7f39 req-67edab56-93c8-4e34-85ef-86a2067476c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066270 Aug 30 04:38:54.495826 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2716/5500] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:54.523958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:54.527716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:54.537399 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3935fba8-b020-4215-87ec-8ed0b2126c10 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-volume_attachments/c5887c6c-0f03-4923-987f-03db297e91f5" status: 202 len: 0 microversion: 2.1 time: 0.309396 Aug 30 04:38:54.538572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.539284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.539724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.540495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:54.540955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:54.541404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:54.547032 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2785/5501] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:38:54 2022] DELETE /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-volume_attachments/c5887c6c-0f03-4923-987f-03db297e91f5 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:38:54.701723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:54.741731 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6a2ac42-80a4-431f-85cb-cc0f462d43b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1205 microversion: 2.1 time: 0.233792 Aug 30 04:38:54.756761 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2717/5502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:54 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1205 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:55.115013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:55.116390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:55.126287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:55.126956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:55.127761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:55.129222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:55.129912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:55.130643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:55.340808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:55.341540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:55.362405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:55.362928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:55.363390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:55.364607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:55.365077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:55.365545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:56.142564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:56.146148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:56.163981 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68022811-ebe3-47dd-9cd6-f7997853d69f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1313 microversion: 2.1 time: 0.828251 Aug 30 04:38:56.165229 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2718/5503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:55 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1313 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:56.177224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:56.178008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:56.192704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:56.193209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:56.197647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:56.199020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:56.199202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:56.199663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:56.287593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:56.301416 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c74feb6-a9fc-49e0-a070-77bd5b3fdb6d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1692 microversion: 2.1 time: 1.191728 Aug 30 04:38:56.302309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2786/5504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:55 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1692 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:56.727017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:56.985890 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d4cb6d5c-cbc2-4e93-ba66-939e73fb2236 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.600975 Aug 30 04:38:56.985890 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2719/5505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:56 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:57.014230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d5eb27c4-3e56-46f1-9180-bd04b89d592a req-ac3edaec-3228-4f3b-b38e-af8f4d71366e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:57.034426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d5eb27c4-3e56-46f1-9180-bd04b89d592a req-ac3edaec-3228-4f3b-b38e-af8f4d71366e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:57.034913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d5eb27c4-3e56-46f1-9180-bd04b89d592a req-ac3edaec-3228-4f3b-b38e-af8f4d71366e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:57.035349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d5eb27c4-3e56-46f1-9180-bd04b89d592a req-ac3edaec-3228-4f3b-b38e-af8f4d71366e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:57.049376 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d5eb27c4-3e56-46f1-9180-bd04b89d592a req-ac3edaec-3228-4f3b-b38e-af8f4d71366e service nova] Creating event network-changed:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h1-854925-5 Aug 30 04:38:57.065518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-d5eb27c4-3e56-46f1-9180-bd04b89d592a req-ac3edaec-3228-4f3b-b38e-af8f4d71366e service nova] Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:38:57.117468 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d5eb27c4-3e56-46f1-9180-bd04b89d592a req-ac3edaec-3228-4f3b-b38e-af8f4d71366e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490023 Aug 30 04:38:57.124620 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2787/5506] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:38:57.186036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:57.187237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:57.201378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:57.201889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:57.202595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:57.205132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:57.205868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:57.208687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:57.330035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:57.330917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:57.346122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:57.346989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:57.347985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:57.350094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:57.350809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:57.351518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:57.717719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:57.733267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc288c31-bac4-469c-9f42-0e371e2a3671 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1313 microversion: 2.1 time: 0.547951 Aug 30 04:38:57.746607 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2720/5507] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:57 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1313 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:57.801312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:57.803379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:57.844470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:57.844470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:57.844768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:57.845731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:57.847684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:57.850164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:58.057418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:58.073481 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-428263c4-16d2-4734-ad68-db4ff05bb1d0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1692 microversion: 2.1 time: 0.749333 Aug 30 04:38:58.078059 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2788/5508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:57 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1692 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:38:58.284973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:58.296829 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9cbbad42-a54b-4924-a679-56bcdd3a62ef tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.506848 Aug 30 04:38:58.298906 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2721/5509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:57 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:58.760601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:58.761403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:58.778828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:58.779539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:58.781061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:58.781936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:58.785513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:58.787768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:59.073704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:59.083472 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d6b5d05f-aed0-49ba-8c68-5f9262dbfde4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1313 microversion: 2.1 time: 0.329309 Aug 30 04:38:59.093430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2789/5510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:58 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:59.104528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:59.105710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:59.114083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:59.116561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:59.117466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:59.118450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:59.119849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:59.120526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:59.121166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:59.152099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8effcf45-f20f-49cd-b9eb-f1a86af52619 req-3aef5eb8-5d32-42ef-97e2-c97a245245e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ec61768-5550-443f-a6f9-76935be69203", "tag": "8137999c-959b-432e-91db-f02b0312f533"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:38:59.197818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8effcf45-f20f-49cd-b9eb-f1a86af52619 req-3aef5eb8-5d32-42ef-97e2-c97a245245e1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:59.198756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8effcf45-f20f-49cd-b9eb-f1a86af52619 req-3aef5eb8-5d32-42ef-97e2-c97a245245e1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:59.199715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8effcf45-f20f-49cd-b9eb-f1a86af52619 req-3aef5eb8-5d32-42ef-97e2-c97a245245e1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:59.221602 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8effcf45-f20f-49cd-b9eb-f1a86af52619 req-3aef5eb8-5d32-42ef-97e2-c97a245245e1 service nova] Creating event network-changed:8137999c-959b-432e-91db-f02b0312f533 for instance 6ec61768-5550-443f-a6f9-76935be69203 on n-h1-854925-5 Aug 30 04:38:59.231746 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8effcf45-f20f-49cd-b9eb-f1a86af52619 req-3aef5eb8-5d32-42ef-97e2-c97a245245e1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083375 Aug 30 04:38:59.232357 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2790/5511] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:38:59.320050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:38:59.320769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:38:59.328116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:59.329908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:59.336292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:59.337049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:59.338242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:38:59.338916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:38:59.339807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:38:59.345540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc22352d-7819-49a3-a3c4-cb297286f7c8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1690 microversion: 2.1 time: 0.246078 Aug 30 04:38:59.346137 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2722/5512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:59 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1690 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:38:59.362098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:38:59.527236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:38:59.536350 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f294d08-8b90-4be4-9091-923e1ddd3f4f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.221293 Aug 30 04:38:59.537514 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2791/5513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:38:59 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:00.109036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:00.110735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:00.118728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:00.119898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:00.135219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:00.135983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:00.136454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:00.136901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:00.299257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:00.310945 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6471ece-0608-4869-aa50-97fa6ed687f2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1313 microversion: 2.1 time: 0.206402 Aug 30 04:39:00.312000 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2723/5514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:00 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:00.368039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:00.369360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:00.377989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:00.378668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:00.379852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:00.380193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:00.380882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:00.381502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:00.557285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:00.564087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:00.564712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:00.572432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:00.572927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:00.573705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:00.575048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:00.575911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:00.576526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:00.576652 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59adcb92-bee0-40cd-8fa4-2bda30e685a9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1690 microversion: 2.1 time: 0.212168 Aug 30 04:39:00.577952 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2792/5515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:00 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1690 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:00.767490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:00.780121 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-46535c2e-40fc-4ef9-b911-6363131b7714 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.219630 Aug 30 04:39:00.781109 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2724/5516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:00 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:01.063158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-993eb3b1-10d1-489f-a034-02dd9ecbce24 req-43f9b65d-0126-492d-9492-003e7ee2d397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6259119f-80b2-43f5-8a75-145d484649cb", "name": "network-vif-plugged", "status": "completed", "tag": "17fd7a57-22bb-4bf7-8399-c2b91d60c02c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:01.082702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-993eb3b1-10d1-489f-a034-02dd9ecbce24 req-43f9b65d-0126-492d-9492-003e7ee2d397 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:01.083503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-993eb3b1-10d1-489f-a034-02dd9ecbce24 req-43f9b65d-0126-492d-9492-003e7ee2d397 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:01.084257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-993eb3b1-10d1-489f-a034-02dd9ecbce24 req-43f9b65d-0126-492d-9492-003e7ee2d397 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:01.106093 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-993eb3b1-10d1-489f-a034-02dd9ecbce24 req-43f9b65d-0126-492d-9492-003e7ee2d397 service nova] Creating event network-vif-plugged:17fd7a57-22bb-4bf7-8399-c2b91d60c02c for instance 6259119f-80b2-43f5-8a75-145d484649cb on n-h2-854925-5 Aug 30 04:39:01.120390 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-993eb3b1-10d1-489f-a034-02dd9ecbce24 req-43f9b65d-0126-492d-9492-003e7ee2d397 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061510 Aug 30 04:39:01.121027 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2793/5517] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:01.332965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:01.333653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:01.350650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:01.351219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:01.351670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:01.352395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:01.353410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:01.353850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:01.606663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:01.607712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:01.619020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:01.620888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:01.621691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:01.624233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:01.626138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:01.626834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:01.776549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:01.785297 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c985d817-d54d-459b-a690-bed25ec539b4 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1313 microversion: 2.1 time: 0.456465 Aug 30 04:39:01.792670 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2725/5518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:01 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:01.810949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:01.812058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:01.825759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:01.834189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:01.838459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:01.839900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:01.840366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:01.840788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:02.070129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:02.082320 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6a93e835-3909-4b18-8e7c-a72b1c7b856f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1690 microversion: 2.1 time: 0.482582 Aug 30 04:39:02.095659 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2794/5519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:01 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1690 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:02.183099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:02.194890 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adae2bfe-391e-40c1-9506-6cbd4380effb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.388509 Aug 30 04:39:02.210308 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2726/5520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:01 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:02.560634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2010510c-a55a-4969-b549-7635ceb54ef3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:02.569220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2010510c-a55a-4969-b549-7635ceb54ef3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:02.570566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2010510c-a55a-4969-b549-7635ceb54ef3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:02.572405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2010510c-a55a-4969-b549-7635ceb54ef3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:02.599404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2010510c-a55a-4969-b549-7635ceb54ef3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Going to try to stop instance {{(pid=122403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:39:02.676489 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2010510c-a55a-4969-b549-7635ceb54ef3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action" status: 202 len: 0 microversion: 2.1 time: 0.123089 Aug 30 04:39:02.683069 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2795/5521] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:02 2022] POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:39:02.688030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:02.689453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:02.696991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:02.697625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:02.698239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:02.699052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:02.699740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:02.700361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:02.814831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:02.816063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:02.838951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:02.845365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:02.845877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:02.846729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:02.847081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:02.847511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:02.878178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:02.886924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ecc6037f-1614-43a0-9bef-25298a0af1b0 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.202811 Aug 30 04:39:02.889380 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2727/5522] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:02 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:03.025920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:03.034592 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0a54cfb0-ddb6-4cab-8172-6086d95b1b89 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1497 microversion: 2.1 time: 0.225945 Aug 30 04:39:03.035716 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2796/5523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:02 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1497 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:03.054872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b61e31cb-b333-4800-9173-7588b02535a6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:03.068032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.server_groups [None req-b61e31cb-b333-4800-9173-7588b02535a6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Querying cell ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) for 1 instances {{(pid=122402) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 04:39:03.068873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b61e31cb-b333-4800-9173-7588b02535a6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.069451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b61e31cb-b333-4800-9173-7588b02535a6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.069952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b61e31cb-b333-4800-9173-7588b02535a6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.088161 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b61e31cb-b333-4800-9173-7588b02535a6 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/ea66a000-70bc-425b-801b-496985a74396" status: 200 len: 220 microversion: 2.1 time: 0.037143 Aug 30 04:39:03.089575 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2728/5524] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:39:03 2022] GET /compute/v2.1/os-server-groups/ea66a000-70bc-425b-801b-496985a74396 => generated 220 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:03.099739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:03.100241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:03.107889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.108380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.108819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.109737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.110198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.110628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.119973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:03.120820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:03.128035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.128866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.129679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.130376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.130831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.131403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.133433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:03.140776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:39:03.175590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=16 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:03.251487 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a584655-6f61-4df8-b55a-c6cb39172ee1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 204 len: 0 microversion: 2.1 time: 0.155172 Aug 30 04:39:03.252170 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2797/5525] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:03 2022] DELETE /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:03.261617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:03.262724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:03.270642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.271186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.271640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.272678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.273527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.274118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.379051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:03.388030 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f9d1a68-9fe0-40da-8d99-1fa27c36200f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1687 microversion: 2.1 time: 0.272599 Aug 30 04:39:03.388952 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2729/5526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:03 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1687 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:03.394200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:03.395293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:03.402067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.402572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.403014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.403737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.404233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.404738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.487504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=48 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:03.723649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:03.737023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-234e5ea0-4312-4d51-88f1-533595f418e8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.483249 Aug 30 04:39:03.738131 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2798/5527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:03 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:03.746588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:03.747362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:03.755960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:03.757269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:03.764321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.764831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.765277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.767221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.767915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.771018 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a323b872-d38a-4716-abb5-5dd365efa490 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1503 microversion: 2.1 time: 0.380544 Aug 30 04:39:03.772518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.774141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2730/5528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:03 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1503 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:03.917865 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42ee7824-e900-44a6-914d-7d881fb5fda1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action" status: 204 len: 0 microversion: 2.1 time: 0.178261 Aug 30 04:39:03.919007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2799/5529] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:03 2022] POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:03.924155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:03.926054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:03.933919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:03.935198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:03.947730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.948921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.949678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.950448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.951089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.951336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.952290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.952904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.953784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:03.955787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:03.958508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:03.961724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:04.207383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:04.239282 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2530372-99bd-4d06-a4f1-9ffebe19468a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1687 microversion: 2.1 time: 0.309286 Aug 30 04:39:04.240710 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2800/5530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:03 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1687 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:04.267587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:04.276445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c3975762-22d3-44ac-b46c-fff15b2a43c4 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.365796 Aug 30 04:39:04.277051 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2731/5531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:03 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:04.761691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:04.762916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:04.775597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:04.779545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:04.779999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:04.780754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:04.781206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:04.781655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:04.799303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:04.800517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:04.812947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:04.813732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:04.814324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:04.816639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:04.817311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:04.820126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:05.673415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:05.679310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:05.688726 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a79f6c6a-3a8c-42f9-82ff-89974e438772 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1503 microversion: 2.1 time: 0.893338 Aug 30 04:39:05.690122 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-55f4592e-19fd-4689-b2f8-f27a49da2bd3 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.933124 Aug 30 04:39:05.690327 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2732/5532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:04 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1503 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:05.691963 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2801/5533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:04 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:05.700074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:05.706655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:05.709731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:05.709862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:05.728945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:05.733818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:05.736217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:05.739183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:05.743633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:05.744189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:05.746033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:05.764445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:05.765036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:05.765697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:05.766265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:05.766765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:06.369953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:06.380525 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd7d4054-0e60-4225-8924-722b0112b818 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1687 microversion: 2.1 time: 0.688562 Aug 30 04:39:06.403273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:06.403664 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2733/5534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:05 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1687 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:06.412169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-84a5a35d-f761-477e-ad40-c0dbc4edb134 req-aa4185c3-0e35-472d-a6aa-f4c6e14a9fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "name": "network-vif-plugged", "status": "completed", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:06.429746 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a7af1eb-3fc3-4417-992c-9dfe8a22439c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.735026 Aug 30 04:39:06.429746 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2802/5535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:05 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:06.432212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-84a5a35d-f761-477e-ad40-c0dbc4edb134 req-aa4185c3-0e35-472d-a6aa-f4c6e14a9fd4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:06.433695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-84a5a35d-f761-477e-ad40-c0dbc4edb134 req-aa4185c3-0e35-472d-a6aa-f4c6e14a9fd4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:06.439308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-84a5a35d-f761-477e-ad40-c0dbc4edb134 req-aa4185c3-0e35-472d-a6aa-f4c6e14a9fd4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:06.469041 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-84a5a35d-f761-477e-ad40-c0dbc4edb134 req-aa4185c3-0e35-472d-a6aa-f4c6e14a9fd4 service nova] Creating event network-vif-plugged:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h1-854925-5 Aug 30 04:39:06.492914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-84a5a35d-f761-477e-ad40-c0dbc4edb134 req-aa4185c3-0e35-472d-a6aa-f4c6e14a9fd4 service nova] Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:39:06.507162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-84a5a35d-f761-477e-ad40-c0dbc4edb134 req-aa4185c3-0e35-472d-a6aa-f4c6e14a9fd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101956 Aug 30 04:39:06.510851 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2734/5536] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:06.716139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:06.718326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:06.734073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:06.734571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:06.735008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:06.735721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:06.736174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:06.736597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:06.739571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:06.742935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:06.772161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:06.776540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:06.778135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:06.778580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:06.779318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:06.781127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:06.847599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77c5b13289445378e7808f3f720a6c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ed39068e4e3415696e57dac018e2c57', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:06.860518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce0f0c36-2454-4f22-8642-79704dd38922 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 200 len: 1461 microversion: 2.1 time: 0.150258 Aug 30 04:39:06.864157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2803/5537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:06 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 1461 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:06.869363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-15911a6a-fed2-48f2-9bef-2109cd94f0cd req-2b8a4677-a24e-435e-b2af-2327dc4f8445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6259119f-80b2-43f5-8a75-145d484649cb", "name": "network-vif-deleted", "tag": "17fd7a57-22bb-4bf7-8399-c2b91d60c02c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:06.897478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-15911a6a-fed2-48f2-9bef-2109cd94f0cd req-2b8a4677-a24e-435e-b2af-2327dc4f8445 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:06.898262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-15911a6a-fed2-48f2-9bef-2109cd94f0cd req-2b8a4677-a24e-435e-b2af-2327dc4f8445 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:06.898884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-15911a6a-fed2-48f2-9bef-2109cd94f0cd req-2b8a4677-a24e-435e-b2af-2327dc4f8445 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:06.916941 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-15911a6a-fed2-48f2-9bef-2109cd94f0cd req-2b8a4677-a24e-435e-b2af-2327dc4f8445 service nova] Creating event network-vif-deleted:17fd7a57-22bb-4bf7-8399-c2b91d60c02c for instance 6259119f-80b2-43f5-8a75-145d484649cb on n-h2-854925-5 Aug 30 04:39:06.942144 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-15911a6a-fed2-48f2-9bef-2109cd94f0cd req-2b8a4677-a24e-435e-b2af-2327dc4f8445 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067243 Aug 30 04:39:06.942917 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2804/5538] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:07.119591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:07.131408 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c1312ec-493f-44f8-8b6a-8e254f68cec0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.411725 Aug 30 04:39:07.133653 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2735/5539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:06 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:07.411487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:07.412550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:07.420631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:07.421125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:07.421596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:07.422306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:07.423044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:07.423472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:07.439557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:07.454738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:07.455361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:07.457473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:07.468358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:07.469195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:07.469739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:07.470449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:07.470904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:07.471332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:07.474700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:07.642320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:07.654494 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff047866-57e4-4172-a8e2-2f67f3b27fa3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1679 microversion: 2.1 time: 0.247266 Aug 30 04:39:07.655088 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2805/5540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:07 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1679 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:07.793369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:07.802136 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-72f6455a-0b50-4c61-abd2-319cc951a618 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.351764 Aug 30 04:39:07.803037 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2736/5541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:07 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:07.886171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:07.886938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:07.894821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:07.895399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:07.895988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:07.896764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:07.897416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:07.897979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:07.915836 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] HTTP exception thrown: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Request method failure captured: Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb HTTP/1.1 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZRVJBFvbPqg3I2jSHWjDsA26ZbaxUwD4sxIk2eLybQK1UDAK9A08corIA7ZTO-UZfuWodZBhs_MYJOTXi-xfikwOJr6CVO7pKDOCvQv_28Geuz4dV0Rf7rVzPalg_nysI2t9dyk4Th7eAFGTjlsU-CbJEYgbwcuy3XWsoHohcD2FVo Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ed39068e4e3415696e57dac018e2c57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}] Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c77c5b13289445378e7808f3f720a6c1 Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '6259119f-80b2-43f5-8a75-145d484649cb'} Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:07.918100 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Returning 404 to user: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c255a45-2463-483e-87e7-022e9934cb9f tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 404 len: 111 microversion: 2.1 time: 0.038885 Aug 30 04:39:07.923210 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2806/5542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:07 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:07.932407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d4cb30a-f565-45f5-8cc1-a88bd6c3740e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:07.950185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.server_groups [None req-7d4cb30a-f565-45f5-8cc1-a88bd6c3740e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Querying cell ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) for 1 instances {{(pid=122402) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 04:39:07.950916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d4cb30a-f565-45f5-8cc1-a88bd6c3740e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:07.951405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d4cb30a-f565-45f5-8cc1-a88bd6c3740e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:07.951842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d4cb30a-f565-45f5-8cc1-a88bd6c3740e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:07.975235 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d4cb30a-f565-45f5-8cc1-a88bd6c3740e tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups" status: 200 len: 185 microversion: 2.1 time: 0.046596 Aug 30 04:39:07.983013 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2737/5543] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Aug 30 04:39:07 2022] GET /compute/v2.1/os-server-groups => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:07.987871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-44d1ffaf-3121-4585-9135-3efc713ce299 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.004513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.compute.server_groups [None req-44d1ffaf-3121-4585-9135-3efc713ce299 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Querying cell ae7f45c9-5d99-4b18-9061-1e16276d093b(cell1) for 1 instances {{(pid=122403) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 30 04:39:08.017464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d1ffaf-3121-4585-9135-3efc713ce299 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.018400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d1ffaf-3121-4585-9135-3efc713ce299 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.018860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44d1ffaf-3121-4585-9135-3efc713ce299 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.042981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-44d1ffaf-3121-4585-9135-3efc713ce299 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/os-server-groups/ea66a000-70bc-425b-801b-496985a74396" status: 200 len: 182 microversion: 2.1 time: 0.058894 Aug 30 04:39:08.043573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2807/5544] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 04:39:07 2022] GET /compute/v2.1/os-server-groups/ea66a000-70bc-425b-801b-496985a74396 => generated 182 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:08.056427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.056939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:08.066617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.067137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.067594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.068426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.068900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.069511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.094224 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] HTTP exception thrown: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Request method failure captured: Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb HTTP/1.1 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZRVJBFvbPqg3I2jSHWjDsA26ZbaxUwD4sxIk2eLybQK1UDAK9A08corIA7ZTO-UZfuWodZBhs_MYJOTXi-xfikwOJr6CVO7pKDOCvQv_28Geuz4dV0Rf7rVzPalg_nysI2t9dyk4Th7eAFGTjlsU-CbJEYgbwcuy3XWsoHohcD2FVo Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ed39068e4e3415696e57dac018e2c57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}] Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: c77c5b13289445378e7808f3f720a6c1 Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6259119f-80b2-43f5-8a75-145d484649cb'} Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:08.095920 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Returning 404 to user: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1070960-6921-4d94-afa5-516b14ed0df2 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 404 len: 111 microversion: 2.1 time: 0.047232 Aug 30 04:39:08.103485 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2738/5545] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:08 2022] DELETE /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:08.114517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.115336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] [instance: 6259119f-80b2-43f5-8a75-145d484649cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:08.122471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.123166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.123782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.124689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.125143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.125613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.142175 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] HTTP exception thrown: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Request method failure captured: Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb HTTP/1.1 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZRVJBFvbPqg3I2jSHWjDsA26ZbaxUwD4sxIk2eLybQK1UDAK9A08corIA7ZTO-UZfuWodZBhs_MYJOTXi-xfikwOJr6CVO7pKDOCvQv_28Geuz4dV0Rf7rVzPalg_nysI2t9dyk4Th7eAFGTjlsU-CbJEYgbwcuy3XWsoHohcD2FVo Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ed39068e4e3415696e57dac018e2c57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}] Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c77c5b13289445378e7808f3f720a6c1 Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '6259119f-80b2-43f5-8a75-145d484649cb'} Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.143999 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Returning 404 to user: Instance 6259119f-80b2-43f5-8a75-145d484649cb could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37b880dc-2ace-4eb9-93b2-be102d1c0fc1 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb" status: 404 len: 111 microversion: 2.1 time: 0.042697 Aug 30 04:39:08.153112 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2808/5546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:08 2022] GET /compute/v2.1/servers/6259119f-80b2-43f5-8a75-145d484649cb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:08.154901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.154901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:08.155221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a075ebf-4266-486a-bf24-1f0fb9009c20 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.160295 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1a075ebf-4266-486a-bf24-1f0fb9009c20 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] HTTP exception thrown: Instance group 87fb44f4-e6e7-49ae-88e7-a7207efc9662 could not be found. Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a075ebf-4266-486a-bf24-1f0fb9009c20 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Request method failure captured: Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-server-groups/87fb44f4-e6e7-49ae-88e7-a7207efc9662 HTTP/1.1 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZRVJBFvbPqg3I2jSHWjDsA26ZbaxUwD4sxIk2eLybQK1UDAK9A08corIA7ZTO-UZfuWodZBhs_MYJOTXi-xfikwOJr6CVO7pKDOCvQv_28Geuz4dV0Rf7rVzPalg_nysI2t9dyk4Th7eAFGTjlsU-CbJEYgbwcuy3XWsoHohcD2FVo Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ed39068e4e3415696e57dac018e2c57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}] Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c77c5b13289445378e7808f3f720a6c1 Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance group 87fb44f4-e6e7-49ae-88e7-a7207efc9662 could not be found. Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '87fb44f4-e6e7-49ae-88e7-a7207efc9662'} Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 87fb44f4-e6e7-49ae-88e7-a7207efc9662 could not be found. Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 87fb44f4-e6e7-49ae-88e7-a7207efc9662 could not be found. Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.161868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 87fb44f4-e6e7-49ae-88e7-a7207efc9662 could not be found. Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a075ebf-4266-486a-bf24-1f0fb9009c20 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Returning 404 to user: Instance group 87fb44f4-e6e7-49ae-88e7-a7207efc9662 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a075ebf-4266-486a-bf24-1f0fb9009c20 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/87fb44f4-e6e7-49ae-88e7-a7207efc9662" status: 404 len: 117 microversion: 2.1 time: 0.012647 Aug 30 04:39:08.165994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2809/5547] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:39:08 2022] DELETE /compute/v2.1/os-server-groups/87fb44f4-e6e7-49ae-88e7-a7207efc9662 => generated 117 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:08.169539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.170583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.171612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.171732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8be4a27-83cc-4db2-9aea-96e132a32a48 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.172850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.173723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.174376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.178575 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e8be4a27-83cc-4db2-9aea-96e132a32a48 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] HTTP exception thrown: Instance group 290246a1-8220-40a2-b90d-5d0e3fedf70e could not be found. Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8be4a27-83cc-4db2-9aea-96e132a32a48 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Request method failure captured: Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-server-groups/290246a1-8220-40a2-b90d-5d0e3fedf70e HTTP/1.1 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZRVJBFvbPqg3I2jSHWjDsA26ZbaxUwD4sxIk2eLybQK1UDAK9A08corIA7ZTO-UZfuWodZBhs_MYJOTXi-xfikwOJr6CVO7pKDOCvQv_28Geuz4dV0Rf7rVzPalg_nysI2t9dyk4Th7eAFGTjlsU-CbJEYgbwcuy3XWsoHohcD2FVo Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ed39068e4e3415696e57dac018e2c57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}] Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c77c5b13289445378e7808f3f720a6c1 Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance group 290246a1-8220-40a2-b90d-5d0e3fedf70e could not be found. Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '290246a1-8220-40a2-b90d-5d0e3fedf70e'} Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 290246a1-8220-40a2-b90d-5d0e3fedf70e could not be found. Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 290246a1-8220-40a2-b90d-5d0e3fedf70e could not be found. Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.180094 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 290246a1-8220-40a2-b90d-5d0e3fedf70e could not be found. Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8be4a27-83cc-4db2-9aea-96e132a32a48 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Returning 404 to user: Instance group 290246a1-8220-40a2-b90d-5d0e3fedf70e could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e8be4a27-83cc-4db2-9aea-96e132a32a48 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/290246a1-8220-40a2-b90d-5d0e3fedf70e" status: 404 len: 117 microversion: 2.1 time: 0.013646 Aug 30 04:39:08.186750 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2810/5548] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:39:08 2022] DELETE /compute/v2.1/os-server-groups/290246a1-8220-40a2-b90d-5d0e3fedf70e => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:08.190146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ebc09a4-8f90-480d-92da-3fb23e2f6966 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.197538 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-9ebc09a4-8f90-480d-92da-3fb23e2f6966 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] HTTP exception thrown: Instance group cd23c362-b853-4d24-9ca0-59da24063cb0 could not be found. Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ebc09a4-8f90-480d-92da-3fb23e2f6966 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Request method failure captured: Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-server-groups/cd23c362-b853-4d24-9ca0-59da24063cb0 HTTP/1.1 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZRVJBFvbPqg3I2jSHWjDsA26ZbaxUwD4sxIk2eLybQK1UDAK9A08corIA7ZTO-UZfuWodZBhs_MYJOTXi-xfikwOJr6CVO7pKDOCvQv_28Geuz4dV0Rf7rVzPalg_nysI2t9dyk4Th7eAFGTjlsU-CbJEYgbwcuy3XWsoHohcD2FVo Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ed39068e4e3415696e57dac018e2c57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}] Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c77c5b13289445378e7808f3f720a6c1 Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance group cd23c362-b853-4d24-9ca0-59da24063cb0 could not be found. Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'cd23c362-b853-4d24-9ca0-59da24063cb0'} Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group cd23c362-b853-4d24-9ca0-59da24063cb0 could not be found. Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group cd23c362-b853-4d24-9ca0-59da24063cb0 could not be found. Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.199083 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group cd23c362-b853-4d24-9ca0-59da24063cb0 could not be found. Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ebc09a4-8f90-480d-92da-3fb23e2f6966 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Returning 404 to user: Instance group cd23c362-b853-4d24-9ca0-59da24063cb0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:08.203050 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ebc09a4-8f90-480d-92da-3fb23e2f6966 tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/cd23c362-b853-4d24-9ca0-59da24063cb0" status: 404 len: 117 microversion: 2.1 time: 0.014130 Aug 30 04:39:08.204367 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2811/5549] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:39:08 2022] DELETE /compute/v2.1/os-server-groups/cd23c362-b853-4d24-9ca0-59da24063cb0 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:08.226589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d84083ac-f5ef-4513-8746-fbef8a77f7dc tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.239422 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-d84083ac-f5ef-4513-8746-fbef8a77f7dc tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] HTTP exception thrown: Instance group 415436a0-c7b7-419d-ac6a-8794ceec3260 could not be found. Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d84083ac-f5ef-4513-8746-fbef8a77f7dc tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Request method failure captured: Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/os-server-groups/415436a0-c7b7-419d-ac6a-8794ceec3260 HTTP/1.1 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZRVJBFvbPqg3I2jSHWjDsA26ZbaxUwD4sxIk2eLybQK1UDAK9A08corIA7ZTO-UZfuWodZBhs_MYJOTXi-xfikwOJr6CVO7pKDOCvQv_28Geuz4dV0Rf7rVzPalg_nysI2t9dyk4Th7eAFGTjlsU-CbJEYgbwcuy3XWsoHohcD2FVo Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0ed39068e4e3415696e57dac018e2c57", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0ed39068e4e3415696e57dac018e2c57"}]}] Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 0ed39068e4e3415696e57dac018e2c57 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerGroupTestJSON-1040760658 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: c77c5b13289445378e7808f3f720a6c1 Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerGroupTestJSON-1040760658-project Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance group 415436a0-c7b7-419d-ac6a-8794ceec3260 could not be found. Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '415436a0-c7b7-419d-ac6a-8794ceec3260'} Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 415436a0-c7b7-419d-ac6a-8794ceec3260 could not be found. Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 415436a0-c7b7-419d-ac6a-8794ceec3260 could not be found. Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.241001 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 415436a0-c7b7-419d-ac6a-8794ceec3260 could not be found. Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d84083ac-f5ef-4513-8746-fbef8a77f7dc tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Returning 404 to user: Instance group 415436a0-c7b7-419d-ac6a-8794ceec3260 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:08.245111 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d84083ac-f5ef-4513-8746-fbef8a77f7dc tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/415436a0-c7b7-419d-ac6a-8794ceec3260" status: 404 len: 117 microversion: 2.1 time: 0.037115 Aug 30 04:39:08.246250 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2812/5550] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:39:08 2022] DELETE /compute/v2.1/os-server-groups/415436a0-c7b7-419d-ac6a-8794ceec3260 => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:08.253645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90bffe1f-2d21-48b6-bf72-2938cc100b2c tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.301061 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-90bffe1f-2d21-48b6-bf72-2938cc100b2c tempest-ServerGroupTestJSON-1040760658 tempest-ServerGroupTestJSON-1040760658-project] 10.222.0.27 "DELETE /compute/v2.1/os-server-groups/ea66a000-70bc-425b-801b-496985a74396" status: 204 len: 0 microversion: 2.1 time: 0.053393 Aug 30 04:39:08.303045 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2813/5551] 10.222.0.27 () {58 vars in 1266 bytes} [Tue Aug 30 04:39:08 2022] DELETE /compute/v2.1/os-server-groups/ea66a000-70bc-425b-801b-496985a74396 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:08.487513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:08.497945 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2becc49-aea8-4e8d-87e7-b0209fbac620 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.348812 Aug 30 04:39:08.510803 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2739/5552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:08 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:08.536732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-66406ce8-6d4b-4113-a0b5-f724fdf717d8 req-8758ca14-5f34-4d27-9866-fc44065f2e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec61768-5550-443f-a6f9-76935be69203", "name": "network-vif-plugged", "status": "completed", "tag": "8137999c-959b-432e-91db-f02b0312f533"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:08.557549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-66406ce8-6d4b-4113-a0b5-f724fdf717d8 req-8758ca14-5f34-4d27-9866-fc44065f2e69 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.558467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-66406ce8-6d4b-4113-a0b5-f724fdf717d8 req-8758ca14-5f34-4d27-9866-fc44065f2e69 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.559635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-66406ce8-6d4b-4113-a0b5-f724fdf717d8 req-8758ca14-5f34-4d27-9866-fc44065f2e69 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.576190 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-66406ce8-6d4b-4113-a0b5-f724fdf717d8 req-8758ca14-5f34-4d27-9866-fc44065f2e69 service nova] Creating event network-vif-plugged:8137999c-959b-432e-91db-f02b0312f533 for instance 6ec61768-5550-443f-a6f9-76935be69203 on n-h1-854925-5 Aug 30 04:39:08.584725 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-66406ce8-6d4b-4113-a0b5-f724fdf717d8 req-8758ca14-5f34-4d27-9866-fc44065f2e69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050435 Aug 30 04:39:08.586858 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2814/5553] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:08.826138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:08.828584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:08.854759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.856825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.857546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:08.858990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:08.859656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:08.860317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:09.047683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:09.056627 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b97d87a-1fba-4de5-8142-37681b1200e1 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.235388 Aug 30 04:39:09.057379 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2740/5554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:08 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:09.520567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:09.521275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:09.529056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:09.529579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:09.530019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:09.530718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:09.531169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:09.531600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:09.735537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:09.743466 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0003787-22bc-4289-8c8c-e9c7a2703955 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1309 microversion: 2.1 time: 0.227945 Aug 30 04:39:09.744554 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2815/5555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:09 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1309 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:10.078820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:10.080085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:10.095707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:10.096263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:10.096637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:10.103217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:10.103751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:10.104198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:10.286073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:10.295159 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da329d19-68d8-4683-8edc-387a6610bd6d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.220632 Aug 30 04:39:10.310398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2741/5556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:10 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:10.765319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:10.766593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:10.775390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:10.775891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:10.776336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:10.795467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:10.796182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:10.798302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.115110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:11.128055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-81721be1-14f1-4232-bee4-d04566272665 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1489 microversion: 2.1 time: 0.367207 Aug 30 04:39:11.129240 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2816/5557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:10 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1489 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:11.151835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1795411432"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:11.159946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:11.178861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.179351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.180923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.183857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.184356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.184788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.324916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:11.326945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:11.330188 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9b461df0-f483-473e-9eff-11a390c9ff10 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "PUT /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1074 microversion: 2.1 time: 0.182487 Aug 30 04:39:11.331323 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2742/5558] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:39:11 2022] PUT /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1074 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:11.358145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.358677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.359133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.359941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.360652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.361089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.364270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:11.365016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:11.375338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.376200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.376920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.377898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.378591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.379210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.780076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:11.796905 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d3e5baba-888e-4508-8ff2-9ba9c51ea1b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.481025 Aug 30 04:39:11.804900 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2817/5559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:11 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:11.811823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:11.823001 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-36dff03e-1f33-49fd-b813-02d643e2f138 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1500 microversion: 2.1 time: 0.475054 Aug 30 04:39:11.843611 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2743/5560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:11 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1500 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:11.851519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:11.852202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:11.860219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.860898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.861629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:11.862294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:11.862872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:11.863482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:12.112648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:12.130379 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-861dc22e-ddaa-4011-b292-99ab31c75fb5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1500 microversion: 2.1 time: 0.284804 Aug 30 04:39:12.131238 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2818/5561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:11 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1500 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:12.153209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f501c3d1-2876-434e-9552-8787956318b7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:12.160017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f501c3d1-2876-434e-9552-8787956318b7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:12.160772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f501c3d1-2876-434e-9552-8787956318b7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:12.161456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f501c3d1-2876-434e-9552-8787956318b7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:12.185648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f501c3d1-2876-434e-9552-8787956318b7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Going to try to stop instance {{(pid=122402) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 04:39:12.240179 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f501c3d1-2876-434e-9552-8787956318b7 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "POST /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203/action" status: 202 len: 0 microversion: 2.1 time: 0.091903 Aug 30 04:39:12.240799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2744/5562] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:12 2022] POST /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:39:12.249904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:12.250631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:12.257473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:12.258027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:12.258478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:12.259273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:12.259734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:12.260213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:12.601806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:12.614004 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33ce935a-1f20-4768-8b74-a659b467d1f9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.368331 Aug 30 04:39:12.615189 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2819/5563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:12 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:12.832670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:12.833819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:12.845141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:12.846593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:12.852162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:12.854167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:12.857943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:12.858648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:13.262513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:13.276930 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa798b87-22aa-4079-b9a4-aba8e89695e8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1677 microversion: 2.1 time: 0.446310 Aug 30 04:39:13.291757 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2745/5564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:12 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1677 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:13.638252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:13.638993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:13.647034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:13.647795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:13.648337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:13.649134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:13.650235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:13.650923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:13.847630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:13.859552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c222bec4-1557-4dd1-8fa7-7c495703867b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.227075 Aug 30 04:39:13.860772 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2820/5565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:13 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:14.298670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:14.299871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:14.309506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.310002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.310577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.311903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.312622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.313228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.633599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:14.648509 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2c7e7b9-4d62-4932-ac79-d182c29ba127 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1654 microversion: 2.1 time: 0.353567 Aug 30 04:39:14.649644 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2746/5566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:14 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1654 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:14.669583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c75fa24e-f523-48e4-80dc-f8c09b7acdb9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:14.677120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c75fa24e-f523-48e4-80dc-f8c09b7acdb9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.677868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c75fa24e-f523-48e4-80dc-f8c09b7acdb9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.678461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c75fa24e-f523-48e4-80dc-f8c09b7acdb9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.709251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c75fa24e-f523-48e4-80dc-f8c09b7acdb9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Going to try to start instance {{(pid=122403) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 04:39:14.764545 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c75fa24e-f523-48e4-80dc-f8c09b7acdb9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action" status: 202 len: 0 microversion: 2.1 time: 0.098816 Aug 30 04:39:14.765395 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2821/5567] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:14 2022] POST /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:39:14.775492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:14.776293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:14.783338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.784143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.784853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.786005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.786916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.787624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.896688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:14.897462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:14.907795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.907795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.908182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:14.912526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:14.915440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:14.917761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:15.632045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:15.641805 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d57f3c3a-3050-4664-b570-19bebd8e1617 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1663 microversion: 2.1 time: 0.871835 Aug 30 04:39:15.642396 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2747/5568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:14 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1663 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:15.708679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:15.723801 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3518fa3a-e815-41b6-821a-fe77edc3c7fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.842673 Aug 30 04:39:15.726083 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2822/5569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:14 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:16.668632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:16.670149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:16.681845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:16.686742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:16.687467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:16.688436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:16.689117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:16.689814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:16.745923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:16.747143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:16.761776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:16.762814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:16.763409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:16.764350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:16.778080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:16.778809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:17.151366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:17.160864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:17.169957 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc843be0-0c45-4889-8f98-7c7bf57604b5 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.428914 Aug 30 04:39:17.170104 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84ec8ad8-1802-403f-8ce5-177c331f022b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1663 microversion: 2.1 time: 0.505884 Aug 30 04:39:17.171163 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2748/5570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:16 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1663 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:17.178950 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2823/5571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:16 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:18.191457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:18.192078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:18.202755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:18.203413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:18.218430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:18.218914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:18.222866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:18.223252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:18.225382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:18.225847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:18.226409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:18.227226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:18.228299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:18.229001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:18.229516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:18.233001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:18.634373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:18.660592 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-57618f99-8764-4812-93d2-4704eab7e73c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1667 microversion: 2.1 time: 0.472939 Aug 30 04:39:18.669474 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2749/5572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:18 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1667 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:18.879170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:18.895958 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a246a5b-5ebd-404a-9f01-98114f26e743 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.698981 Aug 30 04:39:18.933640 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2824/5573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:18 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:19.955547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:19.957165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:19.973842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:19.975896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:19.978304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:19.979286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:19.982942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:19.983893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:20.390907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:20.408348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-67a88fae-9ed6-4d68-a16d-88928b6962c6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.456723 Aug 30 04:39:20.411377 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2750/5574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:19 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:21.366540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1678207572", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:21.435107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:21.436500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:21.452147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] validate_networks() for [('27fa2046-0bb2-41f9-8766-d50f2e2b01e0', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:39:21.452590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:21.453164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:21.453631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:21.454344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:21.454803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:21.455237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.166310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:22.175008 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11a25422-a653-4181-bdcd-66dd8ad7b525 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.745090 Aug 30 04:39:22.175707 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2751/5575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:21 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:22.592002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07846214-aa35-49d8-945d-3d4e8a1fbb4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Action: 'create', calling method: .version_select at 0x7fe96994bca0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1483683336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdWj6hhWNHQ9P0YCdObfAvoGPaSettILvvPeI24XwFdK1c6GJKBwHSdnxzJUw1Hpo4OWRGOT6LMgg0Pwoe+/+JFV3ApO/ZI1vjzYDpcTz33NEi7KPgnBhlUT8vc5UJRjw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:22.608895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-07846214-aa35-49d8-945d-3d4e8a1fbb4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Getting quotas for project 31b8981568fc4441bdf38caf7ad25f53. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:22.614291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-07846214-aa35-49d8-945d-3d4e8a1fbb4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Getting quotas for user 5b5ad8d1e2754e0d92305fc3f645876a and project 31b8981568fc4441bdf38caf7ad25f53. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:22.643804 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07846214-aa35-49d8-945d-3d4e8a1fbb4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057240 Aug 30 04:39:22.645010 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2752/5576] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:39:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:22.693461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:39:22.694425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:39:22.694935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:39:22.695525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:39:22.696816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:39:22.706860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.707335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.707871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.708625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:22.709255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:22.709969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:22.730524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Getting quotas for project 794f15db103e419c838d09d71e74c5ca. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:22.741125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Getting quotas for user cae3abbe74a54a7cba5137e36d27b2a6 and project 794f15db103e419c838d09d71e74c5ca. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:22.756239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:39:22.760856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:39:22.812382 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-714c485c-cca5-4e45-8a23-d7ce001c66e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.623549 Aug 30 04:39:22.825073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8788adf7-c352-4e2e-90d9-fafde2deb2cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:22.826302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8788adf7-c352-4e2e-90d9-fafde2deb2cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:22.827696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2825/5577] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:39:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:39:22.934510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8788adf7-c352-4e2e-90d9-fafde2deb2cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:22.945851 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8788adf7-c352-4e2e-90d9-fafde2deb2cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1217 microversion: 2.1 time: 0.125292 Aug 30 04:39:22.948278 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2753/5578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:22 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:23.197212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:23.198453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:23.209525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:23.210343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:23.210708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:23.211436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:23.212947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:23.213606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:23.535026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:23.546059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ee1fd608-de6d-466c-a6f2-e3e829e2cf55 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.353145 Aug 30 04:39:23.547337 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2826/5579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:23 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:23.970426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:23.971016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:23.988063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:23.988549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:23.989010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:23.989739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:23.990314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:23.990608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:24.024002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:24.080180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:24.089373 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51a63a57-798e-4008-a803-abe15557feaa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1269 microversion: 2.1 time: 0.122864 Aug 30 04:39:24.090248 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2754/5580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:23 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1269 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:24.377838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1485045773", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2e5c7572-18b6-47ef-997b-d98078d1fd47", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1483683336", "security_groups": [{"name": "tempest-secgroup-smoke-320364001"}], "networks": [{"uuid": "f64095ce-83b6-4b33-bee5-07a9e3230977"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:24.569597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:24.570229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:24.583711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:24.584308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:24.585137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:24.588197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:24.589408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:24.590562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:24.659323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] validate_networks() for [('f64095ce-83b6-4b33-bee5-07a9e3230977', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:39:24.995248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:25.008258 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c71b5dcc-2d0b-42e4-9ab5-455cb8cdafc6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.442948 Aug 30 04:39:25.022047 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2755/5581] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:24 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:25.112548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:25.113647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:25.123633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:25.124524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:25.125131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:25.126095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:25.126704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:25.127490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:25.252632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:25.263242 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a13baf5e-794e-4907-bfe8-4d5f47550e6f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1275 microversion: 2.1 time: 0.155946 Aug 30 04:39:25.264745 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2756/5582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:25 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:25.666783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:39:25.667288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:39:25.667650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:39:25.668184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:39:25.668523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:39:25.695866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:25.696928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:25.697393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:25.698127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:25.698575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:25.699666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:25.734753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Getting quotas for project 31b8981568fc4441bdf38caf7ad25f53. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:25.742047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Getting quotas for user 5b5ad8d1e2754e0d92305fc3f645876a and project 31b8981568fc4441bdf38caf7ad25f53. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:25.823725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:39:25.825816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e5c7572-18b6-47ef-997b-d98078d1fd47',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:39:26.031275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:26.032159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:26.043696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:26.044612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:26.045212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:26.046284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:26.046949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:26.047375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:26.059436 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95db69b2-b2a3-4951-abd9-5ffa3e7bcce9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.686281 Aug 30 04:39:26.065972 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2827/5583] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:39:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:39:26.075846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f6459df-2a96-4f88-a469-92e356e97c4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:26.076984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9f6459df-2a96-4f88-a469-92e356e97c4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:26.495061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9f6459df-2a96-4f88-a469-92e356e97c4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:26.502556 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f6459df-2a96-4f88-a469-92e356e97c4a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1099 microversion: 2.1 time: 0.432111 Aug 30 04:39:26.503349 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2828/5584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:26 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1099 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:26.517048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:26.517704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:26.521948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:26.528695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:26.529576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:26.530276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:26.531527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:26.532167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:26.532752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:26.707542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:26.723316 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20d40409-2fe0-44c1-84b9-b32b6184ad2a tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.695824 Aug 30 04:39:26.724665 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2757/5585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:26 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:26.803462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:26.813289 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3c9f9161-2b98-46d3-afee-97c9aaeaab1d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1317 microversion: 2.1 time: 0.308738 Aug 30 04:39:26.813925 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2829/5586] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:26 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:27.210742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4c1044f4-62a9-4349-bbf4-67e5e3e035a5 req-7ca46419-d12b-4e19-9a23-6aea52732408 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6022067-fd07-48f1-abc8-c400ad50ccd0", "tag": "40a2327c-07b2-4270-8067-e8e4815b60b5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:27.224390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4c1044f4-62a9-4349-bbf4-67e5e3e035a5 req-7ca46419-d12b-4e19-9a23-6aea52732408 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.224882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4c1044f4-62a9-4349-bbf4-67e5e3e035a5 req-7ca46419-d12b-4e19-9a23-6aea52732408 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.225390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4c1044f4-62a9-4349-bbf4-67e5e3e035a5 req-7ca46419-d12b-4e19-9a23-6aea52732408 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.237706 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4c1044f4-62a9-4349-bbf4-67e5e3e035a5 req-7ca46419-d12b-4e19-9a23-6aea52732408 service nova] Creating event network-changed:40a2327c-07b2-4270-8067-e8e4815b60b5 for instance b6022067-fd07-48f1-abc8-c400ad50ccd0 on n-h2-854925-5 Aug 30 04:39:27.244283 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4c1044f4-62a9-4349-bbf4-67e5e3e035a5 req-7ca46419-d12b-4e19-9a23-6aea52732408 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038467 Aug 30 04:39:27.245291 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2758/5587] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:27.523414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:27.524427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:27.532339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.533136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.534408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.535335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.536003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.536620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.648029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:27.659403 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c02e284a-bcab-4888-884a-2aeabba5dd81 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1197 microversion: 2.1 time: 0.139918 Aug 30 04:39:27.660921 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2830/5588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:27 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:27.745777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:27.747095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:27.753899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.754391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.754828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.755600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.756078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.756509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.836229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:27.837779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:27.846918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.848436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.849876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.850932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:27.854340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:27.855280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:27.858686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:28.121393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:28.133594 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-123e9641-e111-4cc5-b45a-2872ed752928 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.389092 Aug 30 04:39:28.134244 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2759/5589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:27 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:28.180922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:28.189888 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a7253b9-a47b-4ed1-ae23-e76222a82089 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1317 microversion: 2.1 time: 0.357538 Aug 30 04:39:28.193295 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2831/5590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:27 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:28.684301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:28.684918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:28.703020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:28.703992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:28.704640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:28.707451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:28.708521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:28.709536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:28.835939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:28.848499 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e28d493-0af0-46a3-9f5b-fe400271d091 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1215 microversion: 2.1 time: 0.168493 Aug 30 04:39:28.851059 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2760/5591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:28 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:29.160150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:29.160871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:29.174196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.175071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.181768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.182788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.183454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.184075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.212958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:29.219045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:29.231210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.232629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.233391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.238860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.240530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.242073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.700394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:29.710400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c74a409c-2c45-4fb4-a3ba-1b6ae661e5be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.555979 Aug 30 04:39:29.713093 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2832/5592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:29 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:29.763259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:29.772846 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ccd08cf0-f47f-48af-b231-f4d7275c9efb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1317 microversion: 2.1 time: 0.564138 Aug 30 04:39:29.773646 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2761/5593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:29 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1317 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:29.878460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:29.879095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:29.891963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.892471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.892915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:29.893670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:29.894130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:29.894558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:30.315379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:30.332599 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6ae64d9c-746b-4970-a5c3-77517614b836 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1282 microversion: 2.1 time: 0.461913 Aug 30 04:39:30.333225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2833/5594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:29 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1282 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:30.735372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:30.735983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:30.750304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:30.751313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:30.751927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:30.752803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:30.753465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:30.754053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:30.794791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:30.795391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:30.815358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:30.815855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:30.818043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:30.823135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:30.823741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:30.826113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.280671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:31.291259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e524a75e-7a7d-4abc-840e-4bb87d050dbf tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.560567 Aug 30 04:39:31.292548 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2762/5595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:30 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:31.304209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a7441e96-2542-48de-bf28-2e2ae1253250 req-9b0c7d46-2e12-4e33-8754-08946498b72b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34bbc66-38a3-4ec2-a11b-d703c31b8d6a", "tag": "53d0e403-9119-49ad-8be3-0bd0b4d7d201"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:31.325574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:31.326673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a7441e96-2542-48de-bf28-2e2ae1253250 req-9b0c7d46-2e12-4e33-8754-08946498b72b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.327163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a7441e96-2542-48de-bf28-2e2ae1253250 req-9b0c7d46-2e12-4e33-8754-08946498b72b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.327804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a7441e96-2542-48de-bf28-2e2ae1253250 req-9b0c7d46-2e12-4e33-8754-08946498b72b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.337808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-00709c79-c9e9-403a-9fbb-b68422352294 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1317 microversion: 2.1 time: 0.546940 Aug 30 04:39:31.341002 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2834/5596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:30 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1317 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:31.341296 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a7441e96-2542-48de-bf28-2e2ae1253250 req-9b0c7d46-2e12-4e33-8754-08946498b72b service nova] Creating event network-changed:53d0e403-9119-49ad-8be3-0bd0b4d7d201 for instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a on n-h1-854925-5 Aug 30 04:39:31.347241 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a7441e96-2542-48de-bf28-2e2ae1253250 req-9b0c7d46-2e12-4e33-8754-08946498b72b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053309 Aug 30 04:39:31.348812 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2763/5597] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:31.361675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:31.362469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:31.372259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.372761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.373202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:31.373966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:31.374417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:31.374841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:32.047554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:32.056439 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3f38e771-8a55-40af-89c0-8b81eb0ee0b4 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1282 microversion: 2.1 time: 0.698825 Aug 30 04:39:32.073910 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2835/5598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:31 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1282 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:32.316509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:32.317829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:32.325832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:32.326327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:32.326930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:32.327812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:32.329468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:32.330108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:32.364703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:32.365559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:32.380287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:32.382900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:32.384086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:32.387711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:32.388296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:32.388823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:32.660820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:32.670879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-41aa3d06-5a25-4f6a-aa73-bff90499f744 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.359517 Aug 30 04:39:32.685888 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2764/5599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:32 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:33.067543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:33.148692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-28ab9776-633b-4d0b-a3c2-a94fd56ef430 req-4463495e-cefb-47e8-a113-40fc177de540 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6022067-fd07-48f1-abc8-c400ad50ccd0", "name": "network-vif-plugged", "status": "completed", "tag": "40a2327c-07b2-4270-8067-e8e4815b60b5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:33.185775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-28ab9776-633b-4d0b-a3c2-a94fd56ef430 req-4463495e-cefb-47e8-a113-40fc177de540 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.186574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-28ab9776-633b-4d0b-a3c2-a94fd56ef430 req-4463495e-cefb-47e8-a113-40fc177de540 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.187169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-28ab9776-633b-4d0b-a3c2-a94fd56ef430 req-4463495e-cefb-47e8-a113-40fc177de540 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.214453 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-28ab9776-633b-4d0b-a3c2-a94fd56ef430 req-4463495e-cefb-47e8-a113-40fc177de540 service nova] Creating event network-vif-plugged:40a2327c-07b2-4270-8067-e8e4815b60b5 for instance b6022067-fd07-48f1-abc8-c400ad50ccd0 on n-h2-854925-5 Aug 30 04:39:33.220305 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-28ab9776-633b-4d0b-a3c2-a94fd56ef430 req-4463495e-cefb-47e8-a113-40fc177de540 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165643 Aug 30 04:39:33.221402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2765/5600] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:33.228092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:33.229001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:33.245766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.266478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.266478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.266478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.268711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.269201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.276729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:33.289150 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-914541f2-fcac-4849-a960-a561c9086cdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1317 microversion: 2.1 time: 0.929666 Aug 30 04:39:33.316525 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2836/5601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:32 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1317 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:33.571819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:33.580211 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-795dce19-6e4e-4d89-b506-07e37a6c9230 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1282 microversion: 2.1 time: 0.357568 Aug 30 04:39:33.580799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2766/5602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:33 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1282 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:33.693504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:33.694110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:33.701646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.702348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.702770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.703640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:33.704090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:33.704688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:33.847862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:33.856801 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d62a278-2716-4804-b1e1-a7f63c37469c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.167071 Aug 30 04:39:33.857421 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2837/5603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:33 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:34.318107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:34.318745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:34.325964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.326449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.326904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.327613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.328249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.328681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.501661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:34.514474 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9388c821-bf57-4fdf-9bea-3e0408d64659 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1317 microversion: 2.1 time: 0.200409 Aug 30 04:39:34.515223 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2767/5604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:34 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:34.603080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:34.603811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:34.609814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.610378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.610911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.611681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.612211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.612717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.769134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:34.780536 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a45655a9-8f61-490c-bee7-867f03586a49 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.181931 Aug 30 04:39:34.781102 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2838/5605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:34 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:34.877465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:34.878192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:34.884428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.885183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.885711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:34.886467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:34.886999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:34.887490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:35.024798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:35.033463 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6bb1761a-606d-44b7-b96d-a72654feab30 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.159917 Aug 30 04:39:35.034058 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2768/5606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:34 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:35.535577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:35.536216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:35.542825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:35.543315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:35.543762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:35.544459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:35.544946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:35.545438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:35.683765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:35.691648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78affb7b-9e0e-4543-840b-a88d1e7ad37f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.159932 Aug 30 04:39:35.692294 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2839/5607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:35 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:35.751281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1542635579", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:35.806884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:35.807521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:35.808492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] validate_networks() for [('27fa2046-0bb2-41f9-8766-d50f2e2b01e0', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:39:35.809979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:35.825894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:35.826671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:35.827186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:35.828038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:35.828574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:35.829103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.031980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:36.040888 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40367f89-b99d-4ec5-a393-a533dc5b0b75 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.238614 Aug 30 04:39:36.041752 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2840/5608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:35 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:36.055810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:36.056719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:36.062887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:36.063393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:36.063846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.064575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:36.065041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:36.065508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.302401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:36.313065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ebdf54b-f135-45c6-a5c5-78dc11f9c267 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.261856 Aug 30 04:39:36.313917 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2841/5609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:36 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:36.344051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:39:36.344534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:39:36.344941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:39:36.345398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:39:36.345821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:39:36.355563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:36.356048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:36.356520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.357254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:36.357807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:36.358238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:36.375132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Getting quotas for project 794f15db103e419c838d09d71e74c5ca. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:39:36.380405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Getting quotas for user cae3abbe74a54a7cba5137e36d27b2a6 and project 794f15db103e419c838d09d71e74c5ca. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:39:36.394254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:39:36.396614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:39:36.445701 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3254989f-a867-4c08-b845-1150d00c4adf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698258 Aug 30 04:39:36.452243 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2769/5610] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:39:36.459109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e54d36b9-3d3b-4043-aca9-5b622fffc38c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:36.459731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e54d36b9-3d3b-4043-aca9-5b622fffc38c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:36.502357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=14 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:36.521581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e54d36b9-3d3b-4043-aca9-5b622fffc38c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:36.529784 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e54d36b9-3d3b-4043-aca9-5b622fffc38c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1217 microversion: 2.1 time: 0.075485 Aug 30 04:39:36.541362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2842/5611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:36 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:37.063192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:37.063829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:37.071720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.072244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.072651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.073379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.074149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.074751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.333815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:37.334455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:37.343152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.343636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.344076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.344783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.345246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.345695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.375069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:37.384195 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2b760c0-caed-4648-8a9c-5e6f2594a343 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.324661 Aug 30 04:39:37.384778 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2770/5612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:37 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:37.551795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:37.552365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:37.554520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:37.561356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.561905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.562342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.563407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:37.565109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:37.565583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:37.652540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:37.660827 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f0e1bb60-5d1e-4a5d-a8c3-a626ec8236c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.330728 Aug 30 04:39:37.661414 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2843/5613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:37 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:37.702777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:37.711620 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f0a8094-bcaa-41a5-bb00-282a68aa4067 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1269 microversion: 2.1 time: 0.164051 Aug 30 04:39:37.712503 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2771/5614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:37 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:38.404811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:38.405432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:38.412168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.412650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.413083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.413797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.414253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.415296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.682704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:38.683328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:38.690517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.691147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.691651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.692521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.693254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.693767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.720773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:38.732221 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-15acd5af-07ff-4a53-a7ee-def311057d6d tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.331435 Aug 30 04:39:38.732980 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2844/5615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:38 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:38.737802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:38.740448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:38.753863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.754365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.755160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:38.755948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:38.756761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:38.757207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:39.143562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:39.154024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-61bce603-a90b-4b65-92df-87727af43d72 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.475754 Aug 30 04:39:39.155023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2772/5616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:38 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:39.156644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:39.176576 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f3782b06-cbef-466c-be4c-7331fe4970bd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.442236 Aug 30 04:39:39.177577 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2845/5617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:38 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:39.752584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:39.753923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:39.761051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:39.761719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:39.762298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:39.763103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:39.763671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:39.764197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.058297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:40.060726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:40.067747 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d37e961-ba94-4143-a2a8-b30942b9781b tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.319330 Aug 30 04:39:40.068332 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2773/5618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:39 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:40.174028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:40.174656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:40.181300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:40.181815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:40.182257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.182957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:40.183414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:40.183845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.197855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:40.199268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:40.210990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:40.212081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:40.212520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.213680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:40.213806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:40.214141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.509450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:40.519922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:40.527124 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b038cdbf-fce7-4316-8152-def6b0984eed tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.356922 Aug 30 04:39:40.533666 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-443ebb42-e7a2-40a9-94a5-7573e474aaad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.339711 Aug 30 04:39:40.534516 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2774/5619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:40 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:40.544420 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2846/5620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:40 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:40.664833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-890d6de0-002d-4d18-aee2-a38bdfbf2963 req-9117d742-f173-4d7a-bb89-2904ddaf5031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a3e1080-c0f8-4a45-af28-ecc0783e3ae0", "tag": "67d6b0c9-cf5d-4bee-8f6c-40d9f18b10f8"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:40.684130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-890d6de0-002d-4d18-aee2-a38bdfbf2963 req-9117d742-f173-4d7a-bb89-2904ddaf5031 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:40.684785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-890d6de0-002d-4d18-aee2-a38bdfbf2963 req-9117d742-f173-4d7a-bb89-2904ddaf5031 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:40.685471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-890d6de0-002d-4d18-aee2-a38bdfbf2963 req-9117d742-f173-4d7a-bb89-2904ddaf5031 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:40.701144 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-890d6de0-002d-4d18-aee2-a38bdfbf2963 req-9117d742-f173-4d7a-bb89-2904ddaf5031 service nova] Creating event network-changed:67d6b0c9-cf5d-4bee-8f6c-40d9f18b10f8 for instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 on n-h2-854925-5 Aug 30 04:39:40.716764 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-890d6de0-002d-4d18-aee2-a38bdfbf2963 req-9117d742-f173-4d7a-bb89-2904ddaf5031 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057898 Aug 30 04:39:40.718089 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2775/5621] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:41.088406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:41.089179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:41.096576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.097144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.097672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:41.098585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.099042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.099469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:41.239650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:41.248565 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e8920cc-b23d-469d-8b0f-c652ff2574f9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.164256 Aug 30 04:39:41.249151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2847/5622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:41 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:41.548777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:41.549491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:41.555916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.556499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.556923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:41.557640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.558093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.558516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:41.561319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:41.562435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:41.569025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.569800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.570248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:41.570970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:41.571459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:41.571897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:41.754964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:41.764943 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5fe51e4a-ab16-4c4e-9c7c-ff280d7d74b4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.220917 Aug 30 04:39:41.777346 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2776/5623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:41 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:41.779741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:41.782106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:41.789065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d053ba17-353b-4252-a14a-a70a2dfaa18e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.232431 Aug 30 04:39:41.790229 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2848/5624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:41 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:42.268165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:42.268699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:42.274972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.275456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.275891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.276593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.277041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.277493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.500367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:42.510907 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08f0eacb-0009-4b52-84a7-78e7fd9c5c08 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.246675 Aug 30 04:39:42.511751 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2777/5625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:42 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:42.786905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:42.787444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:42.795415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.795906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.796339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.797038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.797523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.797944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.811711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:42.813149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:42.823147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.823918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.824504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:42.825425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:42.826048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:42.826669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:43.092214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:43.100946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6c7dc38-6ca2-42f6-a9db-71e733471015 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1510 microversion: 2.1 time: 0.318139 Aug 30 04:39:43.104295 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2849/5626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:42 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1510 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:43.126305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:43.137630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d27e221d-bf2b-43de-b13a-d20ff48c3bcf tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.329659 Aug 30 04:39:43.150096 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2778/5627] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:42 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:43.532746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:43.533390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:43.539889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:43.540369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:43.540830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:43.541560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:43.542012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:43.542435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:43.679695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:43.688141 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-523cd45c-e8e7-4c84-976e-cfe14a6392a9 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.160109 Aug 30 04:39:43.688718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2850/5628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:43 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:43.954322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:43.956684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:43.965408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:43.966641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:43.966746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:43.967617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:43.968201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:43.968701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.041719 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3953870-7fcf-4adc-ab3c-8b72f55d8591 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action" status: 200 len: 24568 microversion: 2.1 time: 0.091100 Aug 30 04:39:44.048668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2779/5629] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:39:43 2022] POST /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73/action => generated 24568 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:39:44.124872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:44.125640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:44.132586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.133148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.133686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.134449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.134979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.135606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.163849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:44.165152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:44.180907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.180907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.180907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.180907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.180907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.181432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.329203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:44.339540 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0156b1e9-07a9-44f2-a871-c8fccad984fe tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1487 microversion: 2.1 time: 0.218119 Aug 30 04:39:44.348807 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2851/5630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:44 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1487 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:44.362010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1717931836"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:44.365321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:44.372257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.372841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.373509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.375319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.375750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:44.376142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.376735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.384470 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-401b9afe-1001-4ec6-a981-d318cb16a23c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.225498 Aug 30 04:39:44.385415 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2780/5631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:44 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:44.450413 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-57b14863-6be7-4ed7-ae45-e67a23964412 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "PUT /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1060 microversion: 2.1 time: 0.092240 Aug 30 04:39:44.463046 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2852/5632] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:39:44 2022] PUT /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1060 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:44.469021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:44.469724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:44.478770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.479198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.479630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.480537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.481008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.481467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.630127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:44.638160 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-95cb1b30-b526-456c-91fd-7823820858a1 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1487 microversion: 2.1 time: 0.173865 Aug 30 04:39:44.638743 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2781/5633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:44 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1487 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:44.658614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:44.659337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:44.666218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.666728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.667179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.667880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.668341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.668769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.708069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:44.708840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:44.716580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.717408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.717940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.718718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.719414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.720048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.872494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:44.886775 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f58b0bb0-d496-4056-817e-e353678cd5c9 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1487 microversion: 2.1 time: 0.231965 Aug 30 04:39:44.887649 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2853/5634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:44 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1487 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:44.902677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:44.910729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3d754696-8fff-46f5-a27f-41a15b99def8 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.206581 Aug 30 04:39:44.918293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:44.919103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:44.927292 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2782/5635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:44 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:44.927632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.928140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.928594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.929318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:44.929813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:44.930292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:44.974453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:39:45.061037 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9b5578e-c005-4736-a646-63086bb76d6c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 204 len: 0 microversion: 2.1 time: 0.143958 Aug 30 04:39:45.061037 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2854/5636] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:44 2022] DELETE /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:45.069621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:45.070332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:45.081401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:45.082170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:45.082777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:45.083652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:45.084288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:45.085624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:45.251538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:45.260825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14f8eea8-606b-45cd-bcc2-62fa35dadd1b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1493 microversion: 2.1 time: 0.195616 Aug 30 04:39:45.261612 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2783/5637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:45 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1493 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:45.408092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:45.409009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:45.415890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:45.416550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:45.416995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:45.417989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:45.418656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:45.419215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:45.563621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:45.571350 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4c9bbe9-3896-4ede-a3c0-c83e73e42056 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.167859 Aug 30 04:39:45.571924 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2855/5638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:45 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:45.934466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:45.935345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:45.941492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:45.949715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:45.950219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:45.950939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:45.951408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:45.951836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:46.082579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:46.093535 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a33d15c8-394f-4971-b66c-f16281160a1e tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.163276 Aug 30 04:39:46.094128 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2784/5639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:45 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:46.281597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:46.282210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:46.289012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:46.290269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:46.290707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:46.291435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:46.291885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:46.292307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:46.429529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:46.438277 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b46e847f-6076-4a5c-bb73-5adaa490abd8 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1493 microversion: 2.1 time: 0.160596 Aug 30 04:39:46.439222 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2856/5640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:46 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1493 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:46.563303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a57c3285-b280-49bf-b6b0-70e675a7d527 req-35425cc6-3f36-442f-a460-4fb62a034128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34bbc66-38a3-4ec2-a11b-d703c31b8d6a", "name": "network-vif-plugged", "status": "completed", "tag": "53d0e403-9119-49ad-8be3-0bd0b4d7d201"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:46.569805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:46.570538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:46.580904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a57c3285-b280-49bf-b6b0-70e675a7d527 req-35425cc6-3f36-442f-a460-4fb62a034128 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:46.581682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a57c3285-b280-49bf-b6b0-70e675a7d527 req-35425cc6-3f36-442f-a460-4fb62a034128 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:46.582313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a57c3285-b280-49bf-b6b0-70e675a7d527 req-35425cc6-3f36-442f-a460-4fb62a034128 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:46.592570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:46.593200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:46.595236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:46.601730 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a57c3285-b280-49bf-b6b0-70e675a7d527 req-35425cc6-3f36-442f-a460-4fb62a034128 service nova] Creating event network-vif-plugged:53d0e403-9119-49ad-8be3-0bd0b4d7d201 for instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a on n-h1-854925-5 Aug 30 04:39:46.602157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:46.602814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:46.603445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:46.604323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:46.607039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:46.607170 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a57c3285-b280-49bf-b6b0-70e675a7d527 req-35425cc6-3f36-442f-a460-4fb62a034128 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047944 Aug 30 04:39:46.607630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:46.608081 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2785/5641] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:46.825837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:46.835483 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-821fcd59-b777-4ec1-876c-ce177b84f6f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.247036 Aug 30 04:39:46.836733 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2857/5642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:46 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:47.121587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:47.122717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:47.130959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:47.131790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:47.132335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:47.133182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:47.133919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:47.134573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:47.357810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a55dd05d-509a-4b63-9c5e-e636bee5988e req-cf444a85-c321-458b-b975-32dec7d1344e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ec61768-5550-443f-a6f9-76935be69203", "name": "network-vif-deleted", "tag": "8137999c-959b-432e-91db-f02b0312f533"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:47.365591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:47.374686 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-42cba17c-5b85-4009-97af-345ff700abbd tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.262671 Aug 30 04:39:47.387939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a55dd05d-509a-4b63-9c5e-e636bee5988e req-cf444a85-c321-458b-b975-32dec7d1344e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:47.387939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a55dd05d-509a-4b63-9c5e-e636bee5988e req-cf444a85-c321-458b-b975-32dec7d1344e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:47.387939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a55dd05d-509a-4b63-9c5e-e636bee5988e req-cf444a85-c321-458b-b975-32dec7d1344e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:47.389006 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2786/5643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:47 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:47.400848 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a55dd05d-509a-4b63-9c5e-e636bee5988e req-cf444a85-c321-458b-b975-32dec7d1344e service nova] Creating event network-vif-deleted:8137999c-959b-432e-91db-f02b0312f533 for instance 6ec61768-5550-443f-a6f9-76935be69203 on n-h1-854925-5 Aug 30 04:39:47.406794 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a55dd05d-509a-4b63-9c5e-e636bee5988e req-cf444a85-c321-458b-b975-32dec7d1344e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053274 Aug 30 04:39:47.407941 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2858/5644] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:47.460088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:47.460704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:47.467928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:47.468768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:47.469200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:47.470188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:47.470735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:47.471051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:47.538371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:47.547082 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31540417-0c86-4250-908b-2ff161b25225 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1451 microversion: 2.1 time: 0.090902 Aug 30 04:39:47.547666 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2787/5645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:47 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1451 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:47.857504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:47.858206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:47.865346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:47.865859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:47.866309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:47.867007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:47.867465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:47.871853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:48.026939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:48.035020 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f63af62f-a62c-4849-8977-a7fcff3d41e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.182220 Aug 30 04:39:48.035603 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2859/5646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:47 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:48.396590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:48.398810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:48.406794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:48.407450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:48.408013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:48.408820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:48.409999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:48.410533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:48.552692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:48.561395 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-059f0b54-6ca9-4582-85f2-1a2a26a2ee7a tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1270 microversion: 2.1 time: 0.168722 Aug 30 04:39:48.562091 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2788/5647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:48 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:48.568077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:48.568990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:48.576126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:48.576724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:48.577173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:48.578389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:48.579340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:48.579957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:48.614511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:48.615030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:48.615476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:48.615949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lazy-loading 'fault' on Instance uuid 6ec61768-5550-443f-a6f9-76935be69203 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:39:48.626036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2eb1871b-c2c8-4d8c-ac7d-8da663d16418 req-60b97040-18e5-4053-8eee-2416734d2bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3e1080-c0f8-4a45-af28-ecc0783e3ae0", "name": "network-vif-plugged", "status": "completed", "tag": "67d6b0c9-cf5d-4bee-8f6c-40d9f18b10f8"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:48.642909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2eb1871b-c2c8-4d8c-ac7d-8da663d16418 req-60b97040-18e5-4053-8eee-2416734d2bf9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:48.643377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2eb1871b-c2c8-4d8c-ac7d-8da663d16418 req-60b97040-18e5-4053-8eee-2416734d2bf9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:48.643813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2eb1871b-c2c8-4d8c-ac7d-8da663d16418 req-60b97040-18e5-4053-8eee-2416734d2bf9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:48.658794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:48.661612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2eb1871b-c2c8-4d8c-ac7d-8da663d16418 req-60b97040-18e5-4053-8eee-2416734d2bf9 service nova] Creating event network-vif-plugged:67d6b0c9-cf5d-4bee-8f6c-40d9f18b10f8 for instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 on n-h2-854925-5 Aug 30 04:39:48.667430 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2eb1871b-c2c8-4d8c-ac7d-8da663d16418 req-60b97040-18e5-4053-8eee-2416734d2bf9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044932 Aug 30 04:39:48.668944 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2789/5648] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:48.669172 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4dab411-e4db-415c-90ab-fad55ff8b13c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 200 len: 1310 microversion: 2.1 time: 0.104803 Aug 30 04:39:48.669873 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2860/5649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:48 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 1310 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:49.059221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.059927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.066345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.066834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.067300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.067991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.068443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.068866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.202294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:49.210212 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5959d1e2-12a8-47b7-93e2-961d596f7742 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1317 microversion: 2.1 time: 0.155234 Aug 30 04:39:49.210842 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2790/5650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:49.588723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.589369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.596702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.597195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.597679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.598384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.598852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.599317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.691667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.692883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.702114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.702866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.703687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.704573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.705455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.705740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.722122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 HTTP/1.1 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6ec61768-5550-443f-a6f9-76935be69203'} Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.723799 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-453461bc-8ced-4fa7-8b03-ebbc10aaaf0b tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 404 len: 111 microversion: 2.1 time: 0.037348 Aug 30 04:39:49.728383 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2791/5651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:49.741500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.742088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.747296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:49.749026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.749623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.750133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.750907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.751427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.751929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.756462 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8903c6a1-591b-4d21-9925-f636ea13f945 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1459 microversion: 2.1 time: 0.172201 Aug 30 04:39:49.758233 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2861/5652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1459 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:49.771043 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 HTTP/1.1 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6ec61768-5550-443f-a6f9-76935be69203'} Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:49.772769 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.777795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:49.778628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.779167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.779301 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-acfbc671-98dd-4122-ad36-1182439817ae tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 404 len: 111 microversion: 2.1 time: 0.041589 Aug 30 04:39:49.781910 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2792/5653] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:49 2022] DELETE /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:49.785822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.786311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.786980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.787679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.788044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.788311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.788743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.789463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 6ec61768-5550-443f-a6f9-76935be69203] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.795839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.796456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.797259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.798058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.798895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.799289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.816176 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 HTTP/1.1 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6ec61768-5550-443f-a6f9-76935be69203'} Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.817844 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 6ec61768-5550-443f-a6f9-76935be69203 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-abf2f30d-ae23-45e5-871d-3e64e6657395 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203" status: 404 len: 111 microversion: 2.1 time: 0.036644 Aug 30 04:39:49.823408 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2793/5654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/6ec61768-5550-443f-a6f9-76935be69203 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:49.830851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.831349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.837238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.837764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.838205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.838902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.839353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.839778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.855160 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a HTTP/1.1 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e7915c0c-c620-45c5-8cd6-d95cad21f94a'} Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:49.857233 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-165c5af4-a0c5-448a-8526-d64261aa1252 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 404 len: 111 microversion: 2.1 time: 0.031816 Aug 30 04:39:49.862019 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2794/5655] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:49 2022] DELETE /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:49.867479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.868801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e7915c0c-c620-45c5-8cd6-d95cad21f94a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.875401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.876145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.876892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.878149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.878940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.879376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.895722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a HTTP/1.1 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e7915c0c-c620-45c5-8cd6-d95cad21f94a'} Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.897500 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.901830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance e7915c0c-c620-45c5-8cd6-d95cad21f94a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:49.903207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74a63629-706b-422a-9d0b-882fe62f50c4 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a" status: 404 len: 111 microversion: 2.1 time: 0.039171 Aug 30 04:39:49.903350 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2795/5656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/e7915c0c-c620-45c5-8cd6-d95cad21f94a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:49.912342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.912834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.919594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.920083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.920521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.921217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.921994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.922596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.927609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:49.939505 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 HTTP/1.1 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973'} Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:49.941113 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.945794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.947225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:49.947913 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-883517aa-d3b8-48cf-8b8e-7e8b51c774eb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 404 len: 111 microversion: 2.1 time: 0.039427 Aug 30 04:39:49.948461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:49.951620 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2796/5657] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:49 2022] DELETE /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:49.956907 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-11d84b5c-a8f5-43b4-a806-0c59af5f42df tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1459 microversion: 2.1 time: 0.182071 Aug 30 04:39:49.957114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.957767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:49.967480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2862/5658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1459 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:49.967636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.967636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.967636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.967636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:49.967636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:49.967636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:49.981672 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 HTTP/1.1 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973'} Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:49.983294 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-10644e01-91a1-4bc6-9c7e-37f908e80ba0 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973" status: 404 len: 111 microversion: 2.1 time: 0.031534 Aug 30 04:39:49.987305 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2797/5659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:49 2022] GET /compute/v2.1/servers/0e3f70a4-7d8d-42e6-b43d-98b6c0eb2973 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:49.994710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:49.995222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.001856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.002530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.002797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.003512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.003973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.004404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.020098 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df HTTP/1.1 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '010dd0eb-3a66-47a1-adea-743a8fc880df'} Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.022028 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8bcace8f-785a-4e40-b053-8e879518aa3f tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 404 len: 111 microversion: 2.1 time: 0.034266 Aug 30 04:39:50.030663 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2863/5660] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:49 2022] DELETE /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:50.033355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.033974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 010dd0eb-3a66-47a1-adea-743a8fc880df] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.042315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.042804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.043242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.044033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.044588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.045017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.061564 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df HTTP/1.1 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '010dd0eb-3a66-47a1-adea-743a8fc880df'} Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.063309 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 010dd0eb-3a66-47a1-adea-743a8fc880df could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee11320c-54aa-4ded-8f3c-6761d90b6547 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df" status: 404 len: 111 microversion: 2.1 time: 0.035434 Aug 30 04:39:50.071230 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2798/5661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/010dd0eb-3a66-47a1-adea-743a8fc880df => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:50.076364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.077074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.083517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.084356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.084849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.085665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.086313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.086808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.091813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:50.106480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 HTTP/1.1 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'a72cf0f6-e68b-4dba-924c-40c1ef2d0b34'} Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.108229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d859218-28e6-4e92-9cb8-593dcae1896c tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 404 len: 111 microversion: 2.1 time: 0.039536 Aug 30 04:39:50.113183 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2864/5662] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:50 2022] DELETE /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:50.120945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.121942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a72cf0f6-e68b-4dba-924c-40c1ef2d0b34] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.128493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.129004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.129462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.130298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.130757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.131205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.150892 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 HTTP/1.1 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a72cf0f6-e68b-4dba-924c-40c1ef2d0b34'} Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.152783 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c63819f-1b67-4632-843d-939cd16e3593 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34" status: 404 len: 111 microversion: 2.1 time: 0.038391 Aug 30 04:39:50.157128 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2799/5663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/a72cf0f6-e68b-4dba-924c-40c1ef2d0b34 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:50.165600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.166166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.173909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.174439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.175473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.176514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.177142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.178013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.195321 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 HTTP/1.1 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '552511e8-e2bd-4e61-b71f-67bee0adee64'} Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.197290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.202144 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.203833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.204881 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e26a3665-9cd4-4361-ab65-fcbac3c6e3be tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 404 len: 111 microversion: 2.1 time: 0.045247 Aug 30 04:39:50.206019 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2865/5664] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:50 2022] DELETE /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:50.214570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.216200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: 552511e8-e2bd-4e61-b71f-67bee0adee64] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.224553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.225387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.226095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.228655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.229290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.229921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.235239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.236002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.251339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.251339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.251339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.251839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.252480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.253016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.255621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 HTTP/1.1 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '552511e8-e2bd-4e61-b71f-67bee0adee64'} Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.257203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance 552511e8-e2bd-4e61-b71f-67bee0adee64 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-475522b9-fdac-4352-ac1b-eecf7ada80ee tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64" status: 404 len: 111 microversion: 2.1 time: 0.048674 Aug 30 04:39:50.261766 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2800/5665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/552511e8-e2bd-4e61-b71f-67bee0adee64 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:50.267839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fa40b01-f7a5-458f-b564-da472b2bbd2e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.268406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fa40b01-f7a5-458f-b564-da472b2bbd2e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a8d4e78c-50c5-4840-909f-09752604c2eb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.277887 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7fa40b01-f7a5-458f-b564-da472b2bbd2e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fa40b01-f7a5-458f-b564-da472b2bbd2e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb HTTP/1.1 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a8d4e78c-50c5-4840-909f-09752604c2eb'} Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.279613 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fa40b01-f7a5-458f-b564-da472b2bbd2e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7fa40b01-f7a5-458f-b564-da472b2bbd2e tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb" status: 404 len: 111 microversion: 2.1 time: 0.017628 Aug 30 04:39:50.284747 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2801/5666] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:50 2022] DELETE /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:39:50.290490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1c85158-d1e4-4e80-a7d6-bdb552f75cfb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.291343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f1c85158-d1e4-4e80-a7d6-bdb552f75cfb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: a8d4e78c-50c5-4840-909f-09752604c2eb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.298246 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f1c85158-d1e4-4e80-a7d6-bdb552f75cfb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1c85158-d1e4-4e80-a7d6-bdb552f75cfb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb HTTP/1.1 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'a8d4e78c-50c5-4840-909f-09752604c2eb'} Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:50.300255 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1c85158-d1e4-4e80-a7d6-bdb552f75cfb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance a8d4e78c-50c5-4840-909f-09752604c2eb could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1c85158-d1e4-4e80-a7d6-bdb552f75cfb tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb" status: 404 len: 111 microversion: 2.1 time: 0.015945 Aug 30 04:39:50.307023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2802/5667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/a8d4e78c-50c5-4840-909f-09752604c2eb => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:50.317017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.319318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.332435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.333024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.333580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.334351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.334906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.335390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.368204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:39:50.474863 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ea0b094-b36c-4807-b05f-c81f1370c007 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 204 len: 0 microversion: 2.1 time: 0.165546 Aug 30 04:39:50.475544 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2803/5668] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:50 2022] DELETE /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:50.485310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.486494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.492959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.493504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.493938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.494633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.495085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.495509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.579522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:50.588026 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6bdfb9d7-4e56-4b6e-bf3e-7cb8f1b87836 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1506 microversion: 2.1 time: 0.359063 Aug 30 04:39:50.588736 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2866/5669] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1506 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:50.609763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.611030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.617794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.618362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.619037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.619847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.620508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.621160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.648172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:39:50.741015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:50.751879 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aeeae92d-db40-4024-b075-a91a9846f3ff tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 204 len: 0 microversion: 2.1 time: 0.145726 Aug 30 04:39:50.756473 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2867/5670] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:50 2022] DELETE /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:39:50.759754 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f321046e-8869-4dd7-9f4b-3a795cb357dd tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1479 microversion: 2.1 time: 0.278937 Aug 30 04:39:50.762198 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2804/5671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1479 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:50.764598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:50.765719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:50.775361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.776306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.776306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:50.778320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:50.778824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:50.779366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:51.032087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:51.042360 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e03da1d3-2046-4681-bd06-3d792c571ac5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1512 microversion: 2.1 time: 0.283975 Aug 30 04:39:51.043164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2868/5672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:50 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:51.784677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:51.785527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:51.794496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:51.795613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:51.796221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:51.797003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:51.797597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:51.798123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:52.063072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:52.063918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:52.071111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:52.071950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:52.072500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:52.073317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:52.074083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:52.074578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:52.349352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:52.357640 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e968b1f9-4786-47d4-b00a-36197b11a577 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1479 microversion: 2.1 time: 0.578054 Aug 30 04:39:52.358755 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2805/5673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:51 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1479 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:52.416863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:52.425085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80eefb58-a31b-4a4d-9a78-d6a23600fd4c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1512 microversion: 2.1 time: 0.365888 Aug 30 04:39:52.425877 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2869/5674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:52 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:39:53.303133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-87e6903f-a040-47a8-ad15-928f72b078d6 req-bf24bbab-77bb-43d9-a795-4fa15466ceab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34bbc66-38a3-4ec2-a11b-d703c31b8d6a", "tag": "53d0e403-9119-49ad-8be3-0bd0b4d7d201"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:53.319085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-87e6903f-a040-47a8-ad15-928f72b078d6 req-bf24bbab-77bb-43d9-a795-4fa15466ceab service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:53.319922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-87e6903f-a040-47a8-ad15-928f72b078d6 req-bf24bbab-77bb-43d9-a795-4fa15466ceab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:53.320586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-87e6903f-a040-47a8-ad15-928f72b078d6 req-bf24bbab-77bb-43d9-a795-4fa15466ceab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:53.348698 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-87e6903f-a040-47a8-ad15-928f72b078d6 req-bf24bbab-77bb-43d9-a795-4fa15466ceab service nova] Creating event network-changed:53d0e403-9119-49ad-8be3-0bd0b4d7d201 for instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a on n-h1-854925-5 Aug 30 04:39:53.380543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:53.381443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:53.387849 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-87e6903f-a040-47a8-ad15-928f72b078d6 req-bf24bbab-77bb-43d9-a795-4fa15466ceab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091430 Aug 30 04:39:53.391941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2806/5675] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:53.392858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:53.393460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:53.393995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:53.395170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:53.395841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:53.396556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:53.449695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:53.450937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:53.468072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:53.472296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:53.472969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:53.473964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:53.476934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:53.478385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:53.623610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:53.636558 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-57b0271e-ac73-42d7-9ced-6efa56df7f82 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 200 len: 1470 microversion: 2.1 time: 0.192308 Aug 30 04:39:53.640734 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2807/5676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:53 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:53.956994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5b607da903e47b2a43b4b40f41ac300', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '922f018cfdc3480ab4a766a8bcbbc8b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:53.982722 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42b199f0-3224-410b-9f5f-d3ad27f86fe6 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 200 len: 1479 microversion: 2.1 time: 0.606809 Aug 30 04:39:53.987235 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2870/5677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:53 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 1479 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:54.172451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:54.175634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:54.183011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.183807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.184480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.185468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.186135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.186769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.241634 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c251e7a-94ff-42e6-913a-095dc0a24689 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072907 Aug 30 04:39:54.243495 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2808/5678] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:39:54 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:39:54.331841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:54.332350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:54.339979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:39:54.342359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.343185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.343637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.344346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.344819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.346044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.391843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:39:54.586797 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fa1bf272-f982-489f-bb69-f462d3e9e6dd tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 204 len: 0 microversion: 2.1 time: 0.257761 Aug 30 04:39:54.591031 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2871/5679] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:39:54 2022] DELETE /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:39:54.600318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:54.600983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:54.616341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.616834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.617318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.618606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.619052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.619613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.661577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:54.662308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:54.676206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.676715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.677360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.678237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.679110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.679707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.703365 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 HTTP/1.1 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '6a3e1080-c0f8-4a45-af28-ecc0783e3ae0'} Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:54.708615 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:54.715593 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e28e9ff5-f0d7-4a61-8566-27870154f231 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 404 len: 111 microversion: 2.1 time: 0.055359 Aug 30 04:39:54.717651 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2872/5680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:54 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:54.725084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:54.728386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:54.737826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.738338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.739335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.740231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:54.740705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:54.741152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:54.796474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:54.808751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a93dbda8-7d63-46cb-bdc0-5f4dff22a1c3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1673 microversion: 2.1 time: 0.213145 Aug 30 04:39:54.809953 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2809/5681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:54 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:54.943386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:54.957430 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec884d8e-107d-4d11-84fd-5d8fc6a617f6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.238712 Aug 30 04:39:54.959015 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2873/5682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:54 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:55.010760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:55.011643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] [instance: e1499755-e615-4a00-912c-e088f93da875] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:55.021452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.022540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.023489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.025396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.026083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.027294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.046772 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] HTTP exception thrown: Instance e1499755-e615-4a00-912c-e088f93da875 could not be found. Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Request method failure captured: Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 HTTP/1.1 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZOyU1RpURUknC2MKCgD6hH7GfBZWNnhBgKsPJ73EFkKMr2WNSG-PrIB0qLOjbfnnwdExDW9gRynW9VM1G0aWxJuUwNUZ1fkn2LDiU0uP8DEH_cWhEiAxCeykwuKVuDXaKZPlURECT83QV-FoJU_lMGKomIuGfjmIolj5qV7C6YaZ3s Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_922f018cfdc3480ab4a766a8bcbbc8b9", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/922f018cfdc3480ab4a766a8bcbbc8b9"}]}] Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersTestJSON-1411446961 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 922f018cfdc3480ab4a766a8bcbbc8b9 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersTestJSON-1411446961 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5b607da903e47b2a43b4b40f41ac300 Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersTestJSON-1411446961-project Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance e1499755-e615-4a00-912c-e088f93da875 could not be found. Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e1499755-e615-4a00-912c-e088f93da875'} Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1499755-e615-4a00-912c-e088f93da875 could not be found. Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1499755-e615-4a00-912c-e088f93da875 could not be found. Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:55.048710 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1499755-e615-4a00-912c-e088f93da875 could not be found. Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] Returning 404 to user: Instance e1499755-e615-4a00-912c-e088f93da875 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac367ad0-6669-4312-99ec-2fbc8e08cb45 tempest-ServersTestJSON-1411446961 tempest-ServersTestJSON-1411446961-project] 10.222.0.27 "GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875" status: 404 len: 111 microversion: 2.1 time: 0.046133 Aug 30 04:39:55.053497 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2810/5683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:55 2022] GET /compute/v2.1/servers/e1499755-e615-4a00-912c-e088f93da875 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:39:55.103606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e39d9f0-7ed9-48c7-9a0a-803f6ece5e8e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e39d9f0-7ed9-48c7-9a0a-803f6ece5e8e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 163 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": 12345, "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 12345 Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:39:55.108287 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e39d9f0-7ed9-48c7-9a0a-803f6ece5e8e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e39d9f0-7ed9-48c7-9a0a-803f6ece5e8e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.011429 Aug 30 04:39:55.112652 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2874/5684] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:39:55 2022] POST /compute/v2.1/servers => generated 127 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:39:55.125442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:55.126076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:55.132808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.133546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.134022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.134787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.135453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.136078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.370561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:55.380934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c9bcbc06-d28e-4f65-936a-20e0733775c1 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.263951 Aug 30 04:39:55.381895 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2811/5685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:55 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:55.408097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:55.408893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:55.417162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.417679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.418119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.418822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.419276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.419703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.474801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-82f529f2-b13c-4eff-b884-0f814af481d9 req-2b05184b-7e51-49c0-8972-4dfb51a14329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a3e1080-c0f8-4a45-af28-ecc0783e3ae0", "name": "network-vif-deleted", "tag": "67d6b0c9-cf5d-4bee-8f6c-40d9f18b10f8"}, {"server_uuid": "e1499755-e615-4a00-912c-e088f93da875", "name": "network-vif-deleted", "tag": "4efbce0d-f1b9-4644-a1ad-ea1bae9cded0"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:55.488563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-82f529f2-b13c-4eff-b884-0f814af481d9 req-2b05184b-7e51-49c0-8972-4dfb51a14329 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.489052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-82f529f2-b13c-4eff-b884-0f814af481d9 req-2b05184b-7e51-49c0-8972-4dfb51a14329 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.489535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-82f529f2-b13c-4eff-b884-0f814af481d9 req-2b05184b-7e51-49c0-8972-4dfb51a14329 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.503119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-82f529f2-b13c-4eff-b884-0f814af481d9 req-2b05184b-7e51-49c0-8972-4dfb51a14329 service nova] Creating event network-vif-deleted:67d6b0c9-cf5d-4bee-8f6c-40d9f18b10f8 for instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 on n-h2-854925-5 Aug 30 04:39:55.503906 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-82f529f2-b13c-4eff-b884-0f814af481d9 req-2b05184b-7e51-49c0-8972-4dfb51a14329 service nova] Creating event network-vif-deleted:4efbce0d-f1b9-4644-a1ad-ea1bae9cded0 for instance e1499755-e615-4a00-912c-e088f93da875 on n-h1-854925-5 Aug 30 04:39:55.514684 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-82f529f2-b13c-4eff-b884-0f814af481d9 req-2b05184b-7e51-49c0-8972-4dfb51a14329 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044906 Aug 30 04:39:55.516752 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2812/5686] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:55.677180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:55.693562 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9f96968b-f314-4b4d-a29b-71dd7aa07fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.291598 Aug 30 04:39:55.694953 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2875/5687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:55 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:55.834344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:55.835058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:55.853280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.853808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.854667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:55.855396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:55.855860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:55.856291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:56.147882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-fcf08811-f19d-4452-973f-7b7d16156736 req-da0340d0-65c8-4c95-b1a3-3fb942e4d341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34bbc66-38a3-4ec2-a11b-d703c31b8d6a", "tag": "53d0e403-9119-49ad-8be3-0bd0b4d7d201"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:56.175086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fcf08811-f19d-4452-973f-7b7d16156736 req-da0340d0-65c8-4c95-b1a3-3fb942e4d341 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:56.175588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fcf08811-f19d-4452-973f-7b7d16156736 req-da0340d0-65c8-4c95-b1a3-3fb942e4d341 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:56.176360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fcf08811-f19d-4452-973f-7b7d16156736 req-da0340d0-65c8-4c95-b1a3-3fb942e4d341 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:56.201900 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-fcf08811-f19d-4452-973f-7b7d16156736 req-da0340d0-65c8-4c95-b1a3-3fb942e4d341 service nova] Creating event network-changed:53d0e403-9119-49ad-8be3-0bd0b4d7d201 for instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a on n-h1-854925-5 Aug 30 04:39:56.204207 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-fcf08811-f19d-4452-973f-7b7d16156736 req-da0340d0-65c8-4c95-b1a3-3fb942e4d341 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060683 Aug 30 04:39:56.205312 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2876/5688] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:39:56.241245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:56.256070 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca6b52e5-fbdc-4b22-9a65-6268813a00cc tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1673 microversion: 2.1 time: 0.428997 Aug 30 04:39:56.259559 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2813/5689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:55 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1673 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:57.281413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:57.282265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:57.299105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:57.299884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:57.300420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:57.301233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:57.303891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:57.304665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:57.687921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:57.696481 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5af4a036-0ab0-4d6f-86fc-934ce1343f9e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1673 microversion: 2.1 time: 0.418738 Aug 30 04:39:57.697161 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2877/5690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:57 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1673 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:58.311792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0be8a494-2176-453b-aae0-540c94901b9b req-c14f0b51-7c03-4153-b394-4a8c9d0c61e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34bbc66-38a3-4ec2-a11b-d703c31b8d6a", "tag": "53d0e403-9119-49ad-8be3-0bd0b4d7d201"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:58.334347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0be8a494-2176-453b-aae0-540c94901b9b req-c14f0b51-7c03-4153-b394-4a8c9d0c61e6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:58.334850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0be8a494-2176-453b-aae0-540c94901b9b req-c14f0b51-7c03-4153-b394-4a8c9d0c61e6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:58.335293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0be8a494-2176-453b-aae0-540c94901b9b req-c14f0b51-7c03-4153-b394-4a8c9d0c61e6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:58.374979 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0be8a494-2176-453b-aae0-540c94901b9b req-c14f0b51-7c03-4153-b394-4a8c9d0c61e6 service nova] Creating event network-changed:53d0e403-9119-49ad-8be3-0bd0b4d7d201 for instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a on n-h1-854925-5 Aug 30 04:39:58.407339 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0be8a494-2176-453b-aae0-540c94901b9b req-c14f0b51-7c03-4153-b394-4a8c9d0c61e6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101634 Aug 30 04:39:58.408768 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2814/5691] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:39:58.628499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c61ecb43-3ef1-4ef2-b93b-408f5bf87d96 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1373169533", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "01d413d6-47b0-40c9-a4cd-cd020c745d76", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:58.718487 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-c61ecb43-3ef1-4ef2-b93b-408f5bf87d96 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Block Device 01d413d6-47b0-40c9-a4cd-cd020c745d76 is not bootable. Aug 30 04:39:58.722426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:58.723942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c61ecb43-3ef1-4ef2-b93b-408f5bf87d96 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 358 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1373169533", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "01d413d6-47b0-40c9-a4cd-cd020c745d76", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: exception: Block Device 01d413d6-47b0-40c9-a4cd-cd020c745d76 is not bootable. Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1373169533', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '01d413d6-47b0-40c9-a4cd-cd020c745d76'}], 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 01d413d6-47b0-40c9-a4cd-cd020c745d76 is not bootable. Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:39:58.729089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 01d413d6-47b0-40c9-a4cd-cd020c745d76 is not bootable. Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 01d413d6-47b0-40c9-a4cd-cd020c745d76 is not bootable. Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:39:58.735188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c61ecb43-3ef1-4ef2-b93b-408f5bf87d96 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Block Device 01d413d6-47b0-40c9-a4cd-cd020c745d76 is not bootable. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:39:58.736912 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c61ecb43-3ef1-4ef2-b93b-408f5bf87d96 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.111040 Aug 30 04:39:58.740858 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2878/5692] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:39:58 2022] POST /compute/v2.1/servers => generated 110 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:39:58.746197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:58.747301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:58.748102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:58.748298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:58.751483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:58.754332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:58.754950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:58.757537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:58.761237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:58.763929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:58.764448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:58.766718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:58.767515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:58.768899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:59.012672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:59.026076 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-00ecf188-a02e-4988-b7ea-8661653a11fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 200 len: 1606 microversion: 2.1 time: 0.310700 Aug 30 04:39:59.031403 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2815/5693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:58 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 1606 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:59.238123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ef75f79e-f959-430c-8000-32e462ce1106 req-b8568bf8-7b6d-41a3-9184-38cf39dc970b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a01c5f1-b0cc-41ff-9a7a-5a419509f558", "name": "network-vif-deleted", "tag": "08b3bdf5-f483-43b1-95f9-bf8fd827caa9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:39:59.258092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef75f79e-f959-430c-8000-32e462ce1106 req-b8568bf8-7b6d-41a3-9184-38cf39dc970b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:59.258748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef75f79e-f959-430c-8000-32e462ce1106 req-b8568bf8-7b6d-41a3-9184-38cf39dc970b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:59.259204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ef75f79e-f959-430c-8000-32e462ce1106 req-b8568bf8-7b6d-41a3-9184-38cf39dc970b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:59.289944 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ef75f79e-f959-430c-8000-32e462ce1106 req-b8568bf8-7b6d-41a3-9184-38cf39dc970b service nova] Creating event network-vif-deleted:08b3bdf5-f483-43b1-95f9-bf8fd827caa9 for instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 on n-h2-854925-5 Aug 30 04:39:59.293492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:59.296792 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ef75f79e-f959-430c-8000-32e462ce1106 req-b8568bf8-7b6d-41a3-9184-38cf39dc970b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064832 Aug 30 04:39:59.301358 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2816/5694] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 30 04:39:59.304674 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb41364f-45d0-41b0-9ebf-adb78b1db6d7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.561981 Aug 30 04:39:59.306412 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2879/5695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:58 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:39:59.332311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:39:59.333661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:39:59.343893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:59.344835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:59.345525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:59.346614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:39:59.347342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:39:59.347784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:39:59.526012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:39:59.534290 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce45c19c-cef2-4235-86bd-916d0bce73cc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.206749 Aug 30 04:39:59.535563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2817/5696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:39:59 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:00.050881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:00.051502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:00.059398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:00.060564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:00.061174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:00.062064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:00.062670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:00.063256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:00.079757 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] HTTP exception thrown: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Request method failure captured: Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 HTTP/1.1 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZPJBAAf21WlCSkwaMMxDuNpGi35VwHoQ2YIv9D_Ej4jbzAmH1jPWYsldMTpWJmRuupPbyILhjcrVTg7EWJxN2LG2TQLNGkX3qBAVPjH95wr950DEFV6NhQlDKApWFTZSNmFok9DsEfOOt474Wc9X0IAU1oZHHB0xmfkEmOsfqu1mSk Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_855330321e2d47029d650db5ea542865", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/855330321e2d47029d650db5ea542865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}] Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 90dd2d52d02f4777add5570b1c7bc175 Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '4a01c5f1-b0cc-41ff-9a7a-5a419509f558'} Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:00.082198 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:00.087815 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:00.087815 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:00.087815 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:00.087815 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:00.087815 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:00.087815 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:40:00.087815 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:00.089290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Returning 404 to user: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:00.090985 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d60f847d-76fd-4226-a237-5d810e158eab tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 404 len: 111 microversion: 2.1 time: 0.043902 Aug 30 04:40:00.092210 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2880/5697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:00 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:00.101723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c5deaec-22aa-4e86-8d64-4bb6e87be5f9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '.version_select at 0x7fe968e90280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:00.119373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:00.146122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c5deaec-22aa-4e86-8d64-4bb6e87be5f9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125665654" status: 202 len: 0 microversion: 2.1 time: 0.049536 Aug 30 04:40:00.146917 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2818/5698] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:40:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125665654 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:40:01.590584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ff78c9e-dc47-41db-b6da-a3748bcc749d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'create', calling method: .version_select at 0x7fe96adce700>, body: {"keypair": {"name": "tempest-keypair-1492797891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLmGVCzuI2AecvzhKGn5EZ2LjrbY4rexHzTAxwdqjw+kIptiGJJfjx9nAauulIplsPe0XFNm3UeCPb32R2SQ5JsxrPLFj4j3RHLFL/T2FhADj5fW3NQxw23iC+v7GYYIHg=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:01.612428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5ff78c9e-dc47-41db-b6da-a3748bcc749d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for project 855330321e2d47029d650db5ea542865. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:40:01.620194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5ff78c9e-dc47-41db-b6da-a3748bcc749d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for user 90dd2d52d02f4777add5570b1c7bc175 and project 855330321e2d47029d650db5ea542865. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:40:01.654930 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ff78c9e-dc47-41db-b6da-a3748bcc749d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.069482 Aug 30 04:40:01.662507 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2881/5699] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:40:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:02.328512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52fb3b4d-3538-4251-bf5e-d5cec705f921 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1658709203", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "destination_type": "local"}, {"source_type": "volume", "uuid": "f7084667-af19-4df2-ad9f-5739847c2e95", "destination_type": "invalid"}], "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52fb3b4d-3538-4251-bf5e-d5cec705f921 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 495 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1658709203", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "destination_type": "local"}, {"source_type": "volume", "uuid": "f7084667-af19-4df2-ad9f-5739847c2e95", "destination_type": "invalid"}], "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1658709203', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'f7084667-af19-4df2-ad9f-5739847c2e95', 'destination_type': 'invalid'}], 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'invalid' Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:02.344147 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-52fb3b4d-3538-4251-bf5e-d5cec705f921 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-52fb3b4d-3538-4251-bf5e-d5cec705f921 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030776 Aug 30 04:40:02.348898 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2819/5700] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:02 2022] POST /compute/v2.1/servers => generated 155 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:02.357010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:02.358635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:02.366982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:02.368063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:02.368518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:02.369940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:02.370842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:02.371292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:02.619588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:02.632993 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec2169d2-b03d-4314-94c9-af7b394457f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.281987 Aug 30 04:40:02.650471 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2882/5701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:02 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:02.658719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:02.659671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:02.667607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:02.668405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:02.669056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:02.670017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:02.670865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:02.671534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:02.867873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:02.877073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bdabf0a5-86b2-40cc-8a21-a3fa385e347c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.224592 Aug 30 04:40:02.878025 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2820/5702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:02 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:03.050068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7193edf0-41f8-4afd-9020-90fec9cc1e18 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1181602966", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7193edf0-41f8-4afd-9020-90fec9cc1e18 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 492 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1181602966", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1181602966', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:03.054405 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7193edf0-41f8-4afd-9020-90fec9cc1e18 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:03.057991 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7193edf0-41f8-4afd-9020-90fec9cc1e18 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011308 Aug 30 04:40:03.067400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.067973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:03.075458 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2883/5703] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:03 2022] POST /compute/v2.1/servers => generated 624 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:03.077321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.077845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.078286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.078992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.079447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.080047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.415547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:03.417082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:03.425868 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.362971 Aug 30 04:40:03.426456 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2821/5704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:03.453200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.454041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:03.468244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.468897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.469644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.470838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:03.471436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:03.472053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:03.787504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:03.807461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:03.824596 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.375298 Aug 30 04:40:03.825720 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2884/5705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:03.871168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.872205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001420 Aug 30 04:40:03.872553 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2822/5706] 10.222.0.27 () {56 vars in 886 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 04:40:03.881182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.884476 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002638 Aug 30 04:40:03.894114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.894408 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2885/5707] 10.222.0.27 () {54 vars in 1035 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/v2/ => generated 379 bytes in 14 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 30 04:40:03.895582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49792a5d-6897-4326-836f-987f88ebe561 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001952 Aug 30 04:40:03.896196 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2823/5708] 10.222.0.27 () {54 vars in 1041 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:40:03.907882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:03.909429 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b83c668-eeb0-4e6b-a6bf-ddacdefc140f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001836 Aug 30 04:40:03.923124 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2886/5709] 10.222.0.27 () {56 vars in 886 bytes} [Tue Aug 30 04:40:03 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 30 04:40:03.965861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1337454735", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1fbd3160-1732-4dba-93a5-81342c620573"}], "security_groups": [{"name": "tempest-securitygroup--722448087"}], "key_name": "tempest-keypair-1492797891", "user_data": "}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:04.001088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bde7adc5-181d-4173-bfe3-c6cd7accb2d6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bde7adc5-181d-4173-bfe3-c6cd7accb2d6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 416 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.004997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.009496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bde7adc5-181d-4173-bfe3-c6cd7accb2d6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:04.011791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bde7adc5-181d-4173-bfe3-c6cd7accb2d6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.013009 Aug 30 04:40:04.011791 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2887/5710] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:03 2022] POST /compute/v2.1/servers => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 30 04:40:04.021313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:04.021971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:04.029521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.030085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.030531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.031217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.032214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.032214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.136966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] validate_networks() for [('1fbd3160-1732-4dba-93a5-81342c620573', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:40:04.318225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:04.331874 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9b1aadf3-105d-4e11-99f4-17f3597f5aa3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.314451 Aug 30 04:40:04.333048 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2888/5711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:04 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:04.357682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:04.358756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:04.368308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.369253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.370054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.371277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.371930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.372540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.695208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:04.703690 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c1a8ca90-ed5a-44ad-8fd8-4db573a624e8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.352086 Aug 30 04:40:04.704372 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2889/5712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:04 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:04.849240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:40:04.849920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:40:04.850455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fca72539-5fd0-498f-a506-49cc08063df4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-941721038", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": -1, "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:04.850895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:40:04.851182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:40:04.852715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:40:04.864379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.864985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.866005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.867268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.868753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.869620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.884104 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-fca72539-5fd0-498f-a506-49cc08063df4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Flavor -1 could not be found. Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fca72539-5fd0-498f-a506-49cc08063df4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 205 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-941721038", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": -1, "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor -1 could not be found. Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-941721038', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': -1, 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:04.886021 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fca72539-5fd0-498f-a506-49cc08063df4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fca72539-5fd0-498f-a506-49cc08063df4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.043524 Aug 30 04:40:04.890768 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2890/5713] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:04 2022] POST /compute/v2.1/servers => generated 73 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 30 04:40:04.897420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:04.899608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:04.908986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.909859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.911226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.912286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:04.912932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:04.913725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:04.918223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for project 855330321e2d47029d650db5ea542865. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:40:04.927099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Getting quotas for user 90dd2d52d02f4777add5570b1c7bc175 and project 855330321e2d47029d650db5ea542865. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:40:04.943295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:40:04.945781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:40:05.023387 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1fb62bb4-4738-4549-a137-398fcf5c17b8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.067228 Aug 30 04:40:05.025137 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2824/5714] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:40:05.044604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc7fc3d7-4c82-41f5-821a-faa37dda9d17 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:05.045705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc7fc3d7-4c82-41f5-821a-faa37dda9d17 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:05.154360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bc7fc3d7-4c82-41f5-821a-faa37dda9d17 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:05.163513 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc7fc3d7-4c82-41f5-821a-faa37dda9d17 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1238 microversion: 2.1 time: 0.131125 Aug 30 04:40:05.168658 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2825/5715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:05 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1238 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:05.242126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:05.254354 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51d7f1da-5c8b-42c5-970c-1e494e475b47 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.360648 Aug 30 04:40:05.259754 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2891/5716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:04 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:05.283165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:05.284432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:05.292905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:05.293754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:05.294302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:05.295109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:05.295826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:05.296511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:05.542527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:05.551309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-037f9814-f28a-49b9-bdd8-220eb9398f61 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.272176 Aug 30 04:40:05.552440 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2826/5717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:05 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:05.757057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fd9bae2a-1d5e-4282-91e6-8c3a87079d3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1490136133", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fd9bae2a-1d5e-4282-91e6-8c3a87079d3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 173 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1490136133", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1490136133', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi -1 Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:40:05.766445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 30 04:40:05.770776 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:05.772737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fd9bae2a-1d5e-4282-91e6-8c3a87079d3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:05.775091 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fd9bae2a-1d5e-4282-91e6-8c3a87079d3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.022263 Aug 30 04:40:05.776930 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2892/5718] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:05 2022] POST /compute/v2.1/servers => generated 145 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:05.785713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:05.786603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:05.794800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:05.795750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:05.796450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:05.797917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:05.798721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:05.799351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:05.972587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:05.982026 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff23ce91-fb77-4173-a46f-5a6e5dffb67a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.200673 Aug 30 04:40:05.982668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2827/5719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:05 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:06.004929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:06.005810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:06.016043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.016927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.017640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.018516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.019180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.019818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.186133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:06.186672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:06.197343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.198075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.202124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.203139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:06.203398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.204070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.204674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.217987 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-55e58f1a-0d7e-4d62-9198-b5db5602a084 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.217682 Aug 30 04:40:06.219202 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2893/5720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:05 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:06.326528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:06.352629 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6648a2fe-f381-4f35-928f-742d4f730af7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1234 microversion: 2.1 time: 0.162819 Aug 30 04:40:06.353537 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2828/5721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:06 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1234 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:06.402535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-729ba93a-16fb-41f7-9c6f-fbcacd6dc699 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639517277", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:06.408285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-729ba93a-16fb-41f7-9c6f-fbcacd6dc699 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-729ba93a-16fb-41f7-9c6f-fbcacd6dc699 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 215 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-639517277", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-639517277', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:06.410545 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 30 04:40:06.416204 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:06.418045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-729ba93a-16fb-41f7-9c6f-fbcacd6dc699 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:06.419357 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-729ba93a-16fb-41f7-9c6f-fbcacd6dc699 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.022285 Aug 30 04:40:06.423881 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2894/5722] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:06 2022] POST /compute/v2.1/servers => generated 123 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:06.429223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:06.429908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:06.438287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.438990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.439499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.440262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.440783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.441298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.725066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:06.733853 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9194b2b-4396-4c14-96a4-29ad476ff900 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.308809 Aug 30 04:40:06.758987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:06.759905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:06.763177 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2829/5723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:06 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:06.768472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.769214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.770016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.770974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.771388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.771990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.787304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:06.788375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:06.795380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.796318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.796987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:06.797987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:06.798612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:06.799274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:07.178681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-793bbc31-ba1e-48ec-a4ca-2df8fbc15779 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1830 microversion: 2.1 time: 0.394928 Aug 30 04:40:07.179657 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2830/5724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:06 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1830 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:07.254842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:07.297469 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-68c28676-e442-444e-9c35-a9bec67ed6dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.539595 Aug 30 04:40:07.299076 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2895/5725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:06 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:07.385688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:07.386495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:07.405630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:07.409940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:07.412210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:07.423054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:07.425028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:07.426872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:07.544416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb4e0cfe-fe4a-490c-908c-40b117986233 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-499788244", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-key-1562879326", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:07.675226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-eb4e0cfe-fe4a-490c-908c-40b117986233 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] validate_networks() for [('27fa2046-0bb2-41f9-8766-d50f2e2b01e0', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:40:07.980762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:07.994225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ddc43192-868a-4b61-9e16-4a50a63eaadf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1296 microversion: 2.1 time: 0.614946 Aug 30 04:40:07.994932 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2831/5726] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:07 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1296 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:08.633368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:08.633368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:08.642036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.642856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.643321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.644043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.644557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.644996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.676864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:40:08.794921 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-33eaab6d-11e5-4e4e-978a-532a31cadc2e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 204 len: 0 microversion: 2.1 time: 0.166097 Aug 30 04:40:08.800065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-eb4e0cfe-fe4a-490c-908c-40b117986233 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Invalid key_name provided. Aug 30 04:40:08.801081 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2832/5727] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:08 2022] DELETE /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb4e0cfe-fe4a-490c-908c-40b117986233 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 246 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-499788244", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-key-1562879326", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: exception: Invalid key_name provided. Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-499788244', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'key_name': 'tempest-key-1562879326', 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1562879326 not found for user cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:08.801635 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 30 04:40:08.806370 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:08.809363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-33cf0e87-0ddb-4783-b957-3cd6b8350b06 req-3d48068c-4eb5-4d12-babd-a3e1ed2955a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:08.809520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb4e0cfe-fe4a-490c-908c-40b117986233 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid key_name provided. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:08.813245 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb4e0cfe-fe4a-490c-908c-40b117986233 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 1.274038 Aug 30 04:40:08.813894 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2896/5728] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:07 2022] POST /compute/v2.1/servers => generated 70 bytes in 1275 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 30 04:40:08.825686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33cf0e87-0ddb-4783-b957-3cd6b8350b06 req-3d48068c-4eb5-4d12-babd-a3e1ed2955a7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.826590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33cf0e87-0ddb-4783-b957-3cd6b8350b06 req-3d48068c-4eb5-4d12-babd-a3e1ed2955a7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.827338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33cf0e87-0ddb-4783-b957-3cd6b8350b06 req-3d48068c-4eb5-4d12-babd-a3e1ed2955a7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.829110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:08.830058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:08.841757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.842586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.843453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.844563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.845259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.849230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.872099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-33cf0e87-0ddb-4783-b957-3cd6b8350b06 req-3d48068c-4eb5-4d12-babd-a3e1ed2955a7 service nova] Creating event network-changed:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h1-854925-5 Aug 30 04:40:08.886936 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-33cf0e87-0ddb-4783-b957-3cd6b8350b06 req-3d48068c-4eb5-4d12-babd-a3e1ed2955a7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082597 Aug 30 04:40:08.887564 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2833/5729] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:08.903406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:08.905728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:08.921235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.923249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.927047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:08.927906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:08.928387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:08.928822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:09.318820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:09.345366 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fccd845f-0dd1-4666-b7a8-86b1eb7df424 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1685 microversion: 2.1 time: 0.523145 Aug 30 04:40:09.346656 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2897/5730] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:08 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1685 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:09.366683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:09.367860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:09.384035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:09.385145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:09.386070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:09.387289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:09.388052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:09.388805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:09.432092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:09.464592 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f2ccc48-74a9-4100-bb4a-f9910bc0d0c2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.570966 Aug 30 04:40:09.472154 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2834/5731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:08 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:09.516328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:09.519854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:09.540916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:09.542718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:09.543360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:09.544976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:09.545919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:09.546923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:09.659606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:09.672327 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2a11661-61f2-49ec-a8c2-78ccc1880789 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1296 microversion: 2.1 time: 0.323107 Aug 30 04:40:09.681270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2898/5732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:09 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1296 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:09.930860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:09.947034 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66d6ffca-0329-438a-9e80-8dde4031fba2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.450754 Aug 30 04:40:09.947750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2835/5733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:09 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:10.174886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8960175b-8d19-41a9-802c-84180b3a4e35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-719744644", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:10.363245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.security_group_api [None req-8960175b-8d19-41a9-802c-84180b3a4e35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Neutron security group does_not_exist not found {{(pid=122403) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 30 04:40:10.363902 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8960175b-8d19-41a9-802c-84180b3a4e35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 30 04:40:10.377230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8960175b-8d19-41a9-802c-84180b3a4e35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 257 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-719744644", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-719744644', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 30 04:40:10.377868 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 30 04:40:10.383473 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:10.395510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:10.395875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8960175b-8d19-41a9-802c-84180b3a4e35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:10.396045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.396045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.396484 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8960175b-8d19-41a9-802c-84180b3a4e35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.224291 Aug 30 04:40:10.396653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.396653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.396653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.396653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.397710 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2899/5734] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:10 2022] POST /compute/v2.1/servers => generated 106 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:10.404510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:10.405612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:10.416347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.417128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.417917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.419041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.419914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.420862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.768207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:10.780608 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25f414d5-e71d-4bfe-b88f-d2f47977c919 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1685 microversion: 2.1 time: 0.407171 Aug 30 04:40:10.795083 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2836/5735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:10 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1685 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:10.801903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:10.802088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:10.802624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:10.812265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.812999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.813716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.813919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-324868a0-0cc4-46ba-92d1-1c04888f902a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.413935 Aug 30 04:40:10.815304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.816007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.816581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.817393 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2900/5736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:10 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:10.845380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:10.847493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:10.865003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.865844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.866497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:10.867225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:10.868394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:10.876614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:11.334815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:11.354010 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0eeaf18c-3acb-48ab-9a0d-a3dd1a800ed6 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1363 microversion: 2.1 time: 0.557500 Aug 30 04:40:11.366616 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2837/5737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:10 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1363 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:11.383754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:11.398177 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6ed2a0af-56d9-4ac0-a19f-116dc64a6436 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.560366 Aug 30 04:40:11.399988 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2901/5738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:10 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:11.419764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62d010b5-29ab-4dd3-9999-6fdfc761a0f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:11.420275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-62d010b5-29ab-4dd3-9999-6fdfc761a0f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b63aa140-0151-4163-96a9-94ce182b9d80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:11.426009 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-62d010b5-29ab-4dd3-9999-6fdfc761a0f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance b63aa140-0151-4163-96a9-94ce182b9d80 could not be found. Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62d010b5-29ab-4dd3-9999-6fdfc761a0f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/b63aa140-0151-4163-96a9-94ce182b9d80 HTTP/1.1 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b63aa140-0151-4163-96a9-94ce182b9d80 could not be found. Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b63aa140-0151-4163-96a9-94ce182b9d80'} Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63aa140-0151-4163-96a9-94ce182b9d80 could not be found. Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63aa140-0151-4163-96a9-94ce182b9d80 could not be found. Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:11.427699 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63aa140-0151-4163-96a9-94ce182b9d80 could not be found. Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62d010b5-29ab-4dd3-9999-6fdfc761a0f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance b63aa140-0151-4163-96a9-94ce182b9d80 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-62d010b5-29ab-4dd3-9999-6fdfc761a0f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b63aa140-0151-4163-96a9-94ce182b9d80" status: 404 len: 111 microversion: 2.1 time: 0.013266 Aug 30 04:40:11.433203 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2838/5739] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:11 2022] DELETE /compute/v2.1/servers/b63aa140-0151-4163-96a9-94ce182b9d80 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:11.442858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:11.443931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:11.452365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:11.452503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:11.452948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:11.453969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:11.454513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:11.455018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:11.630672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:11.808062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:11.808847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:11.822792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:11.823602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:11.825231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:11.829114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:11.829892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:11.831439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.021904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:12.039426 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6286e2d-d659-4d2b-b090-2bc6e1439af0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.600917 Aug 30 04:40:12.041802 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2902/5740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:11 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:12.047723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5ae9fab7-cea5-4777-8b9f-7de77963e32b req-4a4b88c5-bbea-40cf-ad5c-6b9f86cb94d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46517a40-9c95-4441-b643-45b28b0d717d", "tag": "626e7ecf-c8b9-4d19-9da9-02593a43a970"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:12.059869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5ae9fab7-cea5-4777-8b9f-7de77963e32b req-4a4b88c5-bbea-40cf-ad5c-6b9f86cb94d1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.060640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5ae9fab7-cea5-4777-8b9f-7de77963e32b req-4a4b88c5-bbea-40cf-ad5c-6b9f86cb94d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.061239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5ae9fab7-cea5-4777-8b9f-7de77963e32b req-4a4b88c5-bbea-40cf-ad5c-6b9f86cb94d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.080958 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5ae9fab7-cea5-4777-8b9f-7de77963e32b req-4a4b88c5-bbea-40cf-ad5c-6b9f86cb94d1 service nova] Creating event network-changed:626e7ecf-c8b9-4d19-9da9-02593a43a970 for instance 46517a40-9c95-4441-b643-45b28b0d717d on n-h2-854925-5 Aug 30 04:40:12.089386 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5ae9fab7-cea5-4777-8b9f-7de77963e32b req-4a4b88c5-bbea-40cf-ad5c-6b9f86cb94d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044410 Aug 30 04:40:12.090255 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2903/5741] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:12.097208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:12.098606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:12.107614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.108285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.108895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.109813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.110430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.111323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.420419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:12.429051 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-330fd63a-d2c5-4b4c-ae75-adfe36c06360 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1566 microversion: 2.1 time: 0.625694 Aug 30 04:40:12.430519 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2839/5742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:11 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1566 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:12.444042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:12.444816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:12.453247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.454018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.454759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.455656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.456122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.456921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.658141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:12.668961 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7fc44990-ca9d-4a1a-9886-02cc541edd35 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.576965 Aug 30 04:40:12.670492 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2904/5743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:12 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:12.696158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ba39e19-c978-4b08-90a9-5b6c385ce784 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:12.696780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5ba39e19-c978-4b08-90a9-5b6c385ce784 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 04:40:12.697383 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-5ba39e19-c978-4b08-90a9-5b6c385ce784 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ba39e19-c978-4b08-90a9-5b6c385ce784 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 9223372036854775808 could not be found. Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9223372036854775808'} Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:12.704581 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:12.709654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:12.709654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:12.709654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:12.709654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 30 04:40:12.709654 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:12.711703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ba39e19-c978-4b08-90a9-5b6c385ce784 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:12.713123 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ba39e19-c978-4b08-90a9-5b6c385ce784 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.024649 Aug 30 04:40:12.714339 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2905/5744] 10.222.0.27 () {58 vars in 1188 bytes} [Tue Aug 30 04:40:12 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 30 04:40:12.726005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:12.727230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:12.739237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.739522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.740304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.741091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:12.741702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:12.742364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:12.925064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:12.948537 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d414b3d9-57dd-4f15-82c3-5d8ac5140ca7 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1363 microversion: 2.1 time: 0.505193 Aug 30 04:40:12.956340 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2840/5745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:12 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:13.184552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:13.204786 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17c3b9bb-4eaa-4dde-8714-c4df66bf2918 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.483548 Aug 30 04:40:13.206178 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2906/5746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:12 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:13.229581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:13.230340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:13.237644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.238143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.238582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.239569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.240200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.240637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.451645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:13.452614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:13.464422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.466600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.469963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.471165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.471839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.472382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.527994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.528753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.529440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.530261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lazy-loading 'fault' on Instance uuid 5708a59f-2dbf-496a-9bde-6e1e138afa73 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:40:13.609192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:13.617019 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3d4e4273-364c-4090-af3a-e2789dff8a99 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 200 len: 1355 microversion: 2.1 time: 0.169534 Aug 30 04:40:13.619480 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2907/5747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:13 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 1355 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:13.625879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:13.634708 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a739f254-3cbe-4920-b7c7-8965dbf2213e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.410072 Aug 30 04:40:13.635704 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2841/5748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:13 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:13.662919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae600822-d994-4b81-82d5-564681a15ec9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:13.663501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ae600822-d994-4b81-82d5-564681a15ec9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Failed to fetch instance by id -1 {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2981}} Aug 30 04:40:13.664223 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ae600822-d994-4b81-82d5-564681a15ec9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance -1 could not be found. Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae600822-d994-4b81-82d5-564681a15ec9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance -1 could not be found. Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '-1'} Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:13.666691 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:13.673110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:13.673110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:13.673110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 30 04:40:13.673110 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:13.673110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae600822-d994-4b81-82d5-564681a15ec9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:13.673110 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae600822-d994-4b81-82d5-564681a15ec9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.010375 Aug 30 04:40:13.673110 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2908/5749] 10.222.0.27 () {58 vars in 1137 bytes} [Tue Aug 30 04:40:13 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:40:13.681103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:13.681823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:13.689726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.690462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.691176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.692054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.692669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.693097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.723405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:13.865050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:13.875373 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3b1bad10-4a1e-4e64-92db-6c43d475b582 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.199664 Aug 30 04:40:13.875964 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2842/5750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:13 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:13.899452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:13.900234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:13.909591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.910239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.910679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.911589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.912044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.912470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.976339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:13.977635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:13.989449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.990685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.991339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:13.992069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:13.992959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:13.993439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.571830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:14.582848 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aa7ec0c4-ca7c-485e-a108-7313a684e2dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.688276 Aug 30 04:40:14.584025 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2909/5751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:13 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:14.610269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f042632e-79aa-4e6a-8df9-5974ef427fd6 req-420ab5b9-28a6-4a43-9207-fe2a05ad33ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5708a59f-2dbf-496a-9bde-6e1e138afa73", "name": "network-vif-deleted", "tag": "155b6e86-e8c8-4b95-b056-cf2063ccf929"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:14.642560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f042632e-79aa-4e6a-8df9-5974ef427fd6 req-420ab5b9-28a6-4a43-9207-fe2a05ad33ae service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:14.646099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f042632e-79aa-4e6a-8df9-5974ef427fd6 req-420ab5b9-28a6-4a43-9207-fe2a05ad33ae service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:14.650065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f042632e-79aa-4e6a-8df9-5974ef427fd6 req-420ab5b9-28a6-4a43-9207-fe2a05ad33ae service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.671463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:14.676608 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f042632e-79aa-4e6a-8df9-5974ef427fd6 req-420ab5b9-28a6-4a43-9207-fe2a05ad33ae service nova] Creating event network-vif-deleted:155b6e86-e8c8-4b95-b056-cf2063ccf929 for instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 on n-h1-854925-5 Aug 30 04:40:14.689880 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3572123-2d2d-47cf-9e1e-a68cb1ea43b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1363 microversion: 2.1 time: 0.717365 Aug 30 04:40:14.691049 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2843/5752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:13 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1363 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:14.691180 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f042632e-79aa-4e6a-8df9-5974ef427fd6 req-420ab5b9-28a6-4a43-9207-fe2a05ad33ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105843 Aug 30 04:40:14.691818 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2910/5753] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:14.697190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea874c06-273e-47ed-944e-55fed43706f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:14.697764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea874c06-273e-47ed-944e-55fed43706f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:14.703948 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ea874c06-273e-47ed-944e-55fed43706f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b could not be found. Aug 30 04:40:14.704935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:14.705800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 5708a59f-2dbf-496a-9bde-6e1e138afa73] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea874c06-273e-47ed-944e-55fed43706f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b/action HTTP/1.1 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 19 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: {"forceDelete": {}} Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b could not be found. Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b', 'body': {'forceDelete': {}}} Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b could not be found. Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b could not be found. Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:14.710526 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:14.717867 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:14.717867 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:14.717867 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b could not be found. Aug 30 04:40:14.717867 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.717867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea874c06-273e-47ed-944e-55fed43706f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:14.717867 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea874c06-273e-47ed-944e-55fed43706f7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b/action" status: 404 len: 111 microversion: 2.1 time: 0.019589 Aug 30 04:40:14.717867 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2844/5754] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:14 2022] POST /compute/v2.1/servers/0fa3eb17-2541-4bf2-88f1-f8d7c9e0298b/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:14.718850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:14.718850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:14.719834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.722578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:14.722726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:14.724449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.726990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:14.727632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:14.746248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:14.746759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:14.748267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.749440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:14.750117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:14.756780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:14.763786 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] HTTP exception thrown: Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 could not be found. Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Request method failure captured: Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 HTTP/1.1 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZP7ChyUww-hUkzvipQWnIDpNCPmoy98A3_91tBaDyGm4CFEC8j1-k4mA_n7DBIbWV-90qD9gx-2bD1g3Wq92ImlI-dgcvlnI0RV7IMY4vRA8qPZrm5U3NAwJasx4XwibSfnEvotZqfz96ADH5quJhdHipFRAl7bQxI4S9Xq1C22I7U Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94a6f1ffe69e4a99927df0ef201e6468", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}] Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 13b0fd630f614ae4a6ca14d083d4d2d1 Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 could not be found. Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '5708a59f-2dbf-496a-9bde-6e1e138afa73'} Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 could not be found. Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 could not be found. Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.765557 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 could not be found. Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Returning 404 to user: Instance 5708a59f-2dbf-496a-9bde-6e1e138afa73 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-827ff441-3080-44b4-b58a-3a5bf05ce9af tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73" status: 404 len: 111 microversion: 2.1 time: 0.073696 Aug 30 04:40:14.776997 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2911/5755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:14 2022] GET /compute/v2.1/servers/5708a59f-2dbf-496a-9bde-6e1e138afa73 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:14.881388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:15.158840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:15.200055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:15.209226 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f38c312-dac1-4aec-b0f2-a8f1d36a24b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.490356 Aug 30 04:40:15.209864 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2845/5756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:14 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:15.230720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:15.231545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:15.238262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.239077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.239921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:15.240886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.241589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.242769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:15.581549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:15.590977 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d51efa63-bc22-4caa-8ef8-6fe5263f6ace tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.364050 Aug 30 04:40:15.605379 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2912/5757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:15 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:15.613255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dcb08eb5-f326-4cef-96ad-d6c664203799 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:15.615684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dcb08eb5-f326-4cef-96ad-d6c664203799 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 33ee66ce-f37b-488b-a251-28c548ea21d3] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:15.624830 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-dcb08eb5-f326-4cef-96ad-d6c664203799 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 33ee66ce-f37b-488b-a251-28c548ea21d3 could not be found. Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dcb08eb5-f326-4cef-96ad-d6c664203799 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/33ee66ce-f37b-488b-a251-28c548ea21d3/action HTTP/1.1 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 39 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: {"os-getConsoleOutput": {"length": 10}} Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 33ee66ce-f37b-488b-a251-28c548ea21d3 could not be found. Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '33ee66ce-f37b-488b-a251-28c548ea21d3', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33ee66ce-f37b-488b-a251-28c548ea21d3 could not be found. Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33ee66ce-f37b-488b-a251-28c548ea21d3 could not be found. Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:15.634185 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33ee66ce-f37b-488b-a251-28c548ea21d3 could not be found. Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dcb08eb5-f326-4cef-96ad-d6c664203799 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 33ee66ce-f37b-488b-a251-28c548ea21d3 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:15.640750 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dcb08eb5-f326-4cef-96ad-d6c664203799 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/33ee66ce-f37b-488b-a251-28c548ea21d3/action" status: 404 len: 111 microversion: 2.1 time: 0.027221 Aug 30 04:40:15.645578 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2846/5758] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:15 2022] POST /compute/v2.1/servers/33ee66ce-f37b-488b-a251-28c548ea21d3/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:15.647575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:15.648605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:15.657123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.657603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.658023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:15.658872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.659671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.660170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:15.668767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:15.715964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:15.716658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:15.729366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.730249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.730857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:15.731730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:15.732588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:15.733187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:16.045870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:16.056563 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0bbc056-1512-4f83-8a0e-1d998fee0828 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.413584 Aug 30 04:40:16.058118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2913/5759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:15 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:16.082184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:16.083130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:16.092302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.093235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.094238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:16.095626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.096391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.097175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:16.105049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:16.117694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff0c8616-6f6a-456a-ad77-3c3619fb50ef tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1363 microversion: 2.1 time: 0.404208 Aug 30 04:40:16.118146 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2847/5760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:15 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:16.394455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:16.408483 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-73b5099d-82d9-422d-871a-8e63bee7c6b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.331251 Aug 30 04:40:16.410232 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2914/5761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:16 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:16.440184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4cf23379-e930-424c-92bb-d74573dbdffa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:16.442511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4cf23379-e930-424c-92bb-d74573dbdffa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: cdc44ab9-b192-4508-8051-d73c97942207] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:16.450636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-4cf23379-e930-424c-92bb-d74573dbdffa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance cdc44ab9-b192-4508-8051-d73c97942207 could not be found. Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4cf23379-e930-424c-92bb-d74573dbdffa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/cdc44ab9-b192-4508-8051-d73c97942207 HTTP/1.1 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance cdc44ab9-b192-4508-8051-d73c97942207 could not be found. Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'cdc44ab9-b192-4508-8051-d73c97942207'} Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdc44ab9-b192-4508-8051-d73c97942207 could not be found. Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdc44ab9-b192-4508-8051-d73c97942207 could not be found. Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:16.452486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:16.457897 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:16.457897 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:16.457897 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:16.457897 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdc44ab9-b192-4508-8051-d73c97942207 could not be found. Aug 30 04:40:16.457897 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:16.460375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4cf23379-e930-424c-92bb-d74573dbdffa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance cdc44ab9-b192-4508-8051-d73c97942207 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:16.462277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4cf23379-e930-424c-92bb-d74573dbdffa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/cdc44ab9-b192-4508-8051-d73c97942207" status: 404 len: 111 microversion: 2.1 time: 0.035065 Aug 30 04:40:16.463326 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2848/5762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:16 2022] GET /compute/v2.1/servers/cdc44ab9-b192-4508-8051-d73c97942207 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:16.472788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:16.473827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:16.485481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.486308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.486738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:16.487674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.488134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.489105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:16.728340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:16.740336 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51c88342-53cd-4eb1-88fc-2f51cc3866ee tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.272137 Aug 30 04:40:16.740554 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2915/5763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:16 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:16.762694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:16.763937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:16.776120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.776937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.777668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:16.778646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:16.779819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:16.780328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:17.051965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:17.065942 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2fb003bf-7cd9-4f6d-acdb-e7da5d21a5c3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.307725 Aug 30 04:40:17.071257 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2849/5764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:16 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:17.140325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:17.142695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:17.152211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:17.156119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:17.156770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:17.158248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:17.159415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:17.163466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:17.316058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2df07074-5edc-4b85-95b9-257d112aff53 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-307881741", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2df07074-5edc-4b85-95b9-257d112aff53 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 237 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-307881741", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-307881741', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.338765 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2df07074-5edc-4b85-95b9-257d112aff53 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2df07074-5edc-4b85-95b9-257d112aff53 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029540 Aug 30 04:40:17.344216 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2850/5765] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:17 2022] POST /compute/v2.1/servers => generated 139 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:17.349821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:17.350439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:17.372796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:17.373300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:17.373769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:17.374478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:17.374935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:17.375360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:17.541108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:17.559210 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3406925c-1036-41f2-9023-56103c805309 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1363 microversion: 2.1 time: 0.422328 Aug 30 04:40:17.560141 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2916/5766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:17 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:17.702328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:17.715141 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d58d5fb-1845-4293-81f3-be7aa62276c0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.369641 Aug 30 04:40:17.734518 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2851/5767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:17 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:17.741264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:17.742388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:17.749254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:17.749788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:17.750417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:17.751291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:17.751920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:17.752550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.017520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:18.030723 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2cb12954-848e-4a7c-b117-818be9944d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.293598 Aug 30 04:40:18.031476 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2917/5768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:17 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:18.269209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bb3e82d-9473-47aa-a721-bd1dfea7aff4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626187215", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bb3e82d-9473-47aa-a721-bd1dfea7aff4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 234 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-626187215", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-626187215', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.277407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 30 04:40:18.284440 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:18.298479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bb3e82d-9473-47aa-a721-bd1dfea7aff4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:18.300349 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0bb3e82d-9473-47aa-a721-bd1dfea7aff4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.038029 Aug 30 04:40:18.304121 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2852/5769] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:18 2022] POST /compute/v2.1/servers => generated 133 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:18.316304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:18.317747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:18.327356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.328252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.329022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.330008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.331333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.331998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.502729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:18.512936 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f4bece6-4163-439f-a456-cf00d1cbb4ad tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.201510 Aug 30 04:40:18.526115 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2918/5770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:18 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:18.542623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:18.544089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:18.560023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.562852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.565130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.566349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.568488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.571104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.584064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:18.585443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:18.604630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.607748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.614580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.616309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:18.617985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:18.621556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:18.973372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:18.987143 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa6f05ec-0335-4ee0-bf2e-5ebec9336b3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.453563 Aug 30 04:40:18.990051 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2853/5771] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:18 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:19.015123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc7b904d-6ac5-40e5-ae0a-22c2599095f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:19.015924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc7b904d-6ac5-40e5-ae0a-22c2599095f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: c3636e80-0513-4b11-b5f1-71b5131ead9e] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:19.029549 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-cc7b904d-6ac5-40e5-ae0a-22c2599095f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance c3636e80-0513-4b11-b5f1-71b5131ead9e could not be found. Aug 30 04:40:19.037988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc7b904d-6ac5-40e5-ae0a-22c2599095f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/c3636e80-0513-4b11-b5f1-71b5131ead9e/action HTTP/1.1 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 13 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: {"pause": {}} Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c3636e80-0513-4b11-b5f1-71b5131ead9e could not be found. Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c3636e80-0513-4b11-b5f1-71b5131ead9e', 'body': {'pause': {}}} Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3636e80-0513-4b11-b5f1-71b5131ead9e could not be found. Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3636e80-0513-4b11-b5f1-71b5131ead9e could not be found. Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:19.043165 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:19.047267 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:19.047267 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:19.047267 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3636e80-0513-4b11-b5f1-71b5131ead9e could not be found. Aug 30 04:40:19.047267 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:19.055608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc7b904d-6ac5-40e5-ae0a-22c2599095f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance c3636e80-0513-4b11-b5f1-71b5131ead9e could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:19.059739 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc7b904d-6ac5-40e5-ae0a-22c2599095f4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/c3636e80-0513-4b11-b5f1-71b5131ead9e/action" status: 404 len: 111 microversion: 2.1 time: 0.049787 Aug 30 04:40:19.063666 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2854/5772] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:19 2022] POST /compute/v2.1/servers/c3636e80-0513-4b11-b5f1-71b5131ead9e/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:19.069302 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ae124dc3-1be0-4668-92e3-fd8a057e7681 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1363 microversion: 2.1 time: 0.480036 Aug 30 04:40:19.071182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2919/5773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:18 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:19.075250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:19.076142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:19.083470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.084224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.084848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.086450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.087098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.087710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.328478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:19.342380 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c777b13b-d7a3-4997-9e7a-861acc052654 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.274335 Aug 30 04:40:19.343614 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2855/5774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:19 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:19.369058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:19.372520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:19.382607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:19.385400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.386542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.387161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.388050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.388749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.389591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.480255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b51ab2f7-6b59-4125-97e3-b058238cffa1 req-fbd45423-dacf-405a-9a21-fe4d3468e705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46517a40-9c95-4441-b643-45b28b0d717d", "name": "network-vif-plugged", "status": "completed", "tag": "626e7ecf-c8b9-4d19-9da9-02593a43a970"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:19.505598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b51ab2f7-6b59-4125-97e3-b058238cffa1 req-fbd45423-dacf-405a-9a21-fe4d3468e705 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.511118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b51ab2f7-6b59-4125-97e3-b058238cffa1 req-fbd45423-dacf-405a-9a21-fe4d3468e705 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.513632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b51ab2f7-6b59-4125-97e3-b058238cffa1 req-fbd45423-dacf-405a-9a21-fe4d3468e705 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.579477 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b51ab2f7-6b59-4125-97e3-b058238cffa1 req-fbd45423-dacf-405a-9a21-fe4d3468e705 service nova] Creating event network-vif-plugged:626e7ecf-c8b9-4d19-9da9-02593a43a970 for instance 46517a40-9c95-4441-b643-45b28b0d717d on n-h2-854925-5 Aug 30 04:40:19.593164 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b51ab2f7-6b59-4125-97e3-b058238cffa1 req-fbd45423-dacf-405a-9a21-fe4d3468e705 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120060 Aug 30 04:40:19.605664 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2856/5775] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:19.669121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:19.680473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7998c4da-6d02-4623-ac5b-6ab60b33a5e0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.317437 Aug 30 04:40:19.681060 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2920/5776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:19 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:19.708134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:19.709289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:19.721815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.724486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.725713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.728338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.729162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.730573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.851230 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-92360354-59a6-4786-8518-7dab4b984ccd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 202 len: 0 microversion: 2.1 time: 0.145730 Aug 30 04:40:19.852456 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2857/5777] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:19 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:40:19.860843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:19.861601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:19.874298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.875231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.875687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:19.877145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:19.878325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:19.878933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:20.093882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:20.095845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:20.099013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:20.104158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:20.105077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:20.106380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:20.109060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:20.110328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:20.112517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:20.116740 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9dd5ad80-52e6-4273-b4a8-a70f1faf7279 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1512 microversion: 2.1 time: 0.259911 Aug 30 04:40:20.120714 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2921/5778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:19 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:20.313992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:20.331969 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3930424-b192-4d7f-af38-70dbbdacaac8 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1363 microversion: 2.1 time: 0.243554 Aug 30 04:40:20.332607 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2858/5779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:20 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:20.697810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fa33215c-37a5-4430-a92a-82f6b342135d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '.version_select at 0x7fe9692d69d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:20.725303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fa33215c-37a5-4430-a92a-82f6b342135d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-488562152" status: 202 len: 0 microversion: 2.1 time: 0.032014 Aug 30 04:40:20.726875 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2922/5780] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Aug 30 04:40:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-488562152 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:40:20.759422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0a259e3-d0f2-43fb-ac23-29b4d48ec0db tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: .version_select at 0x7fe968e9f790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1506553375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJW8ysLUe2oR8GMsxwXgWeAGSsHW0M4pcQx6EN346ZcEBvkDWNw3a48oCJ5wpLBucxw/gs3fpQl3FBHVxZYBT5dIfw4tQs33pXXkG/yZkTJozQzXBtnGlGbx60XoxWIKw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:20.770595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:20.778156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f0a259e3-d0f2-43fb-ac23-29b4d48ec0db tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:40:20.785558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f0a259e3-d0f2-43fb-ac23-29b4d48ec0db tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:40:20.816001 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0a259e3-d0f2-43fb-ac23-29b4d48ec0db tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.061179 Aug 30 04:40:20.821870 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2859/5781] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:40:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:21.146605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:21.148120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:21.158953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.159939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.160609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.161658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.162538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.163045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.325307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:21.339073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc018335-11ea-4fcd-a1c1-f9068ed80108 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1492 microversion: 2.1 time: 0.198973 Aug 30 04:40:21.340126 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2923/5782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:21 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1492 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:21.356529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:21.357364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:21.371524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:21.372082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:21.373582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.375360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.376085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.378146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.379195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.380489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.381269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.383138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.383138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.383904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.384737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.385373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.421837 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Cannot 'pause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state paused Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action HTTP/1.1 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 13 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: {"pause": {}} Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'pause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state paused Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'pause': {}}} Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 in vm_state paused. Cannot pause while the instance is in this state. Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state paused Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:21.424907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:21.432995 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:21.432995 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:21.432995 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:21.432995 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state paused Aug 30 04:40:21.432995 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:21.434863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 409 to user: Cannot 'pause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state paused {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:21.436068 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8204f209-0d3a-4a5e-9559-13e1627046de tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 409 len: 143 microversion: 2.1 time: 0.074763 Aug 30 04:40:21.437369 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2924/5783] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:21 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 143 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:40:21.451648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:21.452147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:21.459799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.460335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.461787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.462581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.463358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.463805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.553043 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb03b6d4-5db5-4b4b-8dea-aa7622f3e62d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 202 len: 0 microversion: 2.1 time: 0.110033 Aug 30 04:40:21.557521 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2925/5784] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:21 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:40:21.563416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:21.564354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:21.578460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.579196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.579824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.591383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.594128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.595842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.600320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:21.613224 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c524818-5cd0-4734-a3b5-3bfad4d2fc4e tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1549 microversion: 2.1 time: 0.262322 Aug 30 04:40:21.614402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2860/5785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:21 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1549 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:21.642243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:21.643107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:21.651259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.652036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.652802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.653672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:21.654887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:21.655580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:21.800049 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2a861452-c781-45a1-9171-123499440c7d tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164932 Aug 30 04:40:21.808637 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2861/5786] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 04:40:21 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:21.891089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:21.921240 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fa468fbf-d6f4-44cd-b9d6-e8a792a2d31f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1499 microversion: 2.1 time: 0.362198 Aug 30 04:40:21.922188 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2926/5787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:21 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1499 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:22.948044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:22.948685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:22.963823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:22.966255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:22.967069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:22.969191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:22.969820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:22.971731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:23.699374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4c041d25-42b6-4a1c-a911-ace0c2a29077 req-59c4de20-3459-4591-ae9a-8be08f8c3ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46517a40-9c95-4441-b643-45b28b0d717d", "tag": "626e7ecf-c8b9-4d19-9da9-02593a43a970"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:23.713856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c041d25-42b6-4a1c-a911-ace0c2a29077 req-59c4de20-3459-4591-ae9a-8be08f8c3ca2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:23.714572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c041d25-42b6-4a1c-a911-ace0c2a29077 req-59c4de20-3459-4591-ae9a-8be08f8c3ca2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:23.715076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4c041d25-42b6-4a1c-a911-ace0c2a29077 req-59c4de20-3459-4591-ae9a-8be08f8c3ca2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:23.728750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:23.730008 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4c041d25-42b6-4a1c-a911-ace0c2a29077 req-59c4de20-3459-4591-ae9a-8be08f8c3ca2 service nova] Creating event network-changed:626e7ecf-c8b9-4d19-9da9-02593a43a970 for instance 46517a40-9c95-4441-b643-45b28b0d717d on n-h2-854925-5 Aug 30 04:40:23.735943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4c041d25-42b6-4a1c-a911-ace0c2a29077 req-59c4de20-3459-4591-ae9a-8be08f8c3ca2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040904 Aug 30 04:40:23.739369 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2927/5788] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:23.744170 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a7d34a9-ebe5-4ddb-ae34-bbcbde3c250f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.802581 Aug 30 04:40:23.745706 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2862/5789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:22 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:23.772294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:23.773097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:23.782517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:23.783305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:23.783898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:23.784629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:23.785095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:23.785647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.152011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:24.167826 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83fe1a72-35bf-4c38-aecf-ff0ede7a13b7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.399586 Aug 30 04:40:24.172325 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2928/5790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:23 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:24.191278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:24.193718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:24.201792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.202562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.203228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.204117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.204734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.205357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.220780 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0/action HTTP/1.1 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 28 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: {"reboot": {"type": "SOFT"}} Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6a3e1080-c0f8-4a45-af28-ecc0783e3ae0', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:24.223388 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:24.228724 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:24.230375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:24.231467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-280a1b9b-93ed-4fcf-ab2d-eee248d2db67 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0/action" status: 404 len: 111 microversion: 2.1 time: 0.044667 Aug 30 04:40:24.232836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2863/5791] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:24 2022] POST /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:24.241534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:24.243730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:24.251001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.251498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.251943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.252704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.253201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.256198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.615700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:24.633527 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-275e8bcc-dcc4-4076-833c-07ec6ff9863b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.394143 Aug 30 04:40:24.634288 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2929/5792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:24 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:24.657255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:24.658165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:24.667255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.672356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.672827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:24.673695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:24.674163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:24.674604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.037041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:25.053034 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fa4370a-6cfb-4c85-8d00-e8ba76bb5e33 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.399431 Aug 30 04:40:25.054084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2864/5793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:24 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:25.074339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a5a5ae7-4fbe-494c-844e-5a02d0c974e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:25.076732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a5a5ae7-4fbe-494c-844e-5a02d0c974e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 8be4a88c-696c-47c2-be44-b92b8647a3cb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:25.090405 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1a5a5ae7-4fbe-494c-844e-5a02d0c974e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 8be4a88c-696c-47c2-be44-b92b8647a3cb could not be found. Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a5a5ae7-4fbe-494c-844e-5a02d0c974e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/8be4a88c-696c-47c2-be44-b92b8647a3cb/action HTTP/1.1 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 28 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: {"reboot": {"type": "SOFT"}} Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 8be4a88c-696c-47c2-be44-b92b8647a3cb could not be found. Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '8be4a88c-696c-47c2-be44-b92b8647a3cb', 'body': {'reboot': {'type': 'SOFT'}}} Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8be4a88c-696c-47c2-be44-b92b8647a3cb could not be found. Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8be4a88c-696c-47c2-be44-b92b8647a3cb could not be found. Aug 30 04:40:25.095265 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8be4a88c-696c-47c2-be44-b92b8647a3cb could not be found. Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a5a5ae7-4fbe-494c-844e-5a02d0c974e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 8be4a88c-696c-47c2-be44-b92b8647a3cb could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a5a5ae7-4fbe-494c-844e-5a02d0c974e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/8be4a88c-696c-47c2-be44-b92b8647a3cb/action" status: 404 len: 111 microversion: 2.1 time: 0.026597 Aug 30 04:40:25.100855 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2930/5794] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:25 2022] POST /compute/v2.1/servers/8be4a88c-696c-47c2-be44-b92b8647a3cb/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:25.107115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:25.107810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:25.123580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.124085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.124527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.125250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.125744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.126370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.387142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:25.417798 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a492ac1-e342-474f-8809-552554c0d5ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.313755 Aug 30 04:40:25.438059 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2865/5795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:25 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:25.443223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:25.443781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:25.459122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.459706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.460651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.463671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.464890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.465980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.755923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:25.758973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:25.776873 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c40e1d3f-20fc-46d2-8bfc-481102648dd5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.338385 Aug 30 04:40:25.777489 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2931/5796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:25 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:25.797566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:25.800424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:25.807513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.808028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.808535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.809426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.809860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.810315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.827993 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0/action HTTP/1.1 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 65 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6a3e1080-c0f8-4a45-af28-ecc0783e3ae0', 'body': {'rebuild': {'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2'}}} Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 04:40:25.830082 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:40:25.834795 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:25.837140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:25.838415 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f46fb45b-e4e6-450a-8a82-1415cb583394 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0/action" status: 404 len: 111 microversion: 2.1 time: 0.045170 Aug 30 04:40:25.839011 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2866/5797] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:25 2022] POST /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:25.848622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:25.849251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:25.857964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.859164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.859925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:25.860884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:25.861737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:25.862440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:26.107240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:26.115594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6f3c85f-54e0-41ae-98b0-97fba6dfe523 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.271586 Aug 30 04:40:26.116385 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2932/5798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:25 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:26.139349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:26.140157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:26.146889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:26.147656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:26.148713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:26.149663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:26.150288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:26.151032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:26.154461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:26.413426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:26.422981 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23fc5b94-8893-437d-8500-385005113563 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.287936 Aug 30 04:40:26.438843 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2867/5799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:26 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:26.455976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fab5e56f-6597-44b3-878f-5cf6177fe0ef tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:26.460055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fab5e56f-6597-44b3-878f-5cf6177fe0ef tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: d1c9e662-b6e8-4992-8605-0e3bf727632c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:26.471241 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-fab5e56f-6597-44b3-878f-5cf6177fe0ef tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance d1c9e662-b6e8-4992-8605-0e3bf727632c could not be found. Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fab5e56f-6597-44b3-878f-5cf6177fe0ef tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/d1c9e662-b6e8-4992-8605-0e3bf727632c/action HTTP/1.1 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 65 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance d1c9e662-b6e8-4992-8605-0e3bf727632c could not be found. Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'd1c9e662-b6e8-4992-8605-0e3bf727632c', 'body': {'rebuild': {'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2'}}} Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1c9e662-b6e8-4992-8605-0e3bf727632c could not be found. Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 30 04:40:26.473547 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1c9e662-b6e8-4992-8605-0e3bf727632c could not be found. Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1c9e662-b6e8-4992-8605-0e3bf727632c could not be found. Aug 30 04:40:26.480666 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:26.486177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fab5e56f-6597-44b3-878f-5cf6177fe0ef tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance d1c9e662-b6e8-4992-8605-0e3bf727632c could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:26.489317 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fab5e56f-6597-44b3-878f-5cf6177fe0ef tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/d1c9e662-b6e8-4992-8605-0e3bf727632c/action" status: 404 len: 111 microversion: 2.1 time: 0.042073 Aug 30 04:40:26.494249 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2933/5800] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:26 2022] POST /compute/v2.1/servers/d1c9e662-b6e8-4992-8605-0e3bf727632c/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:26.502480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:26.503560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:26.510531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:26.511741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:26.512263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:26.513059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:26.513770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:26.514279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.300546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:27.315752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af97b2ee-6ffe-4917-9931-437be201a90e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.816699 Aug 30 04:40:27.318232 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2868/5801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:26 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:27.350749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:27.351393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:27.361802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.362734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.363189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.363919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.364636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.365629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.565228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:27.575144 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eaea5c49-66f7-4190-9732-2e951660a0ca tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.229158 Aug 30 04:40:27.576291 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2934/5802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:27 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:27.600171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-522c76be-8467-4fa6-9bf6-7a53f610d328 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:27.600786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-522c76be-8467-4fa6-9bf6-7a53f610d328 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 42b92406-f24a-4f18-a33f-96e2ebf07100] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:27.622622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-522c76be-8467-4fa6-9bf6-7a53f610d328 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 42b92406-f24a-4f18-a33f-96e2ebf07100 could not be found. Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-522c76be-8467-4fa6-9bf6-7a53f610d328 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/42b92406-f24a-4f18-a33f-96e2ebf07100/action HTTP/1.1 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 15 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: {"restore": {}} Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 42b92406-f24a-4f18-a33f-96e2ebf07100 could not be found. Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '42b92406-f24a-4f18-a33f-96e2ebf07100', 'body': {'restore': {}}} Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42b92406-f24a-4f18-a33f-96e2ebf07100 could not be found. Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42b92406-f24a-4f18-a33f-96e2ebf07100 could not be found. Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:27.624209 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:27.629180 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:27.629180 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:27.629180 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42b92406-f24a-4f18-a33f-96e2ebf07100 could not be found. Aug 30 04:40:27.629180 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:27.630850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-522c76be-8467-4fa6-9bf6-7a53f610d328 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 42b92406-f24a-4f18-a33f-96e2ebf07100 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:27.631886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-522c76be-8467-4fa6-9bf6-7a53f610d328 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/42b92406-f24a-4f18-a33f-96e2ebf07100/action" status: 404 len: 111 microversion: 2.1 time: 0.036628 Aug 30 04:40:27.632837 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2869/5803] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:27 2022] POST /compute/v2.1/servers/42b92406-f24a-4f18-a33f-96e2ebf07100/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:27.640749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:27.641537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:27.651495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.653282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.653929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.654751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:27.656453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:27.657862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:27.956897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:27.970006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dff71006-461e-4abc-9f26-2ea2726254b8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.333053 Aug 30 04:40:27.971942 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2935/5804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:27 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:27.997190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:27.998438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:28.027874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.034759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.035474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.036453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.037095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.037714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.428777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:28.439884 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3781be70-1818-491e-a9e2-d6e5d325ad15 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.447754 Aug 30 04:40:28.441181 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2870/5805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:27 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:28.466139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:28.467854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:28.478906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.479886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.480539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.481609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.482295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.482949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.521504 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Cannot 'restore' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action HTTP/1.1 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 15 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: {"restore": {}} Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'restore' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'restore': {}}} Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 in vm_state active. Cannot restore while the instance is in this state. Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:28.528070 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:28.532572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:28.532572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:28.532572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:28.532572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:28.532572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:28.534150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 409 to user: Cannot 'restore' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:28.535198 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bfdca98b-a4f0-4227-ae1a-b25ac9763842 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 409 len: 145 microversion: 2.1 time: 0.077472 Aug 30 04:40:28.544157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2936/5806] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:28 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 145 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:40:28.544301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:28.544875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:28.563261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.563757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.564200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.564918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.565392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.565861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.928524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:28.944699 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5defdc5c-10d1-4e51-a90d-6e94f2d60ca9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.398494 Aug 30 04:40:28.950750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2871/5807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:28 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:28.968447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:28.969161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:28.977557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.978298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.978911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:28.979804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:28.980427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:28.981020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:29.595352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:29.626312 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d92250d5-6d89-4c15-9953-d0810d14ecb8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.644854 Aug 30 04:40:29.627116 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2937/5808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:28 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:29.655646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dd9649d-e8b8-4517-82e0-0a2e54c6fe28 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:29.656532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6dd9649d-e8b8-4517-82e0-0a2e54c6fe28 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:29.670736 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6dd9649d-e8b8-4517-82e0-0a2e54c6fe28 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a could not be found. Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dd9649d-e8b8-4517-82e0-0a2e54c6fe28 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a/action HTTP/1.1 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 14 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: {"resume": {}} Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a could not be found. Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a', 'body': {'resume': {}}} Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a could not be found. Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a could not be found. Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:29.683843 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:29.691406 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:29.691406 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:29.691406 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a could not be found. Aug 30 04:40:29.691406 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:29.691406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dd9649d-e8b8-4517-82e0-0a2e54c6fe28 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:29.691406 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dd9649d-e8b8-4517-82e0-0a2e54c6fe28 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a/action" status: 404 len: 111 microversion: 2.1 time: 0.039797 Aug 30 04:40:29.691406 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2872/5809] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:29 2022] POST /compute/v2.1/servers/61ede5dd-8ddf-4283-8bfe-1ac82b4ee65a/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:29.698745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:29.699371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:29.718187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:29.719138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:29.719921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:29.722358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:29.725853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:29.727001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.079735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:30.093961 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d95b95f7-705d-4d62-85f6-1aaa0fc852a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.400774 Aug 30 04:40:30.096522 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2938/5810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:29 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:30.119980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:30.120850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:30.129350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.132493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.134426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.135678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.137904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.138667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.463380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:30.479877 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0539afd7-4403-4506-8be6-cc49fceda8f5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.364579 Aug 30 04:40:30.480474 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2873/5811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:30 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:30.502675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:30.503316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:30.511411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.511987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.512504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.513386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.514201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.514709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.542423 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Cannot 'resume' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action HTTP/1.1 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 14 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: {"resume": {}} Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'resume' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'resume': {}}} Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 in vm_state active. Cannot resume while the instance is in this state. Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:30.544835 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:30.549703 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:30.549703 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:30.549703 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:30.549703 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:30.549703 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:30.549703 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:40:30.549703 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:30.552019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 409 to user: Cannot 'resume' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:30.553075 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1aefd382-8a9b-4d1d-b0e7-0743bdde41cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 409 len: 144 microversion: 2.1 time: 0.054869 Aug 30 04:40:30.554208 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2939/5812] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:30 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 144 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:40:30.563425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:30.564418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:30.573138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.574028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.574736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.575706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.576370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.577107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.794830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:30.840466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:30.855013 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-677febfd-cb1b-4b46-9ecb-645a698d0fe0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.295632 Aug 30 04:40:30.855909 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2874/5813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:30 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:30.878793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:30.879412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:30.888848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.889364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.889815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:30.893498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:30.894203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:30.913790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:31.290365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:31.303313 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a31fa3e-260e-4477-a927-846b50276188 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.428518 Aug 30 04:40:31.308482 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2940/5814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:30 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:31.529973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77df0e8f-b4f9-4889-9110-1ede793af68d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77df0e8f-b4f9-4889-9110-1ede793af68d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 160 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "27fa2046-0bb2-41f9-8766-d50f2e2b01e0"}]}} Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'body': {'server': {'name': '', 'imageRef': 'b5ae2bcd-efca-4003-b452-ab36e7c230c2', 'flavorRef': '452', 'networks': [{'uuid': '27fa2046-0bb2-41f9-8766-d50f2e2b01e0'}]}}} Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi '' Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:40:31.534463 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:40:31.540301 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:40:31.542312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77df0e8f-b4f9-4889-9110-1ede793af68d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:31.543335 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77df0e8f-b4f9-4889-9110-1ede793af68d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.017494 Aug 30 04:40:31.544080 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2875/5815] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:31 2022] POST /compute/v2.1/servers => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:40:31.553308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:31.554194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:31.563359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:31.564034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:31.564647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:31.565632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:31.566257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:31.566885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:31.904939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:31.920619 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9b764775-0a49-4514-a167-4e7f90ebb670 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.372102 Aug 30 04:40:31.924171 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2941/5816] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:31 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:31.948654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:31.949227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:31.966371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:31.967157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:31.967799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:31.968980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:31.969639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:31.970235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:32.284656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:32.297764 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83de8529-5cde-4e42-ac57-59162e9a27e2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.349294 Aug 30 04:40:32.309702 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2876/5817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:31 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:32.319299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-baded009-7fd8-4504-8527-9642ee6c63f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:32.320133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-baded009-7fd8-4504-8527-9642ee6c63f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 7bde4cf4-feef-4641-8d35-c32bbc79ddf1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:32.326871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-baded009-7fd8-4504-8527-9642ee6c63f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 7bde4cf4-feef-4641-8d35-c32bbc79ddf1 could not be found. Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-baded009-7fd8-4504-8527-9642ee6c63f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/7bde4cf4-feef-4641-8d35-c32bbc79ddf1/action HTTP/1.1 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 14 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: {"shelve": {}} Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7bde4cf4-feef-4641-8d35-c32bbc79ddf1 could not be found. Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7bde4cf4-feef-4641-8d35-c32bbc79ddf1', 'body': {'shelve': {}}} Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bde4cf4-feef-4641-8d35-c32bbc79ddf1 could not be found. Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bde4cf4-feef-4641-8d35-c32bbc79ddf1 could not be found. Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:32.329573 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:32.334756 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:32.334756 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:32.334756 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bde4cf4-feef-4641-8d35-c32bbc79ddf1 could not be found. Aug 30 04:40:32.334756 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:32.335947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-baded009-7fd8-4504-8527-9642ee6c63f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 7bde4cf4-feef-4641-8d35-c32bbc79ddf1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:32.337206 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-baded009-7fd8-4504-8527-9642ee6c63f2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/7bde4cf4-feef-4641-8d35-c32bbc79ddf1/action" status: 404 len: 111 microversion: 2.1 time: 0.021940 Aug 30 04:40:32.348175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:32.349069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:32.351895 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2942/5818] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:32 2022] POST /compute/v2.1/servers/7bde4cf4-feef-4641-8d35-c32bbc79ddf1/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:32.358142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:32.358913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:32.359539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:32.360563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:32.361256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:32.361957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:32.797300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:32.817730 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2e93689-f1c3-4012-ada9-c61de07cb871 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.466764 Aug 30 04:40:32.844178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2877/5819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:32 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:32.849758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:32.850712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:32.866264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:32.869164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:32.872049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:32.874988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:32.875734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:32.876891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:33.024429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-454964205", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "b3399300-6eb1-4fd8-9fba-8e525d72d6a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1506553375", "security_groups": [{"name": "tempest-secgroup-smoke-1809638336"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:33.184313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:33.197258 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c73f8b0e-4c0e-45c9-994d-e5788838b690 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.351766 Aug 30 04:40:33.199099 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2943/5820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:32 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:33.221393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:33.222024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:33.235529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:33.236041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:33.239351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:33.240662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:33.241161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:33.244645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:33.275637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lazy-loading 'flavor' on Instance uuid b6022067-fd07-48f1-abc8-c400ad50ccd0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:40:33.309679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] validate_networks() for [('b3399300-6eb1-4fd8-9fba-8e525d72d6a5', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:40:33.617850 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6eb058fb-c0fe-4eb8-bf1b-cc3b7b514780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 202 len: 0 microversion: 2.1 time: 0.402903 Aug 30 04:40:33.618789 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2944/5821] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:40:33 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:40:33.635387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:33.635988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:33.663772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:33.664290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:33.664766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:33.672340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:33.672852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:33.673309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:33.735026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:40:33.937471 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-964ec630-9cd0-42be-b96c-9572e7c40f0f tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 204 len: 0 microversion: 2.1 time: 0.317421 Aug 30 04:40:33.938376 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2945/5822] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:40:33 2022] DELETE /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:40:33.946478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9bad3e62-edde-49c8-b56e-7ef0e64bd3a3 req-5eeb3a0f-1f14-4bd3-b20c-f572093e8146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f34bbc66-38a3-4ec2-a11b-d703c31b8d6a", "tag": "53d0e403-9119-49ad-8be3-0bd0b4d7d201"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:33.971959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9bad3e62-edde-49c8-b56e-7ef0e64bd3a3 req-5eeb3a0f-1f14-4bd3-b20c-f572093e8146 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:33.972792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9bad3e62-edde-49c8-b56e-7ef0e64bd3a3 req-5eeb3a0f-1f14-4bd3-b20c-f572093e8146 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:33.973434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9bad3e62-edde-49c8-b56e-7ef0e64bd3a3 req-5eeb3a0f-1f14-4bd3-b20c-f572093e8146 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:33.996970 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9bad3e62-edde-49c8-b56e-7ef0e64bd3a3 req-5eeb3a0f-1f14-4bd3-b20c-f572093e8146 service nova] Creating event network-changed:53d0e403-9119-49ad-8be3-0bd0b4d7d201 for instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a on n-h1-854925-5 Aug 30 04:40:34.006199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9bad3e62-edde-49c8-b56e-7ef0e64bd3a3 req-5eeb3a0f-1f14-4bd3-b20c-f572093e8146 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066216 Aug 30 04:40:34.010111 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2946/5823] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:34.020502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:34.026330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:34.037778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:34.038590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:34.043398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:34.043612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:40:34.044066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:40:34.044526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:40:34.044946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:40:34.045377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:34.045507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:40:34.046129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:34.046737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:34.059680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:34.061801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:34.062271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:34.067252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:34.067754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:34.068450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:34.117649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:40:34.130794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:40:34.160170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:40:34.162841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:40:34.261416 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dcd5ecc9-b43a-4b91-ac95-accd888fa321 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.241411 Aug 30 04:40:34.268551 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2878/5824] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:40:34.280126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:34.283741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:34.300488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:34.302133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:34.306004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:34.307057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:34.307760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:34.308452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:34.496896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:34.507269 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b5151aa4-2c44-4257-9993-3a2d8faaf2c8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.495651 Aug 30 04:40:34.511523 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2947/5825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:34 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:34.517809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d8d0c745-e3ef-44b0-8d8f-862e89fc447e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:34.532076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d8d0c745-e3ef-44b0-8d8f-862e89fc447e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:34.673520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d8d0c745-e3ef-44b0-8d8f-862e89fc447e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:34.683208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d8d0c745-e3ef-44b0-8d8f-862e89fc447e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1266 microversion: 2.1 time: 0.170425 Aug 30 04:40:34.683952 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2948/5826] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:34 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:34.703681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:34.713621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c17b3c9d-f143-4bc4-b206-afed602ad356 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1583 microversion: 2.1 time: 0.443688 Aug 30 04:40:34.714480 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2879/5827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:34 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1583 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:35.535493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:35.536250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:35.551328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:35.554050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:35.555808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:35.558847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:35.559520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:35.560775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:35.612882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:35.705175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:35.705844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:35.717152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:35.717681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:35.718131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:35.718934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:35.728331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:35.729736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:35.918749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:35.944327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef52da6e-776c-47d4-b1a6-6c4da580a6c7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1262 microversion: 2.1 time: 0.243863 Aug 30 04:40:35.944945 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2880/5828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:35 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1262 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:35.984752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:35.985438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:36.007364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.010391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.010870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:36.011629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.015465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.015938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:36.018570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:36.031849 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a2106369-8644-4b6c-8e87-52829eed2fdc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.499541 Aug 30 04:40:36.033557 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2949/5829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:35 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:36.397448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:36.410853 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8415537-5519-4786-9667-bd22cb52bf32 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1583 microversion: 2.1 time: 0.445648 Aug 30 04:40:36.412033 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2881/5830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:35 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1583 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:36.971374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:36.972529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:36.987668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.988242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.988919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:36.990391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:36.991192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:36.992678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.055101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:37.055954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:37.072999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:37.074979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:37.077669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.080126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:37.082458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:37.083866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.140375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:37.156085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d3b909c-9a1e-40a3-8609-d786cb97b700 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1336 microversion: 2.1 time: 0.189449 Aug 30 04:40:37.157978 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2950/5831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:36 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1336 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:37.366984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:37.383493 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c272aef-7c81-424a-ae41-222a6393f166 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.333077 Aug 30 04:40:37.397931 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2882/5832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:37 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:37.436299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:37.437199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:37.452275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:37.454619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:37.456918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.460197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:37.462805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:37.463513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.751561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:37.760499 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9c2258dc-90ca-4d59-8926-6e9675256d28 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1465 microversion: 2.1 time: 0.330895 Aug 30 04:40:37.761696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2951/5833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:37 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1465 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:37.891237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-be292ef2-c599-4a99-ac88-ae89404721c2 req-c8881686-399a-4cff-911a-178b93928ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f34bbc66-38a3-4ec2-a11b-d703c31b8d6a", "name": "network-vif-deleted", "tag": "53d0e403-9119-49ad-8be3-0bd0b4d7d201"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:37.916284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be292ef2-c599-4a99-ac88-ae89404721c2 req-c8881686-399a-4cff-911a-178b93928ce7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:37.917797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be292ef2-c599-4a99-ac88-ae89404721c2 req-c8881686-399a-4cff-911a-178b93928ce7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:37.921569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be292ef2-c599-4a99-ac88-ae89404721c2 req-c8881686-399a-4cff-911a-178b93928ce7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:37.942342 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-be292ef2-c599-4a99-ac88-ae89404721c2 req-c8881686-399a-4cff-911a-178b93928ce7 service nova] Creating event network-vif-deleted:53d0e403-9119-49ad-8be3-0bd0b4d7d201 for instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a on n-h1-854925-5 Aug 30 04:40:37.950713 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-be292ef2-c599-4a99-ac88-ae89404721c2 req-c8881686-399a-4cff-911a-178b93928ce7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062862 Aug 30 04:40:37.952288 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2883/5834] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:38.194368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:38.196378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:38.208192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.208887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.209492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.210448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.212405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.212933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.418034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:38.418937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:38.446188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.448124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.455182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.462201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.464320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.465023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.556966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:38.578389 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-454d3412-518c-41ea-8117-50aa5ad1b41d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.399908 Aug 30 04:40:38.580678 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2952/5835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:38 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:38.776059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:38.802056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:38.806028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:38.818277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c3d73f7-71f0-41a6-9801-c0799f4cc8ab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.404690 Aug 30 04:40:38.829695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.829695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.829695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.829695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:38.829695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:38.829695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:38.831715 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2884/5836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:38 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:39.005462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:39.022217 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b88e6608-7986-43f6-9fbf-a09098963627 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1230 microversion: 2.1 time: 0.237743 Aug 30 04:40:39.025294 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2953/5837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:38 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1230 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:39.603179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:39.605462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:39.624718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.625900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.626580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.628036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.628818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.630123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.843331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:39.843953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:39.860089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.860816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.861552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.862477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:39.863096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:39.863687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:39.989906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:39.999042 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f3802f5-f5f8-4fd0-9b91-124d1a28ef62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.400990 Aug 30 04:40:40.017123 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2885/5838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:39 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:40.045259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:40.046523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:40.058711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:40.059211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:40.062784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:40.063559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:40.064042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:40.064486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:40.209233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:40.217820 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aa4b2ea8-d461-4999-8f19-a0af0dee4848 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.378534 Aug 30 04:40:40.234712 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2954/5839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:39 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:40.249205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5d6bf623-f599-4b7c-9ea7-29a0cd56080a req-3f6268a8-770a-4d6d-af5c-379e39414c14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:40.270151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d6bf623-f599-4b7c-9ea7-29a0cd56080a req-3f6268a8-770a-4d6d-af5c-379e39414c14 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:40.271034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d6bf623-f599-4b7c-9ea7-29a0cd56080a req-3f6268a8-770a-4d6d-af5c-379e39414c14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:40.271646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5d6bf623-f599-4b7c-9ea7-29a0cd56080a req-3f6268a8-770a-4d6d-af5c-379e39414c14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:40.271777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:40.286247 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5f53ab5c-4481-475d-9ddb-108229b68374 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1230 microversion: 2.1 time: 0.244067 Aug 30 04:40:40.287753 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2886/5840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:40 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1230 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:40.294297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5d6bf623-f599-4b7c-9ea7-29a0cd56080a req-3f6268a8-770a-4d6d-af5c-379e39414c14 service nova] Creating event network-changed:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:40:40.306189 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5d6bf623-f599-4b7c-9ea7-29a0cd56080a req-3f6268a8-770a-4d6d-af5c-379e39414c14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070089 Aug 30 04:40:40.307368 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2955/5841] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:41.025375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:41.026180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:41.039842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.041637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.042402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.045373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.046027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.052484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.207018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:41.216770 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c8cacb46-9200-47e1-844a-8f39b3c11ec7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.196290 Aug 30 04:40:41.220697 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2887/5842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:41 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:41.243835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:41.245138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:41.251653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.252415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.253137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.254072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.254723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.255344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.311110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:41.312355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:41.319583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.320462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.321137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.322110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:41.323059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:41.323807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:41.330014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:41.429155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:41.437937 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-512e1838-4481-465c-ace1-d2b5625a2345 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1230 microversion: 2.1 time: 0.133187 Aug 30 04:40:41.438522 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2888/5843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:41 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1230 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:41.472984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:41.490595 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-70632133-1dcc-4021-8f8e-7989a7c01662 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.251028 Aug 30 04:40:41.492807 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2956/5844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:41 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:42.246709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:42.247602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:42.258149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.259050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.259503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.260383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.260876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.261757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.431418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:42.440118 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2dc4091-8409-42b4-9310-5ddcce2448ea tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.202441 Aug 30 04:40:42.440633 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2889/5845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:42 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:42.460013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:42.460674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:42.469197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.469900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.470521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.471230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.472074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.472511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.512815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:42.513771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:42.522769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.523543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.524237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.525179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:42.525677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:42.526152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:42.577639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:42.592645 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f3833921-1577-4c45-af9f-39017bf885f1 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1230 microversion: 2.1 time: 0.134845 Aug 30 04:40:42.595581 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2957/5846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:42 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1230 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:42.711476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:42.721944 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c1e001c0-84a5-4bc9-b304-bb4dab3ff69b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.213190 Aug 30 04:40:42.723129 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2890/5847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:42 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:43.471173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:43.472424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:43.482656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.483153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.483787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.484465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.485078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.485688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.620509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:43.621184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:43.634031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.634553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.634960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.635673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.636132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.636558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.717815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b5ad8d1e2754e0d92305fc3f645876a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31b8981568fc4441bdf38caf7ad25f53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:43.730000 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fc356f8-aaa7-4f6a-bf0e-db403af82ab7 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 200 len: 1230 microversion: 2.1 time: 0.113681 Aug 30 04:40:43.732035 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2891/5848] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:43 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:43.749297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:43.750145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:43.760235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.761205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.761839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.762894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:43.764303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:43.764912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:43.780210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:43.806732 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4bd752f4-1afc-4ed2-aae0-8c1d42e110e9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.342822 Aug 30 04:40:43.817160 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2958/5849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:43 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:43.980913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:43.989987 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-43bebb8f-e9c1-47bb-b765-f2d8508c6448 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.249151 Aug 30 04:40:43.990625 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2892/5850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:43 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:44.754464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:44.755795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] [instance: f34bbc66-38a3-4ec2-a11b-d703c31b8d6a] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:44.770241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:44.776197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:44.777770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:44.779785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:44.780747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:44.781987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:44.782656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:44.804070 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] HTTP exception thrown: Instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a could not be found. Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Request method failure captured: Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a HTTP/1.1 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZOqIcBVUSpK2xNWm06n_ofYuUyTh1gxcmWPWPL6_cwwgzzCrwi3czfHE61N1lV0rx3ZVN2HKIH3oWDaojqyKBqBvGZAwKHYJ3sJG1nYAsNx0o8jisJBXLzkCIw9NpNT5XnHA6XVri95eOn44rgOnYaJ7SlqBflIOzlS2L_K04ihMlc Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 31b8981568fc4441bdf38caf7ad25f53 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBackupRestore-1422202160 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_31b8981568fc4441bdf38caf7ad25f53", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/31b8981568fc4441bdf38caf7ad25f53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/31b8981568fc4441bdf38caf7ad25f53"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/31b8981568fc4441bdf38caf7ad25f53"}]}] Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBackupRestore-1422202160 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 31b8981568fc4441bdf38caf7ad25f53 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1422202160 Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBackupRestore-1422202160-project Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 5b5ad8d1e2754e0d92305fc3f645876a Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBackupRestore-1422202160-project Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a could not be found. Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'f34bbc66-38a3-4ec2-a11b-d703c31b8d6a'} Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a could not be found. Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a could not be found. Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:40:44.806853 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:44.811640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:40:44.811640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:40:44.811640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:40:44.811640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:40:44.811640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:40:44.811640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a could not be found. Aug 30 04:40:44.811640 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:40:44.814241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Returning 404 to user: Instance f34bbc66-38a3-4ec2-a11b-d703c31b8d6a could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:40:44.815425 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb2b937c-18fb-4e3c-ae4d-19ebcfc42b99 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a" status: 404 len: 111 microversion: 2.1 time: 0.066348 Aug 30 04:40:44.816820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2959/5851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:44 2022] GET /compute/v2.1/servers/f34bbc66-38a3-4ec2-a11b-d703c31b8d6a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:40:44.839188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:44.839931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:44.842222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:44.843145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:44.855731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:44.861656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:44.862255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:44.863108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:44.864231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:44.865577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.014972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:45.015815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:45.022434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.023955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.024621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.025739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:45.026541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:45.027309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:45.101597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:45.109687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a2202fe3-7ffb-4f22-b00f-2cf45a73f77f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.275188 Aug 30 04:40:45.121843 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2893/5852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:44 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:45.197366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9be2ce2e-f970-4029-88b2-f81168257cc5 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] Calling method '.version_select at 0x7fe968e901f0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:45.224353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9be2ce2e-f970-4029-88b2-f81168257cc5 tempest-TestVolumeBackupRestore-1422202160 tempest-TestVolumeBackupRestore-1422202160-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1483683336" status: 202 len: 0 microversion: 2.1 time: 0.031069 Aug 30 04:40:45.225903 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2894/5853] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 04:40:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1483683336 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:40:45.237984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:45.266814 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a24fad90-ddeb-403a-a18a-dc3e382740dc tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1534 microversion: 2.1 time: 0.255622 Aug 30 04:40:45.270451 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2960/5854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:45 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1534 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:46.133966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:46.135500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:46.148340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.149472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.150109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.151322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.152237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.152840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.294685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:46.295319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:46.307181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.307677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.308119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.308834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:46.309286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:46.309742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:46.472832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:46.487467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-65cb76bc-479a-46bb-9c51-d8de53811664 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.359882 Aug 30 04:40:46.489110 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2895/5855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:46 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:46.617873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:46.630528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76818b3b-8ebe-4a76-a59c-598cbbf75d95 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1534 microversion: 2.1 time: 0.342942 Aug 30 04:40:46.651591 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2961/5856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:46 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1534 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:47.056117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0afab318-a178-44b6-8f92-d853d8b1719b req-1d924ffa-d479-4380-8134-f788150cd6b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "name": "network-vif-plugged", "status": "completed", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:47.079190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0afab318-a178-44b6-8f92-d853d8b1719b req-1d924ffa-d479-4380-8134-f788150cd6b0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:47.079853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0afab318-a178-44b6-8f92-d853d8b1719b req-1d924ffa-d479-4380-8134-f788150cd6b0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:47.080571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0afab318-a178-44b6-8f92-d853d8b1719b req-1d924ffa-d479-4380-8134-f788150cd6b0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:47.107467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0afab318-a178-44b6-8f92-d853d8b1719b req-1d924ffa-d479-4380-8134-f788150cd6b0 service nova] Creating event network-vif-plugged:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:40:47.125848 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0afab318-a178-44b6-8f92-d853d8b1719b req-1d924ffa-d479-4380-8134-f788150cd6b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073761 Aug 30 04:40:47.126756 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2896/5857] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:47.525626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:47.531208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:47.559854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:47.560384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:47.561191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:47.561748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:47.562210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:47.562643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:47.658317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:47.682590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:47.709930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:47.713297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:47.723685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:47.724152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:47.724973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:47.736799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:47.739386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:48.119468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:48.149073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6cc3dbe6-5ecd-466e-a7bd-3eb35dee67fe tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1392 microversion: 2.1 time: 0.642580 Aug 30 04:40:48.150734 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2962/5858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:47 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1392 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:48.260689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:48.289938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b5bee41f-af6a-4821-b24c-b939b255635e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.641991 Aug 30 04:40:48.300781 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2897/5859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:47 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:49.175589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:49.176216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:49.205135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:49.205734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:49.206189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:49.213455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:49.214420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:49.214875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:49.326962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:49.328379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:49.349084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:49.349645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:49.354455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:49.360330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:49.360826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:49.361271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:50.720601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:50.721046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:50.733535 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b51a12f-f22b-48c3-b439-af9c5134b036 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1565 microversion: 2.1 time: 1.562352 Aug 30 04:40:50.734148 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2963/5860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:49 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1565 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:50.750892 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ad1112fe-d4cc-4ff0-9418-7887ab4e771e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 1.428561 Aug 30 04:40:50.751817 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2898/5861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:49 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:50.770595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:50.771220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:50.778152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:50.778972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:50.779584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:50.780462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:50.781131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:50.781750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:50.808820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c6064360-c960-4969-9670-32b2c27ed0be req-94dbe4bf-d030-4bf8-b6f6-d400b4971973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6022067-fd07-48f1-abc8-c400ad50ccd0", "name": "network-vif-plugged", "status": "completed", "tag": "40a2327c-07b2-4270-8067-e8e4815b60b5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:50.838944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:50.846059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c6064360-c960-4969-9670-32b2c27ed0be req-94dbe4bf-d030-4bf8-b6f6-d400b4971973 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:50.849044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c6064360-c960-4969-9670-32b2c27ed0be req-94dbe4bf-d030-4bf8-b6f6-d400b4971973 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:50.849714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c6064360-c960-4969-9670-32b2c27ed0be req-94dbe4bf-d030-4bf8-b6f6-d400b4971973 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:50.891379 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c6064360-c960-4969-9670-32b2c27ed0be req-94dbe4bf-d030-4bf8-b6f6-d400b4971973 service nova] Creating event network-vif-plugged:40a2327c-07b2-4270-8067-e8e4815b60b5 for instance b6022067-fd07-48f1-abc8-c400ad50ccd0 on n-h2-854925-5 Aug 30 04:40:50.932963 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c6064360-c960-4969-9670-32b2c27ed0be req-94dbe4bf-d030-4bf8-b6f6-d400b4971973 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159421 Aug 30 04:40:50.934537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2964/5862] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:40:51.437622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:51.447476 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca70fe1f-8741-4720-a173-54d67c043b8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1565 microversion: 2.1 time: 0.694896 Aug 30 04:40:51.451600 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2899/5863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:50 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1565 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:51.777655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:51.778512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:51.796566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:51.797084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:51.801543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:51.805951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:51.806664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:51.807294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:52.255671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:52.268692 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-351bc4d9-3b83-496c-82fa-a35ba0604db7 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.497794 Aug 30 04:40:52.273133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2965/5864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:51 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:53.253161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-851030371", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "e6560fc6-1849-474c-9124-892029116e15"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:53.293015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:53.294425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:53.309899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:53.311919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:53.314576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:53.317937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:53.322280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:53.332361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:53.364190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] validate_networks() for [('e6560fc6-1849-474c-9124-892029116e15', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:40:53.683520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:53.695938 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be62c5d6-99b4-4ee6-acd9-73d1493ab39c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.406661 Aug 30 04:40:53.710711 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2966/5865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:53 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:54.369445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:40:54.369983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:40:54.370339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:40:54.370812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:40:54.371223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:40:54.406971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:54.407648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:54.408245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:54.409185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:54.409916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:54.410534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:54.432984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Getting quotas for project 5ef3efd0c785402fa1d0c7dbcec479ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:40:54.440981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Getting quotas for user 878877a593354c2392496730c638f797 and project 5ef3efd0c785402fa1d0c7dbcec479ce. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:40:54.459270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:40:54.474347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:40:54.574435 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c90cefd7-11ad-46db-bbd2-4da155c275bb tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.544135 Aug 30 04:40:54.584156 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2900/5866] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:40:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:40:54.586342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1760f273-a347-41bb-a661-bfe5eea83932 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:54.587499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1760f273-a347-41bb-a661-bfe5eea83932 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:54.727187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:54.728507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:54.775630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:54.776072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:54.776500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:54.777221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:54.777700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:54.779135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1760f273-a347-41bb-a661-bfe5eea83932 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:54.781113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:54.786859 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1760f273-a347-41bb-a661-bfe5eea83932 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1213 microversion: 2.1 time: 0.204504 Aug 30 04:40:54.792135 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2967/5867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:54 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1213 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:55.114956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:55.138910 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f16f3c5a-bea6-4eaf-a9ec-0641172ce60d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.422275 Aug 30 04:40:55.140954 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2901/5868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:54 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:55.428627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:55.429151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:55.439644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cf8430ec-9941-424e-b0e5-f6f6eab0a739 req-e435d89f-4f7c-423c-b7a1-443151c87bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:40:55.464286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:55.467306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:55.467820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:55.468593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cf8430ec-9941-424e-b0e5-f6f6eab0a739 req-e435d89f-4f7c-423c-b7a1-443151c87bd1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:55.469263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cf8430ec-9941-424e-b0e5-f6f6eab0a739 req-e435d89f-4f7c-423c-b7a1-443151c87bd1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:55.471149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cf8430ec-9941-424e-b0e5-f6f6eab0a739 req-e435d89f-4f7c-423c-b7a1-443151c87bd1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:55.471448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:55.472031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:55.477727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:55.532762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cf8430ec-9941-424e-b0e5-f6f6eab0a739 req-e435d89f-4f7c-423c-b7a1-443151c87bd1 service nova] Creating event network-changed:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:40:55.551538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cf8430ec-9941-424e-b0e5-f6f6eab0a739 req-e435d89f-4f7c-423c-b7a1-443151c87bd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116280 Aug 30 04:40:55.565227 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2902/5869] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:40:55.812630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:55.813712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:55.828878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:55.829407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:55.829858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:55.830576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:55.849150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:55.849753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:56.137489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:56.139470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:56.140447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=100 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:40:56.152528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c1786957-76d7-4a09-a9d2-f0183c334817 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1565 microversion: 2.1 time: 0.727865 Aug 30 04:40:56.165360 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2968/5870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:55 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1565 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:56.165714 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-06a18997-c724-48c2-a15b-576b0845e81e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1265 microversion: 2.1 time: 0.354313 Aug 30 04:40:56.177094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:56.186013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:56.187935 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2903/5871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:55 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1265 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:56.196820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:56.208141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:56.208736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:56.213121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:56.213824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:56.214431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:56.865624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:56.880455 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b4e0cb7-959e-40bf-81ab-468d42864144 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.704698 Aug 30 04:40:56.904122 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2969/5872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:56 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:57.196566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:57.198175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:57.209375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:57.209945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:57.210486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:57.211286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:57.211808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:57.212301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:57.662960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:57.677797 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ecde3329-39d2-4733-803e-d676edacd26e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1271 microversion: 2.1 time: 0.486021 Aug 30 04:40:57.691493 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2904/5873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:57 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1271 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:40:57.916216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:57.917988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:57.932817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:57.936010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:57.936726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:57.938364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:57.941306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:57.942343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:58.365797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:58.383564 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-658abed2-9f54-4fee-8c4c-888f6e0f82df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.477784 Aug 30 04:40:58.385070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2970/5874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:57 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:58.703689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:58.705083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:58.720130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:58.723672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:58.726854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:58.747353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:58.748517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:58.752410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:58.926307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:40:58.961112 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b48e37be-c9de-4ca0-9c13-b0959e5dcbf5 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1271 microversion: 2.1 time: 0.261606 Aug 30 04:40:58.965484 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2905/5875] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:58 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:40:59.411740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:59.412364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:40:59.425236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:59.430532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:59.431902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:59.432670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:40:59.437863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:40:59.438324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:40:59.994758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:40:59.995490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:00.006558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:00.009835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:00.012428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:00.012595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:00.013639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:00.015807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:00.017232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:00.023745 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff4ba595-76cd-4cc4-b86b-e9b570e1e082 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.616962 Aug 30 04:41:00.024640 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2971/5876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:59 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:00.511409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:00.518794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:00.521922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:00.542229 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b07cfdd2-f1bc-4c63-8e36-4eafc023198d tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1313 microversion: 2.1 time: 0.552335 Aug 30 04:41:00.546944 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2906/5877] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:40:59 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:00.547500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:00.548224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:00.548882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:00.549915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:00.550727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:00.551372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:00.581578 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-84330812-82d4-4b64-bd0e-357ec9fa74d9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/ips" status: 200 len: 145 microversion: 2.1 time: 0.074508 Aug 30 04:41:00.589939 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2972/5878] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:41:00 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/ips => generated 145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:01.047313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:01.048446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:01.059270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:01.062061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:01.062708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:01.064418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:01.066002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:01.068234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:01.181522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-81c49258-ea49-4f1e-a0da-43c9812976a4 req-63f12db6-cf9c-40a1-810d-56e7b259e2fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6511cba7-6f10-43f5-a155-a9d48ec26f82", "tag": "6d058048-79ce-432c-bad0-50e31818541d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:01.220953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-81c49258-ea49-4f1e-a0da-43c9812976a4 req-63f12db6-cf9c-40a1-810d-56e7b259e2fe service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:01.223321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-81c49258-ea49-4f1e-a0da-43c9812976a4 req-63f12db6-cf9c-40a1-810d-56e7b259e2fe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:01.224008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-81c49258-ea49-4f1e-a0da-43c9812976a4 req-63f12db6-cf9c-40a1-810d-56e7b259e2fe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:01.262842 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-81c49258-ea49-4f1e-a0da-43c9812976a4 req-63f12db6-cf9c-40a1-810d-56e7b259e2fe service nova] Creating event network-changed:6d058048-79ce-432c-bad0-50e31818541d for instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 on n-h2-854925-5 Aug 30 04:41:01.285149 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-81c49258-ea49-4f1e-a0da-43c9812976a4 req-63f12db6-cf9c-40a1-810d-56e7b259e2fe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.509643 Aug 30 04:41:01.288334 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2907/5879] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:01.505413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:01.520464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4ceb3cd-6a1e-42e8-b73b-f22cf88e0025 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.479019 Aug 30 04:41:01.521115 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2973/5880] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:01 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:01.568714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:01.569619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:01.581678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:01.583434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:01.585184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:01.586149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:01.587359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:01.588249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:01.627672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:01.877967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:01.889844 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ebaa968-989c-4f31-af7a-fe9ba922685c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1313 microversion: 2.1 time: 0.325632 Aug 30 04:41:01.907751 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2908/5881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:01 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:02.618589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:02.914132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:02.915639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:02.934996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:02.936639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:02.937285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:02.938261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:02.939274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:02.940142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:03.118649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:03.129985 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ccb21ad9-4f04-4268-81c6-b8365c87a82c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.587458 Aug 30 04:41:03.131184 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2974/5882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:02 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:03.493392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:03.514177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d837d3c1-b666-4d09-bb13-edd71368f36c tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1313 microversion: 2.1 time: 0.598794 Aug 30 04:41:03.514801 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2909/5883] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:02 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:03.537775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f56b1fce-7928-4ed1-800b-e2d4808a77c9"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:03.540480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:03.550639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:03.551121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:03.551569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:03.552283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:03.552781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:03.553249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:03.973745 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f60ab875-00f1-49f5-b906-c8be5e478fce tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439258 Aug 30 04:41:03.981353 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2975/5884] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:41:03 2022] POST /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:04.152983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:04.155478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:04.168219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:04.168966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:04.169632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:04.170508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:04.171136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:04.182794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:04.424630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:04.455280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:04.476826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:04.492664 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a93740a1-1010-46de-a2f3-a268174d994c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.337851 Aug 30 04:41:04.510526 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2910/5885] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:04 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:04.541627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:04.543574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:04.554682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:04.555685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:04.556350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:04.557476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:04.558106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:04.558709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:04.787006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:04.879561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:04.891621 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6d0f819-aa01-4a50-be6a-22eb7da1807f tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1313 microversion: 2.1 time: 0.355454 Aug 30 04:41:04.895585 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2976/5886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:04 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:05.516750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:05.518095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:05.530911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:05.531415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:05.548457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:05.549258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:05.549761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:05.553705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:05.892586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:05.907177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e25cdcd2-80be-4480-8cb1-e236ea507e4d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.394356 Aug 30 04:41:05.914930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:05.916983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:05.930496 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2911/5887] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:05 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:05.938943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:05.943882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:05.948596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:05.954111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:05.957753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:05.960964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:06.549004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:06.560180 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-90f76564-3698-4823-a913-e0dab8275c1e tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1313 microversion: 2.1 time: 0.651411 Aug 30 04:41:06.577188 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2977/5888] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:05 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:06.944073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:06.945563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:06.958922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:06.965195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:06.966127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:06.967406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:06.968471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:06.969160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:07.258983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:07.279701 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-05b97358-697e-4295-b4e5-97fb27bce010 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.348912 Aug 30 04:41:07.296150 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2912/5889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:06 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:07.580508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:07.581954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:07.610618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:07.612184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:07.612859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:07.614015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:07.614772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:07.615415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:07.827791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b265fb3b-cfda-4337-9436-e4de9f75d7ca req-05fece77-ce94-48e2-8177-40ff962368f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6511cba7-6f10-43f5-a155-a9d48ec26f82", "name": "network-vif-plugged", "status": "completed", "tag": "6d058048-79ce-432c-bad0-50e31818541d"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:07.852459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b265fb3b-cfda-4337-9436-e4de9f75d7ca req-05fece77-ce94-48e2-8177-40ff962368f9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:07.852459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b265fb3b-cfda-4337-9436-e4de9f75d7ca req-05fece77-ce94-48e2-8177-40ff962368f9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:07.852459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b265fb3b-cfda-4337-9436-e4de9f75d7ca req-05fece77-ce94-48e2-8177-40ff962368f9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:07.886768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b265fb3b-cfda-4337-9436-e4de9f75d7ca req-05fece77-ce94-48e2-8177-40ff962368f9 service nova] Creating event network-vif-plugged:6d058048-79ce-432c-bad0-50e31818541d for instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 on n-h2-854925-5 Aug 30 04:41:07.904635 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b265fb3b-cfda-4337-9436-e4de9f75d7ca req-05fece77-ce94-48e2-8177-40ff962368f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080693 Aug 30 04:41:07.906039 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2913/5890] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:08.156873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:08.179906 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19415f6e-3012-47b1-934a-eed661dfdfc4 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1313 microversion: 2.1 time: 0.603608 Aug 30 04:41:08.183923 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2978/5891] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:07 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:08.308400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:08.309369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:08.330098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:08.332864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:08.333365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:08.334143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:08.334608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:08.335044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:08.772730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:08.783875 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b344d26f-6972-4c46-bf7e-9bffcf79861a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.482328 Aug 30 04:41:08.788165 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2914/5892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:08 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:09.207677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:09.208878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:09.223614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:09.224783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:09.229292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:09.230428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:09.231068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:09.231732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:09.638517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:09.650138 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1c8410b-95b0-453e-b6be-a010e0a9e7c1 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1313 microversion: 2.1 time: 0.447039 Aug 30 04:41:09.652968 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2979/5893] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:09 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:09.809872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:09.810709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:09.828183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:09.828698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:09.829195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:09.831729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:09.834849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:09.836008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:10.177762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:10.201864 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc3c34a0-d1ed-4cb2-aad8-f7ab7928bdc0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.396310 Aug 30 04:41:10.202801 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2915/5894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:09 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:10.676415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:10.677635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:10.690049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:10.690532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:10.690966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:10.696806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:10.697291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:10.697937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:11.003456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:11.013666 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b424649a-9c77-41fb-83e9-53a0b2f5a13b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1496 microversion: 2.1 time: 0.341283 Aug 30 04:41:11.017312 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2980/5895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:10 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1496 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:11.224681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:11.225372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:11.243270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:11.244061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:11.244696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:11.245598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:11.246218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:11.246812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:11.541560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:11.549724 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1fde195b-1752-4c4f-b30a-a03cc5f985d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1529 microversion: 2.1 time: 0.328881 Aug 30 04:41:11.551220 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2916/5896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:11 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1529 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:12.572589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:12.573220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:12.583477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:12.584214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:12.584858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:12.586369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:12.587007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:12.587636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:12.884202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:12.906092 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-66abbc7b-8aba-422a-b17f-e926a3367098 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1511 microversion: 2.1 time: 0.337850 Aug 30 04:41:12.907368 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2981/5897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:12 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1511 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:13.929902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:13.930602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:13.938245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:13.938822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:13.939613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:13.940576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:13.941197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:13.941971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:14.146471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:14.159373 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49532acc-8a56-49ea-878c-7871ee8c9981 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1511 microversion: 2.1 time: 0.233514 Aug 30 04:41:14.160066 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2917/5898] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:13 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1511 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:15.181026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:15.182201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:15.213630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:15.214170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.214272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:15.214555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.215093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.215756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.216323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.219487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.224826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.225346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.229410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.230311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.230940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.231566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.276749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:41:15.400049 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-822c3725-d39e-4b8b-b1f8-2727edb6790b tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 204 len: 0 microversion: 2.1 time: 0.190806 Aug 30 04:41:15.401099 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2918/5899] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:41:15 2022] DELETE /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:41:15.415796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:15.416698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:15.424491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.424991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.425472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.426184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.426830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.427455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.453751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:15.463877 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-230aaaf8-4b45-4ad2-bc27-3bf2993cebc2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1514 microversion: 2.1 time: 0.286711 Aug 30 04:41:15.465516 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2982/5900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:15 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:15.485773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:15.497250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:15.510469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.513582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.514044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.515326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.516006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.516465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.661735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:15.670199 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da00035a-aac0-407f-9205-439f41bb76c7 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1502 microversion: 2.1 time: 0.263902 Aug 30 04:41:15.670801 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2919/5901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:15 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:15.695924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:15.703737 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19aa7202-e71c-43c1-ac2d-a6e02015852b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1514 microversion: 2.1 time: 0.222342 Aug 30 04:41:15.704315 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2983/5902] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:15 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1514 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:15.753825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:15.754608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:15.761186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.761716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.762162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.763067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.763600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.764030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.787533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lazy-loading 'flavor' on Instance uuid b6022067-fd07-48f1-abc8-c400ad50ccd0 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:15.799931 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Cannot 'shelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state shelved_offloaded Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action HTTP/1.1 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 14 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: {"shelve": {}} Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: exception: Cannot 'shelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state shelved_offloaded Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'shelve': {}}} Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:41:15.801913 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state shelved_offloaded Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state shelved_offloaded Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 409 to user: Cannot 'shelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state shelved_offloaded {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3046c65a-46cf-4b66-8fe8-2e95eff2940d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 409 len: 155 microversion: 2.1 time: 0.053844 Aug 30 04:41:15.808068 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2920/5903] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:15 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 155 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:41:15.814036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:15.814538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:15.821261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.821793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.822299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.823016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.823479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.823918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.838604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:15.868576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122403) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 04:41:15.939246 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9dba04f7-1be3-4865-b8de-7af0360df780 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 202 len: 0 microversion: 2.1 time: 0.129386 Aug 30 04:41:15.940174 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2984/5904] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:15 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:41:15.949355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:15.950283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:15.957982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.958550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.959041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:15.959960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:15.960677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:15.961307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:16.141068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:16.150624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a58f236b-5c76-4eb5-b277-260c10883291 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1522 microversion: 2.1 time: 0.206258 Aug 30 04:41:16.151970 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2921/5905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:15 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:16.696571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:16.697365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:16.704732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:16.705414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:16.705928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:16.706876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:16.707446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:16.708095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:16.925533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:16.936779 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-08bc6812-3925-4920-9308-ca9845692745 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1502 microversion: 2.1 time: 0.244732 Aug 30 04:41:16.937409 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2985/5906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:16 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:17.172323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:17.172933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:17.180586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:17.181067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:17.181785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:17.182834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:17.183402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:17.183948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:17.438909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:17.461470 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f235e5e-5955-4518-93fe-ce3c5f4392a6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1464 microversion: 2.1 time: 0.293523 Aug 30 04:41:17.462252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2922/5907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:17 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1464 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:17.579212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5088122b-b273-47ec-8bb1-fe7f7ba62d4d req-97712987-bcc4-4dc4-a6fc-4d2c02d29979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6511cba7-6f10-43f5-a155-a9d48ec26f82", "name": "network-vif-deleted", "tag": "6d058048-79ce-432c-bad0-50e31818541d"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:17.607378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5088122b-b273-47ec-8bb1-fe7f7ba62d4d req-97712987-bcc4-4dc4-a6fc-4d2c02d29979 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:17.608746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5088122b-b273-47ec-8bb1-fe7f7ba62d4d req-97712987-bcc4-4dc4-a6fc-4d2c02d29979 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:17.609982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5088122b-b273-47ec-8bb1-fe7f7ba62d4d req-97712987-bcc4-4dc4-a6fc-4d2c02d29979 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:17.620909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6c699616-cb95-48d3-85f6-fac1886c45a8 req-4a1f2bcd-7bb4-490e-951b-0d136452173d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6022067-fd07-48f1-abc8-c400ad50ccd0", "name": "network-vif-unplugged", "status": "completed", "tag": "40a2327c-07b2-4270-8067-e8e4815b60b5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:17.629404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5088122b-b273-47ec-8bb1-fe7f7ba62d4d req-97712987-bcc4-4dc4-a6fc-4d2c02d29979 service nova] Creating event network-vif-deleted:6d058048-79ce-432c-bad0-50e31818541d for instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 on n-h2-854925-5 Aug 30 04:41:17.636216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5088122b-b273-47ec-8bb1-fe7f7ba62d4d req-97712987-bcc4-4dc4-a6fc-4d2c02d29979 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065934 Aug 30 04:41:17.637413 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2986/5908] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:17.638202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6c699616-cb95-48d3-85f6-fac1886c45a8 req-4a1f2bcd-7bb4-490e-951b-0d136452173d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:17.638799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6c699616-cb95-48d3-85f6-fac1886c45a8 req-4a1f2bcd-7bb4-490e-951b-0d136452173d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:17.639343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6c699616-cb95-48d3-85f6-fac1886c45a8 req-4a1f2bcd-7bb4-490e-951b-0d136452173d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:17.653174 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6c699616-cb95-48d3-85f6-fac1886c45a8 req-4a1f2bcd-7bb4-490e-951b-0d136452173d service nova] Creating event network-vif-unplugged:40a2327c-07b2-4270-8067-e8e4815b60b5 for instance b6022067-fd07-48f1-abc8-c400ad50ccd0 on n-h1-854925-5 Aug 30 04:41:17.659335 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6c699616-cb95-48d3-85f6-fac1886c45a8 req-4a1f2bcd-7bb4-490e-951b-0d136452173d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051927 Aug 30 04:41:17.659948 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2923/5909] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:17.961771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:17.962588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:17.969090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:17.969856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:17.970465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:17.971175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:17.971636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:17.972075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.007727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.008385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.008840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.009300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lazy-loading 'fault' on Instance uuid 6511cba7-6f10-43f5-a155-a9d48ec26f82 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:18.056690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '878877a593354c2392496730c638f797', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ef3efd0c785402fa1d0c7dbcec479ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:18.070517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f9862ea5-2eea-4926-9a6c-5bad03d52345 tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 200 len: 1303 microversion: 2.1 time: 0.115434 Aug 30 04:41:18.071496 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2987/5910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:17 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:18.494232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:18.510958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:18.515360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:18.516361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:18.517768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:18.527177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.527971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.528724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.529502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.530158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.531820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.545428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.546042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.546575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.547292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.547770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.548191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.582351 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-faf8886c-5ccb-43c4-a2d0-dd313f5266d2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070719 Aug 30 04:41:18.584604 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2988/5911] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:41:18 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:18.599087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:18.600307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:18.620099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.620774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.621785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.623181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.624195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.624733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.674771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-060c046d-83f0-4cf9-becd-6d17bcd549fa tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/f56b1fce-7928-4ed1-800b-e2d4808a77c9" status: 200 len: 194 microversion: 2.1 time: 0.083518 Aug 30 04:41:18.682086 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2989/5912] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 30 04:41:18 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/f56b1fce-7928-4ed1-800b-e2d4808a77c9 => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:18.686991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-09dbfc94-fadd-4648-a04d-2d396276b84a req-a806f01f-e0d3-458d-9bc3-a12aec84712f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6022067-fd07-48f1-abc8-c400ad50ccd0", "tag": "40a2327c-07b2-4270-8067-e8e4815b60b5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:18.698886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-09dbfc94-fadd-4648-a04d-2d396276b84a req-a806f01f-e0d3-458d-9bc3-a12aec84712f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:18.699470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-09dbfc94-fadd-4648-a04d-2d396276b84a req-a806f01f-e0d3-458d-9bc3-a12aec84712f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:18.700325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-09dbfc94-fadd-4648-a04d-2d396276b84a req-a806f01f-e0d3-458d-9bc3-a12aec84712f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:18.714034 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-09dbfc94-fadd-4648-a04d-2d396276b84a req-a806f01f-e0d3-458d-9bc3-a12aec84712f service nova] Creating event network-changed:40a2327c-07b2-4270-8067-e8e4815b60b5 for instance b6022067-fd07-48f1-abc8-c400ad50ccd0 on n-h1-854925-5 Aug 30 04:41:18.720701 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-09dbfc94-fadd-4648-a04d-2d396276b84a req-a806f01f-e0d3-458d-9bc3-a12aec84712f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043542 Aug 30 04:41:18.722007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2990/5913] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:18.852146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:18.864044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:18.868348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8409d203-0c28-48b4-bfba-d08003f20c3b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.381328 Aug 30 04:41:18.869119 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2924/5914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:18 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:19.093575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:19.094338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] [instance: 6511cba7-6f10-43f5-a155-a9d48ec26f82] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:19.106514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Calling method '.version_select at 0x7fe9699770d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:19.109263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.109716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.110241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.110609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.110889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.111975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.112117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.112830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.113287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.143980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.144563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.145007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.146804 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] HTTP exception thrown: Instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 could not be found. Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Request method failure captured: Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 HTTP/1.1 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZTQ6u8uhWlr13dgPdjN0_y99qURj8COkZz2i9FDs4hj6W6Ql0gElWG4LckIv5_M2L7uaO2-rGXXMbMWJLoGgKJknjoiivEDMLQ8Z7sH9nk5Ixv7FMsg88ZkFAotFR2aautUyXMmVf4fia8dceuP4BrOjuXD6auZ9w-a4iBd2XwmMcE Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 5ef3efd0c785402fa1d0c7dbcec479ce Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesActionsTest-1211894853 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_5ef3efd0c785402fa1d0c7dbcec479ce", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/5ef3efd0c785402fa1d0c7dbcec479ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5ef3efd0c785402fa1d0c7dbcec479ce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/5ef3efd0c785402fa1d0c7dbcec479ce"}]}] Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesActionsTest-1211894853 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 5ef3efd0c785402fa1d0c7dbcec479ce Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesActionsTest-1211894853 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesActionsTest-1211894853-project Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 878877a593354c2392496730c638f797 Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesActionsTest-1211894853-project Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 could not be found. Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6511cba7-6f10-43f5-a155-a9d48ec26f82'} Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 could not be found. Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 could not be found. Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:19.149129 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 could not be found. Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] Returning 404 to user: Instance 6511cba7-6f10-43f5-a155-a9d48ec26f82 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bcefdb57-ddcc-416b-8469-6e0a72dd85af tempest-VolumesActionsTest-1211894853 tempest-VolumesActionsTest-1211894853-project] 10.222.0.27 "GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82" status: 404 len: 111 microversion: 2.1 time: 0.062537 Aug 30 04:41:19.156590 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2925/5915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:19 2022] GET /compute/v2.1/servers/6511cba7-6f10-43f5-a155-a9d48ec26f82 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:41:19.164958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.165603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.166054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.175629 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9f6a73a-12c4-48c0-867d-c409c85a7c1e tempest-PortsAdminExtendedAttrsTestJSON-759281226 tempest-PortsAdminExtendedAttrsTestJSON-759281226-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.235620 Aug 30 04:41:19.176548 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2991/5916] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:41:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:19.891578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:19.892713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:19.902156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.902987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.903689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:19.904628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:19.907539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:19.908296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:20.337732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:20.349850 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8765652e-858f-4ff2-9b55-1cf200b3fef8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.461952 Aug 30 04:41:20.351701 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2926/5917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:19 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:21.271081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1145fcd2-fbcc-485c-9e19-b6f04029210e"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:21.274292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:21.286776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:21.287264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:21.287916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:21.289455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:21.289907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:21.290523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:21.376248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:21.376847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:21.391965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:21.392473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:21.393164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:21.394340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:21.394995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:21.395585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:21.704216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f26605d-20cb-4341-8bd1-96c49ecc008c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "POST /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437235 Aug 30 04:41:21.706585 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2992/5918] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:41:21 2022] POST /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments => generated 194 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:21.919483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:21.934845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b8a260f-6673-46f4-bac3-5a63904feb4e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.563089 Aug 30 04:41:21.935474 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2927/5919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:21 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:22.962319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:22.963863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:22.966210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:22.979956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:22.983198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:22.983901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:22.989109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:22.989856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:22.990475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:23.359808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:23.374020 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80bf522e-b450-42ae-a1e0-412830d1cd29 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.415730 Aug 30 04:41:23.374993 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2993/5920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:22 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:24.397946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:24.397946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:24.405137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:24.406121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:24.407079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:24.408277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:24.409417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:24.410279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:24.739521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:24.761973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bbb29b74-9a57-480d-8b28-a3883043e06d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.369130 Aug 30 04:41:24.779320 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2928/5921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:24 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:25.789106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:25.791175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:25.807298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:25.808642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:25.809277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:25.812310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:25.816004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:25.816708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:26.231269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:26.240538 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fecdb3a7-d256-4dca-ab94-e485fa2455a5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.456195 Aug 30 04:41:26.249843 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2994/5922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:25 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:27.268142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:27.269399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:27.286171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:27.286958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:27.287602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:27.288550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:27.291055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:27.291663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:27.831902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:27.855856 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8ca9a89-6518-45b5-81f6-6491bf731447 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.591770 Aug 30 04:41:27.856808 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2929/5923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:27 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:28.879008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:28.879700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:28.888975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:28.889706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:28.890384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:28.891546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:28.892182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:28.892795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:29.171484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:29.189342 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-69a4a273-0a9d-4660-a7f1-b7b90db5789d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.310802 Aug 30 04:41:29.191309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2995/5924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:28 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:30.224927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:30.227525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:30.236060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:30.236841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:30.237737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:30.238664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:30.239291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:30.239933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:30.410009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:30.418511 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bcd4edd3-f404-4a82-b18c-cc592eeb5a19 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.209771 Aug 30 04:41:30.428511 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2930/5925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:30 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:31.440418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:31.441791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:31.449874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:31.450555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:31.451022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:31.451709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:31.452156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:31.452785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:31.635843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:31.646021 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fa72be98-b723-4f57-b348-1dcc0537828f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.209749 Aug 30 04:41:31.648537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2996/5926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:31 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:32.669603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:32.670163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:32.679965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:32.680464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:32.680902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:32.681806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:32.682453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:32.682988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:33.108835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:33.111138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:33.122797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:33.123493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:33.124122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:33.125203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:33.125838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:33.126545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:33.216596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:33.226468 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-520fbd45-fd3c-4740-b4d3-072d4d6b9ba5 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.561565 Aug 30 04:41:33.246495 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2931/5927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:32 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:33.283298 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a6521c8f-bfd6-4f80-8d14-4189cccd0fa5 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action" status: 200 len: 24559 microversion: 2.1 time: 0.179566 Aug 30 04:41:33.286309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2997/5928] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:33 2022] POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action => generated 24559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:41:34.248973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:34.250333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:34.263762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:34.269367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:34.269911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:34.271171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:34.273254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:34.273798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:34.492658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:34.511403 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07b43510-aa34-4fdc-91db-683accc4c34f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.266750 Aug 30 04:41:34.512382 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2932/5929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:34 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:35.535054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:35.536427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:35.543821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:35.544445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:35.544978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:35.546039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:35.546561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:35.547215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:35.816840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:35.825580 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-65650298-94f2-41a5-a979-e5c3809509fa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.296514 Aug 30 04:41:35.826239 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2998/5930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:35 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:36.589165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:36.592353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:36.599713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.600197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.600839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.601753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.602373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.602973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.647483 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc702f6d-d550-4e56-8f6a-25c0dc1ebaaf tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069938 Aug 30 04:41:36.648668 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2933/5931] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:41:36 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments => generated 371 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:36.800236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:36.801679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:36.809895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.810689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.811132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.811808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.812339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.812852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.847630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:36.848358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:36.853553 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f387051-0d59-47bd-aa4f-71cb3d96d4b3 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/f56b1fce-7928-4ed1-800b-e2d4808a77c9" status: 200 len: 194 microversion: 2.1 time: 0.058202 Aug 30 04:41:36.854670 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 2999/5932] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 30 04:41:36 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/f56b1fce-7928-4ed1-800b-e2d4808a77c9 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:36.865318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.865563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:36.866246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.866765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:36.867208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.868114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.868761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.869397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.873555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.882794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.883739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.884963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:36.885909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:36.886781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:36.894680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:37.042504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lazy-loading 'services' on Instance uuid 46517a40-9c95-4441-b643-45b28b0d717d {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:37.080327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:37.091614 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6de03c65-8284-4652-912a-5bf37fae8b74 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.248329 Aug 30 04:41:37.092484 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2934/5933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:36 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:37.178389 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-562dafff-01b1-4898-a8c1-2ec684925710 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/f56b1fce-7928-4ed1-800b-e2d4808a77c9" status: 202 len: 0 microversion: 2.1 time: 0.315575 Aug 30 04:41:37.180646 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3000/5934] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:41:36 2022] DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/f56b1fce-7928-4ed1-800b-e2d4808a77c9 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:41:38.117313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:38.117968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:38.131410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:38.131850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:38.132456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:38.133037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:38.133532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:38.133966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:38.386200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:38.404060 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-407ceb82-9b71-4ab9-ba38-42573955b24c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.291171 Aug 30 04:41:38.411869 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2935/5935] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:38 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:39.431733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:39.433766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:39.442452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:39.443218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:39.444093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:39.445583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:39.446214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:39.446813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:39.699197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:39.711204 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-729c6787-47d4-47a2-aefd-e409afce0a9d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.284686 Aug 30 04:41:39.714114 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3001/5936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:39 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:40.740773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:40.743147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:40.754099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:40.754847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:40.755357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:40.756445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:40.757702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:40.758346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:40.953477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:40.962385 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b10a7aeb-ff52-48f1-8a23-0344f1e3daac tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.226417 Aug 30 04:41:40.977021 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2936/5937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:40 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:41.471420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a7b821e9-5ac8-4087-9143-84fad33abc9a req-79893d25-ce4f-4401-9f7a-c66c6713eda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6022067-fd07-48f1-abc8-c400ad50ccd0", "name": "network-vif-plugged", "status": "completed", "tag": "40a2327c-07b2-4270-8067-e8e4815b60b5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:41.488691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a7b821e9-5ac8-4087-9143-84fad33abc9a req-79893d25-ce4f-4401-9f7a-c66c6713eda8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:41.489179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a7b821e9-5ac8-4087-9143-84fad33abc9a req-79893d25-ce4f-4401-9f7a-c66c6713eda8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:41.489657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a7b821e9-5ac8-4087-9143-84fad33abc9a req-79893d25-ce4f-4401-9f7a-c66c6713eda8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:41.502815 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a7b821e9-5ac8-4087-9143-84fad33abc9a req-79893d25-ce4f-4401-9f7a-c66c6713eda8 service nova] Creating event network-vif-plugged:40a2327c-07b2-4270-8067-e8e4815b60b5 for instance b6022067-fd07-48f1-abc8-c400ad50ccd0 on n-h1-854925-5 Aug 30 04:41:41.512987 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a7b821e9-5ac8-4087-9143-84fad33abc9a req-79893d25-ce4f-4401-9f7a-c66c6713eda8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044988 Aug 30 04:41:41.515531 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3002/5938] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:41.996549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:41.998450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:42.012814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:42.013880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:42.015476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:42.017848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:42.018590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:42.019453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:42.359029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:42.370264 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-efa87291-27d6-461f-81bc-bf4ed47bb363 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.382168 Aug 30 04:41:42.375387 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2937/5939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:41 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:43.400663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:43.401231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:43.417888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.420605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.421419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.422825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.423769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.424476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.663908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:43.672073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea485b8e-9223-4942-b5e1-6c65476b75c4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1520 microversion: 2.1 time: 0.277467 Aug 30 04:41:43.685456 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3003/5940] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:43 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:43.793016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:43.793561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:43.801498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.802033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.802475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.803172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.804387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.804821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.841118 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7371d653-33f9-42d0-aa92-9e87cd964cf9 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/1145fcd2-fbcc-485c-9e19-b6f04029210e" status: 200 len: 194 microversion: 2.1 time: 0.052052 Aug 30 04:41:43.847746 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2938/5941] 10.222.0.27 () {58 vars in 1413 bytes} [Tue Aug 30 04:41:43 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/1145fcd2-fbcc-485c-9e19-b6f04029210e => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:43.860250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:43.860763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:43.875527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.876251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.876702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:43.877442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:43.877904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:43.878501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:44.008570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lazy-loading 'services' on Instance uuid 46517a40-9c95-4441-b643-45b28b0d717d {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:44.106784 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b16be3fe-6b23-4634-8084-9d56fea0a02f tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/1145fcd2-fbcc-485c-9e19-b6f04029210e" status: 202 len: 0 microversion: 2.1 time: 0.256558 Aug 30 04:41:44.108077 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3004/5942] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:41:43 2022] DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments/1145fcd2-fbcc-485c-9e19-b6f04029210e => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:41:44.693869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:44.695276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:44.715241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:44.715849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:44.716303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:44.717050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:44.717790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:44.718216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:44.943949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:44.953510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2fe4a22-be10-45d3-a4d8-bf5af75e173c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.263370 Aug 30 04:41:44.954252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2939/5943] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:44 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:44.976146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:44.976769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:44.984344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:44.985092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:44.985818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:44.987066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:44.987712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:44.988150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:45.150203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:45.163611 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d1ec6fc-80d5-4205-b9b5-ccaaa3d3be72 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.191567 Aug 30 04:41:45.164631 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3005/5944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:44 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:45.191210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:45.191829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:45.199567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:45.200366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:45.201043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:45.202407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:45.203232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:45.203711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:45.380170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:45.390217 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-85e735ba-fce6-4db2-a151-e1a0b9ee5d73 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.202889 Aug 30 04:41:45.390829 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2940/5945] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:45 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:45.417654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-edc9d1dc-2035-4004-bbf9-ad2004507b3a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:45.432317 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-edc9d1dc-2035-4004-bbf9-ad2004507b3a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 95753993-5a14-4533-b491-5dd8de9dd320 has no mapping to a cell. Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-edc9d1dc-2035-4004-bbf9-ad2004507b3a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/95753993-5a14-4533-b491-5dd8de9dd320/action HTTP/1.1 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 15 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: {"os-stop": {}} Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 95753993-5a14-4533-b491-5dd8de9dd320 has no mapping to a cell. Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '95753993-5a14-4533-b491-5dd8de9dd320', 'body': {'os-stop': {}}} Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 95753993-5a14-4533-b491-5dd8de9dd320 has no mapping to a cell. Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:45.440481 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95753993-5a14-4533-b491-5dd8de9dd320 has no mapping to a cell. Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95753993-5a14-4533-b491-5dd8de9dd320 has no mapping to a cell. Aug 30 04:41:45.446890 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:45.448499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-edc9d1dc-2035-4004-bbf9-ad2004507b3a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 95753993-5a14-4533-b491-5dd8de9dd320 has no mapping to a cell. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:45.449399 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-edc9d1dc-2035-4004-bbf9-ad2004507b3a tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/95753993-5a14-4533-b491-5dd8de9dd320/action" status: 404 len: 117 microversion: 2.1 time: 0.038053 Aug 30 04:41:45.453345 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3006/5946] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:45 2022] POST /compute/v2.1/servers/95753993-5a14-4533-b491-5dd8de9dd320/action => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:45.458670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:45.459273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:45.471430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:45.471929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:45.472557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:45.473487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:45.474120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:45.474718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:45.823651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:45.834593 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b87d5fa-461a-4693-94f5-efef089d7dd0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.380210 Aug 30 04:41:45.835304 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2941/5947] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:45 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:45.860436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:45.861701 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:45.869618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:45.870408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:45.871085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:45.872020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:45.872680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:45.873338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.066723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:46.083139 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7181c4a0-7f92-41f0-9eae-9856ae034ecd tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.227920 Aug 30 04:41:46.108333 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3007/5948] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:45 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:46.110228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af47f2fd-33d1-4729-b4ef-052fd6026272 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:46.111307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-af47f2fd-33d1-4729-b4ef-052fd6026272 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: cace6206-1eaa-47e0-9caf-4281f341ea8b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:46.124823 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-af47f2fd-33d1-4729-b4ef-052fd6026272 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance cace6206-1eaa-47e0-9caf-4281f341ea8b could not be found. Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af47f2fd-33d1-4729-b4ef-052fd6026272 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/cace6206-1eaa-47e0-9caf-4281f341ea8b/action HTTP/1.1 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 15 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: {"suspend": {}} Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance cace6206-1eaa-47e0-9caf-4281f341ea8b could not be found. Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'cace6206-1eaa-47e0-9caf-4281f341ea8b', 'body': {'suspend': {}}} Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cace6206-1eaa-47e0-9caf-4281f341ea8b could not be found. Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cace6206-1eaa-47e0-9caf-4281f341ea8b could not be found. Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:46.126794 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:46.132316 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:46.132316 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:46.132316 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cace6206-1eaa-47e0-9caf-4281f341ea8b could not be found. Aug 30 04:41:46.132316 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:46.133481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-af47f2fd-33d1-4729-b4ef-052fd6026272 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance cace6206-1eaa-47e0-9caf-4281f341ea8b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:46.134521 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-af47f2fd-33d1-4729-b4ef-052fd6026272 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/cace6206-1eaa-47e0-9caf-4281f341ea8b/action" status: 404 len: 111 microversion: 2.1 time: 0.028510 Aug 30 04:41:46.135613 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2942/5949] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:46 2022] POST /compute/v2.1/servers/cace6206-1eaa-47e0-9caf-4281f341ea8b/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:46.146330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:46.147049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:46.160215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.160739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.162333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.165914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.166822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.168146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.431182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:46.455633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0849cf8d-f161-41ba-8492-2d2681dc6e26 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.314318 Aug 30 04:41:46.471828 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3008/5950] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:46 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:46.480564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:46.481563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:46.498371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.499176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.499836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.501113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.501908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.503349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.557042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:46.838049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:46.848215 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-40f09d8e-0de7-452d-88ec-c70aaa5bb3b9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.371677 Aug 30 04:41:46.849447 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2943/5951] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:46 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:46.878481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:46.879265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:46.903396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.903396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.903396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.903396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:46.903396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:46.906103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:46.967227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lazy-loading 'flavor' on Instance uuid b6022067-fd07-48f1-abc8-c400ad50ccd0 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:47.123656 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6310d95e-6a1b-48d4-9afa-5bac004ad8aa tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 202 len: 0 microversion: 2.1 time: 0.249313 Aug 30 04:41:47.128596 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3009/5952] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:46 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:41:47.134078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:47.139827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:47.159580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:47.160102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:47.160562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:47.162304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:47.162304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:47.162304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:47.346088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:47.355102 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef66ccde-dfe1-40bf-b39e-be629309aad8 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1515 microversion: 2.1 time: 0.225505 Aug 30 04:41:47.355931 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2944/5953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:47 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:48.377844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:48.379644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:48.389297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.389960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.390412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.391493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.392208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.392821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.657886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:48.679598 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6ad5418b-f18b-46da-9c4e-1aaa13883e9c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1498 microversion: 2.1 time: 0.305856 Aug 30 04:41:48.680207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3010/5954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:48 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1498 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:48.704331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:48.705595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:48.714443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=42 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:48.716706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.718147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.718939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.720203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.722088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.725147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.767026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lazy-loading 'flavor' on Instance uuid b6022067-fd07-48f1-abc8-c400ad50ccd0 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:48.787676 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Cannot 'suspend' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state suspended Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action HTTP/1.1 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 15 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: {"suspend": {}} Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: exception: Cannot 'suspend' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state suspended Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'suspend': {}}} Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 in vm_state suspended. Cannot suspend while the instance is in this state. Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 30 04:41:48.791354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state suspended Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state suspended Aug 30 04:41:48.798067 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:48.801436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 409 to user: Cannot 'suspend' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state suspended {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:48.802562 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ca4f19e-cd7b-4841-9b5e-bdc7e3a06c8b tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 409 len: 148 microversion: 2.1 time: 0.103317 Aug 30 04:41:48.807565 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2945/5955] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:48 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 148 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:41:48.815028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:48.815437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:48.838735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.839599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.840473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.841505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:48.842583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:48.843033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:48.983893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-620293c2-fbca-4927-a914-ee0a46475bda tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 202 len: 0 microversion: 2.1 time: 0.175199 Aug 30 04:41:48.985609 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3011/5956] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:48 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:41:49.004346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:49.005398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:49.034396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:49.036249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:49.036950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:49.041094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:49.050334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:49.051040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:49.653256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:49.667236 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a868788-3c6c-4997-834f-931d12783ad0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1504 microversion: 2.1 time: 0.676070 Aug 30 04:41:49.668448 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2946/5957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:48 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1504 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:50.700652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:50.702095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:50.719692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.720516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.721134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:50.722091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.722740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.723568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:50.917719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:50.924336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:50.940301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.940802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.941240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:50.941976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:50.942432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:50.942856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:50.993397 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d49c4981-1f6c-47bd-9a41-43f09e6d7d96 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085380 Aug 30 04:41:51.001255 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2947/5958] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:41:50 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:41:51.033888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:51.051557 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-505c4025-7ceb-4821-bd6d-00c9e369ff24 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1504 microversion: 2.1 time: 0.365791 Aug 30 04:41:51.052427 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3012/5959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:50 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1504 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:51.173131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:51.175449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:51.182666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:51.183169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:51.183615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:51.184335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:51.184937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:51.185404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:51.227394 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83630bda-b9e1-4edb-b3fa-bb290cccb59b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058393 Aug 30 04:41:51.234398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2948/5960] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 04:41:51 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 04:41:51.318060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:51.319306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:51.327056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:51.327899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:51.328519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:51.329475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:51.330171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:51.330786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:51.395861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:41:51.447828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:51.522041 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a8e89b9c-7d2f-4d47-a354-1dee054f6297 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 204 len: 0 microversion: 2.1 time: 0.207966 Aug 30 04:41:51.523348 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3013/5961] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:41:51 2022] DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:41:51.533795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:51.534664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:51.553679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:51.554759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:51.555420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:51.556406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:51.556958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:51.557521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:51.728143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:51.737248 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2692f093-8d86-4ccd-a7cf-3e83e6af6a0b tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1673 microversion: 2.1 time: 0.208822 Aug 30 04:41:51.738296 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2949/5962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:51 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1673 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:52.074133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:52.074985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:52.081727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.082330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.082877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.083680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.084240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.085348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.276287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:52.285385 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1568ebed-a688-45e7-8534-c5b540c61b68 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.215394 Aug 30 04:41:52.286278 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3014/5963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:52 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:52.308396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:52.309146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:52.316526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.317284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.317941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.318825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.319806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.320218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.555751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:52.585033 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-72038ba6-d38e-4146-9ec6-16ad66831fab tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.280390 Aug 30 04:41:52.586502 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2950/5964] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:52 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:52.606291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-778731ec-e055-4113-8569-9fdcdcd8463f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:52.607121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-778731ec-e055-4113-8569-9fdcdcd8463f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 7d0e757b-ab8b-4726-a1e8-a439b72b3944] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:52.613711 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-778731ec-e055-4113-8569-9fdcdcd8463f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 7d0e757b-ab8b-4726-a1e8-a439b72b3944 could not be found. Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-778731ec-e055-4113-8569-9fdcdcd8463f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/7d0e757b-ab8b-4726-a1e8-a439b72b3944/action HTTP/1.1 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 15 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: {"unpause": {}} Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7d0e757b-ab8b-4726-a1e8-a439b72b3944 could not be found. Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7d0e757b-ab8b-4726-a1e8-a439b72b3944', 'body': {'unpause': {}}} Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d0e757b-ab8b-4726-a1e8-a439b72b3944 could not be found. Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d0e757b-ab8b-4726-a1e8-a439b72b3944 could not be found. Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:52.615626 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:52.621759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:52.621759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:52.621759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d0e757b-ab8b-4726-a1e8-a439b72b3944 could not be found. Aug 30 04:41:52.621759 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:52.622973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-778731ec-e055-4113-8569-9fdcdcd8463f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 7d0e757b-ab8b-4726-a1e8-a439b72b3944 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:52.624018 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-778731ec-e055-4113-8569-9fdcdcd8463f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/7d0e757b-ab8b-4726-a1e8-a439b72b3944/action" status: 404 len: 111 microversion: 2.1 time: 0.021772 Aug 30 04:41:52.624762 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3015/5965] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:52 2022] POST /compute/v2.1/servers/7d0e757b-ab8b-4726-a1e8-a439b72b3944/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:41:52.634237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:52.635112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:52.642840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.643578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.644198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.645766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.646383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.646998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.764630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:52.765944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:52.781724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.782373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.783360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.784466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.785014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.785568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.927705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:52.935722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f47e69bd-b7e6-4320-a82d-1ffc918514b0 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.305397 Aug 30 04:41:52.948896 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2951/5966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:52 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:52.962266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:52.962947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:52.979355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.980347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.980986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:52.981928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:52.982581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:52.983201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.105483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:53.117700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7e93890-9dc3-4919-a142-ffe30a3b3af2 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1673 microversion: 2.1 time: 0.362632 Aug 30 04:41:53.118637 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3016/5967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:52 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1673 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:53.327440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:53.336053 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-094e3bbd-893c-42f8-ac4a-3f0eddbd3d0f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.381216 Aug 30 04:41:53.336636 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2952/5968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:52 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:53.357139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:53.357636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:53.359630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:41:53.365505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.365943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.366388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.367091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.367550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.367980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.393798 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Cannot 'unpause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action HTTP/1.1 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 15 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: {"unpause": {}} Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'unpause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'unpause': {}}} Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 in vm_state active. Cannot unpause while the instance is in this state. Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:53.395452 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:53.401062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:53.401062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:53.401062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:53.401062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:53.401062 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:53.401062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 409 to user: Cannot 'unpause' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:53.401062 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a9683914-79a7-4d85-8151-9260fdc32ec3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 409 len: 145 microversion: 2.1 time: 0.044062 Aug 30 04:41:53.402052 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3017/5969] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:53 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 145 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:41:53.407750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:53.408363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:53.416141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.416897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.417570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.418558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.419189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.419708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.742847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:53.751503 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88e0e472-f386-47fa-9f0a-5b611a0ab0da tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.347834 Aug 30 04:41:53.764610 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2953/5970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:53 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:53.774560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:53.775536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:53.781596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.782161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.782613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:53.783489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:53.784240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:53.784797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.050325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:54.085756 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-89eca289-5097-45ff-a3ec-7784409693ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.315987 Aug 30 04:41:54.089127 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3018/5971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:53 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:54.110275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec96e5ee-08d9-4317-9013-aa6ec055bcc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:54.111160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec96e5ee-08d9-4317-9013-aa6ec055bcc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: e24312dc-c683-44e5-99c2-7a3098049af4] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:54.123249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ec96e5ee-08d9-4317-9013-aa6ec055bcc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance e24312dc-c683-44e5-99c2-7a3098049af4 could not be found. Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec96e5ee-08d9-4317-9013-aa6ec055bcc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/e24312dc-c683-44e5-99c2-7a3098049af4/action HTTP/1.1 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 18 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: {"unshelve": null} Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance e24312dc-c683-44e5-99c2-7a3098049af4 could not be found. Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e24312dc-c683-44e5-99c2-7a3098049af4', 'body': {'unshelve': None}} Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e24312dc-c683-44e5-99c2-7a3098049af4 could not be found. Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e24312dc-c683-44e5-99c2-7a3098049af4 could not be found. Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:54.125994 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e24312dc-c683-44e5-99c2-7a3098049af4 could not be found. Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec96e5ee-08d9-4317-9013-aa6ec055bcc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance e24312dc-c683-44e5-99c2-7a3098049af4 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec96e5ee-08d9-4317-9013-aa6ec055bcc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/e24312dc-c683-44e5-99c2-7a3098049af4/action" status: 404 len: 111 microversion: 2.1 time: 0.021887 Aug 30 04:41:54.130591 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2954/5972] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:54 2022] POST /compute/v2.1/servers/e24312dc-c683-44e5-99c2-7a3098049af4/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:54.137153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:54.137820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:54.145194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.150091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:54.150856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.151576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.152516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.153553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:54.157717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.157717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.173370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.173969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.174601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.176927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.178020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.179997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.494260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:54.504405 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9a7a2866-bdda-4d35-bde1-0fd9ab2795ff tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1673 microversion: 2.1 time: 0.362670 Aug 30 04:41:54.516180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:54.520969 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2955/5973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:54 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1673 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:54.553620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f0609324-4cb2-4149-9f14-7a2f9ede10d2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.420841 Aug 30 04:41:54.554934 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3019/5974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:54 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:54.577444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:54.578766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:54.588508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.607601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.610591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.613967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.614788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.616727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.948414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:54.959740 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99980b8d-be4a-4345-b883-f2f5873de6ec tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.386010 Aug 30 04:41:54.960679 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2956/5975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:54 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:54.981946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:54.982943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:54.991554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.992357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.992959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:54.993919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:54.994852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:54.995463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.022565 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Cannot 'unshelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action HTTP/1.1 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 18 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: {"unshelve": null} Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: exception: Cannot 'unshelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'unshelve': None}} Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 in vm_state active. Cannot unshelve while the instance is in this state. Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 04:41:55.024212 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active Aug 30 04:41:55.032445 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:55.036459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 409 to user: Cannot 'unshelve' instance b6022067-fd07-48f1-abc8-c400ad50ccd0 while it is in vm_state active {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:55.037737 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7924cbbe-c85c-49ae-aafd-e3bccf2bd546 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action" status: 409 len: 146 microversion: 2.1 time: 0.061512 Aug 30 04:41:55.039601 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3020/5976] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:41:54 2022] POST /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 04:41:55.047935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:55.048739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:55.055598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.056088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.056528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.057235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.057924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.058146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.378933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-29e8bffc-08df-45a9-87c9-5f7c812f19f9 req-bf02de4e-5061-4e90-ac07-af74d9d17523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46517a40-9c95-4441-b643-45b28b0d717d", "name": "network-vif-deleted", "tag": "626e7ecf-c8b9-4d19-9da9-02593a43a970"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:55.389011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:55.400065 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d4bdb3fb-38ba-45c0-ad58-6d6b646490df tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.356218 Aug 30 04:41:55.405133 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2957/5977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:55 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:55.410295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-29e8bffc-08df-45a9-87c9-5f7c812f19f9 req-bf02de4e-5061-4e90-ac07-af74d9d17523 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.411136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-29e8bffc-08df-45a9-87c9-5f7c812f19f9 req-bf02de4e-5061-4e90-ac07-af74d9d17523 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.411823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-29e8bffc-08df-45a9-87c9-5f7c812f19f9 req-bf02de4e-5061-4e90-ac07-af74d9d17523 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.426492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:55.428071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:55.437784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.449994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.450882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.453559 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-29e8bffc-08df-45a9-87c9-5f7c812f19f9 req-bf02de4e-5061-4e90-ac07-af74d9d17523 service nova] Creating event network-vif-deleted:626e7ecf-c8b9-4d19-9da9-02593a43a970 for instance 46517a40-9c95-4441-b643-45b28b0d717d on n-h2-854925-5 Aug 30 04:41:55.457201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.458251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.458921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.480568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-29e8bffc-08df-45a9-87c9-5f7c812f19f9 req-bf02de4e-5061-4e90-ac07-af74d9d17523 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105371 Aug 30 04:41:55.486682 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3021/5978] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:41:55.533151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:55.534093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:55.548504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.548906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.549574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.551015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.551704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.557586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.632795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:55.636585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:55.638090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:55.640943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lazy-loading 'fault' on Instance uuid 46517a40-9c95-4441-b643-45b28b0d717d {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:41:55.839097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90dd2d52d02f4777add5570b1c7bc175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '855330321e2d47029d650db5ea542865', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:55.868116 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-efac05ab-f141-41aa-902e-73045291f983 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 200 len: 1328 microversion: 2.1 time: 0.342751 Aug 30 04:41:55.870034 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3022/5979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:55 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 1328 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:55.989045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:56.008042 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12a0dba5-e0ca-4f85-b89d-fdb52082dcb2 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.585384 Aug 30 04:41:56.022770 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2958/5980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:55 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:56.031630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdac3ad3-8aba-4102-a1fd-547c80889ccb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1183300200_updated"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:56.034947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cdac3ad3-8aba-4102-a1fd-547c80889ccb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: c2b10066-8615-48e6-9e75-d9e32a8823a3] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:56.042097 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-cdac3ad3-8aba-4102-a1fd-547c80889ccb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance c2b10066-8615-48e6-9e75-d9e32a8823a3 could not be found. Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdac3ad3-8aba-4102-a1fd-547c80889ccb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: request: PUT /compute/v2.1/servers/c2b10066-8615-48e6-9e75-d9e32a8823a3 HTTP/1.1 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 81 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1183300200_updated"}} Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c2b10066-8615-48e6-9e75-d9e32a8823a3 could not be found. Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c2b10066-8615-48e6-9e75-d9e32a8823a3', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1183300200_updated'}}} Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b10066-8615-48e6-9e75-d9e32a8823a3 could not be found. Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 30 04:41:56.044907 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b10066-8615-48e6-9e75-d9e32a8823a3 could not be found. Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b10066-8615-48e6-9e75-d9e32a8823a3 could not be found. Aug 30 04:41:56.050172 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.052156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cdac3ad3-8aba-4102-a1fd-547c80889ccb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance c2b10066-8615-48e6-9e75-d9e32a8823a3 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:56.053604 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cdac3ad3-8aba-4102-a1fd-547c80889ccb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "PUT /compute/v2.1/servers/c2b10066-8615-48e6-9e75-d9e32a8823a3" status: 404 len: 111 microversion: 2.1 time: 0.027023 Aug 30 04:41:56.055211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3023/5981] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:41:56 2022] PUT /compute/v2.1/servers/c2b10066-8615-48e6-9e75-d9e32a8823a3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:56.064559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:56.065316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:56.078041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.078744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.079343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.080442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.081060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.081783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.368928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:56.379475 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fbf96c81-ac9a-4da5-8df5-47755c782cb9 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.319337 Aug 30 04:41:56.380071 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2959/5982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:56 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:56.404905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:56.405738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:56.419598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.422229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.423351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.424327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.426037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.427546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.650779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:56.659627 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a416366b-4c61-45ab-87d8-cfd3137d4c01 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.258618 Aug 30 04:41:56.660250 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3024/5983] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:56 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:56.689665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbefa9c3-ed32-406c-9ad4-ad7383574886 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbefa9c3-ed32-406c-9ad4-ad7383574886 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 HTTP/1.1 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 280 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.696085 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 30 04:41:56.700661 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.703744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbefa9c3-ed32-406c-9ad4-ad7383574886 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:56.704800 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dbefa9c3-ed32-406c-9ad4-ad7383574886 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "PUT /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 400 len: 619 microversion: 2.1 time: 0.021883 Aug 30 04:41:56.705919 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2960/5984] 10.222.0.27 () {60 vars in 1257 bytes} [Tue Aug 30 04:41:56 2022] PUT /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 619 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:41:56.714770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:56.715393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:56.722088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.722589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.723879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.724711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.725185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.726561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.893643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:56.894536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:56.905939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.912922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.913740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.914739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:56.915614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:56.916363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:56.946896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] HTTP exception thrown: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Request method failure captured: Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d HTTP/1.1 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZPJBAAf21WlCSkwaMMxDuNpGi35VwHoQ2YIv9D_Ej4jbzAmH1jPWYsldMTpWJmRuupPbyILhjcrVTg7EWJxN2LG2TQLNGkX3qBAVPjH95wr950DEFV6NhQlDKApWFTZSNmFok9DsEfOOt474Wc9X0IAU1oZHHB0xmfkEmOsfqu1mSk Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_855330321e2d47029d650db5ea542865", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/855330321e2d47029d650db5ea542865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}] Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 90dd2d52d02f4777add5570b1c7bc175 Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '46517a40-9c95-4441-b643-45b28b0d717d'} Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:56.948486 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:56.954684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Returning 404 to user: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:56.961198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:56.966417 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-63ea07c0-4686-44f0-b9f2-e51696eae24c tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 404 len: 111 microversion: 2.1 time: 0.078735 Aug 30 04:41:56.967009 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2961/5985] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:56 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:41:56.973166 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20d66db2-0d09-4e7b-b82e-2f7ceb92d80d tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.263140 Aug 30 04:41:56.973850 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3025/5986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:56 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:41:56.989454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4fa9937b-53a6-40eb-a8e9-efd832039682 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '.version_select at 0x7fe9691e9f70>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:57.001478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:57.002464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:57.012171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4fa9937b-53a6-40eb-a8e9-efd832039682 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492797891" status: 202 len: 0 microversion: 2.1 time: 0.039330 Aug 30 04:41:57.012752 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2962/5987] 10.222.0.27 () {58 vars in 1221 bytes} [Tue Aug 30 04:41:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1492797891 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:41:57.031912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:57.032422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:57.032846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:57.033824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:57.034476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:57.035120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:57.319797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:57.328778 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a6b7bf5-861c-4c0e-b9ad-bc97fe32a3a3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.336995 Aug 30 04:41:57.329964 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3026/5988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:56 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:41:57.356255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59bbef11-0503-4b09-a6ae-d605cec03245 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59bbef11-0503-4b09-a6ae-d605cec03245 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: request: PUT /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 HTTP/1.1 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 24 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: {"server": {"name": ""}} Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0', 'body': {'server': {'name': ''}}} Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi '' Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 04:41:57.361035 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 30 04:41:57.367279 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:41:57.370371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59bbef11-0503-4b09-a6ae-d605cec03245 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:41:57.371730 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59bbef11-0503-4b09-a6ae-d605cec03245 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "PUT /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 400 len: 108 microversion: 2.1 time: 0.021706 Aug 30 04:41:57.372927 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2963/5989] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 04:41:57 2022] PUT /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 04:41:57.380919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:41:57.381507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:41:57.388762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:57.389255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:57.389939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:57.390839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:41:57.391604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:41:57.392232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:41:57.629974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:41:57.642213 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc5ded6e-e4e8-48e0-8d98-327209069be3 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1507 microversion: 2.1 time: 0.265090 Aug 30 04:41:57.664102 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3027/5990] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:41:57 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:05.582728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:05.583374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:05.597240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.598053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.599247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.601494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.602140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.602739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.626695 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 HTTP/1.1 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '6a3e1080-c0f8-4a45-af28-ecc0783e3ae0'} Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:05.632247 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.637888 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.640724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:05.648003 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce13c138-4800-4d47-a41a-bc7a5d939d8f tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 404 len: 111 microversion: 2.1 time: 0.070949 Aug 30 04:42:05.652076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2964/5991] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:42:05 2022] DELETE /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:05.661674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:05.662817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:05.679279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.679784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.680228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.680961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.681441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.683867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.728103 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 HTTP/1.1 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '6a3e1080-c0f8-4a45-af28-ecc0783e3ae0'} Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:05.734585 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance 6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7645123f-be95-495f-9be9-531d4b3ebd7e tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0" status: 404 len: 111 microversion: 2.1 time: 0.085825 Aug 30 04:42:05.744032 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3028/5992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:05 2022] GET /compute/v2.1/servers/6a3e1080-c0f8-4a45-af28-ecc0783e3ae0 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:05.751867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:05.752594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:05.764693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.769127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.769127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.769127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.774336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.774964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.802286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=100 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:05.808659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:42:05.934024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ff6c0bb-9bc7-4d49-b5b1-7a7d51e233e6 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 204 len: 0 microversion: 2.1 time: 0.188964 Aug 30 04:42:05.942565 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2965/5993] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:42:05 2022] DELETE /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:42:05.947041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:05.947665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:05.960385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.964332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.967557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:05.970629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:05.971116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:05.973425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:06.245139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:06.255472 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27747bae-31e6-4bad-aef5-61b93e2260ed tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.312823 Aug 30 04:42:06.257674 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3029/5994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:05 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:07.034538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:07.036006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:07.051649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.055074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.056574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.060041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.063640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.064798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.106428 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] HTTP exception thrown: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Request method failure captured: Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d HTTP/1.1 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZPJBAAf21WlCSkwaMMxDuNpGi35VwHoQ2YIv9D_Ej4jbzAmH1jPWYsldMTpWJmRuupPbyILhjcrVTg7EWJxN2LG2TQLNGkX3qBAVPjH95wr950DEFV6NhQlDKApWFTZSNmFok9DsEfOOt474Wc9X0IAU1oZHHB0xmfkEmOsfqu1mSk Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_855330321e2d47029d650db5ea542865", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/855330321e2d47029d650db5ea542865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}] Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 90dd2d52d02f4777add5570b1c7bc175 Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '46517a40-9c95-4441-b643-45b28b0d717d'} Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:07.111379 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.115863 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.126318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Returning 404 to user: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:07.127220 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b11c839-ca7b-4f13-bf6c-e1e60ff32bda tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 404 len: 111 microversion: 2.1 time: 0.098167 Aug 30 04:42:07.128131 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2966/5995] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:42:07 2022] DELETE /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:07.136809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:07.137514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 46517a40-9c95-4441-b643-45b28b0d717d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:07.145857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.146613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.147067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.148322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.148780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.149256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.171792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] HTTP exception thrown: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Request method failure captured: Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d HTTP/1.1 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZPJBAAf21WlCSkwaMMxDuNpGi35VwHoQ2YIv9D_Ej4jbzAmH1jPWYsldMTpWJmRuupPbyILhjcrVTg7EWJxN2LG2TQLNGkX3qBAVPjH95wr950DEFV6NhQlDKApWFTZSNmFok9DsEfOOt474Wc9X0IAU1oZHHB0xmfkEmOsfqu1mSk Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_855330321e2d47029d650db5ea542865", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/855330321e2d47029d650db5ea542865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}] Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 90dd2d52d02f4777add5570b1c7bc175 Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '46517a40-9c95-4441-b643-45b28b0d717d'} Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:07.176740 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.183618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:07.183618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:07.183618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:07.183618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:07.183618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:07.183618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. Aug 30 04:42:07.183618 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:07.190661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Returning 404 to user: Instance 46517a40-9c95-4441-b643-45b28b0d717d could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:07.190661 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3d152092-659b-4d48-8ab4-12e654b8f473 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d" status: 404 len: 111 microversion: 2.1 time: 0.054344 Aug 30 04:42:07.191370 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3030/5996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:07 2022] GET /compute/v2.1/servers/46517a40-9c95-4441-b643-45b28b0d717d => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:07.277822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:07.279262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:07.288860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.289374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.294230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.297620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:07.299191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:07.301203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:07.571282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:07.588117 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4bb21627-aae5-4320-aece-3d604d1b5dc4 tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.314100 Aug 30 04:42:07.601571 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2967/5997] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:07 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:08.611173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:08.612362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:08.638308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:08.638823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:08.640260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:08.641047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:08.641995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:08.643818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:08.997075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cae3abbe74a54a7cba5137e36d27b2a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794f15db103e419c838d09d71e74c5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:09.007689 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26c83bb5-c149-4a96-850d-cdc57a7543cb tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 200 len: 1513 microversion: 2.1 time: 0.402835 Aug 30 04:42:09.012366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-baa81e45-37c1-4d92-aa2d-25ed52536064 req-5da84a37-adcf-4d62-9b63-9bbdcbbf15e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6022067-fd07-48f1-abc8-c400ad50ccd0", "name": "network-vif-deleted", "tag": "40a2327c-07b2-4270-8067-e8e4815b60b5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:09.016166 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3031/5998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:08 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 1513 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:09.033936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-baa81e45-37c1-4d92-aa2d-25ed52536064 req-5da84a37-adcf-4d62-9b63-9bbdcbbf15e3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:09.037196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-baa81e45-37c1-4d92-aa2d-25ed52536064 req-5da84a37-adcf-4d62-9b63-9bbdcbbf15e3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:09.037927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-baa81e45-37c1-4d92-aa2d-25ed52536064 req-5da84a37-adcf-4d62-9b63-9bbdcbbf15e3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:09.065943 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-baa81e45-37c1-4d92-aa2d-25ed52536064 req-5da84a37-adcf-4d62-9b63-9bbdcbbf15e3 service nova] Creating event network-vif-deleted:40a2327c-07b2-4270-8067-e8e4815b60b5 for instance b6022067-fd07-48f1-abc8-c400ad50ccd0 on n-h1-854925-5 Aug 30 04:42:09.075044 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-baa81e45-37c1-4d92-aa2d-25ed52536064 req-5da84a37-adcf-4d62-9b63-9bbdcbbf15e3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066473 Aug 30 04:42:09.076160 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2968/5999] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:10.036124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:10.036775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] [instance: b6022067-fd07-48f1-abc8-c400ad50ccd0] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:10.044351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:10.045057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:10.045689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:10.047191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:10.049097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:10.050084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:10.088303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] HTTP exception thrown: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 could not be found. Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Request method failure captured: Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 HTTP/1.1 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZR4Zu75wK6ZxX7wN0arjqnerZWjRKVxhFjLYvAvjXZBD9b2ShsY7OjVMeZrOzxUxFu3_fO-fUlZF4fvPWXTvReZjJkwliLVU17qn-XL32-oAEAcSLBpkhSVDjJJUvzC0fFx-X1F006xWnylFx07XUQrsIRcQT-WAVFayt9Ff-xR4X8 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_794f15db103e419c838d09d71e74c5ca", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/794f15db103e419c838d09d71e74c5ca"}]}] Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 794f15db103e419c838d09d71e74c5ca Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1163495502 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: cae3abbe74a54a7cba5137e36d27b2a6 Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-1163495502-project Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 could not be found. Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'b6022067-fd07-48f1-abc8-c400ad50ccd0'} Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 could not be found. Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 could not be found. Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:10.090905 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:10.096419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:10.096419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:10.096419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:10.096419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:10.096419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:10.096419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 could not be found. Aug 30 04:42:10.096419 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:10.098266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] Returning 404 to user: Instance b6022067-fd07-48f1-abc8-c400ad50ccd0 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:10.099230 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a76fab62-5ae3-4149-b356-d08b2c9b9d5c tempest-ServersNegativeTestJSON-1163495502 tempest-ServersNegativeTestJSON-1163495502-project] 10.222.0.27 "GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0" status: 404 len: 111 microversion: 2.1 time: 0.067072 Aug 30 04:42:10.100268 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3032/6000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:10 2022] GET /compute/v2.1/servers/b6022067-fd07-48f1-abc8-c400ad50ccd0 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:11.668206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:11.670476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:11.686228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:11.687496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:11.688731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:11.691420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:11.692632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:11.693821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:11.727728 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] HTTP exception thrown: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Request method failure captured: Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 HTTP/1.1 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZPJBAAf21WlCSkwaMMxDuNpGi35VwHoQ2YIv9D_Ej4jbzAmH1jPWYsldMTpWJmRuupPbyILhjcrVTg7EWJxN2LG2TQLNGkX3qBAVPjH95wr950DEFV6NhQlDKApWFTZSNmFok9DsEfOOt474Wc9X0IAU1oZHHB0xmfkEmOsfqu1mSk Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_855330321e2d47029d650db5ea542865", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/855330321e2d47029d650db5ea542865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}] Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 90dd2d52d02f4777add5570b1c7bc175 Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '4a01c5f1-b0cc-41ff-9a7a-5a419509f558'} Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:11.736425 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.742100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.743265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Returning 404 to user: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:11.744666 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5db57322-5a2a-46ca-9be2-c9adfc116268 tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 404 len: 111 microversion: 2.1 time: 0.082992 Aug 30 04:42:11.746460 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2969/6001] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:42:11 2022] DELETE /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:42:11.756208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:11.757885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] [instance: 4a01c5f1-b0cc-41ff-9a7a-5a419509f558] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:11.770202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:11.771082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:11.771822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:11.773501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:11.774616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:11.775306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:11.796552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] HTTP exception thrown: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Request method failure captured: Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 HTTP/1.1 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZPJBAAf21WlCSkwaMMxDuNpGi35VwHoQ2YIv9D_Ej4jbzAmH1jPWYsldMTpWJmRuupPbyILhjcrVTg7EWJxN2LG2TQLNGkX3qBAVPjH95wr950DEFV6NhQlDKApWFTZSNmFok9DsEfOOt474Wc9X0IAU1oZHHB0xmfkEmOsfqu1mSk Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_855330321e2d47029d650db5ea542865", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/855330321e2d47029d650db5ea542865"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/855330321e2d47029d650db5ea542865"}]}] Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 855330321e2d47029d650db5ea542865 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-AttachVolumeTestJSON-424509854 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 90dd2d52d02f4777add5570b1c7bc175 Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-AttachVolumeTestJSON-424509854-project Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '4a01c5f1-b0cc-41ff-9a7a-5a419509f558'} Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:11.798600 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.803980 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:11.803980 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:11.803980 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:11.803980 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:11.803980 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:11.803980 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. Aug 30 04:42:11.803980 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:11.804622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] Returning 404 to user: Instance 4a01c5f1-b0cc-41ff-9a7a-5a419509f558 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:11.805629 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52672d14-9d4b-44e0-855e-090f2182f60a tempest-AttachVolumeTestJSON-424509854 tempest-AttachVolumeTestJSON-424509854-project] 10.222.0.27 "GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558" status: 404 len: 111 microversion: 2.1 time: 0.054826 Aug 30 04:42:11.807443 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3033/6002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:11 2022] GET /compute/v2.1/servers/4a01c5f1-b0cc-41ff-9a7a-5a419509f558 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:12.340067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:12.340976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:12.348377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:12.349254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:12.349917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:12.350835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:12.351451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:12.352052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.172068 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e201937d-b1ef-4495-b343-578bc44bfdcb tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1834 microversion: 2.1 time: 0.836895 Aug 30 04:42:13.173540 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2970/6003] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:12 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1834 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:13.197485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:13.198103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:13.209781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.210312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.210970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.212912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.213533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.214159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.599544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:13.612395 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6b9340b1-1268-4f0e-b2eb-b2a130daec43 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1683 microversion: 2.1 time: 0.418915 Aug 30 04:42:13.613898 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3034/6004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:13 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1683 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:13.764988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:13.767703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:13.776216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.777569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.778260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.779169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:13.779927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:13.780536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:13.861502 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77f368a6-b973-477f-bcf1-70492129ef70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action" status: 200 len: 32636 microversion: 2.1 time: 0.100864 Aug 30 04:42:13.869625 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2971/6005] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:42:13 2022] POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action => generated 32636 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:42:14.083925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:14.084521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:14.095133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:14.095647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:14.096098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:14.096815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:14.097434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:14.097877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:14.110768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:14.191854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5583b1acea8e4acab71c1c036549325d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2724aba0657492e86610b2426a7dc9b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:14.193730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] flavor_id is None. Assuming migration. {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4194}} Aug 30 04:42:14.196289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 04:42:14.406029 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc795dd5-fb4a-42f4-a125-5db340d39b42 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action" status: 202 len: 0 microversion: 2.1 time: 0.325730 Aug 30 04:42:14.406912 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3035/6006] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:42:14 2022] POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:42:14.416622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:14.417433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:14.431644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:14.432281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:14.432792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:14.435256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:14.435256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:14.436299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:14.848587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:14.867296 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be5ddceb-6394-4927-8552-c1028a2998f0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1692 microversion: 2.1 time: 0.455504 Aug 30 04:42:14.868788 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2972/6007] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:14 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1692 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:15.890568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:15.892341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:15.903219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:15.904653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:15.909902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:15.911008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:15.911700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:15.912531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:16.408341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:16.437671 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-260c19ec-b1a9-4c6d-8b67-d6b545860dbb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1692 microversion: 2.1 time: 0.548755 Aug 30 04:42:16.439025 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3036/6008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:15 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1692 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:17.709166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:17.710011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:17.719053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:17.719548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:17.719983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:17.720693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:17.721412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:17.722170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:17.913722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:17.924106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9bd3b90-2824-43bb-8819-145aeb9c8f9d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1692 microversion: 2.1 time: 0.468752 Aug 30 04:42:17.939215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2973/6009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:17 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1692 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:18.950074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:18.950786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:18.965908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.967082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.967647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:18.971786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:18.972704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:18.974610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:19.192362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:19.212572 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e97fb6e-5691-49ac-8061-aa0c5181be73 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1692 microversion: 2.1 time: 0.268291 Aug 30 04:42:19.229349 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3037/6010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:18 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1692 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:20.246661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:20.249137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:20.258757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:20.283061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:20.287823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:20.292526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:20.294960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:20.298629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:20.300641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:21.040322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:21.052935 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-644f1a46-a936-4ba6-8ac5-0c419d9b3ebb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.814989 Aug 30 04:42:21.055629 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2974/6011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:20 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:21.459359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-092310a4-f290-4bc2-93d3-28d2c71f5c5d tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Action: 'create', calling method: .version_select at 0x7fe96adce820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2136813609", "metadata": {"Type": "work"}}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:21.946327 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-092310a4-f290-4bc2-93d3-28d2c71f5c5d tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.711408 Aug 30 04:42:21.946968 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3038/6012] 10.222.0.27 () {60 vars in 1156 bytes} [Tue Aug 30 04:42:21 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 713 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 04:42:21.959722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eee8eb48-5f72-4b43-950f-8596111eae67 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe96aa4e0d0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:22.062498 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eee8eb48-5f72-4b43-950f-8596111eae67 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 200 len: 353 microversion: 2.1 time: 0.106985 Aug 30 04:42:22.064335 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2975/6013] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:21 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 353 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:42:22.076190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:22.076965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:22.089970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:22.090682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:22.091229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:22.092573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:22.094132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:22.095370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:22.333086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:22.349459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0d2b3b22-c216-412a-b54c-7c4fcfc2c021 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.270873 Aug 30 04:42:22.350912 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3039/6014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:22 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:23.078938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-07e19c28-d1fb-48b9-940e-4cae2af1a588 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe9692a8d30>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:23.188145 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-07e19c28-d1fb-48b9-940e-4cae2af1a588 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 200 len: 353 microversion: 2.1 time: 0.115234 Aug 30 04:42:23.188826 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2976/6015] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:23 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:23.375100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:23.376618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:23.384689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=48 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:23.388942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:23.389818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:23.390518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:23.391494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:23.392211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:23.393158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:23.682007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:23.695908 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5ea0c6a-7e66-4e61-a69b-245c1bae539a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.324090 Aug 30 04:42:23.699733 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3040/6016] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:23 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:24.202485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce3d5a1d-53c6-4ed7-91a5-d5c922701f63 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe96925f310>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:24.277613 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce3d5a1d-53c6-4ed7-91a5-d5c922701f63 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 200 len: 354 microversion: 2.1 time: 0.079229 Aug 30 04:42:24.286294 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2977/6017] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:24 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:24.294449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-722c0403-6474-431e-8f7c-d57287dc34a0 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe96a9df820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:24.359802 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-722c0403-6474-431e-8f7c-d57287dc34a0 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 200 len: 354 microversion: 2.1 time: 0.072346 Aug 30 04:42:24.362436 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3041/6018] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:24 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:42:24.377114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-76749bbe-519c-4d8f-a22e-0970ba6b0616 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe96a4eadc0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:24.496276 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-76749bbe-519c-4d8f-a22e-0970ba6b0616 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 202 len: 0 microversion: 2.1 time: 0.123758 Aug 30 04:42:24.497126 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2978/6019] 10.222.0.27 () {58 vars in 1248 bytes} [Tue Aug 30 04:42:24 2022] DELETE /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:42:24.509249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-376eb29b-0867-4b7c-b900-99d6c83cf8ff tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe96a8fe040>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:24.576052 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-376eb29b-0867-4b7c-b900-99d6c83cf8ff tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 200 len: 353 microversion: 2.1 time: 0.073544 Aug 30 04:42:24.584796 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3042/6020] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:24 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:24.728913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:24.728913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:24.742507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:24.743141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:24.743792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:24.744591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:24.745145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:24.746982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:25.082726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:25.091029 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9cc8b1a9-6c70-4eb6-92d5-4e0cc90224e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.368674 Aug 30 04:42:25.095813 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2979/6021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:24 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:25.592549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5103612c-9278-42a4-8ded-52821c073f85 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe96ad0a670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:25.711362 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5103612c-9278-42a4-8ded-52821c073f85 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 200 len: 353 microversion: 2.1 time: 0.125391 Aug 30 04:42:25.712201 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3043/6022] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:25 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:26.114968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:26.115739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:26.127283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:26.127788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:26.128241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:26.128956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:26.129453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:26.129884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:26.359704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:26.375541 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba519770-3a18-44c4-a5a5-9c420561fead tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.261529 Aug 30 04:42:26.377411 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2980/6023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:26 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:26.727230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7991894f-fb72-4eee-90df-6d29138ee9a6 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe96a9df670>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:26.842104 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7991894f-fb72-4eee-90df-6d29138ee9a6 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 200 len: 353 microversion: 2.1 time: 0.120996 Aug 30 04:42:26.843000 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3044/6024] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:26 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:27.401476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:27.402212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:27.413970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:27.417948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:27.418510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:27.419353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:27.419924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:27.420457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:27.662020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:27.671121 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d5541a7-afa5-45f3-845b-e61e19db638f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.275985 Aug 30 04:42:27.672473 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2981/6025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:27 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:27.856938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-214ec04e-5747-428d-86a0-6fd3ce3368f4 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Calling method '.version_select at 0x7fe9690bb820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:27.937096 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-214ec04e-5747-428d-86a0-6fd3ce3368f4 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] HTTP exception thrown: Volume d6987d0d-2fdf-4d52-8b70-4226250c067c could not be found. Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-214ec04e-5747-428d-86a0-6fd3ce3368f4 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Request method failure captured: Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c HTTP/1.1 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZUtob1TwSgLoKTaBZw1GDg71UkN2t85KhYSvyRwzxNiHh-pyYH2L0bbmC1U8G8S_LA7JdQBI_WGaFN3xfeH3DaTlTmm-qX2J84S042Yr1kR1teUt3caFhmNQSwnKGfoMYvzvWR_klxOHsZT7faheuD1dg1tPauJzxmlsZC3zNkTtaY Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: d39e0379fa584d54abf8551d4fc3acc0 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesGetTestJSON-517937307 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d39e0379fa584d54abf8551d4fc3acc0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d39e0379fa584d54abf8551d4fc3acc0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d39e0379fa584d54abf8551d4fc3acc0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d39e0379fa584d54abf8551d4fc3acc0"}]}] Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesGetTestJSON-517937307 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: d39e0379fa584d54abf8551d4fc3acc0 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesGetTestJSON-517937307 Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesGetTestJSON-517937307-project Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9d9efe46b131469dae3ae9c6fb126b3b Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesGetTestJSON-517937307-project Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: method: Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: exception: Volume d6987d0d-2fdf-4d52-8b70-4226250c067c could not be found. Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'd6987d0d-2fdf-4d52-8b70-4226250c067c'} Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d6987d0d-2fdf-4d52-8b70-4226250c067c could not be found. (HTTP 404) (Request-ID: req-8865bd81-a651-4309-8af7-82bd74fe5564) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 04:42:27.939511 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d6987d0d-2fdf-4d52-8b70-4226250c067c could not be found. Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d6987d0d-2fdf-4d52-8b70-4226250c067c could not be found. Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d6987d0d-2fdf-4d52-8b70-4226250c067c could not be found. Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-214ec04e-5747-428d-86a0-6fd3ce3368f4 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] Returning 404 to user: Volume d6987d0d-2fdf-4d52-8b70-4226250c067c could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-214ec04e-5747-428d-86a0-6fd3ce3368f4 tempest-VolumesGetTestJSON-517937307 tempest-VolumesGetTestJSON-517937307-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c" status: 404 len: 109 microversion: 2.1 time: 0.088336 Aug 30 04:42:27.945435 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3045/6026] 10.222.0.27 () {58 vars in 1245 bytes} [Tue Aug 30 04:42:27 2022] GET /compute/v2.1/os-volumes/d6987d0d-2fdf-4d52-8b70-4226250c067c => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:42:28.695330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:28.696100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:28.713150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:28.715394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:28.716217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:28.717201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:28.718775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:28.719574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:29.253121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:29.271387 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-55db2012-7127-4c44-a08f-ce17e014ecde tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.581690 Aug 30 04:42:29.291242 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2982/6027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:28 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:30.294166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:30.294860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:30.311265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:30.311681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:30.312119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:30.318019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:30.318437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:30.319471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:30.718940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:30.729111 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a527410-84b5-413b-9e78-16203c481f72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.440066 Aug 30 04:42:30.734646 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3046/6028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:30 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:31.757253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:31.757931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:31.764713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:31.765218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:31.765682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:31.766606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:31.767241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:31.768061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:32.331226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:32.343646 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6f1bcadf-d4eb-4ecc-8817-34f48cfd33e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1697 microversion: 2.1 time: 0.589976 Aug 30 04:42:32.346647 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2983/6029] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:31 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1697 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:33.370618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:33.372010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:33.400630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:33.401711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:33.403629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:33.404384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:33.404852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:33.407450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:34.261585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9d3257a3-20e2-41f4-bde7-65d9bdd7a465 req-9a21d422-8f34-4f73-b51a-e3a7ba149efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "name": "network-vif-unplugged", "status": "completed", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:34.294392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9d3257a3-20e2-41f4-bde7-65d9bdd7a465 req-9a21d422-8f34-4f73-b51a-e3a7ba149efd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:34.296282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9d3257a3-20e2-41f4-bde7-65d9bdd7a465 req-9a21d422-8f34-4f73-b51a-e3a7ba149efd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:34.296912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9d3257a3-20e2-41f4-bde7-65d9bdd7a465 req-9a21d422-8f34-4f73-b51a-e3a7ba149efd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:34.326556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9d3257a3-20e2-41f4-bde7-65d9bdd7a465 req-9a21d422-8f34-4f73-b51a-e3a7ba149efd service nova] Creating event network-vif-unplugged:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h2-854925-5 Aug 30 04:42:34.338053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:34.363708 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86b3824b-b703-478b-87ad-60943416777e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1696 microversion: 2.1 time: 0.982991 Aug 30 04:42:34.367207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3047/6030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:33 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1696 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:34.368870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-9d3257a3-20e2-41f4-bde7-65d9bdd7a465 req-9a21d422-8f34-4f73-b51a-e3a7ba149efd service nova] Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:42:34.390422 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9d3257a3-20e2-41f4-bde7-65d9bdd7a465 req-9a21d422-8f34-4f73-b51a-e3a7ba149efd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134358 Aug 30 04:42:34.392121 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2984/6031] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:42:35.389813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:35.390785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:35.409823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:35.412317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:35.412842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:35.414746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:35.417905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:35.418581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:36.082799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:36.098295 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52837d19-1d25-4d32-b830-b711c5c2fec0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1696 microversion: 2.1 time: 0.714951 Aug 30 04:42:36.103044 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3048/6032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:35 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1696 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:36.450493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d77081a5-e414-421e-8076-61d2c1523451 req-e71252f0-45f5-4542-ae75-7969502dcda6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:36.485029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d77081a5-e414-421e-8076-61d2c1523451 req-e71252f0-45f5-4542-ae75-7969502dcda6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:36.485462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d77081a5-e414-421e-8076-61d2c1523451 req-e71252f0-45f5-4542-ae75-7969502dcda6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:36.485912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d77081a5-e414-421e-8076-61d2c1523451 req-e71252f0-45f5-4542-ae75-7969502dcda6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:36.501360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:36.530547 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d77081a5-e414-421e-8076-61d2c1523451 req-e71252f0-45f5-4542-ae75-7969502dcda6 service nova] Creating event network-changed:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h2-854925-5 Aug 30 04:42:36.567993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-d77081a5-e414-421e-8076-61d2c1523451 req-e71252f0-45f5-4542-ae75-7969502dcda6 service nova] Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:42:36.623584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d77081a5-e414-421e-8076-61d2c1523451 req-e71252f0-45f5-4542-ae75-7969502dcda6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179903 Aug 30 04:42:36.624583 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2985/6033] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:37.127262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:37.128662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:37.140381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:37.141744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:37.142389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:37.143349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:37.144318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:37.145177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:37.539934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:37.555408 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-84c5c034-8067-4250-b646-5796485cd306 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1694 microversion: 2.1 time: 0.432827 Aug 30 04:42:37.571382 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3049/6034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:37 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1694 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:38.584814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:38.586580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:38.596144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:38.599395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:38.605399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:38.608352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:38.609041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:38.609711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:39.066567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:39.088876 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0f3f3532-dfb2-42b4-bb32-fd513710f0ff tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1694 microversion: 2.1 time: 0.506789 Aug 30 04:42:39.110001 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2986/6035] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:38 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1694 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:40.120592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:40.121461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:40.145855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:40.148630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:40.149793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:40.152191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:40.156191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:40.158570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:40.429174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:40.439302 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b394174f-c64f-4ad1-a001-321e1c66dd4b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1691 microversion: 2.1 time: 0.323960 Aug 30 04:42:40.440745 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3050/6036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:40 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1691 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:40.464458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:40.465015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:40.476918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:40.480409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:40.483015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:40.484669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:40.486383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:40.488571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:40.764776 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3b4fa91e-f81b-4144-b783-0c3be170c64c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action" status: 202 len: 0 microversion: 2.1 time: 0.303996 Aug 30 04:42:40.776339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:40.777117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:40.785065 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2987/6037] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:42:40 2022] POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:42:40.794205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:40.796707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:40.797188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:40.797955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:40.798601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:40.802850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:41.295468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:41.308038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-56e6395c-cb42-4965-9b60-accfd21b0f3a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.536393 Aug 30 04:42:41.314604 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3051/6038] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:40 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:42.330812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:42.331646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:42.352471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:42.353060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:42.357997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:42.358827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:42.359538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:42.360154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:42.464503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-77264e29-db1e-4299-96a1-8aa13f6cd513 req-860ed09b-4998-468e-bb4d-6d3584e7611d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "name": "network-vif-plugged", "status": "completed", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:42.488751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-77264e29-db1e-4299-96a1-8aa13f6cd513 req-860ed09b-4998-468e-bb4d-6d3584e7611d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:42.490762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-77264e29-db1e-4299-96a1-8aa13f6cd513 req-860ed09b-4998-468e-bb4d-6d3584e7611d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:42.492766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-77264e29-db1e-4299-96a1-8aa13f6cd513 req-860ed09b-4998-468e-bb4d-6d3584e7611d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:42.517006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-77264e29-db1e-4299-96a1-8aa13f6cd513 req-860ed09b-4998-468e-bb4d-6d3584e7611d service nova] Creating event network-vif-plugged:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h2-854925-5 Aug 30 04:42:42.533809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-77264e29-db1e-4299-96a1-8aa13f6cd513 req-860ed09b-4998-468e-bb4d-6d3584e7611d service nova] Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:42:42.555055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-77264e29-db1e-4299-96a1-8aa13f6cd513 req-860ed09b-4998-468e-bb4d-6d3584e7611d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093965 Aug 30 04:42:42.556460 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3052/6039] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:42:42.794124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:42.809307 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e6518a8-2cfe-4517-ad04-6d30fd0e4a08 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.481824 Aug 30 04:42:42.810738 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2988/6040] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:42 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:43.833418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:43.834969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:43.857854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:43.862050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:43.863892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:43.871467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:43.875299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:43.876715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:44.405078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:44.408325 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:44.424447 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ad64085-d411-4b31-b238-5ca8bb241838 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.595966 Aug 30 04:42:44.440623 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3053/6041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:43 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:45.448690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:45.449312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:45.466584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:45.467107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:45.467506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:45.468223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:45.468938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:45.469391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:45.966173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:45.982046 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18f60178-3d99-4d90-b5c7-abf0452fa372 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.537191 Aug 30 04:42:45.982662 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2989/6042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:45 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:46.095282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6f8c26ba-bc3b-4dad-910b-446e4e6cb789 req-7376feea-5640-4c0b-b112-fa5eddd7ed7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "name": "network-vif-unplugged", "status": "completed", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:46.141379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6f8c26ba-bc3b-4dad-910b-446e4e6cb789 req-7376feea-5640-4c0b-b112-fa5eddd7ed7f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:46.141913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6f8c26ba-bc3b-4dad-910b-446e4e6cb789 req-7376feea-5640-4c0b-b112-fa5eddd7ed7f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:46.143530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6f8c26ba-bc3b-4dad-910b-446e4e6cb789 req-7376feea-5640-4c0b-b112-fa5eddd7ed7f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:46.216843 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6f8c26ba-bc3b-4dad-910b-446e4e6cb789 req-7376feea-5640-4c0b-b112-fa5eddd7ed7f service nova] Creating event network-vif-unplugged:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:42:46.237120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-6f8c26ba-bc3b-4dad-910b-446e4e6cb789 req-7376feea-5640-4c0b-b112-fa5eddd7ed7f service nova] Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:42:46.265206 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6f8c26ba-bc3b-4dad-910b-446e4e6cb789 req-7376feea-5640-4c0b-b112-fa5eddd7ed7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.174445 Aug 30 04:42:46.266524 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3054/6043] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:47.006174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:47.007317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:47.017978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:47.019139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:47.019139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:47.019591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:47.025562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:47.026258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:47.428332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:47.442327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-efe5a6b0-2b41-4707-8c05-5cd8e9904f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.440465 Aug 30 04:42:47.443050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2990/6044] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:47 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:48.302323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c1c97074-32f2-4bb4-8036-dcb097d1c489 req-125eca40-db2a-452c-9017-95b8f2108763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:48.317104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c1c97074-32f2-4bb4-8036-dcb097d1c489 req-125eca40-db2a-452c-9017-95b8f2108763 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:48.318229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c1c97074-32f2-4bb4-8036-dcb097d1c489 req-125eca40-db2a-452c-9017-95b8f2108763 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:48.319788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c1c97074-32f2-4bb4-8036-dcb097d1c489 req-125eca40-db2a-452c-9017-95b8f2108763 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:48.386761 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c1c97074-32f2-4bb4-8036-dcb097d1c489 req-125eca40-db2a-452c-9017-95b8f2108763 service nova] Creating event network-changed:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:42:48.407339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-c1c97074-32f2-4bb4-8036-dcb097d1c489 req-125eca40-db2a-452c-9017-95b8f2108763 service nova] Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 04:42:48.434661 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c1c97074-32f2-4bb4-8036-dcb097d1c489 req-125eca40-db2a-452c-9017-95b8f2108763 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137098 Aug 30 04:42:48.436682 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3055/6045] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:42:48.466639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:48.467243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:48.482467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:48.482967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:48.483416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:48.484135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:48.484598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:48.485029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:48.847901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:48.864018 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e62c7f9-4087-4c05-ae8e-a8885a935f29 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.401083 Aug 30 04:42:48.874553 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2991/6046] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:48 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:49.889567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:49.890289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:49.901575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:49.905478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:49.906155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:49.907109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:49.907754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:49.908381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:50.467833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:50.480814 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f5a1f8c-eacc-4ef8-bd75-c91c93e3da71 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.597265 Aug 30 04:42:50.482486 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3056/6047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:49 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:42:51.503583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:51.504828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:51.517754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=32 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:42:51.519664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:51.522449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:51.523162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:51.524254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:51.526012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:51.526725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:51.926682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:51.951184 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ca92c9e-ebfb-4273-8acb-fd8abba0fea0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1690 microversion: 2.1 time: 0.451352 Aug 30 04:42:51.953098 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2992/6048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:51 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1690 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:52.980003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:42:52.981490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:42:52.991473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:52.992303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:52.992934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:52.995136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:52.995648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:52.996286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:53.220192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:42:53.231489 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c62e056-6058-4258-865c-2a1b3ac7b2d7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1683 microversion: 2.1 time: 0.257253 Aug 30 04:42:53.233650 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3057/6049] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:42:52 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1683 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:42:56.171649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-be933843-3138-4ccf-9f5b-e31f386f7613 req-38121dc0-aae7-4368-9d68-846daa72c765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "name": "network-vif-plugged", "status": "completed", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:42:56.210665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be933843-3138-4ccf-9f5b-e31f386f7613 req-38121dc0-aae7-4368-9d68-846daa72c765 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:42:56.213850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be933843-3138-4ccf-9f5b-e31f386f7613 req-38121dc0-aae7-4368-9d68-846daa72c765 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:42:56.214629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-be933843-3138-4ccf-9f5b-e31f386f7613 req-38121dc0-aae7-4368-9d68-846daa72c765 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:42:56.231122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-be933843-3138-4ccf-9f5b-e31f386f7613 req-38121dc0-aae7-4368-9d68-846daa72c765 service nova] Creating event network-vif-plugged:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:42:56.238368 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-be933843-3138-4ccf-9f5b-e31f386f7613 req-38121dc0-aae7-4368-9d68-846daa72c765 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071167 Aug 30 04:42:56.239730 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2993/6050] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:17.318670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=25 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:17.322304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=21 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:17.560512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Calling method '.version_select at 0x7fe96e616af0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:17.562607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:17.563243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:17.563788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:17.578323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:17.578920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:17.579464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:17.590557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:17.591195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:17.591737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:17.598297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26df0b9d-f055-4817-8943-a4ea2a012e63 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1388168417-project-admin] 10.222.0.27 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.287356 Aug 30 04:43:17.599026 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3058/6051] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 04:43:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:19.739326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:19.740700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:19.745178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-75426091", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "359983f1-3fc0-4d1c-b83b-0eaf089b8db5"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:19.816708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] validate_networks() for [('359983f1-3fc0-4d1c-b83b-0eaf089b8db5', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:43:20.496136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:43:20.497442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:43:20.498576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:43:20.499265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:43:20.499965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:43:20.514059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:20.515075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:20.515666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:20.516579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:20.517687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:20.518272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:20.549638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Getting quotas for project b86c2bd4837f4d358ac4a356d27904d4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:43:20.560014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Getting quotas for user 3d50f8bae9834381938c7aaabf42f692 and project b86c2bd4837f4d358ac4a356d27904d4. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:43:20.581396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:43:20.586011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:43:20.660446 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [55ab355f-10a5-4138-9361-6b480e2d9ff2] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:43:21.670208 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [55ab355f-10a5-4138-9361-6b480e2d9ff2] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 49948. Aug 30 04:43:21.676653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-598aa745-d31c-4aea-a2b7-29c47af573a3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.939355 Aug 30 04:43:21.690324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eaad0d2b-24dc-4fca-bd5e-08ed75317548 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:21.691640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eaad0d2b-24dc-4fca-bd5e-08ed75317548 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:21.695257 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2994/6052] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:43:21.805066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eaad0d2b-24dc-4fca-bd5e-08ed75317548 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:21.813358 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eaad0d2b-24dc-4fca-bd5e-08ed75317548 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1212 microversion: 2.1 time: 0.127634 Aug 30 04:43:21.823889 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3059/6053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:21 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1212 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:22.835700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:22.836845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:22.848257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:22.852612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:22.853075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:22.853868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:22.854492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:22.855796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:22.965900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:22.980591 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e36c6166-424f-4cee-b89a-d17a42f98263 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1264 microversion: 2.1 time: 0.149223 Aug 30 04:43:22.981476 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2995/6054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:22 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:24.009130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:24.011276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:24.024890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:24.025635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:24.027283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:24.028097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:24.028791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:24.029479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:24.109688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:24.119061 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-016d84d8-4fd2-4b89-941e-76a1571ea737 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1270 microversion: 2.1 time: 0.117393 Aug 30 04:43:24.119818 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3060/6055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:23 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:25.141289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:25.142486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:25.152350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:25.153106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:25.153806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:25.154717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:25.155841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:25.156962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:25.418500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:25.447190 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c6910d5c-b0bb-491e-9517-1a602c83d262 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1312 microversion: 2.1 time: 0.310587 Aug 30 04:43:25.453511 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2996/6056] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:25 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1312 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:25.465660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-147dace0-9c8d-46b0-b56e-e4b3c3efac0f req-830856a0-4160-4e73-97fa-f487d317f3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c1a765-b1e3-4f2b-900f-67012fcef62b", "tag": "e0de4044-f79a-4687-ada7-e960c60e39d1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:25.486183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-147dace0-9c8d-46b0-b56e-e4b3c3efac0f req-830856a0-4160-4e73-97fa-f487d317f3ab service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:25.487079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-147dace0-9c8d-46b0-b56e-e4b3c3efac0f req-830856a0-4160-4e73-97fa-f487d317f3ab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:25.487870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-147dace0-9c8d-46b0-b56e-e4b3c3efac0f req-830856a0-4160-4e73-97fa-f487d317f3ab service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:25.515361 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-147dace0-9c8d-46b0-b56e-e4b3c3efac0f req-830856a0-4160-4e73-97fa-f487d317f3ab service nova] Creating event network-changed:e0de4044-f79a-4687-ada7-e960c60e39d1 for instance 25c1a765-b1e3-4f2b-900f-67012fcef62b on n-h2-854925-5 Aug 30 04:43:25.547592 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-147dace0-9c8d-46b0-b56e-e4b3c3efac0f req-830856a0-4160-4e73-97fa-f487d317f3ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085250 Aug 30 04:43:25.548229 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3061/6057] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:43:26.474003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:26.474003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:26.481268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:26.482167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:26.482627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:26.487998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:26.489815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:26.494206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:27.069248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:27.078612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ca00aed-7d86-489f-adfd-3d706b22de50 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1312 microversion: 2.1 time: 0.611461 Aug 30 04:43:27.083107 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2997/6058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:26 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1312 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:28.106148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:28.106871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:28.114124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:28.114614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:28.115086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:28.117650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:28.118640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:28.119317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:28.770299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:28.780535 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a8fc7678-c3c2-485c-9d2f-ee6f8ce39bfe tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1312 microversion: 2.1 time: 0.680950 Aug 30 04:43:28.782315 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3062/6059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:28 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1312 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:29.762831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:29.765310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:29.779584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:29.780094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:29.780536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:29.783331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:29.794015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:29.794485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:29.806693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:29.807321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:29.814513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:29.815148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:29.815913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:29.816780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:29.817997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:29.819423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:29.886297 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c7411f97-9105-438b-a2df-6a4ce0b0aa62 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action" status: 200 len: 63156 microversion: 2.1 time: 0.127512 Aug 30 04:43:29.887115 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2998/6060] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:43:29 2022] POST /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89/action => generated 63156 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:43:29.988775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:29.999084 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26fb6e9b-e700-4e91-8561-98024d338276 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1312 microversion: 2.1 time: 0.196753 Aug 30 04:43:30.000430 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3063/6061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:29 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1312 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:31.022840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:31.024099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:31.028065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:31.028789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:31.038186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:31.038186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:31.038186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:31.038186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:31.038186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:31.038186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:31.237102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:31.247343 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4830a872-c09a-4a9d-854d-a8fa9be628cf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1312 microversion: 2.1 time: 0.230247 Aug 30 04:43:31.248468 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 2999/6062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:31 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:32.269974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:32.270664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:32.281102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:32.282736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:32.283355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:32.284067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:32.285064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:32.285854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:32.286728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:32.433625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0626f0d9-9bb3-45ed-b1dc-9357e0f880fd req-054910e3-7309-42ad-af15-f3c3299edd14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c1a765-b1e3-4f2b-900f-67012fcef62b", "name": "network-vif-plugged", "status": "completed", "tag": "e0de4044-f79a-4687-ada7-e960c60e39d1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:32.455939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0626f0d9-9bb3-45ed-b1dc-9357e0f880fd req-054910e3-7309-42ad-af15-f3c3299edd14 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:32.458414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0626f0d9-9bb3-45ed-b1dc-9357e0f880fd req-054910e3-7309-42ad-af15-f3c3299edd14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:32.459641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0626f0d9-9bb3-45ed-b1dc-9357e0f880fd req-054910e3-7309-42ad-af15-f3c3299edd14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:32.460366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:32.470112 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ee47012-d8f7-443f-9e59-5f6ad497c7be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1312 microversion: 2.1 time: 0.204046 Aug 30 04:43:32.470899 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3064/6063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:32 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:32.481512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0626f0d9-9bb3-45ed-b1dc-9357e0f880fd req-054910e3-7309-42ad-af15-f3c3299edd14 service nova] Creating event network-vif-plugged:e0de4044-f79a-4687-ada7-e960c60e39d1 for instance 25c1a765-b1e3-4f2b-900f-67012fcef62b on n-h2-854925-5 Aug 30 04:43:32.493957 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0626f0d9-9bb3-45ed-b1dc-9357e0f880fd req-054910e3-7309-42ad-af15-f3c3299edd14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065748 Aug 30 04:43:32.495125 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3000/6064] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:43:33.493215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:33.494681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:33.502131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:33.502943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:33.503448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:33.504381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:33.505064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:33.506447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:33.731898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:33.744564 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a5e2062-f086-4e23-8028-53f5a9dbf0fa tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1312 microversion: 2.1 time: 0.256107 Aug 30 04:43:33.746157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3065/6065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:33 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1312 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:34.774565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:34.776122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:34.784865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:34.785733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:34.786351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:34.787865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:34.788507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:34.789115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:35.198449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:35.210510 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e22a8675-e71d-4838-a0bf-c2e64a8250df tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1497 microversion: 2.1 time: 0.443866 Aug 30 04:43:35.211319 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3001/6066] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:34 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1497 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:35.810015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:35.810547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:35.819665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:35.820236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:35.820681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:35.821448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:35.822114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:35.822548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:35.850653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:43:35.939396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7f17a0d-48fd-41b2-98fa-66064902864b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 204 len: 0 microversion: 2.1 time: 0.133120 Aug 30 04:43:35.939994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3066/6067] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:43:35 2022] DELETE /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:43:35.948636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:35.950025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:35.957421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:35.957932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:35.958380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:35.959094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:35.959554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:35.959982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:36.275782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:36.284857 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-79912f00-9285-4cbe-bdb7-a24a92d60e61 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1503 microversion: 2.1 time: 0.340266 Aug 30 04:43:36.286031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3002/6068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:35 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1503 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:37.311817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:37.315061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:37.345065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:37.345593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:37.348214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:37.348967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:37.349515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:37.354066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:37.951916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:37.960699 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-faca0382-8efe-4211-83b5-a563ef56df08 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1503 microversion: 2.1 time: 0.657827 Aug 30 04:43:37.961513 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3067/6069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:37 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1503 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:43:38.983070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:38.983694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:38.993868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:39.005308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:39.006039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:39.006955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:39.007568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:39.008177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:39.267232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:39.280191 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cff469c4-f4fb-412e-9a9e-fb883c992214 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 200 len: 1461 microversion: 2.1 time: 0.300593 Aug 30 04:43:39.281402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3003/6070] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:38 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 1461 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:39.376137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3e69ac20-a1b1-4997-84ec-e9a0dc6afc48 req-451f23bb-e945-4430-8c06-e6ed8cd0d494 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c1a765-b1e3-4f2b-900f-67012fcef62b", "name": "network-vif-deleted", "tag": "e0de4044-f79a-4687-ada7-e960c60e39d1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:39.395109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3e69ac20-a1b1-4997-84ec-e9a0dc6afc48 req-451f23bb-e945-4430-8c06-e6ed8cd0d494 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:39.396008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3e69ac20-a1b1-4997-84ec-e9a0dc6afc48 req-451f23bb-e945-4430-8c06-e6ed8cd0d494 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:39.397145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3e69ac20-a1b1-4997-84ec-e9a0dc6afc48 req-451f23bb-e945-4430-8c06-e6ed8cd0d494 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:39.422576 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3e69ac20-a1b1-4997-84ec-e9a0dc6afc48 req-451f23bb-e945-4430-8c06-e6ed8cd0d494 service nova] Creating event network-vif-deleted:e0de4044-f79a-4687-ada7-e960c60e39d1 for instance 25c1a765-b1e3-4f2b-900f-67012fcef62b on n-h2-854925-5 Aug 30 04:43:39.433126 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3e69ac20-a1b1-4997-84ec-e9a0dc6afc48 req-451f23bb-e945-4430-8c06-e6ed8cd0d494 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062211 Aug 30 04:43:39.434479 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3068/6071] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:40.308790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:40.309461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 25c1a765-b1e3-4f2b-900f-67012fcef62b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:40.317161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:40.317891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:40.318377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:40.319316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:40.319967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:40.320620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:40.337627 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] HTTP exception thrown: Instance 25c1a765-b1e3-4f2b-900f-67012fcef62b could not be found. Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Request method failure captured: Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b HTTP/1.1 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZVlxyLTFT4v5VxhD-Cr8LAzk-CIJY7OeNqpRe0Zs7dLUyxAMxo1eHJ9_lJvx5QgO38WYrxBAEU1n_PS0sUqspq4SyDQ_m5WULfqWj77ANIMqvu9LtBnz956SmuNe6IU5H61VpaeNd-tttVLeWPAsKBin8H4EXqidi1yleM3F3nBzUQ Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: b86c2bd4837f4d358ac4a356d27904d4 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesActionsTest-1109372419 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b86c2bd4837f4d358ac4a356d27904d4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b86c2bd4837f4d358ac4a356d27904d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b86c2bd4837f4d358ac4a356d27904d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b86c2bd4837f4d358ac4a356d27904d4"}]}] Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesActionsTest-1109372419 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: b86c2bd4837f4d358ac4a356d27904d4 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesActionsTest-1109372419 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesActionsTest-1109372419-project Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 3d50f8bae9834381938c7aaabf42f692 Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesActionsTest-1109372419-project Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 25c1a765-b1e3-4f2b-900f-67012fcef62b could not be found. Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '25c1a765-b1e3-4f2b-900f-67012fcef62b'} Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c1a765-b1e3-4f2b-900f-67012fcef62b could not be found. Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c1a765-b1e3-4f2b-900f-67012fcef62b could not be found. Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:43:40.340100 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:43:40.343491 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:43:40.343491 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:43:40.343491 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:43:40.343491 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:43:40.343491 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:43:40.343491 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c1a765-b1e3-4f2b-900f-67012fcef62b could not be found. Aug 30 04:43:40.343491 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:43:40.345723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Returning 404 to user: Instance 25c1a765-b1e3-4f2b-900f-67012fcef62b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:43:40.347038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd61b666-8a4a-4dca-ace0-ca19394390c3 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b" status: 404 len: 111 microversion: 2.1 time: 0.042126 Aug 30 04:43:40.348167 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3004/6072] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:40 2022] GET /compute/v2.1/servers/25c1a765-b1e3-4f2b-900f-67012fcef62b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:43:40.517297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-502097931", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "359983f1-3fc0-4d1c-b83b-0eaf089b8db5"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:40.601234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] validate_networks() for [('359983f1-3fc0-4d1c-b83b-0eaf089b8db5', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:43:41.241359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:43:41.242358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:43:41.243338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:43:41.244193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:43:41.244967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:43:41.269602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:41.270503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:41.271757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:41.272721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:41.273417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:41.274002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:41.342507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Getting quotas for project b86c2bd4837f4d358ac4a356d27904d4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:43:41.353770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Getting quotas for user 3d50f8bae9834381938c7aaabf42f692 and project b86c2bd4837f4d358ac4a356d27904d4. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:43:41.386463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:43:41.389191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:43:41.482363 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf316ccf-2a1d-4470-87ca-a6c011a87f63 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970061 Aug 30 04:43:41.483674 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3069/6073] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:43:41.495842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-844a9f9a-702c-42e8-acdc-3f419dba1f83 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:41.496459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-844a9f9a-702c-42e8-acdc-3f419dba1f83 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:41.589129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-844a9f9a-702c-42e8-acdc-3f419dba1f83 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:41.603630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-844a9f9a-702c-42e8-acdc-3f419dba1f83 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1213 microversion: 2.1 time: 0.112276 Aug 30 04:43:41.608348 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3005/6074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:41 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:43:42.631800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:42.633039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:42.642777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:42.643529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:42.644173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:42.645214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:42.645906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:42.647244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:42.718501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:42.729310 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0440bdd4-f367-43e1-9f78-160f9127cb1b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1265 microversion: 2.1 time: 0.103034 Aug 30 04:43:42.730763 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3070/6075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:42 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:43.752778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:43.754056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:43.762543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:43.763267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:43.763983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:43.764958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:43.765636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:43.766362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:43.925713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:43.934988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea85e462-440e-44c1-b8d4-fb8bb5b279be tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1271 microversion: 2.1 time: 0.187316 Aug 30 04:43:43.935655 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3006/6076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:43 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:44.955437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:44.956815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:44.966478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:44.967084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:44.968898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:44.970636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:44.971306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:44.971832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:45.391251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:45.416139 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a8e4fdd-2ae0-47b0-9e7e-df853c8f462f tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1313 microversion: 2.1 time: 0.464982 Aug 30 04:43:45.421649 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3071/6077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:44 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1313 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:45.968523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3f647ce2-e56b-42f1-b53b-c76e39539b98 req-51517d3b-c118-41d4-8471-5764d269c76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b5c46d1-4917-4035-adc7-68d1c0e44a95", "tag": "6086d178-c4a6-486a-9e5a-118d9fdeb742"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:45.986487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3f647ce2-e56b-42f1-b53b-c76e39539b98 req-51517d3b-c118-41d4-8471-5764d269c76f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:45.987566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3f647ce2-e56b-42f1-b53b-c76e39539b98 req-51517d3b-c118-41d4-8471-5764d269c76f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:45.988242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3f647ce2-e56b-42f1-b53b-c76e39539b98 req-51517d3b-c118-41d4-8471-5764d269c76f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:46.004805 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3f647ce2-e56b-42f1-b53b-c76e39539b98 req-51517d3b-c118-41d4-8471-5764d269c76f service nova] Creating event network-changed:6086d178-c4a6-486a-9e5a-118d9fdeb742 for instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 on n-h2-854925-5 Aug 30 04:43:46.013996 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3f647ce2-e56b-42f1-b53b-c76e39539b98 req-51517d3b-c118-41d4-8471-5764d269c76f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048149 Aug 30 04:43:46.017952 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3007/6078] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:46.446512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:46.447698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:46.451141 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:43:46.451477 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 04:43:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 (ip 10.222.0.27) !!! Aug 30 04:43:46.482213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:46.485649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:46.486901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:46.487818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:46.488432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:46.489013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:46.732030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:46.743049 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e73dd7bb-40f6-46aa-a70c-c82b1b08122b tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1313 microversion: 2.1 time: 0.301121 Aug 30 04:43:46.759848 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3072/6079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:46 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:47.771134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:47.772161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:47.783472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:47.784140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:47.784558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:47.785435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:47.786037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:47.787265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:48.016245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:48.033956 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd8e4443-c8fd-473d-8517-eda566db6613 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1313 microversion: 2.1 time: 0.259773 Aug 30 04:43:48.048436 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3008/6080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:47 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:49.055308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:49.057050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:49.058781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:49.067401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:49.070003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:49.070606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:49.073214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:49.075482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:49.076070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:49.079939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:49.299167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:49.309808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-05915aa7-19e9-4239-80b8-806de9bdc596 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1313 microversion: 2.1 time: 0.258413 Aug 30 04:43:49.312268 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3073/6081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:49 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:50.332753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:50.335041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:50.338256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:50.345346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:50.346220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:50.346814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:50.347838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:50.348439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:50.349561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:50.356425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=67 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:50.683179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:50.691204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3117ef81-eed6-48d6-b2e8-52f2fec9b135 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1313 microversion: 2.1 time: 0.362864 Aug 30 04:43:50.691925 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3009/6082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:50 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:51.712717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:51.713535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:51.723043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:51.731531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:51.733221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:51.733877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:51.734410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:51.735360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:51.736055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:51.736693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:52.151179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:52.166868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bfaa2f74-1760-4b8c-93ae-a63ce306c28c tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1313 microversion: 2.1 time: 0.458482 Aug 30 04:43:52.167472 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3074/6083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:51 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:52.566291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-60ec2ebf-c497-499f-b11c-579ef27dc32c req-65863504-00c6-44a5-a145-8cbd0fb17f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5c46d1-4917-4035-adc7-68d1c0e44a95", "name": "network-vif-plugged", "status": "completed", "tag": "6086d178-c4a6-486a-9e5a-118d9fdeb742"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:52.582395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:43:52.592140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60ec2ebf-c497-499f-b11c-579ef27dc32c req-65863504-00c6-44a5-a145-8cbd0fb17f9d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:52.593631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60ec2ebf-c497-499f-b11c-579ef27dc32c req-65863504-00c6-44a5-a145-8cbd0fb17f9d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:52.594240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60ec2ebf-c497-499f-b11c-579ef27dc32c req-65863504-00c6-44a5-a145-8cbd0fb17f9d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:52.632494 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-60ec2ebf-c497-499f-b11c-579ef27dc32c req-65863504-00c6-44a5-a145-8cbd0fb17f9d service nova] Creating event network-vif-plugged:6086d178-c4a6-486a-9e5a-118d9fdeb742 for instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 on n-h2-854925-5 Aug 30 04:43:52.643147 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-60ec2ebf-c497-499f-b11c-579ef27dc32c req-65863504-00c6-44a5-a145-8cbd0fb17f9d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080970 Aug 30 04:43:52.647759 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3010/6084] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:53.145092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:53.145747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:53.156996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:53.157522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:53.161963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:53.162989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:53.166874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:53.167671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:53.188804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:53.189548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:53.201829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:53.202322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:53.203021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:53.209824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:53.210633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:53.211315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:53.949006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4af7d46f-234c-4073-aed6-cf122d1c0b2f tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1834 microversion: 2.1 time: 1.234206 Aug 30 04:43:53.949654 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3075/6085] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:52 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1834 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:53.972695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:53.989710 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b3a73f5-99c0-4960-9319-a09256d35516 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1313 microversion: 2.1 time: 0.805106 Aug 30 04:43:54.006191 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3011/6086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:53 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1313 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:55.014486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:55.015127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:55.022083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:55.022573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:55.023026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:55.030589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:55.031128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:55.031593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:55.340174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:55.353140 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-702502ee-6a85-4ba2-a617-a18fdef34288 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1497 microversion: 2.1 time: 0.343000 Aug 30 04:43:55.354927 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3076/6087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:55 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1497 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:56.045196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:56.047276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:56.058455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.059377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.059972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.060833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.062460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.063138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.103309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:43:56.270109 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e91e8dcc-2e20-4647-a544-28635fa71549 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 204 len: 0 microversion: 2.1 time: 0.229860 Aug 30 04:43:56.270693 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3012/6088] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:43:56 2022] DELETE /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:43:56.278909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:56.279668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:56.287348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.287834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.288269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.288969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.289488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.290067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.618160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:56.632458 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a8774783-0725-4c0e-93c1-059b52be0aa9 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1503 microversion: 2.1 time: 0.357311 Aug 30 04:43:56.633140 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3077/6089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:56 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1503 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:56.651608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:56.652370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:56.657295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d9ababff-8f07-407b-9ec7-8ace425e6956 req-6067252e-2e3b-4d9d-a8ba-f5d326d56c97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:56.659707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.660303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.660820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.661710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.662829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.663461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.668834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d9ababff-8f07-407b-9ec7-8ace425e6956 req-6067252e-2e3b-4d9d-a8ba-f5d326d56c97 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.669541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d9ababff-8f07-407b-9ec7-8ace425e6956 req-6067252e-2e3b-4d9d-a8ba-f5d326d56c97 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.670131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d9ababff-8f07-407b-9ec7-8ace425e6956 req-6067252e-2e3b-4d9d-a8ba-f5d326d56c97 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.681675 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d9ababff-8f07-407b-9ec7-8ace425e6956 req-6067252e-2e3b-4d9d-a8ba-f5d326d56c97 service nova] Creating event network-changed:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:43:56.687839 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d9ababff-8f07-407b-9ec7-8ace425e6956 req-6067252e-2e3b-4d9d-a8ba-f5d326d56c97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034143 Aug 30 04:43:56.688670 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3078/6090] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:43:56.701001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:43:56.853353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c53ad1da-517b-45a1-aa47-cdc8339ad0b3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 204 len: 0 microversion: 2.1 time: 0.196803 Aug 30 04:43:56.853353 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3013/6091] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:43:56 2022] DELETE /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:43:56.859883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:56.860596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:56.867166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.867673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.868122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:56.868842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:56.869307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:56.869785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:57.040824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:57.051284 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e8d52e51-3cbb-46c9-9ee5-6cb490d99d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1689 microversion: 2.1 time: 0.195452 Aug 30 04:43:57.057569 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3079/6092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:56 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:57.656709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:57.658312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:57.670555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:57.674265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:57.678032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:57.679194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:57.679902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:57.683130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:57.992492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d50f8bae9834381938c7aaabf42f692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b86c2bd4837f4d358ac4a356d27904d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:58.004161 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be9b54a1-26c5-4148-ae0b-d8ecdce28ea2 tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 200 len: 1503 microversion: 2.1 time: 0.352641 Aug 30 04:43:58.005143 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3014/6093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:57 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 1503 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:58.078031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:58.081646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:58.091153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:58.094261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:58.097365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:58.100274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:58.102449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:58.102932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:58.419716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:43:58.428581 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-30145432-b4ed-437d-b56c-219630f7cfb9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1689 microversion: 2.1 time: 0.359035 Aug 30 04:43:58.429192 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3080/6094] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:58 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1689 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:43:58.703772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-af7917c1-65d1-402b-b39e-8d03267494ae req-fbb6f86d-a2fd-4702-8979-022225d7b9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b5c46d1-4917-4035-adc7-68d1c0e44a95", "name": "network-vif-deleted", "tag": "6086d178-c4a6-486a-9e5a-118d9fdeb742"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:43:58.715193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af7917c1-65d1-402b-b39e-8d03267494ae req-fbb6f86d-a2fd-4702-8979-022225d7b9cc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:58.715820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af7917c1-65d1-402b-b39e-8d03267494ae req-fbb6f86d-a2fd-4702-8979-022225d7b9cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:58.717068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af7917c1-65d1-402b-b39e-8d03267494ae req-fbb6f86d-a2fd-4702-8979-022225d7b9cc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:58.732228 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-af7917c1-65d1-402b-b39e-8d03267494ae req-fbb6f86d-a2fd-4702-8979-022225d7b9cc service nova] Creating event network-vif-deleted:6086d178-c4a6-486a-9e5a-118d9fdeb742 for instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 on n-h2-854925-5 Aug 30 04:43:58.738443 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-af7917c1-65d1-402b-b39e-8d03267494ae req-fbb6f86d-a2fd-4702-8979-022225d7b9cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039078 Aug 30 04:43:58.739229 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3015/6095] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:43:59.026685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:59.027646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] [instance: 9b5c46d1-4917-4035-adc7-68d1c0e44a95] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:59.037176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:59.038275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:59.039144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:59.040116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:59.041073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:59.041913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:59.066328 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] HTTP exception thrown: Instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 could not be found. Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Request method failure captured: Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 HTTP/1.1 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZVlxyLTFT4v5VxhD-Cr8LAzk-CIJY7OeNqpRe0Zs7dLUyxAMxo1eHJ9_lJvx5QgO38WYrxBAEU1n_PS0sUqspq4SyDQ_m5WULfqWj77ANIMqvu9LtBnz956SmuNe6IU5H61VpaeNd-tttVLeWPAsKBin8H4EXqidi1yleM3F3nBzUQ Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: b86c2bd4837f4d358ac4a356d27904d4 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-VolumesActionsTest-1109372419 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b86c2bd4837f4d358ac4a356d27904d4", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b86c2bd4837f4d358ac4a356d27904d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b86c2bd4837f4d358ac4a356d27904d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b86c2bd4837f4d358ac4a356d27904d4"}]}] Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-VolumesActionsTest-1109372419 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: b86c2bd4837f4d358ac4a356d27904d4 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-VolumesActionsTest-1109372419 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-VolumesActionsTest-1109372419-project Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3d50f8bae9834381938c7aaabf42f692 Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-VolumesActionsTest-1109372419-project Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 could not be found. Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9b5c46d1-4917-4035-adc7-68d1c0e44a95'} Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 could not be found. Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 could not be found. Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:43:59.068119 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 could not be found. Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] Returning 404 to user: Instance 9b5c46d1-4917-4035-adc7-68d1c0e44a95 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:43:59.072315 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e601a64e-3c24-4f1e-9f62-21d24e85accf tempest-VolumesActionsTest-1109372419 tempest-VolumesActionsTest-1109372419-project] 10.222.0.27 "GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95" status: 404 len: 111 microversion: 2.1 time: 0.047702 Aug 30 04:43:59.075876 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3081/6096] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:59 2022] GET /compute/v2.1/servers/9b5c46d1-4917-4035-adc7-68d1c0e44a95 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:43:59.456745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:43:59.457557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:43:59.474802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:59.475417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:59.477508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:43:59.478280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:43:59.478751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:43:59.481835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:00.192506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:00.203986 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-72763c5a-d1b9-41bd-8697-45dc48e0fb81 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1689 microversion: 2.1 time: 0.752331 Aug 30 04:44:00.217392 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3016/6097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:43:59 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1689 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:00.748437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-75c04203-2323-466e-8c51-402f4abedf78 req-6113ec0d-b4e0-421e-b057-5f4b9082964a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373330c3-965c-436b-9b77-fdab4f2bdb89", "name": "network-vif-deleted", "tag": "b6bb8436-87b4-4e0c-aaf4-18182310c2f5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:00.800069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-75c04203-2323-466e-8c51-402f4abedf78 req-6113ec0d-b4e0-421e-b057-5f4b9082964a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:00.803197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-75c04203-2323-466e-8c51-402f4abedf78 req-6113ec0d-b4e0-421e-b057-5f4b9082964a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:00.804397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-75c04203-2323-466e-8c51-402f4abedf78 req-6113ec0d-b4e0-421e-b057-5f4b9082964a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:00.831688 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-75c04203-2323-466e-8c51-402f4abedf78 req-6113ec0d-b4e0-421e-b057-5f4b9082964a service nova] Creating event network-vif-deleted:b6bb8436-87b4-4e0c-aaf4-18182310c2f5 for instance 373330c3-965c-436b-9b77-fdab4f2bdb89 on n-h1-854925-5 Aug 30 04:44:00.839618 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-75c04203-2323-466e-8c51-402f4abedf78 req-6113ec0d-b4e0-421e-b057-5f4b9082964a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292824 Aug 30 04:44:00.841824 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3082/6098] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:01.230799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:01.232004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:01.240438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:01.241162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:01.242039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:01.243121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:01.244004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:01.244688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:01.290478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:01.291122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:01.291658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:01.292261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lazy-loading 'fault' on Instance uuid 373330c3-965c-436b-9b77-fdab4f2bdb89 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:44:01.384430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:01.398145 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bddf28d2-7c65-44d7-b684-423e24527e14 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 200 len: 1356 microversion: 2.1 time: 0.171323 Aug 30 04:44:01.401925 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3017/6099] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:01 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 1356 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:02.429724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:02.433595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 373330c3-965c-436b-9b77-fdab4f2bdb89] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:02.460622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:02.461133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:02.463745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:02.468070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:02.470866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:02.472338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:02.515726 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] HTTP exception thrown: Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 could not be found. Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Request method failure captured: Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 HTTP/1.1 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZP7ChyUww-hUkzvipQWnIDpNCPmoy98A3_91tBaDyGm4CFEC8j1-k4mA_n7DBIbWV-90qD9gx-2bD1g3Wq92ImlI-dgcvlnI0RV7IMY4vRA8qPZrm5U3NAwJasx4XwibSfnEvotZqfz96ADH5quJhdHipFRAl7bQxI4S9Xq1C22I7U Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94a6f1ffe69e4a99927df0ef201e6468", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}] Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 13b0fd630f614ae4a6ca14d083d4d2d1 Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 could not be found. Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '373330c3-965c-436b-9b77-fdab4f2bdb89'} Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 could not be found. Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 could not be found. Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:44:02.520979 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 could not be found. Aug 30 04:44:02.526104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:44:02.530314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Returning 404 to user: Instance 373330c3-965c-436b-9b77-fdab4f2bdb89 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:44:02.531867 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f3f1daa0-7b2e-491c-855a-c85f9159b4f2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89" status: 404 len: 111 microversion: 2.1 time: 0.115561 Aug 30 04:44:02.534437 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3083/6100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:02 2022] GET /compute/v2.1/servers/373330c3-965c-436b-9b77-fdab4f2bdb89 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:44:09.948113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f4db1c1e-5b4c-400b-8cf1-e982354c6e85 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '.version_select at 0x7fe96ad38a60>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:10.000686 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f4db1c1e-5b4c-400b-8cf1-e982354c6e85 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1506553375" status: 202 len: 0 microversion: 2.1 time: 0.057502 Aug 30 04:44:10.002524 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3018/6101] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Aug 30 04:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1506553375 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:44:10.060631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38213003-1272-42ed-a891-67b5606a86c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: .version_select at 0x7fe96a2ee310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1149982284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBQG9SKsRYErhy6zVAaNd5VQyqig7BlWr3uwhA2bB75ASyWWHk/L6k/eyoOteFA3OSm0QUnz7wtEu6X0jelrrsng4dfhqDUedrsLR/GIJmvFe443RHCIxBLh+8oh3mKJA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:10.086342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-38213003-1272-42ed-a891-67b5606a86c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:44:10.098277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-38213003-1272-42ed-a891-67b5606a86c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:44:10.154903 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38213003-1272-42ed-a891-67b5606a86c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.094474 Aug 30 04:44:10.156226 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3084/6102] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:44:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:24.470019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1368752945", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "17b57c57-b601-4249-b844-fb85c4882742"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1149982284", "security_groups": [{"name": "tempest-secgroup-smoke-691203574"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:24.510829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:24.513044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:24.744829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] validate_networks() for [('17b57c57-b601-4249-b844-fb85c4882742', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:44:25.703882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:44:25.705099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:44:25.705813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:44:25.706442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:44:25.707185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:44:25.723486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:25.724372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:25.725053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:25.726063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:25.726760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:25.727422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:25.777210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:44:25.785203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:44:25.830085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:44:25.832912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:44:25.997799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a68e00c-da11-46d9-bc0f-9c2b074c99e6 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.531707 Aug 30 04:44:26.002448 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3019/6103] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:44:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:44:26.015935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17e3b852-080b-4bff-9e8d-9f21136aa00c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:26.017295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17e3b852-080b-4bff-9e8d-9f21136aa00c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:26.026843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=49 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:26.041127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:26.044433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:26.234306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17e3b852-080b-4bff-9e8d-9f21136aa00c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:26.247984 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17e3b852-080b-4bff-9e8d-9f21136aa00c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1267 microversion: 2.1 time: 0.236877 Aug 30 04:44:26.268780 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3085/6104] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:26 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:27.274315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:27.274909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:27.286908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:27.287452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:27.287831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:27.288540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:27.289000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:27.313240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:27.484277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:27.498490 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c546a32-6247-4acb-965b-b8717198412c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1271 microversion: 2.1 time: 0.227480 Aug 30 04:44:27.499609 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3020/6105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:27 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1271 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:28.522819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:28.523398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:28.543462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:28.543962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:28.551762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:28.553052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:28.553781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:28.554697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:28.757573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:28.770434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-67f40db3-25f9-4f5d-8e85-3accaf6d3fe2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1337 microversion: 2.1 time: 0.252148 Aug 30 04:44:28.773214 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3086/6106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:28 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1337 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:29.793848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:29.794672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:29.802904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:29.814785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:29.815344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:29.816216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:29.820796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:29.821838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:30.095043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:30.111869 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec057b76-96af-4956-a8e9-791fca5a8570 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1325 microversion: 2.1 time: 0.322062 Aug 30 04:44:30.133101 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3021/6107] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:29 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:31.133094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:31.134259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:31.150817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:31.151474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:31.151991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:31.152758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:31.153225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:31.153693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:31.609913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:31.619914 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25e12f49-3ca9-46d0-a896-9d3fa31f4404 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1392 microversion: 2.1 time: 0.491620 Aug 30 04:44:31.629234 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3087/6108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:31 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:32.654011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:32.654608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:32.691771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:32.695552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:32.698142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:32.704948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:32.705683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:32.706488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:32.804568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6fe63215-59da-4334-bfba-15cc826c47f7 req-73efa749-c052-4109-ac5d-2a29b8a7e28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19374624-2813-461e-8b68-6da1cf810cbc", "tag": "04b7bc67-72f2-4878-8616-5efc77cabe48"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:32.820077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6fe63215-59da-4334-bfba-15cc826c47f7 req-73efa749-c052-4109-ac5d-2a29b8a7e28e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:32.821017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6fe63215-59da-4334-bfba-15cc826c47f7 req-73efa749-c052-4109-ac5d-2a29b8a7e28e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:32.821894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6fe63215-59da-4334-bfba-15cc826c47f7 req-73efa749-c052-4109-ac5d-2a29b8a7e28e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:32.850097 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6fe63215-59da-4334-bfba-15cc826c47f7 req-73efa749-c052-4109-ac5d-2a29b8a7e28e service nova] Creating event network-changed:04b7bc67-72f2-4878-8616-5efc77cabe48 for instance 19374624-2813-461e-8b68-6da1cf810cbc on n-h2-854925-5 Aug 30 04:44:32.862083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6fe63215-59da-4334-bfba-15cc826c47f7 req-73efa749-c052-4109-ac5d-2a29b8a7e28e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062132 Aug 30 04:44:32.867023 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3088/6109] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:44:33.152391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:33.171046 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-855b50b8-a2c4-47b7-aa6e-db99a340c7f8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1392 microversion: 2.1 time: 0.515898 Aug 30 04:44:33.173658 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3022/6110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:32 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1392 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:34.200619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:34.202993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:34.220018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:34.223440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:34.228560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:34.238353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:34.239101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:34.239922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:34.763499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:34.772452 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f923cc08-2e8f-49ac-bae8-e821bb59e609 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1392 microversion: 2.1 time: 0.578269 Aug 30 04:44:34.778151 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3089/6111] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:34 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1392 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:35.796370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:35.800132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:35.810696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:35.819186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:35.829653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:35.835840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:35.836476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:35.837517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:35.838231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:35.838988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:36.344227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:36.352618 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc100b4d-2174-4e35-89f3-a8aa803f8422 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1392 microversion: 2.1 time: 0.560450 Aug 30 04:44:36.369450 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3023/6112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:35 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1392 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:37.386706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:37.388392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:37.397673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:44:37.403024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:37.405181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:37.407943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:37.407943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:37.407943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:37.407943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:37.736089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:37.747216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d2098a4-d9db-4b55-a64a-032c9e62ddd7 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1392 microversion: 2.1 time: 0.373720 Aug 30 04:44:37.750061 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3090/6113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:37 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1392 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:38.771586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:38.772249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:38.789192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:38.789729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:38.790170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:38.810472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:38.812693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:38.813187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:39.272405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:39.292277 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4a3714cc-6085-48fa-abd0-010f3c889071 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1392 microversion: 2.1 time: 0.520388 Aug 30 04:44:39.295185 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3024/6114] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:38 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1392 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:39.667463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e219ea61-e8ea-4d02-9c11-c2a5a31942f5 req-df6ec774-4391-4472-96e1-123a5cfa3a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19374624-2813-461e-8b68-6da1cf810cbc", "name": "network-vif-plugged", "status": "completed", "tag": "04b7bc67-72f2-4878-8616-5efc77cabe48"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:39.691459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e219ea61-e8ea-4d02-9c11-c2a5a31942f5 req-df6ec774-4391-4472-96e1-123a5cfa3a9e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:39.701472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e219ea61-e8ea-4d02-9c11-c2a5a31942f5 req-df6ec774-4391-4472-96e1-123a5cfa3a9e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:39.702098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e219ea61-e8ea-4d02-9c11-c2a5a31942f5 req-df6ec774-4391-4472-96e1-123a5cfa3a9e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:39.742397 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e219ea61-e8ea-4d02-9c11-c2a5a31942f5 req-df6ec774-4391-4472-96e1-123a5cfa3a9e service nova] Creating event network-vif-plugged:04b7bc67-72f2-4878-8616-5efc77cabe48 for instance 19374624-2813-461e-8b68-6da1cf810cbc on n-h2-854925-5 Aug 30 04:44:39.748734 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e219ea61-e8ea-4d02-9c11-c2a5a31942f5 req-df6ec774-4391-4472-96e1-123a5cfa3a9e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474287 Aug 30 04:44:39.750215 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3091/6115] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:40.315700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:40.316244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:40.329818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:40.330619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:40.331288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:40.332434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:40.334063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:40.334685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:41.557967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:41.572147 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a5f6195-e8ee-445a-8a86-0d98c23f7257 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1392 microversion: 2.1 time: 1.261512 Aug 30 04:44:41.572868 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3025/6116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:40 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1392 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:42.597508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:42.599172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:42.616358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:42.616885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:42.617376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:42.625106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:42.625662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:42.626129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:42.990535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:43.001156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ed4a5d2-dd64-4572-8234-83d999ac277b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1564 microversion: 2.1 time: 0.408974 Aug 30 04:44:43.002505 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3092/6117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:42 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1564 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:43.024797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:43.025382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:43.043625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:43.044151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:43.044663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:43.045468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:43.046265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:43.046699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:43.348896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:43.361837 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea249d37-7616-4e8d-bdad-a33824126962 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1564 microversion: 2.1 time: 0.341821 Aug 30 04:44:43.370381 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3026/6118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:43 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1564 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:44:46.823470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:44:46.824153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:44:46.836286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:46.837994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:46.840095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:46.841016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:46.842448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:46.843911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:46.850779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-016d1e11-89bf-40ac-bc80-2a0e01c9a6ee req-5ef37859-3867-47a3-82d0-c7bd548091d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19374624-2813-461e-8b68-6da1cf810cbc", "tag": "04b7bc67-72f2-4878-8616-5efc77cabe48"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:44:46.869886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-016d1e11-89bf-40ac-bc80-2a0e01c9a6ee req-5ef37859-3867-47a3-82d0-c7bd548091d4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:44:46.876608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-016d1e11-89bf-40ac-bc80-2a0e01c9a6ee req-5ef37859-3867-47a3-82d0-c7bd548091d4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:44:46.877465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-016d1e11-89bf-40ac-bc80-2a0e01c9a6ee req-5ef37859-3867-47a3-82d0-c7bd548091d4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:44:46.901037 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-016d1e11-89bf-40ac-bc80-2a0e01c9a6ee req-5ef37859-3867-47a3-82d0-c7bd548091d4 service nova] Creating event network-changed:04b7bc67-72f2-4878-8616-5efc77cabe48 for instance 19374624-2813-461e-8b68-6da1cf810cbc on n-h2-854925-5 Aug 30 04:44:46.909243 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-016d1e11-89bf-40ac-bc80-2a0e01c9a6ee req-5ef37859-3867-47a3-82d0-c7bd548091d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063031 Aug 30 04:44:46.910469 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3027/6119] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:44:48.013146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:44:48.025831 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-125ba30d-fef4-4473-afeb-3863ab12b2fa tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1564 microversion: 2.1 time: 1.203935 Aug 30 04:44:48.026649 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3093/6120] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:44:46 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1564 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:07.477428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:07.479905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:07.494445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.495395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=46 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:07.519981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:07.529536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:07.530401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:07.531355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:07.532523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:07.533085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:07.636872 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e905f069-4bd1-478d-8ed2-89080cba706e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action" status: 200 len: 24538 microversion: 2.1 time: 0.164360 Aug 30 04:45:07.644331 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3028/6121] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:07 2022] POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action => generated 24538 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:45:14.039510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:14.040162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:14.046088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=20 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:14.047416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=40 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:14.049544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:14.073921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:14.078181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:14.079178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:14.080297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:14.081673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:14.445252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:14.455998 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-71e78f84-201e-4311-bd66-fbe3d79f7c69 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1683 microversion: 2.1 time: 0.420995 Aug 30 04:45:14.469987 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3094/6122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:14 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1683 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:14.670938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:14.673268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:14.691950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:14.692496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:14.692939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:14.693674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:14.698782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:14.699441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:14.802366 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9fcab6d0-fe0e-4e8e-9f27-08c8a4519635 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action" status: 200 len: 32606 microversion: 2.1 time: 0.135498 Aug 30 04:45:14.803699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3029/6123] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:14 2022] POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action => generated 32606 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:45:15.006040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:15.006663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:15.019138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:15.019634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:15.020072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:15.021566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:15.022021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:15.022478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:15.259275 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-88257a62-9a0b-4981-a5e7-883305c04543 tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1834 microversion: 2.1 time: 0.257489 Aug 30 04:45:15.262089 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3095/6124] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:15 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1834 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:15.296064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:15.303234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:15.314735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:15.315525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:15.316188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:15.318198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:15.318865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:15.319481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:15.421461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lazy-loading 'flavor' on Instance uuid 19374624-2813-461e-8b68-6da1cf810cbc {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:45:15.438082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Going to try to live migrate instance to another host {{(pid=122402) live_migrate /opt/stack/nova/nova/compute/api.py:5480}} Aug 30 04:45:19.041862 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-853697f8-28ae-4445-ac37-5ecff7d8564d tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action" status: 202 len: 0 microversion: 2.1 time: 3.752435 Aug 30 04:45:19.044469 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3030/6125] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:15 2022] POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action => generated 0 bytes in 3757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:45:19.055974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:19.056778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:19.093240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:19.094329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:19.095033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:19.096123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:19.097877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:19.098945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:19.445274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:19.455578 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-39415d9d-b918-4f5e-a208-ed5c7d3c1726 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.404507 Aug 30 04:45:19.484961 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3096/6126] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:19 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:20.478755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:20.479387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:20.497744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:20.498602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:20.499068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:20.500163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:20.500642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:20.501081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:20.891079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:20.903807 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f60f90fb-9c81-4b6b-a863-92d265e2fdeb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.429071 Aug 30 04:45:20.904447 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3031/6127] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:20 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:21.128306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f4268ce3-4f88-4990-9060-200024f57a7b req-14fa4884-27d3-49ff-8f66-443647aaf6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19374624-2813-461e-8b68-6da1cf810cbc", "name": "network-vif-unplugged", "status": "completed", "tag": "04b7bc67-72f2-4878-8616-5efc77cabe48"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:21.154393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f4268ce3-4f88-4990-9060-200024f57a7b req-14fa4884-27d3-49ff-8f66-443647aaf6c5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:21.155843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f4268ce3-4f88-4990-9060-200024f57a7b req-14fa4884-27d3-49ff-8f66-443647aaf6c5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:21.156468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f4268ce3-4f88-4990-9060-200024f57a7b req-14fa4884-27d3-49ff-8f66-443647aaf6c5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:21.189136 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f4268ce3-4f88-4990-9060-200024f57a7b req-14fa4884-27d3-49ff-8f66-443647aaf6c5 service nova] Creating event network-vif-unplugged:04b7bc67-72f2-4878-8616-5efc77cabe48 for instance 19374624-2813-461e-8b68-6da1cf810cbc on n-h2-854925-5 Aug 30 04:45:21.204727 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f4268ce3-4f88-4990-9060-200024f57a7b req-14fa4884-27d3-49ff-8f66-443647aaf6c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081006 Aug 30 04:45:21.209765 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3097/6128] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:45:21.929820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:21.930532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:21.942682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:21.943175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:21.943620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:21.944324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:21.944787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:21.957219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:22.406153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:22.418440 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aea78205-bf2d-49d0-a847-141a7d86f9fc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.492324 Aug 30 04:45:22.423040 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3032/6129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:21 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:23.443115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:23.444389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:23.451200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:23.452033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:23.452841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:23.453855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:23.454526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:23.455247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:23.620872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-dc009af3-351c-491e-8739-baa7cee4e74f req-1faa28d2-5870-4524-9a1c-6dd7216e8822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19374624-2813-461e-8b68-6da1cf810cbc", "tag": "04b7bc67-72f2-4878-8616-5efc77cabe48"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:23.632731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-dc009af3-351c-491e-8739-baa7cee4e74f req-1faa28d2-5870-4524-9a1c-6dd7216e8822 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:23.633221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-dc009af3-351c-491e-8739-baa7cee4e74f req-1faa28d2-5870-4524-9a1c-6dd7216e8822 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:23.633706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-dc009af3-351c-491e-8739-baa7cee4e74f req-1faa28d2-5870-4524-9a1c-6dd7216e8822 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:23.645898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-dc009af3-351c-491e-8739-baa7cee4e74f req-1faa28d2-5870-4524-9a1c-6dd7216e8822 service nova] Creating event network-changed:04b7bc67-72f2-4878-8616-5efc77cabe48 for instance 19374624-2813-461e-8b68-6da1cf810cbc on n-h2-854925-5 Aug 30 04:45:23.651153 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-dc009af3-351c-491e-8739-baa7cee4e74f req-1faa28d2-5870-4524-9a1c-6dd7216e8822 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034052 Aug 30 04:45:23.651948 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3033/6130] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:45:23.849652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:23.865978 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-928da86c-48c6-47e1-a959-ee371dba3fb3 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.426267 Aug 30 04:45:23.867688 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3098/6131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:23 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:24.891467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:24.894085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:24.911314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:24.914961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:24.915847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:24.917461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:24.919475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:24.920560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:25.198861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:25.214597 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-62c51a90-98f7-4297-aec5-7c5cce1f17ef tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.328143 Aug 30 04:45:25.218949 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3034/6132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:24 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:26.240553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:26.241462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:26.256106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:26.257527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:26.258398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:26.259366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:26.260112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:26.261357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:27.072048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:27.081059 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1f5f8d3-b948-4cf2-857c-efee2c317d60 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.846895 Aug 30 04:45:27.089590 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3099/6133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:26 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:28.112526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:28.113150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:28.125162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:28.125935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:28.126802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:28.127944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:28.128617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:28.129528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:28.430360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:28.439124 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f34217c-8711-4fcc-9b51-b3b5a1bdbb8e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.331086 Aug 30 04:45:28.440871 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3035/6134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:28 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:29.468983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:29.470099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:29.489573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:29.489999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:29.492920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:29.494013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:29.495808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:29.496814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:29.824118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:29.835861 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83ad0007-46ba-4d65-8f44-3e28c24ebc72 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.373349 Aug 30 04:45:29.835861 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3100/6135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:29 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:30.858943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:30.859567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:30.873277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:30.873819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:30.874274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:30.879178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:30.879947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:30.880198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:31.207832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:31.218279 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18b2f3ab-1b4b-4b87-9473-7fd029a2e279 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.361102 Aug 30 04:45:31.218910 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3036/6136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:30 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:32.250003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:32.251284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:32.273490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:32.274494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:32.275097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:32.276003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:32.276668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:32.277281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:32.604732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:32.634619 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f7c85d4-6b4b-4220-9775-713f79ad590e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1693 microversion: 2.1 time: 0.391878 Aug 30 04:45:32.649037 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3101/6137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:32 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1693 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:33.656138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:33.656767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:33.684273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:33.684772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:33.685217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:33.685960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:33.686420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:33.686856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:34.177652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:34.185746 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3aca7b0-23ed-40a2-9df2-35a62d2ecf44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1683 microversion: 2.1 time: 0.533503 Aug 30 04:45:34.198106 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3037/6138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:33 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1683 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:34.228202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:34.228590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:34.240181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:34.240765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:34.241221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:34.242897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:34.244409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:34.245951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:34.646133 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f22891b4-5dbf-414a-a3e7-ea76bd9059bf tempest-TestNetworkAdvancedServerOps-2021500741 tempest-TestNetworkAdvancedServerOps-2021500741-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1834 microversion: 2.1 time: 0.425442 Aug 30 04:45:34.647203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3102/6139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:34 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1834 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:34.672863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:34.677926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:34.686746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:34.687471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:34.688065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:34.688955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:34.689878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:34.690447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:34.916041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:34.975031 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0603b95d-161f-4836-9cca-8fcab9809965 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1683 microversion: 2.1 time: 0.306422 Aug 30 04:45:34.976142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3038/6140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:34 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1683 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:37.190596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:37.193196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:37.210036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:37.212911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:37.213388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:37.214147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:37.214609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:37.215044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:37.365787 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6920f6a1-52dc-4eda-83a1-ccdcfbea02c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action" status: 200 len: 38643 microversion: 2.1 time: 0.179874 Aug 30 04:45:37.367447 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3103/6141] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:45:37 2022] POST /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc/action => generated 38643 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:45:39.664490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:39.665653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:39.667987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=25 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:39.683948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:39.695266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e3cc4329-a150-471b-9d36-c4fe5e2ef0fc req-5aa20495-14a9-4b59-b0f7-16afe7fbf44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19374624-2813-461e-8b68-6da1cf810cbc", "tag": "04b7bc67-72f2-4878-8616-5efc77cabe48"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:39.696980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:39.699294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:39.700746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:39.701228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:39.701703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:39.722961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:39.726320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e3cc4329-a150-471b-9d36-c4fe5e2ef0fc req-5aa20495-14a9-4b59-b0f7-16afe7fbf44c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:39.735293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e3cc4329-a150-471b-9d36-c4fe5e2ef0fc req-5aa20495-14a9-4b59-b0f7-16afe7fbf44c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:39.737064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e3cc4329-a150-471b-9d36-c4fe5e2ef0fc req-5aa20495-14a9-4b59-b0f7-16afe7fbf44c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:39.782167 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e3cc4329-a150-471b-9d36-c4fe5e2ef0fc req-5aa20495-14a9-4b59-b0f7-16afe7fbf44c service nova] Creating event network-changed:04b7bc67-72f2-4878-8616-5efc77cabe48 for instance 19374624-2813-461e-8b68-6da1cf810cbc on n-h1-854925-5 Aug 30 04:45:39.803973 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e3cc4329-a150-471b-9d36-c4fe5e2ef0fc req-5aa20495-14a9-4b59-b0f7-16afe7fbf44c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112421 Aug 30 04:45:39.808210 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3104/6142] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:45:39.817350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:45:40.147805 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-75b3572f-4ec6-4baa-b767-bc39ba564e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 204 len: 0 microversion: 2.1 time: 0.488015 Aug 30 04:45:40.149059 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3039/6143] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:45:39 2022] DELETE /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:45:40.160231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:40.161089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:40.173075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:40.177536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:40.178113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:40.180375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:40.182272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:40.182801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:41.359853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:41.377929 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b62c0838-1338-488c-82c7-e46f81cfa36c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1689 microversion: 2.1 time: 1.220639 Aug 30 04:45:41.380819 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3105/6144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:40 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1689 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:45:42.423651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:42.425303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:42.439310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:42.440045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:42.440723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:42.442895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:42.443731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:42.444331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:42.573669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a0994863-e0b1-42f1-8382-be43257196a8 req-0c65d5dd-05f8-4ebf-8ed4-3a9b59b590f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19374624-2813-461e-8b68-6da1cf810cbc", "name": "network-vif-deleted", "tag": "04b7bc67-72f2-4878-8616-5efc77cabe48"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:42.603615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a0994863-e0b1-42f1-8382-be43257196a8 req-0c65d5dd-05f8-4ebf-8ed4-3a9b59b590f2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:42.604106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a0994863-e0b1-42f1-8382-be43257196a8 req-0c65d5dd-05f8-4ebf-8ed4-3a9b59b590f2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:42.604541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a0994863-e0b1-42f1-8382-be43257196a8 req-0c65d5dd-05f8-4ebf-8ed4-3a9b59b590f2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:42.656145 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a0994863-e0b1-42f1-8382-be43257196a8 req-0c65d5dd-05f8-4ebf-8ed4-3a9b59b590f2 service nova] Creating event network-vif-deleted:04b7bc67-72f2-4878-8616-5efc77cabe48 for instance 19374624-2813-461e-8b68-6da1cf810cbc on n-h1-854925-5 Aug 30 04:45:42.665700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a0994863-e0b1-42f1-8382-be43257196a8 req-0c65d5dd-05f8-4ebf-8ed4-3a9b59b590f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098277 Aug 30 04:45:42.669927 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3106/6145] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:45:42.764662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:45:42.778787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-02ee9a51-06aa-4e62-8261-d0f24d396d1a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 200 len: 1622 microversion: 2.1 time: 0.359842 Aug 30 04:45:42.782715 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3040/6146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:42 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 1622 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:45:43.807803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:43.809221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 19374624-2813-461e-8b68-6da1cf810cbc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:45:43.840817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:43.841581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:43.842442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:43.843384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:45:43.844242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:45:43.845546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:45:43.864786 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] HTTP exception thrown: Instance 19374624-2813-461e-8b68-6da1cf810cbc could not be found. Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Request method failure captured: Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc HTTP/1.1 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZP7ChyUww-hUkzvipQWnIDpNCPmoy98A3_91tBaDyGm4CFEC8j1-k4mA_n7DBIbWV-90qD9gx-2bD1g3Wq92ImlI-dgcvlnI0RV7IMY4vRA8qPZrm5U3NAwJasx4XwibSfnEvotZqfz96ADH5quJhdHipFRAl7bQxI4S9Xq1C22I7U Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94a6f1ffe69e4a99927df0ef201e6468", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}] Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 13b0fd630f614ae4a6ca14d083d4d2d1 Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 19374624-2813-461e-8b68-6da1cf810cbc could not be found. Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '19374624-2813-461e-8b68-6da1cf810cbc'} Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19374624-2813-461e-8b68-6da1cf810cbc could not be found. Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19374624-2813-461e-8b68-6da1cf810cbc could not be found. Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:45:43.872727 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19374624-2813-461e-8b68-6da1cf810cbc could not be found. Aug 30 04:45:43.877177 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:45:43.878925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Returning 404 to user: Instance 19374624-2813-461e-8b68-6da1cf810cbc could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:45:43.880791 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51c17137-4a97-4c02-9aff-cd49a69fd686 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc" status: 404 len: 111 microversion: 2.1 time: 0.077844 Aug 30 04:45:43.881936 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3107/6147] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:45:43 2022] GET /compute/v2.1/servers/19374624-2813-461e-8b68-6da1cf810cbc => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:45:50.725943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e2b88163-4f03-4cb9-b912-c1af9b4d7e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '.version_select at 0x7fe96a024310>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:45:50.782383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e2b88163-4f03-4cb9-b912-c1af9b4d7e70 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1149982284" status: 202 len: 0 microversion: 2.1 time: 0.060892 Aug 30 04:45:50.783374 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3041/6148] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Aug 30 04:45:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1149982284 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:45:50.824192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dcf45d1b-9f9e-4cda-b012-cc59d6243a18 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: .version_select at 0x7fe96a350040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-984393577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/1Y0f7RLZYWqsIukz//6ASueqVcd8/VzDv+OaUvFBr3F728LbYbYC3POTvm/263M1nAEHeJreW4z2hHvAqybX2rogTEuhWwpSDftxsjN41r31tI4/nA5i1zH/m9dxWfA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:45:50.867996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=29 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:45:50.898212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-dcf45d1b-9f9e-4cda-b012-cc59d6243a18 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:45:50.907420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-dcf45d1b-9f9e-4cda-b012-cc59d6243a18 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:45:50.940802 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dcf45d1b-9f9e-4cda-b012-cc59d6243a18 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.129188 Aug 30 04:45:50.941443 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3108/6149] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:45:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:04.245209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:04.246267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:04.265453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-779824313", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "4e87ac23-6eca-41bc-9709-99f5dd2cab6c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-984393577", "security_groups": [{"name": "tempest-secgroup-smoke-1579583608"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:04.564693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] validate_networks() for [('4e87ac23-6eca-41bc-9709-99f5dd2cab6c', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:46:06.039725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:46:06.040367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:46:06.040755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:46:06.041273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:46:06.041795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:46:06.059272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:06.062058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:06.062765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:06.063768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:06.067196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:06.067986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:06.118665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:46:06.134588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Getting quotas for user 13b0fd630f614ae4a6ca14d083d4d2d1 and project 94a6f1ffe69e4a99927df0ef201e6468. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:46:06.169723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:46:06.174926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:46:06.330717 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f265bda6-91cf-4c2e-a804-36bdcb5d5b44 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.087202 Aug 30 04:46:06.340247 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3042/6150] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:46:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:46:06.341619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=66 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:06.343204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:06.344097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:06.349138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-980ffeba-8124-48b3-90fe-0ccbd3c58f8f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:06.349812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-980ffeba-8124-48b3-90fe-0ccbd3c58f8f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:06.588890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-980ffeba-8124-48b3-90fe-0ccbd3c58f8f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:06.596918 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-980ffeba-8124-48b3-90fe-0ccbd3c58f8f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1265 microversion: 2.1 time: 0.256892 Aug 30 04:46:06.597788 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3109/6151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:06 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:07.619595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:07.620967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:07.644224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:07.645460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:07.661710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:07.663022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:07.664644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:07.665085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:07.863172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:07.886194 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1d5c6bc-eab3-46ba-929d-06141aa04f61 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1269 microversion: 2.1 time: 0.271691 Aug 30 04:46:07.902562 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3043/6152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:07 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1269 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:08.935670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:08.936302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:08.994580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:08.995187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:08.995636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:08.996394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:08.996943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:08.997465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:09.536963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:09.553107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5564c6c6-ae53-4922-8052-51b861727293 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1323 microversion: 2.1 time: 0.627266 Aug 30 04:46:09.575727 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3110/6153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:08 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1323 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:10.586109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:10.586737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:10.596110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:10.596612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:10.597056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:10.604731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:10.606176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:10.606882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:10.737045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:10.751705 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b1aba2e-3da9-4864-bda2-aece78afdd7c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1323 microversion: 2.1 time: 0.169461 Aug 30 04:46:10.771365 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3044/6154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:10 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:11.802072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:11.802705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:11.814869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:11.824197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:11.824580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:11.827585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:11.830249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:11.830897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:12.565994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:12.580027 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b0f7c65-62db-49f0-bdf8-69c2e3057f0a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1391 microversion: 2.1 time: 0.787901 Aug 30 04:46:12.581658 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3111/6155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:11 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1391 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:13.331276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5fa071b6-8468-4fd1-9dc8-002fbb34d804 req-9549e33c-0c1f-4ab5-abeb-6e2bddfe8a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5976e2-46bd-4380-bf1c-bb18e915a030", "tag": "76f67f03-bbb3-447c-b837-98e248fae99c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:13.367114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5fa071b6-8468-4fd1-9dc8-002fbb34d804 req-9549e33c-0c1f-4ab5-abeb-6e2bddfe8a68 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:13.367871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5fa071b6-8468-4fd1-9dc8-002fbb34d804 req-9549e33c-0c1f-4ab5-abeb-6e2bddfe8a68 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:13.368082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5fa071b6-8468-4fd1-9dc8-002fbb34d804 req-9549e33c-0c1f-4ab5-abeb-6e2bddfe8a68 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:13.400919 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5fa071b6-8468-4fd1-9dc8-002fbb34d804 req-9549e33c-0c1f-4ab5-abeb-6e2bddfe8a68 service nova] Creating event network-changed:76f67f03-bbb3-447c-b837-98e248fae99c for instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 on n-h2-854925-5 Aug 30 04:46:13.427291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5fa071b6-8468-4fd1-9dc8-002fbb34d804 req-9549e33c-0c1f-4ab5-abeb-6e2bddfe8a68 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.469857 Aug 30 04:46:13.440402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3045/6156] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:13.612946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:13.614807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:13.634977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:13.637271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:13.642176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:13.643274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:13.649448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:13.652284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:14.010934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:14.026252 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fdf35c16-bf3e-4df1-9f50-1bdee5462a58 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1391 microversion: 2.1 time: 0.424076 Aug 30 04:46:14.027527 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3112/6157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:13 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1391 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:15.049574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:15.050439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:15.067908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:15.072278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:15.073787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:15.074677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:15.075944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:15.080005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:15.550187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:15.559041 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ceaa44b-0a7e-438c-9fed-724e79aab1c2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1391 microversion: 2.1 time: 0.515198 Aug 30 04:46:15.559640 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3046/6158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:15 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1391 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:16.580385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:16.581006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:16.595460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:16.601689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:16.602369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:16.603306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:16.604087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:16.604948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:16.605653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:16.996241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:17.009916 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-06539160-aac3-4efb-8262-973bd97c0359 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1391 microversion: 2.1 time: 0.433595 Aug 30 04:46:17.015211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3113/6159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:16 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1391 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:18.040595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:18.041888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:18.048979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:18.050265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:18.052531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:18.053192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:18.054139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:18.055022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:18.055858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:18.056457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:18.332867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:18.394036 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1151d78d-012a-4f34-b44a-0d6300275089 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1391 microversion: 2.1 time: 0.354434 Aug 30 04:46:18.396010 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3047/6160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:18 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1391 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:19.124818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f5a982aa-a931-4561-9ced-16df4e1d970e req-c5f3fd8e-d990-465b-831c-e50f7421b182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5976e2-46bd-4380-bf1c-bb18e915a030", "name": "network-vif-plugged", "status": "completed", "tag": "76f67f03-bbb3-447c-b837-98e248fae99c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:19.148972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5a982aa-a931-4561-9ced-16df4e1d970e req-c5f3fd8e-d990-465b-831c-e50f7421b182 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:19.150490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5a982aa-a931-4561-9ced-16df4e1d970e req-c5f3fd8e-d990-465b-831c-e50f7421b182 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:19.151254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5a982aa-a931-4561-9ced-16df4e1d970e req-c5f3fd8e-d990-465b-831c-e50f7421b182 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:19.184810 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f5a982aa-a931-4561-9ced-16df4e1d970e req-c5f3fd8e-d990-465b-831c-e50f7421b182 service nova] Creating event network-vif-plugged:76f67f03-bbb3-447c-b837-98e248fae99c for instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 on n-h2-854925-5 Aug 30 04:46:19.192479 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f5a982aa-a931-4561-9ced-16df4e1d970e req-c5f3fd8e-d990-465b-831c-e50f7421b182 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073492 Aug 30 04:46:19.195701 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3114/6161] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:19.420448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:19.422271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:19.436737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:19.439142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:19.439867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:19.446635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:19.448706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:19.449890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:19.788578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:19.800717 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-245905e7-d85e-4f38-8a2a-73a21f2989b1 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1391 microversion: 2.1 time: 0.383774 Aug 30 04:46:19.814611 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3048/6162] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:19 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1391 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:20.825203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:20.826084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:20.834475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:20.835194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:20.836156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:20.837107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:20.837817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:20.838393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:21.143132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:21.157303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83a8e538-d73f-4011-ac0d-094359999edc tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1562 microversion: 2.1 time: 0.334828 Aug 30 04:46:21.173220 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3115/6163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:20 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1562 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:21.190740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:21.191370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:21.205654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:21.226938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:21.227768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:21.232564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:21.233126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:21.233614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:21.508395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:21.520495 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7ae4cd3d-3bfa-46db-9de4-3f7bdd0d0bda tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1562 microversion: 2.1 time: 0.338182 Aug 30 04:46:21.522976 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3049/6164] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:21 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1562 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:28.657478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:28.658129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:28.666072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-138084f2-b681-4e56-853f-771251af8450 req-bf093902-7f31-4d01-a213-db08aff7a3ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5976e2-46bd-4380-bf1c-bb18e915a030", "tag": "76f67f03-bbb3-447c-b837-98e248fae99c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:28.684974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:28.695507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:28.696090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:28.696843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:28.697305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:28.697767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:28.698446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-138084f2-b681-4e56-853f-771251af8450 req-bf093902-7f31-4d01-a213-db08aff7a3ff service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:28.698934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-138084f2-b681-4e56-853f-771251af8450 req-bf093902-7f31-4d01-a213-db08aff7a3ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:28.699369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-138084f2-b681-4e56-853f-771251af8450 req-bf093902-7f31-4d01-a213-db08aff7a3ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:28.734308 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-138084f2-b681-4e56-853f-771251af8450 req-bf093902-7f31-4d01-a213-db08aff7a3ff service nova] Creating event network-changed:76f67f03-bbb3-447c-b837-98e248fae99c for instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 on n-h2-854925-5 Aug 30 04:46:28.750953 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-138084f2-b681-4e56-853f-771251af8450 req-bf093902-7f31-4d01-a213-db08aff7a3ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088451 Aug 30 04:46:28.751585 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3050/6165] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:46:29.304659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:29.313522 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9ca9277e-c8c0-47d2-910d-2a71a020dd09 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1562 microversion: 2.1 time: 0.659946 Aug 30 04:46:29.331104 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3116/6166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:28 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1562 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:29.624382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-977255640", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "c9da2cff-bcc5-4f01-82e4-11e7757ae282"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:29.698306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] validate_networks() for [('c9da2cff-bcc5-4f01-82e4-11e7757ae282', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:46:30.976903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:46:30.977501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:46:30.978030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:46:30.978619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:46:30.979031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:46:30.989596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:30.990091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:30.990527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:30.991594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:30.992055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:30.992645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:31.021746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Getting quotas for project 754a747b965249349b3a850158553fd6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:46:31.030540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Getting quotas for user eabb2f9c36d7457e97343142e2487ccf and project 754a747b965249349b3a850158553fd6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:46:31.052071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:46:31.056422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:46:31.120933 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3db90a20-1295-4454-93e2-2eaa894f573f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504104 Aug 30 04:46:31.135359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-209c9a5f-ff75-4195-b69c-5684e6d9be61 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:31.136703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-209c9a5f-ff75-4195-b69c-5684e6d9be61 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:31.143849 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3051/6167] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:46:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:46:31.219621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-209c9a5f-ff75-4195-b69c-5684e6d9be61 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:31.232780 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-209c9a5f-ff75-4195-b69c-5684e6d9be61 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1218 microversion: 2.1 time: 0.101957 Aug 30 04:46:31.233627 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3117/6168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:31 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:32.254925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:32.255725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:32.267954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:32.278363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:32.278955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:32.279812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:32.280384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:32.280918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:32.375930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:32.385917 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6163c18f-a0c8-48ae-87c8-d925e228b89f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1270 microversion: 2.1 time: 0.135292 Aug 30 04:46:32.387800 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3052/6169] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:32 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:33.408556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:33.409829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:33.418712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:33.419493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:33.419935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:33.420797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:33.421443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:33.422028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:33.560258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:33.572527 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c2789b6-10df-401e-a0d9-360af74035e5 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1276 microversion: 2.1 time: 0.168109 Aug 30 04:46:33.598945 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3118/6170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:33 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:34.595859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:34.599744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:34.607163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:34.610351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:34.611097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:34.611961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:34.614034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:34.615280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:34.617791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:34.627904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=51 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:34.996969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:35.009914 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da21692c-a9f8-4394-a80d-959f4f3d1155 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.418627 Aug 30 04:46:35.012848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3053/6171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:34 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:35.462778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6a72f8ac-7e12-4c74-9ceb-8c42c84dff51 req-e377f869-bd9c-4a13-8e3d-246341ef044b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a0491c-d261-4832-8e5e-e8694309e410", "tag": "54f57f56-cfff-4e64-8d72-9dd02b6c217b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:35.507427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6a72f8ac-7e12-4c74-9ceb-8c42c84dff51 req-e377f869-bd9c-4a13-8e3d-246341ef044b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:35.508303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6a72f8ac-7e12-4c74-9ceb-8c42c84dff51 req-e377f869-bd9c-4a13-8e3d-246341ef044b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:35.509108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6a72f8ac-7e12-4c74-9ceb-8c42c84dff51 req-e377f869-bd9c-4a13-8e3d-246341ef044b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:35.532857 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6a72f8ac-7e12-4c74-9ceb-8c42c84dff51 req-e377f869-bd9c-4a13-8e3d-246341ef044b service nova] Creating event network-changed:54f57f56-cfff-4e64-8d72-9dd02b6c217b for instance 76a0491c-d261-4832-8e5e-e8694309e410 on n-h1-854925-5 Aug 30 04:46:35.540347 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6a72f8ac-7e12-4c74-9ceb-8c42c84dff51 req-e377f869-bd9c-4a13-8e3d-246341ef044b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082863 Aug 30 04:46:35.541232 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3119/6172] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:36.033202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:36.034648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:36.050497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:36.051151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:36.051694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:36.052529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:36.053104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:36.053662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:36.346958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:36.357675 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fcf0ab0e-f900-4353-ae98-db20f9605a89 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.328685 Aug 30 04:46:36.358409 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3054/6173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:36 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:37.380580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:37.382467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:37.390142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=27 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:37.393034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:37.393997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:37.394970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:37.396085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:37.396727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:37.397400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:37.402626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=47 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:37.714786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:37.723589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42e42827-3f92-4799-b32c-acbc09c75185 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.348362 Aug 30 04:46:37.724197 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3120/6174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:37 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:38.744548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:38.745158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:38.767902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:38.768397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:38.768848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:38.777872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:38.781974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:38.783594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:39.044113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:39.053569 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca00d137-a318-4c3f-aa1e-c882012262f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.312749 Aug 30 04:46:39.062660 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3055/6175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:38 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:40.088111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:40.089929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:40.104360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:40.114577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:40.115900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:40.122121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:40.122962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:40.131252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:40.491927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:40.500751 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20de1592-e293-4ae5-9ecd-d6168a67c60a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.417067 Aug 30 04:46:40.501767 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3121/6176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:40 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:41.525529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:41.526212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:41.529819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:41.531371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:41.538530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:41.539059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:41.539631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:41.545884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:41.546379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:41.547013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:41.854091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:41.864232 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3ace6073-695a-49ec-b7f8-4cea14d0bc82 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.345122 Aug 30 04:46:41.866048 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3056/6177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:41 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:42.882240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-12ffbbbb-2e47-4405-88df-f6dcf60967eb req-c566994a-9722-41f1-bd33-581581e932d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a0491c-d261-4832-8e5e-e8694309e410", "name": "network-vif-plugged", "status": "completed", "tag": "54f57f56-cfff-4e64-8d72-9dd02b6c217b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:42.886553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:42.887199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:42.893900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:42.901223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:42.901917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:42.902836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:42.903103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:46:42.903448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:42.903880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:42.909892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-12ffbbbb-2e47-4405-88df-f6dcf60967eb req-c566994a-9722-41f1-bd33-581581e932d3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:42.911037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-12ffbbbb-2e47-4405-88df-f6dcf60967eb req-c566994a-9722-41f1-bd33-581581e932d3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:42.911910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-12ffbbbb-2e47-4405-88df-f6dcf60967eb req-c566994a-9722-41f1-bd33-581581e932d3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:42.940913 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-12ffbbbb-2e47-4405-88df-f6dcf60967eb req-c566994a-9722-41f1-bd33-581581e932d3 service nova] Creating event network-vif-plugged:54f57f56-cfff-4e64-8d72-9dd02b6c217b for instance 76a0491c-d261-4832-8e5e-e8694309e410 on n-h1-854925-5 Aug 30 04:46:42.949978 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-12ffbbbb-2e47-4405-88df-f6dcf60967eb req-c566994a-9722-41f1-bd33-581581e932d3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078090 Aug 30 04:46:42.952366 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3122/6178] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:46:43.118028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:43.128846 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8d24a19a-b276-4972-aed6-bedf4f0259bd tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.246179 Aug 30 04:46:43.129580 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3057/6179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:42 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:44.171703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:44.442296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:44.454654 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f898673b-d152-4e2d-9c8a-235e0e4f4d30 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1318 microversion: 2.1 time: 0.307915 Aug 30 04:46:44.455781 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3123/6180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:44 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:46:45.476104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:45.476674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:45.487735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:45.488306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:45.488770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:45.489811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:45.490809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:45.491261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:45.658294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:45.666958 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-58538a05-1499-4956-a384-36a3b89c2aeb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1507 microversion: 2.1 time: 0.195650 Aug 30 04:46:45.667549 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3058/6181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:45 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:46.130098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:46.132867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:46.147622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:46.148636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:46.149543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:46.150752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:46.151478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:46.152073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:46.267549 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9bf9cf94-5ce9-4012-9ab5-de7a42bdc1d9 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030/action" status: 200 len: 24574 microversion: 2.1 time: 0.141750 Aug 30 04:46:46.270167 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3124/6182] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:46:46 2022] POST /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030/action => generated 24574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:46:52.645262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:46:52.650726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:52.668988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:52.669531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:52.669979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:52.670704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:52.671160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:52.683632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:52.866189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:46:52.868055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:46:52.870632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:46:52.871985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:46:52.873269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:46:53.099904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:53.123595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:53.130526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:53.131421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:53.132430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:53.133127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:53.133876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:53.165228 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3faea3ef-2fa0-43f1-81a7-d6fe2bd9ccd2 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030/action" status: 202 len: 1135 microversion: 2.1 time: 0.534897 Aug 30 04:46:53.185464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3059/6183] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:46:52 2022] POST /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030/action => generated 1135 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 30 04:46:53.193386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:53.194573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:53.223875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:53.224378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:53.224827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:53.232641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:53.233896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:53.236628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:53.866862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:53.887109 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d7f3e9c-6774-4195-abf3-d288c3969b5a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.700144 Aug 30 04:46:53.910166 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3125/6184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:53 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:46:54.912832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:54.913678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:54.929371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:54.929985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:54.930861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:54.931687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:54.932218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:54.932674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:55.296529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:55.304785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-761ad927-d2a8-4618-bbe5-cf8227e9d52d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.396576 Aug 30 04:46:55.323156 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3060/6185] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:54 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:56.330391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:56.331008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:56.334346 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:46:56.334732 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 04:46:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 (ip 10.222.0.27) !!! Aug 30 04:46:56.356699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:56.357206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:56.357684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:56.358583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:56.359218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:56.359834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:56.637466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:56.648199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-de1aafec-b0ef-4200-9ef1-16922943d191 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.321526 Aug 30 04:46:56.654032 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3126/6186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:56 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:57.675196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:57.676494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:57.688611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:57.690014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:57.691239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:57.692716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:57.693958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:57.695125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:58.150429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:58.162751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8185948c-a6f6-46e8-a89b-3e8ce0646703 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.491585 Aug 30 04:46:58.163360 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3061/6187] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:57 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:46:59.184776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:46:59.186024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:46:59.198038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:59.198781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:59.199440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:59.200349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:46:59.201027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:46:59.201720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:46:59.453341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:46:59.467523 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8685262c-3e89-47e7-9931-7a8c8b0c554b tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.287302 Aug 30 04:46:59.470290 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3127/6188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:46:59 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:00.492208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:00.493693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:00.510647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:00.511656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:00.512575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:00.513772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:00.514394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:00.515011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:00.753405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:00.766044 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ae3b3b9-44e9-475c-b9a9-8ab790f85b0c tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.276255 Aug 30 04:47:00.767024 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3062/6189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:00 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:01.798064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:01.799859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:01.809147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:01.809669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:01.810424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:01.811145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:01.811603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:01.812033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:02.045963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:02.060507 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-36f0c79a-a7bc-4c06-b8e6-f5836227c8be tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.268050 Aug 30 04:47:02.061633 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3128/6190] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:01 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:03.086444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:03.087537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:03.105148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:03.109981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:03.110544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:03.112749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:03.113360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:03.113868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:03.369532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:03.380165 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66d2e25a-1590-4cf4-a9f5-3e178d6f5b01 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.299824 Aug 30 04:47:03.381169 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3063/6191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:03 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:04.402187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:04.404948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:04.417708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:04.420011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:04.420970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:04.422913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:04.432625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:04.435875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:04.731681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:04.742699 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af18b73f-a1f4-44c8-b4b2-b0cc34d31649 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1689 microversion: 2.1 time: 0.344626 Aug 30 04:47:04.745505 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3129/6192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:04 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1689 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:05.768769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:05.770240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:05.777321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=26 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:05.795626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:05.800528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:05.805938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:05.807273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:05.807762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:05.808454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:05.819415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:06.122701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:06.153365 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9c6abaae-4239-4ab3-bd49-58d82a253b5f tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1695 microversion: 2.1 time: 0.378762 Aug 30 04:47:06.154084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3064/6193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:05 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1695 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:47:07.213458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:07.214130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:07.231316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:07.233051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:07.233051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:07.234122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:07.235008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:07.235854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:07.524080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:07.526394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=58 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:07.552767 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb066597-7188-4058-8b5d-9d999f7725eb tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1695 microversion: 2.1 time: 0.355993 Aug 30 04:47:07.571065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3130/6194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:07 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1695 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:08.575559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:08.576947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:08.591705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:08.594318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:08.596686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:08.601706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:08.603799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:08.605265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:08.896351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:08.905859 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74caabec-119e-4c4c-875d-f035b1e20c9a tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1680 microversion: 2.1 time: 0.334334 Aug 30 04:47:08.912429 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3065/6195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:08 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1680 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:09.608269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e1240218-6f44-46a5-bc63-83a1a8c92cfb req-315e447a-bed3-4a3a-8b79-dd3e3a37132e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5976e2-46bd-4380-bf1c-bb18e915a030", "name": "network-vif-unplugged", "status": "completed", "tag": "76f67f03-bbb3-447c-b837-98e248fae99c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:09.629754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=22 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:09.631950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e1240218-6f44-46a5-bc63-83a1a8c92cfb req-315e447a-bed3-4a3a-8b79-dd3e3a37132e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:09.632616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e1240218-6f44-46a5-bc63-83a1a8c92cfb req-315e447a-bed3-4a3a-8b79-dd3e3a37132e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:09.633203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e1240218-6f44-46a5-bc63-83a1a8c92cfb req-315e447a-bed3-4a3a-8b79-dd3e3a37132e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:09.647336 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e1240218-6f44-46a5-bc63-83a1a8c92cfb req-315e447a-bed3-4a3a-8b79-dd3e3a37132e service nova] Creating event network-vif-unplugged:76f67f03-bbb3-447c-b837-98e248fae99c for instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 on n-h2-854925-5 Aug 30 04:47:09.679076 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e1240218-6f44-46a5-bc63-83a1a8c92cfb req-315e447a-bed3-4a3a-8b79-dd3e3a37132e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060350 Aug 30 04:47:09.680400 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3131/6196] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:47:11.717885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-936cf4e8-e432-4ad1-a407-79e11bc11ccc req-c734d23e-bfaa-405a-bbe8-53e6ddff5b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5976e2-46bd-4380-bf1c-bb18e915a030", "name": "network-vif-plugged", "status": "completed", "tag": "76f67f03-bbb3-447c-b837-98e248fae99c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:11.740624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-936cf4e8-e432-4ad1-a407-79e11bc11ccc req-c734d23e-bfaa-405a-bbe8-53e6ddff5b16 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:11.741181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-936cf4e8-e432-4ad1-a407-79e11bc11ccc req-c734d23e-bfaa-405a-bbe8-53e6ddff5b16 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:11.741711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-936cf4e8-e432-4ad1-a407-79e11bc11ccc req-c734d23e-bfaa-405a-bbe8-53e6ddff5b16 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:11.793474 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-936cf4e8-e432-4ad1-a407-79e11bc11ccc req-c734d23e-bfaa-405a-bbe8-53e6ddff5b16 service nova] Creating event network-vif-plugged:76f67f03-bbb3-447c-b837-98e248fae99c for instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 on n-h2-854925-5 Aug 30 04:47:11.812902 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-936cf4e8-e432-4ad1-a407-79e11bc11ccc req-c734d23e-bfaa-405a-bbe8-53e6ddff5b16 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097938 Aug 30 04:47:11.821914 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3066/6197] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:47:17.459228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1143593e-e106-4029-a4ca-df23b8ad99b3", "device": "/dev/sdb"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:17.463713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:17.483642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:17.484946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:17.485618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:17.486401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:17.487270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:17.488665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:17.954509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-858d261d-c117-4f84-b7ce-a40cee9741ff tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "POST /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503630 Aug 30 04:47:17.960597 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3132/6198] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:47:17 2022] POST /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:47:33.158962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=5 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:33.159747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=13 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:33.857237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:33.860681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:33.875320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:33.876936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:33.877433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:33.879414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:33.880503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:33.880953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:33.980369 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-71ef67fd-4f4e-4730-88e1-0262af489ee0 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "POST /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030/action" status: 200 len: 24582 microversion: 2.1 time: 0.830512 Aug 30 04:47:33.988002 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3067/6199] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:47:33 2022] POST /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030/action => generated 24582 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:47:42.060829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:42.062400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:42.070469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e2ee16e6-b93d-4b6d-82a9-367412ce7579 req-f134e59e-dd52-4703-aeae-34d2f4cf0736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5976e2-46bd-4380-bf1c-bb18e915a030", "tag": "76f67f03-bbb3-447c-b837-98e248fae99c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:42.092438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:42.098346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:42.102737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:42.110443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:42.111356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e2ee16e6-b93d-4b6d-82a9-367412ce7579 req-f134e59e-dd52-4703-aeae-34d2f4cf0736 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:42.111981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:42.112703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e2ee16e6-b93d-4b6d-82a9-367412ce7579 req-f134e59e-dd52-4703-aeae-34d2f4cf0736 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:42.114376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:42.114981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e2ee16e6-b93d-4b6d-82a9-367412ce7579 req-f134e59e-dd52-4703-aeae-34d2f4cf0736 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:42.115609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:42.123344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:42.167631 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e2ee16e6-b93d-4b6d-82a9-367412ce7579 req-f134e59e-dd52-4703-aeae-34d2f4cf0736 service nova] Creating event network-changed:76f67f03-bbb3-447c-b837-98e248fae99c for instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 on n-h2-854925-5 Aug 30 04:47:42.190408 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e2ee16e6-b93d-4b6d-82a9-367412ce7579 req-f134e59e-dd52-4703-aeae-34d2f4cf0736 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125669 Aug 30 04:47:42.193722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3068/6200] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:47:42.233365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:47:42.472529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4885cb57-c10b-4977-9625-a98e29e2d2b8 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 204 len: 0 microversion: 2.1 time: 0.417058 Aug 30 04:47:42.473156 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3133/6201] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:47:42 2022] DELETE /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:47:42.482309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:42.483527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:42.504159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:42.507854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:42.508574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:42.509802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:42.511120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:42.513773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:42.830764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:42.839204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-10e408f3-198e-46f1-86a1-ac47c2290e4d tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1686 microversion: 2.1 time: 0.361187 Aug 30 04:47:42.843986 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3069/6202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:42 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1686 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:43.868794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:43.869705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:43.889647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:43.890153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:43.890605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:43.891334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:43.891797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:43.892235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:44.628632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:44.638596 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-173ba41c-0cc3-415a-b304-878476591220 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1686 microversion: 2.1 time: 0.774054 Aug 30 04:47:44.664224 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3134/6203] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:43 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1686 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:45.342127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-efa68d96-607e-449b-afe3-629320c2d0cb req-e005087c-f22d-47fc-b026-f630a545b463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5976e2-46bd-4380-bf1c-bb18e915a030", "name": "network-vif-deleted", "tag": "76f67f03-bbb3-447c-b837-98e248fae99c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:47:45.375254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-efa68d96-607e-449b-afe3-629320c2d0cb req-e005087c-f22d-47fc-b026-f630a545b463 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:45.379143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-efa68d96-607e-449b-afe3-629320c2d0cb req-e005087c-f22d-47fc-b026-f630a545b463 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:45.380089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-efa68d96-607e-449b-afe3-629320c2d0cb req-e005087c-f22d-47fc-b026-f630a545b463 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:45.420693 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-efa68d96-607e-449b-afe3-629320c2d0cb req-e005087c-f22d-47fc-b026-f630a545b463 service nova] Creating event network-vif-deleted:76f67f03-bbb3-447c-b837-98e248fae99c for instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 on n-h2-854925-5 Aug 30 04:47:45.430069 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-efa68d96-607e-449b-afe3-629320c2d0cb req-e005087c-f22d-47fc-b026-f630a545b463 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098247 Aug 30 04:47:45.430694 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3070/6204] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:47:45.681033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:45.681849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:45.705628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:45.706556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:45.707287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:45.708323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:45.709013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:45.710366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:45.821645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:45.824430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:45.825593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:45.834293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lazy-loading 'fault' on Instance uuid 1a5976e2-46bd-4380-bf1c-bb18e915a030 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:47:46.043522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b0fd630f614ae4a6ca14d083d4d2d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a6f1ffe69e4a99927df0ef201e6468', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:47:46.061308 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86f533eb-5428-4ce9-b42f-f461da8d9283 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 200 len: 1505 microversion: 2.1 time: 0.388063 Aug 30 04:47:46.074134 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3135/6205] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:45 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 1505 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:47:47.093705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:47.095330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] [instance: 1a5976e2-46bd-4380-bf1c-bb18e915a030] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:47.126398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:47.127475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:47.129615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:47.134329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:47.135699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:47.142299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:47.195049 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] HTTP exception thrown: Instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 could not be found. Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Request method failure captured: Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 HTTP/1.1 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZP7ChyUww-hUkzvipQWnIDpNCPmoy98A3_91tBaDyGm4CFEC8j1-k4mA_n7DBIbWV-90qD9gx-2bD1g3Wq92ImlI-dgcvlnI0RV7IMY4vRA8qPZrm5U3NAwJasx4XwibSfnEvotZqfz96ADH5quJhdHipFRAl7bQxI4S9Xq1C22I7U Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_94a6f1ffe69e4a99927df0ef201e6468", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/94a6f1ffe69e4a99927df0ef201e6468"}]}] Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 94a6f1ffe69e4a99927df0ef201e6468 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829496838 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 13b0fd630f614ae4a6ca14d083d4d2d1 Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829496838-project Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 could not be found. Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1a5976e2-46bd-4380-bf1c-bb18e915a030'} Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 could not be found. Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 could not be found. Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:47:47.197694 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 could not be found. Aug 30 04:47:47.202327 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:47:47.211911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Returning 404 to user: Instance 1a5976e2-46bd-4380-bf1c-bb18e915a030 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:47:47.213880 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c51a1b1-6187-44be-9db3-6a2764a0858e tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030" status: 404 len: 111 microversion: 2.1 time: 0.124537 Aug 30 04:47:47.221293 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3071/6206] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:47:47 2022] GET /compute/v2.1/servers/1a5976e2-46bd-4380-bf1c-bb18e915a030 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:47:55.447721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-03a66bc7-fecf-4c30-afab-3bacf6bede50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] Calling method '.version_select at 0x7fe96973d0d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:55.495816 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-03a66bc7-fecf-4c30-afab-3bacf6bede50 tempest-TestNetworkAdvancedServerOps-1829496838 tempest-TestNetworkAdvancedServerOps-1829496838-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-984393577" status: 202 len: 0 microversion: 2.1 time: 0.057950 Aug 30 04:47:55.500696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3136/6207] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Aug 30 04:47:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-984393577 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:47:59.389740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:47:59.391553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:47:59.397045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=10 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:59.400520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=16 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:47:59.410466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:59.411897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:59.415438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:59.416411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:47:59.417075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:47:59.418214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:47:59.526238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lazy-loading 'services' on Instance uuid 76a0491c-d261-4832-8e5e-e8694309e410 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:47:59.652010 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1288a445-1d9b-40e9-92af-8a08c401ebe1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "DELETE /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410/os-volume_attachments/1143593e-e106-4029-a4ca-df23b8ad99b3" status: 202 len: 0 microversion: 2.1 time: 0.266593 Aug 30 04:47:59.652774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3072/6208] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:47:59 2022] DELETE /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410/os-volume_attachments/1143593e-e106-4029-a4ca-df23b8ad99b3 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:48:02.427611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:02.591417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1293375682", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "02739e9a-e34f-45bd-b12d-0fe1c85fa209"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:02.753800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] validate_networks() for [('02739e9a-e34f-45bd-b12d-0fe1c85fa209', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:48:03.445273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:48:03.448535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:48:03.454237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:48:03.458965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:48:03.462571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:48:03.498673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:03.504346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:03.505221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:03.506402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:03.507076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:03.507863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:03.554764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Getting quotas for project b9d78143c4d746e895864122c1c81bc2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:48:03.572002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Getting quotas for user 8c14c87df9734c26a3bdd235b0104824 and project b9d78143c4d746e895864122c1c81bc2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:48:03.644237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:48:03.647165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:48:03.750612 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28d26843-28f2-4498-89ad-588fb3b60db5 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.323715 Aug 30 04:48:03.751837 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3137/6209] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:48:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:48:03.776039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-67577266-91e7-4867-8f8b-c829ed7d0c48 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:03.777348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-67577266-91e7-4867-8f8b-c829ed7d0c48 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:03.917778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-67577266-91e7-4867-8f8b-c829ed7d0c48 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:03.925782 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-67577266-91e7-4867-8f8b-c829ed7d0c48 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1215 microversion: 2.1 time: 0.165778 Aug 30 04:48:03.937068 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3073/6210] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:03 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:04.951904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:04.953536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:04.968342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:04.968933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:04.969564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:04.971435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:04.974012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:04.974538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:05.549026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:05.562949 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aaa43d04-651f-4eca-a33f-edb5c0d6f5a3 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1219 microversion: 2.1 time: 0.617571 Aug 30 04:48:05.564108 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3138/6211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:04 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1219 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:06.594812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:06.598879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:06.624277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:06.629158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:06.630397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:06.631806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:06.633728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:06.635978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:06.802253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:06.818053 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f59970aa-e0f4-4cd0-8934-cc43115f7a06 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1273 microversion: 2.1 time: 0.236502 Aug 30 04:48:06.820119 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3074/6212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:06 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:07.598721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:07.599292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:07.612165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:07.613393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:07.613926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:07.614835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:07.615453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:07.616051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:07.650745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:48:07.756786 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e7deb656-a13f-4083-afda-f5b7a4fb0dc2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "DELETE /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 204 len: 0 microversion: 2.1 time: 0.162346 Aug 30 04:48:07.758743 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3139/6213] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:48:07 2022] DELETE /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:07.767629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:07.769386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:07.780216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:07.780975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:07.781922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:07.782860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:07.783580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:07.784282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:07.841749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:07.842837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:07.850752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:07.851590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:07.852317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:07.853395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:07.854118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:07.854844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:08.140388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:08.160604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5a15e51d-50a3-4ad4-83cc-1c6f243779f6 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1513 microversion: 2.1 time: 0.397588 Aug 30 04:48:08.161267 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3075/6214] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:07 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1513 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:08.181022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2572bdcf-dd9c-4673-b2bd-563065a2b336 req-b1055085-9918-49f6-a823-93305c8df4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9119a5c0-79cf-4f04-9952-19dae5f1bd7c", "tag": "7a35ef15-ca9d-4573-920a-75073e3a2fb9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:08.202695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2572bdcf-dd9c-4673-b2bd-563065a2b336 req-b1055085-9918-49f6-a823-93305c8df4a2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:08.203393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2572bdcf-dd9c-4673-b2bd-563065a2b336 req-b1055085-9918-49f6-a823-93305c8df4a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:08.203991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2572bdcf-dd9c-4673-b2bd-563065a2b336 req-b1055085-9918-49f6-a823-93305c8df4a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:08.222778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2572bdcf-dd9c-4673-b2bd-563065a2b336 req-b1055085-9918-49f6-a823-93305c8df4a2 service nova] Creating event network-changed:7a35ef15-ca9d-4573-920a-75073e3a2fb9 for instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c on n-h2-854925-5 Aug 30 04:48:08.231094 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2572bdcf-dd9c-4673-b2bd-563065a2b336 req-b1055085-9918-49f6-a823-93305c8df4a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055418 Aug 30 04:48:08.231989 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3076/6215] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:08.273419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:08.287588 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-227e8669-3dcf-40fb-b8e8-cd6b8215d9f2 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1315 microversion: 2.1 time: 0.450816 Aug 30 04:48:08.301785 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3140/6216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:07 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:09.183284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:09.183996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:09.196676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:09.198941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:09.199930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:09.201056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:09.201888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:09.202606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:09.309248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:09.309993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:09.333547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:09.333825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:09.341584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:09.342562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:09.343196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:09.346313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:09.503661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:09.514082 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66234541-057a-4852-ac44-c54a56817fb0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1513 microversion: 2.1 time: 0.336110 Aug 30 04:48:09.530563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3077/6217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:09 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1513 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:09.619856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:09.637853 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a537f1df-f647-49e6-beaf-ece48e479dd9 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1315 microversion: 2.1 time: 0.332831 Aug 30 04:48:09.640914 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3141/6218] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:09 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:10.542805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:10.544324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:10.557790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:10.558286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:10.558728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:10.559442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:10.559901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:10.560332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:10.679113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:10.680484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:10.701795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:10.727145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:10.732618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:10.737153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:10.738321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:10.743592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:10.788624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:10.806087 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5e98080b-e983-4dcd-a47e-1e14ff39d462 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 200 len: 1471 microversion: 2.1 time: 0.266166 Aug 30 04:48:10.807001 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3078/6219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:10 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:10.830029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7c53602a-8fbe-4469-b2c0-dd3470e23d3c req-c8800d02-cefc-4412-864e-1098159fa4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a0491c-d261-4832-8e5e-e8694309e410", "name": "network-vif-deleted", "tag": "54f57f56-cfff-4e64-8d72-9dd02b6c217b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:10.861768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7c53602a-8fbe-4469-b2c0-dd3470e23d3c req-c8800d02-cefc-4412-864e-1098159fa4b5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:10.862529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7c53602a-8fbe-4469-b2c0-dd3470e23d3c req-c8800d02-cefc-4412-864e-1098159fa4b5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:10.862979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7c53602a-8fbe-4469-b2c0-dd3470e23d3c req-c8800d02-cefc-4412-864e-1098159fa4b5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:10.890035 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7c53602a-8fbe-4469-b2c0-dd3470e23d3c req-c8800d02-cefc-4412-864e-1098159fa4b5 service nova] Creating event network-vif-deleted:54f57f56-cfff-4e64-8d72-9dd02b6c217b for instance 76a0491c-d261-4832-8e5e-e8694309e410 on n-h1-854925-5 Aug 30 04:48:10.898769 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7c53602a-8fbe-4469-b2c0-dd3470e23d3c req-c8800d02-cefc-4412-864e-1098159fa4b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088869 Aug 30 04:48:10.902055 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3079/6220] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:11.113156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:11.130761 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8fcf9148-0e5b-4a01-a4e4-0ddcadae2bb1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1315 microversion: 2.1 time: 0.465637 Aug 30 04:48:11.131748 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3142/6221] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:10 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:11.834371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:11.835226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 76a0491c-d261-4832-8e5e-e8694309e410] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:11.854515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:11.855020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:11.860163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:11.861177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:11.861824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:11.862444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:11.886662 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] HTTP exception thrown: Instance 76a0491c-d261-4832-8e5e-e8694309e410 could not be found. Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Request method failure captured: Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 HTTP/1.1 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZXELUyDLMzQxUWk-TB1Is9GkJm5u8PAAR00CHWk2PadfCzP_yvRmwdF2uNi46aSU71zJjSDN5ZwYAEooC7Vxy2DSIc_csOC2qZ4eM-ufzTZBdvR3Ib2iOthdW_NkOuBAY7315sGOvarAgK-InFvlp_UTBmM5qX4JYyMdyrvX26t-yo Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 754a747b965249349b3a850158553fd6 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesSnapshotTestJSON-674509528 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_754a747b965249349b3a850158553fd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/754a747b965249349b3a850158553fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/754a747b965249349b3a850158553fd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/754a747b965249349b3a850158553fd6"}]}] Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesSnapshotTestJSON-674509528 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 754a747b965249349b3a850158553fd6 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-674509528 Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesSnapshotTestJSON-674509528-project Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: eabb2f9c36d7457e97343142e2487ccf Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesSnapshotTestJSON-674509528-project Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 76a0491c-d261-4832-8e5e-e8694309e410 could not be found. Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '76a0491c-d261-4832-8e5e-e8694309e410'} Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a0491c-d261-4832-8e5e-e8694309e410 could not be found. Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a0491c-d261-4832-8e5e-e8694309e410 could not be found. Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:48:11.888904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:11.893348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:11.893348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:48:11.893348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:48:11.893348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:48:11.893348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:48:11.893348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a0491c-d261-4832-8e5e-e8694309e410 could not be found. Aug 30 04:48:11.893348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:11.895392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Returning 404 to user: Instance 76a0491c-d261-4832-8e5e-e8694309e410 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:48:11.896790 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8fd221f8-0938-4287-9d9e-dc2fd5715eb2 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410" status: 404 len: 111 microversion: 2.1 time: 0.072530 Aug 30 04:48:11.898086 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3080/6222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:11 2022] GET /compute/v2.1/servers/76a0491c-d261-4832-8e5e-e8694309e410 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:48:12.163003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:12.164936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:12.170579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:12.183783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:12.191116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:12.194213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:12.196531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:12.202602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:12.203526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:12.469238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:12.490920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af49e4f9-4c5e-4fc1-94b8-6e3de6504b34 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1315 microversion: 2.1 time: 0.332793 Aug 30 04:48:12.492141 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3143/6223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:12 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:13.515878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:13.517278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:13.546325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:13.550474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:13.557104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:13.558121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:13.560183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:13.560782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:13.922579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:13.953585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:13.962334 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa41b7c3-28a5-4364-85e2-21dfe59e85d1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1315 microversion: 2.1 time: 0.450374 Aug 30 04:48:13.962937 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3081/6224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:13 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:14.076925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-21943e3a-f08e-4615-98af-50e7491fe408 req-c653dc82-1e67-47c1-812e-789c8c41d3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9119a5c0-79cf-4f04-9952-19dae5f1bd7c", "name": "network-vif-plugged", "status": "completed", "tag": "7a35ef15-ca9d-4573-920a-75073e3a2fb9"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:14.090072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:14.113714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:14.133441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-21943e3a-f08e-4615-98af-50e7491fe408 req-c653dc82-1e67-47c1-812e-789c8c41d3fa service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:14.134179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-21943e3a-f08e-4615-98af-50e7491fe408 req-c653dc82-1e67-47c1-812e-789c8c41d3fa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:14.135152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-21943e3a-f08e-4615-98af-50e7491fe408 req-c653dc82-1e67-47c1-812e-789c8c41d3fa service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:14.164000 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-21943e3a-f08e-4615-98af-50e7491fe408 req-c653dc82-1e67-47c1-812e-789c8c41d3fa service nova] Creating event network-vif-plugged:7a35ef15-ca9d-4573-920a-75073e3a2fb9 for instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c on n-h2-854925-5 Aug 30 04:48:14.174808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-21943e3a-f08e-4615-98af-50e7491fe408 req-c653dc82-1e67-47c1-812e-789c8c41d3fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104219 Aug 30 04:48:14.176501 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3144/6225] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:14.985601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:14.986843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:14.994291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:14.994785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:14.995230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:14.995937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:14.996420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:14.996831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:15.253348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:15.267845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e036c820-b38a-4176-bf44-b1d1a71ec552 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1315 microversion: 2.1 time: 0.285802 Aug 30 04:48:15.277826 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3082/6226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:14 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:16.294238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:16.295008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:16.308092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.308830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.310267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:16.311476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.312231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.312815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:16.486972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:16.497058 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-162c46a4-2fa2-407e-8692-c5ea11b4e195 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1503 microversion: 2.1 time: 0.209313 Aug 30 04:48:16.498118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3145/6227] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:16 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:16.518459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:16.519123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:16.529307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.529879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.530675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:16.531240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.531702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.532134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:16.698519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:16.715435 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1d221138-1c9f-4843-a4e7-eb4c28697530 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1503 microversion: 2.1 time: 0.200765 Aug 30 04:48:16.718304 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3083/6228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:16 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:16.739310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:16.740403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:16.748221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.748927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.749408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:16.750288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.750749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.751187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:16.781639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lazy-loading 'flavor' on Instance uuid 9119a5c0-79cf-4f04-9952-19dae5f1bd7c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:48:16.875265 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b29d3f02-90ae-4101-a1cb-81cab61a2f0d tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action" status: 202 len: 0 microversion: 2.1 time: 0.140474 Aug 30 04:48:16.878800 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3146/6229] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:48:16 2022] POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:48:16.887552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:16.888691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:16.898023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.913500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.916181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:16.917187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:16.922237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:16.923020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:17.159682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:17.168272 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-04aa3f8b-8416-4e3a-a2f8-2bc2793d8afb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1511 microversion: 2.1 time: 0.285125 Aug 30 04:48:17.169560 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3084/6230] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:16 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:18.195814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:18.196540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:18.213219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:18.213751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:18.214207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:18.214925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:18.215385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:18.215820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:18.473919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:18.483704 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e08f753e-f4c7-4cbe-97f4-335d424a866c tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1494 microversion: 2.1 time: 0.293510 Aug 30 04:48:18.484891 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3147/6231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:18 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1494 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:18.505730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:18.506485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:18.513586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:18.514394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:18.515044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:18.515978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:18.516649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:18.517284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:18.607392 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a316acf-1759-459f-86cc-b056b293ac8e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action" status: 202 len: 0 microversion: 2.1 time: 0.102503 Aug 30 04:48:18.611517 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3085/6232] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:48:18 2022] POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:48:18.616595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:18.617707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:18.629342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:18.630203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:18.630868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:18.634476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:18.635224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:18.635895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:18.991936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:19.004441 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c70ce0a-b87b-46b6-8581-8a33cefafadd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1500 microversion: 2.1 time: 0.389009 Aug 30 04:48:19.005463 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3148/6233] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:18 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1500 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:20.034028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:20.035688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:20.068548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:20.069437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:20.071393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:20.072711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:20.073893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:20.075890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:20.327260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:20.352439 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1732f792-533c-4c1d-8d08-5cbfb2901c3a tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1500 microversion: 2.1 time: 0.328734 Aug 30 04:48:20.356789 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3086/6234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:20 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1500 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:21.380345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:21.381027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:21.390443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:21.392312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:21.393154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:21.395410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:21.396124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:21.396788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:21.416103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-193589002", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "c9da2cff-bcc5-4f01-82e4-11e7757ae282"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:21.507804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] validate_networks() for [('c9da2cff-bcc5-4f01-82e4-11e7757ae282', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:48:21.717617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:21.731333 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-72041c26-ef80-46a2-a824-a25a0ec27945 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1503 microversion: 2.1 time: 0.352688 Aug 30 04:48:21.762270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3149/6235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:21 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:21.776919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:21.777870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:21.789936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:21.790661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:21.792494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:21.803414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:21.803414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:21.803414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:21.847071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lazy-loading 'flavor' on Instance uuid 9119a5c0-79cf-4f04-9952-19dae5f1bd7c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:48:21.923958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:22.017224 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7a6c880a-7466-4389-b671-0831377949a4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action" status: 202 len: 0 microversion: 2.1 time: 0.242718 Aug 30 04:48:22.022933 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3150/6236] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:48:21 2022] POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:48:22.035926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:22.037851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:22.055301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:22.055879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:22.056231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:22.058129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:22.058330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:22.058837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:22.343225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:22.351959 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59965461-ba7a-4f40-b751-4d1d77e74393 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1511 microversion: 2.1 time: 0.326622 Aug 30 04:48:22.355753 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3151/6237] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:22 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:22.382200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:48:22.383156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:48:22.383816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:48:22.384505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:48:22.384989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:48:22.396296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:22.397276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:22.397843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:22.398672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:22.399436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:22.400177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:22.423288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Getting quotas for project 754a747b965249349b3a850158553fd6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:48:22.430494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Getting quotas for user eabb2f9c36d7457e97343142e2487ccf and project 754a747b965249349b3a850158553fd6. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:48:22.448711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:48:22.451695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:48:22.514787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a94aad84-9296-4b7e-b552-6c0c40d877d7 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.102561 Aug 30 04:48:22.515922 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3087/6238] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:48:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 04:48:22.528566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8df572d-7940-4f02-a523-71ef49400f0c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:22.529198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e8df572d-7940-4f02-a523-71ef49400f0c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:22.682283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e8df572d-7940-4f02-a523-71ef49400f0c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:22.694476 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e8df572d-7940-4f02-a523-71ef49400f0c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1218 microversion: 2.1 time: 0.170757 Aug 30 04:48:22.695214 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3152/6239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:22 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:23.375425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:23.376508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:23.386017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.386907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.387619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.388735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.389201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.389946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.566444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:23.577455 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12672259-9535-4189-8ac4-32b09ee0c1fc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1494 microversion: 2.1 time: 0.206808 Aug 30 04:48:23.594770 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3088/6240] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:23 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1494 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:23.604210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:23.606006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:23.614582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.615810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.617043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.618019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.618703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.619341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.718323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:23.720384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:23.729248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.730401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.731095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.732124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.732821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.733591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.735637 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb9e8af8-edeb-4080-91e6-63982059a77f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action" status: 202 len: 0 microversion: 2.1 time: 0.135899 Aug 30 04:48:23.739608 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3153/6241] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:48:23 2022] POST /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:48:23.764360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:23.767736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:23.802219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.805029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.805716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.808342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:23.809778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:23.810541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:23.862523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:23.877433 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b9b98579-7959-436a-8dc8-e87b1089ad6f tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1270 microversion: 2.1 time: 0.162167 Aug 30 04:48:23.879527 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3089/6242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:23 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:24.100688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:24.115296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc29f046-ccc0-4509-8983-b45810dd04cd tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1500 microversion: 2.1 time: 0.372126 Aug 30 04:48:24.116123 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3154/6243] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:23 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1500 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:24.902518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:24.903401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:24.932410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:24.936586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:24.937671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:24.941926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:24.946036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:24.947549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:25.012590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:25.143263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:25.145175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:25.155976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:25.171603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:25.178623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:25.180337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:25.186724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:25.188151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:25.199637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:25.215289 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ab1fa63b-84b3-412a-a188-6fd01f8c7854 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1276 microversion: 2.1 time: 0.318738 Aug 30 04:48:25.215970 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3090/6244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:24 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1276 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:25.678320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:25.700272 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0fd4a244-1a7f-4fac-ba2f-0c13bf2a398f tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1500 microversion: 2.1 time: 0.561464 Aug 30 04:48:25.704432 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3155/6245] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:25 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1500 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:26.236001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:26.236754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:26.247407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.247902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.248342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.249047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.249540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.249967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.509366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:26.519945 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-613a865f-720f-4f75-a762-3df4b7c1e0af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1318 microversion: 2.1 time: 0.286459 Aug 30 04:48:26.529416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3091/6246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:26 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:26.725161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:26.726887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:26.738120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.739195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.739831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.740712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.742306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.743077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.763557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e5269a53-1278-4a07-9b32-450de02080ea req-74017a88-f626-4dcf-acb8-1d152c3c2bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861d0a45-31a6-4215-8def-9712d5f4c6ff", "tag": "aee989ea-607c-414f-87f1-eeb2b3852513"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:26.774836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e5269a53-1278-4a07-9b32-450de02080ea req-74017a88-f626-4dcf-acb8-1d152c3c2bd3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.775364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e5269a53-1278-4a07-9b32-450de02080ea req-74017a88-f626-4dcf-acb8-1d152c3c2bd3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.776189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e5269a53-1278-4a07-9b32-450de02080ea req-74017a88-f626-4dcf-acb8-1d152c3c2bd3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.789504 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e5269a53-1278-4a07-9b32-450de02080ea req-74017a88-f626-4dcf-acb8-1d152c3c2bd3 service nova] Creating event network-changed:aee989ea-607c-414f-87f1-eeb2b3852513 for instance 861d0a45-31a6-4215-8def-9712d5f4c6ff on n-h1-854925-5 Aug 30 04:48:26.795034 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e5269a53-1278-4a07-9b32-450de02080ea req-74017a88-f626-4dcf-acb8-1d152c3c2bd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035184 Aug 30 04:48:26.799722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3092/6247] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:26.922812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:26.931641 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e24ad615-3527-443b-bed5-0871ac9bb9b4 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1503 microversion: 2.1 time: 0.211769 Aug 30 04:48:26.932350 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3156/6248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:26 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1503 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:26.953062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:26.953683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:26.960627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.961123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.961609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.962409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:26.963066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:26.963502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:26.995789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:48:27.101047 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ce6a7f1b-e486-4ec6-aa8d-0f1a19e465cb tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 204 len: 0 microversion: 2.1 time: 0.150830 Aug 30 04:48:27.102206 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3093/6249] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:48:26 2022] DELETE /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:48:27.111860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:27.113976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:27.122054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:27.122781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:27.123671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:27.124552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:27.125182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:27.125911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:27.331836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:27.343499 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f9ef980-f4be-4fff-bb8c-9f181dbd6edc tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1509 microversion: 2.1 time: 0.236935 Aug 30 04:48:27.345092 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3157/6250] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:27 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:27.544715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:27.545463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:27.552705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:27.553202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:27.561204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:27.562258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:27.562920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:27.563678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:27.996141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:28.008005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a2b532aa-ed66-4a3f-93bd-84b15a2a47bb tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1318 microversion: 2.1 time: 0.467333 Aug 30 04:48:28.008641 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3094/6251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:27 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:28.366309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:28.367950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:28.380935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:28.381459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:28.381906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:28.382632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:28.383096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:28.383528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:28.663214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:28.675633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb2e2db2-6822-4df6-a83b-85e3c8abcd4e tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1509 microversion: 2.1 time: 0.312790 Aug 30 04:48:28.688994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3158/6252] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:28 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1509 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:29.028416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:29.029032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:29.047581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:29.048088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:29.048570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:29.054738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:29.055974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:29.056431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:29.467016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:29.475742 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f98eb407-f412-4d11-b693-8a5f3d148695 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1318 microversion: 2.1 time: 0.451185 Aug 30 04:48:29.476349 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3095/6253] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:29 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:29.696786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:29.698007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:29.712926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:29.713723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:29.714394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:29.715305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:29.715954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:29.716623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.164002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f21f5d93-ac4d-42c3-9287-35842e8d7c0e req-901077ec-e591-4e52-a665-84373c159f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9119a5c0-79cf-4f04-9952-19dae5f1bd7c", "name": "network-vif-deleted", "tag": "7a35ef15-ca9d-4573-920a-75073e3a2fb9"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:30.175903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c14c87df9734c26a3bdd235b0104824', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d78143c4d746e895864122c1c81bc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:30.199737 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9533962-cfed-49e3-a0e0-ab2887ba8079 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 200 len: 1509 microversion: 2.1 time: 0.504118 Aug 30 04:48:30.203656 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3159/6254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:29 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 1509 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:30.207573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:30.209813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f21f5d93-ac4d-42c3-9287-35842e8d7c0e req-901077ec-e591-4e52-a665-84373c159f2f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:30.210560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f21f5d93-ac4d-42c3-9287-35842e8d7c0e req-901077ec-e591-4e52-a665-84373c159f2f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:30.211268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f21f5d93-ac4d-42c3-9287-35842e8d7c0e req-901077ec-e591-4e52-a665-84373c159f2f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.229311 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f21f5d93-ac4d-42c3-9287-35842e8d7c0e req-901077ec-e591-4e52-a665-84373c159f2f service nova] Creating event network-vif-deleted:7a35ef15-ca9d-4573-920a-75073e3a2fb9 for instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c on n-h2-854925-5 Aug 30 04:48:30.238116 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f21f5d93-ac4d-42c3-9287-35842e8d7c0e req-901077ec-e591-4e52-a665-84373c159f2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083032 Aug 30 04:48:30.239512 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3096/6255] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:30.497074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:30.497744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:30.511748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:30.511748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:30.512476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.513201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:30.513694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:30.514128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:30.749975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:30.767245 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b6790ca-026f-4d64-86ad-56f15cd587af tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1318 microversion: 2.1 time: 0.274685 Aug 30 04:48:30.767704 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3160/6256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:30 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:31.242345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:31.243542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] [instance: 9119a5c0-79cf-4f04-9952-19dae5f1bd7c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:31.266288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:31.267588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:31.270207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:31.271715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:31.272354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:31.278063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:31.329933 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] HTTP exception thrown: Instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c could not be found. Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Request method failure captured: Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c HTTP/1.1 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZZ_xUrt3lzqrFlvL2fYm_hdPsZfstkEkTgCHCoBvBV0M4H2ChPWh5FIqytX2prEZz-G8tgqS4yf284mFslMhIp-7odanjej-flFw8Y85nQIxTR-ByjkuPv1qEt3kR9DfULlbzOqgv08MIc9NFS2skfbSoyxGUr_7qmytY7keaV4x7c Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: b9d78143c4d746e895864122c1c81bc2 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestServerAdvancedOps-520759411 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_b9d78143c4d746e895864122c1c81bc2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/b9d78143c4d746e895864122c1c81bc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9d78143c4d746e895864122c1c81bc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/b9d78143c4d746e895864122c1c81bc2"}]}] Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestServerAdvancedOps-520759411 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: b9d78143c4d746e895864122c1c81bc2 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestServerAdvancedOps-520759411 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestServerAdvancedOps-520759411-project Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 8c14c87df9734c26a3bdd235b0104824 Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestServerAdvancedOps-520759411-project Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c could not be found. Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9119a5c0-79cf-4f04-9952-19dae5f1bd7c'} Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c could not be found. Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c could not be found. Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:48:31.331939 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:31.336270 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:48:31.336270 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:48:31.336270 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:48:31.336270 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:48:31.336270 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:48:31.336270 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c could not be found. Aug 30 04:48:31.336270 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:48:31.340206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] Returning 404 to user: Instance 9119a5c0-79cf-4f04-9952-19dae5f1bd7c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:48:31.343567 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-761100ea-d3c7-4bdf-a77a-b6bf20a3e6b1 tempest-TestServerAdvancedOps-520759411 tempest-TestServerAdvancedOps-520759411-project] 10.222.0.27 "GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c" status: 404 len: 111 microversion: 2.1 time: 0.116678 Aug 30 04:48:31.344722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3097/6257] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:31 2022] GET /compute/v2.1/servers/9119a5c0-79cf-4f04-9952-19dae5f1bd7c => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:48:31.789933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:31.791439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:31.810731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:31.811628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:31.812279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:31.821647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:31.822459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:31.823139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:32.542803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:32.551963 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-83e4475d-2eab-41f6-9dfd-4c5b4e165656 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1318 microversion: 2.1 time: 0.766039 Aug 30 04:48:32.574206 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3161/6258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:31 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1318 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:33.588473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:33.589069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:33.592566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:33.596703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:33.617639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:33.621199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:33.621990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:33.622738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:33.624948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:33.625598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:33.737008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-51e1566e-d982-488f-b1f2-cb6ca45d53b9 req-060a5adc-cad7-4288-871b-ebf84138b412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861d0a45-31a6-4215-8def-9712d5f4c6ff", "name": "network-vif-plugged", "status": "completed", "tag": "aee989ea-607c-414f-87f1-eeb2b3852513"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:33.755067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:33.763637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-51e1566e-d982-488f-b1f2-cb6ca45d53b9 req-060a5adc-cad7-4288-871b-ebf84138b412 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:33.764423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-51e1566e-d982-488f-b1f2-cb6ca45d53b9 req-060a5adc-cad7-4288-871b-ebf84138b412 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:33.765026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-51e1566e-d982-488f-b1f2-cb6ca45d53b9 req-060a5adc-cad7-4288-871b-ebf84138b412 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:33.795142 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-51e1566e-d982-488f-b1f2-cb6ca45d53b9 req-060a5adc-cad7-4288-871b-ebf84138b412 service nova] Creating event network-vif-plugged:aee989ea-607c-414f-87f1-eeb2b3852513 for instance 861d0a45-31a6-4215-8def-9712d5f4c6ff on n-h1-854925-5 Aug 30 04:48:33.801823 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-51e1566e-d982-488f-b1f2-cb6ca45d53b9 req-060a5adc-cad7-4288-871b-ebf84138b412 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071487 Aug 30 04:48:33.803021 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3162/6259] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:48:34.142962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:34.177963 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19a4cfcd-b7ec-462d-8bc5-f0816f5fc1f1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1318 microversion: 2.1 time: 0.582491 Aug 30 04:48:34.181410 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3098/6260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:33 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1318 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:35.212534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:35.213915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:35.224472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:35.225314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:35.226249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:35.228694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:35.229410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:35.230092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:35.458627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:35.467149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a59b3c5a-8935-4329-87c3-d83a2462cb4b tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1318 microversion: 2.1 time: 0.263101 Aug 30 04:48:35.482511 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3163/6261] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:35 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:36.488135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:36.488760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:36.500462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:36.501372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:36.515230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:36.524536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:36.525346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:36.527882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:36.809941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:48:36.831983 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0cbaf68b-2301-4b3f-b26c-2c70f8d06bd9 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1506 microversion: 2.1 time: 0.346568 Aug 30 04:48:36.833744 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3099/6262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:36 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:36.868650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15cb8722-32ea-4904-8e34-0f24054b4dd1", "device": "/dev/sdb"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:36.881208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:36.927808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:36.935195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:36.936458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:36.938055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:36.938751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:36.939347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:37.367022 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7ecb020-ae6d-4dff-b6bd-fdd585eb4fa1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "POST /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514153 Aug 30 04:48:37.368688 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3164/6263] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 04:48:36 2022] POST /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:55.338910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=7 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:55.340817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:55.798334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:55.800159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:55.800651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:55.801088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:55.802217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:55.805580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:55.808070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:55.858162 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8c526cd-6072-4fdf-92d0-b082945d4b26 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.529802 Aug 30 04:48:55.859429 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3100/6264] 10.222.0.27 () {58 vars in 1185 bytes} [Tue Aug 30 04:48:55 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:48:56.066757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1753356626", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "availability_zone": "nova:n-h1-854925-5", "networks": [{"uuid": "29138688-2c34-46eb-86e0-37bd6a5cf343"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:48:56.084049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=45 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:56.085497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:48:56.205102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] validate_networks() for [('29138688-2c34-46eb-86e0-37bd6a5cf343', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:48:56.886927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:48:56.887359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:48:56.888038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:48:56.888462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:48:56.888882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:48:56.901356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:56.902247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:56.902882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:56.903632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:56.904097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:56.904534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:56.949243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Getting quotas for project bef65ef671014b478529cf047c6f6c45. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:48:56.961256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Getting quotas for user ad84064031554b95824a73d8cb61dd4f and project bef65ef671014b478529cf047c6f6c45. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:48:57.000908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:48:57.009184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:48:57.065402 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-66d9e99f-aa29-45c4-88bc-cf3b9c38a3d4 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.010108 Aug 30 04:48:57.072813 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3165/6265] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:48:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:48:57.077574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-acaf2d3f-b321-4cc4-862d-ec62a48131ce tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:57.078971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-acaf2d3f-b321-4cc4-862d-ec62a48131ce tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:57.210339 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-acaf2d3f-b321-4cc4-862d-ec62a48131ce tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1329 microversion: 2.1 time: 0.136527 Aug 30 04:48:57.228284 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3101/6266] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:57 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1329 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:48:58.233795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:58.234978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:58.254767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:58.255269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:58.255714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:58.256432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:58.257875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:58.258557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:58.502022 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01461ba8-0aca-4964-9238-a92534599c3b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1338 microversion: 2.1 time: 0.266345 Aug 30 04:48:58.506994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3166/6267] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:58 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1338 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:48:59.539711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:48:59.542402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:48:59.574406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:59.579302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:59.583191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:59.585937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:48:59.589257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:48:59.590086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:48:59.794607 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1df71a34-54d6-4553-8759-bbc603d9e986 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1434 microversion: 2.1 time: 0.265540 Aug 30 04:48:59.795213 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3102/6268] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:48:59 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1434 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:00.827806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:00.828448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:00.846465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:00.850614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:00.851148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:00.854365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:00.855068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:00.858814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:01.075546 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4ab5e18-28ba-433f-8ba2-427c9d832ae5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.258957 Aug 30 04:49:01.079230 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3167/6269] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:00 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:02.110078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:02.119114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:02.182967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:02.186853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:02.187567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:02.188513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:02.191117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:02.191761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:02.504758 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f52abfa0-721e-4219-8b8a-a1841b978970 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.397244 Aug 30 04:49:02.505589 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3103/6270] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:02 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:02.743741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-07c726dc-5c89-405c-a2ab-18a111a86d39 req-2fd646c4-9578-4777-8c36-34bd6776ff8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ccc61b-8c10-4b51-97fd-e1797bbe2687", "tag": "1e7ce661-237c-4f17-8112-9489febc185c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:02.761937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-07c726dc-5c89-405c-a2ab-18a111a86d39 req-2fd646c4-9578-4777-8c36-34bd6776ff8f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:02.763396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-07c726dc-5c89-405c-a2ab-18a111a86d39 req-2fd646c4-9578-4777-8c36-34bd6776ff8f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:02.764083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-07c726dc-5c89-405c-a2ab-18a111a86d39 req-2fd646c4-9578-4777-8c36-34bd6776ff8f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:02.779800 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-07c726dc-5c89-405c-a2ab-18a111a86d39 req-2fd646c4-9578-4777-8c36-34bd6776ff8f service nova] Creating event network-changed:1e7ce661-237c-4f17-8112-9489febc185c for instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 on n-h1-854925-5 Aug 30 04:49:02.792205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-07c726dc-5c89-405c-a2ab-18a111a86d39 req-2fd646c4-9578-4777-8c36-34bd6776ff8f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.424061 Aug 30 04:49:02.793854 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3168/6271] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:49:03.526654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:03.527299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:03.542412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:03.542921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:03.543370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:03.544540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:03.546761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:03.548407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:03.797021 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b819d18d-d3a4-4921-8ede-528a2ac4ebaf tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.275086 Aug 30 04:49:03.798729 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3104/6272] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:03 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:04.825694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:04.828465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:04.838916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:04.839626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:04.840227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:04.841122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:04.841957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:04.842545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:05.031329 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8d0aed52-d552-48ec-887e-ec4e6ffb5fa3 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.213847 Aug 30 04:49:05.032513 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3169/6273] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:04 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:06.053083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:06.054334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:06.060771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:06.062877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:06.063616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:06.064060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:06.065524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:06.065990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:06.066424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:06.319598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-676310f7-919e-459f-8705-12f7a9c656be tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.267446 Aug 30 04:49:06.320501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3105/6274] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:06 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:07.343017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:07.343807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:07.346850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:07.348143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:07.359692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:07.360190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:07.360682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:07.361317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:07.371551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:07.372601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:07.564185 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0cbb4df8-7b04-492a-b24f-c5d3a58d45a8 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.225288 Aug 30 04:49:07.564785 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3170/6275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:07 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:08.596666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:08.597882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:08.604899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:08.608050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:08.608904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:08.609581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:08.610729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:08.611402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:08.612687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:08.800081 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-53830493-c646-4e00-881d-492cd7657537 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.208492 Aug 30 04:49:08.803767 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3106/6276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:08 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:09.619567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-98632586-37dd-4977-a225-588fbd942c90 req-0a882955-fd27-45fa-bdc2-eae4265b89bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ccc61b-8c10-4b51-97fd-e1797bbe2687", "name": "network-vif-plugged", "status": "completed", "tag": "1e7ce661-237c-4f17-8112-9489febc185c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:09.638616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:09.639450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:09.641422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98632586-37dd-4977-a225-588fbd942c90 req-0a882955-fd27-45fa-bdc2-eae4265b89bc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:09.642076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98632586-37dd-4977-a225-588fbd942c90 req-0a882955-fd27-45fa-bdc2-eae4265b89bc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:09.642768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98632586-37dd-4977-a225-588fbd942c90 req-0a882955-fd27-45fa-bdc2-eae4265b89bc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:09.660910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:09.662399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:09.664493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:09.670804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:09.672259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:09.673888 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-98632586-37dd-4977-a225-588fbd942c90 req-0a882955-fd27-45fa-bdc2-eae4265b89bc service nova] Creating event network-vif-plugged:1e7ce661-237c-4f17-8112-9489febc185c for instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 on n-h1-854925-5 Aug 30 04:49:09.674274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:09.685406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-98632586-37dd-4977-a225-588fbd942c90 req-0a882955-fd27-45fa-bdc2-eae4265b89bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071047 Aug 30 04:49:09.687905 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3171/6277] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:49:09.839143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:09.839895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:09.858441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:09.860052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:09.860516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:09.861254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:09.866985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:09.867721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:09.960342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lazy-loading 'services' on Instance uuid 861d0a45-31a6-4215-8def-9712d5f4c6ff {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:49:10.085038 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c86375d5-a2fd-41a6-99ca-4427234dfab1 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "DELETE /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff/os-volume_attachments/15cb8722-32ea-4904-8e34-0f24054b4dd1" status: 202 len: 0 microversion: 2.1 time: 0.451423 Aug 30 04:49:10.088906 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3107/6278] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 04:49:09 2022] DELETE /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff/os-volume_attachments/15cb8722-32ea-4904-8e34-0f24054b4dd1 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 04:49:10.264737 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c82a3fc-e783-4617-a3c4-17859063f4c0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.442347 Aug 30 04:49:10.265622 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3172/6279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:09 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:49:11.288415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:11.289211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:11.298866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:11.299512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:11.300033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:11.300834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:11.301441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:11.301961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:11.962760 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adc78508-8f8d-407c-83a2-23f5153c891d tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1464 microversion: 2.1 time: 0.679237 Aug 30 04:49:11.964325 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3108/6280] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:11 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1464 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:12.987418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:12.988230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:13.005559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:13.007391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:13.009043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:13.010116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:13.010812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:13.011744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:13.311343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f1eed17d-2ccd-461c-ab8f-789060ddf945 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1650 microversion: 2.1 time: 0.329347 Aug 30 04:49:13.314454 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3173/6281] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:12 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1650 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:13.338732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:13.340407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:13.351419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:13.357169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:13.357851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:13.359113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:13.359751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:13.360354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:13.630493 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-98cb2515-2093-45e7-8a55-2a14af49279f tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1650 microversion: 2.1 time: 0.295160 Aug 30 04:49:13.631460 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3109/6282] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:13 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1650 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:13.651857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:13.652856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:13.664896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:13.665785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:13.666466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:13.667425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:13.670302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:13.671055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:14.000777 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-53a28f5a-3e46-4be1-9840-4c4fe7d0d136 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1650 microversion: 2.1 time: 0.345000 Aug 30 04:49:14.020851 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3174/6283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:13 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1650 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:14.174035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1220593482", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "availability_zone": "nova:n-h2-854925-5", "networks": [{"uuid": "29138688-2c34-46eb-86e0-37bd6a5cf343"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:14.312555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] validate_networks() for [('29138688-2c34-46eb-86e0-37bd6a5cf343', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:49:15.238393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:49:15.241363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:49:15.243642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:49:15.244278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:49:15.245229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:49:15.269577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:15.270581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:15.271280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:15.272687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:15.273440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:15.274416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:15.298489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Getting quotas for project bef65ef671014b478529cf047c6f6c45. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:49:15.311400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Getting quotas for user ad84064031554b95824a73d8cb61dd4f and project bef65ef671014b478529cf047c6f6c45. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:49:15.340534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:49:15.343726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:49:15.479059 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-222222f9-f79b-47b7-875f-203300276ed7 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.307221 Aug 30 04:49:15.479059 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3110/6284] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:49:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:49:15.494141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8daad40c-cc10-41ee-b140-ee3d279791c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:15.494837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8daad40c-cc10-41ee-b140-ee3d279791c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:15.686012 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8daad40c-cc10-41ee-b140-ee3d279791c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1329 microversion: 2.1 time: 0.200149 Aug 30 04:49:15.691604 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3175/6285] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:15 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1329 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:16.711129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:16.712766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:16.727827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:16.733769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:16.734444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:16.735404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:16.738092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:16.739048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:17.036740 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-05ab428d-3a4c-4816-b677-252921165256 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1338 microversion: 2.1 time: 0.331165 Aug 30 04:49:17.051374 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3111/6286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:16 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1338 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:18.061425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:18.063176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:18.086142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:18.086801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:18.087456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:18.091616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:18.094624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:18.098627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:18.313655 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16510096-dcff-4d8a-81da-97a206d6029c tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1422 microversion: 2.1 time: 0.255507 Aug 30 04:49:18.314851 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3176/6287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:18 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1422 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:18.895041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99c425d3-aac6-417f-b42d-5ec384828a0d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'create', calling method: .version_select at 0x7fe96aa4e790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-307666598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPbJQ9dShBTFa2WVPWobKWSiRKLNZayvbV6oM+3eHCgjnl7+fHGZM54Z+Ha2SHnoS4gtPtO/laKh/FmAGvs3wUbdWDvaP21paGWL7Tk7dwVbXY5HD7DwxdAGaj5QGzWHQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:18.954325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-99c425d3-aac6-417f-b42d-5ec384828a0d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for project 8002c096e4a74cbea72ac0be290db680. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:49:18.974444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-99c425d3-aac6-417f-b42d-5ec384828a0d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for user 9bf154ac497e4e6e84b10d9a338f085e and project 8002c096e4a74cbea72ac0be290db680. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:49:19.070207 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99c425d3-aac6-417f-b42d-5ec384828a0d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.182078 Aug 30 04:49:19.070939 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3112/6288] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:49:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:49:19.339695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:19.341011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:19.352320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:19.358067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:19.359004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:19.361389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:19.362681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:19.371560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:20.229552 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6bb0fa94-ae9e-48c6-bdda-9ed288a93b58 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1464 microversion: 2.1 time: 0.894411 Aug 30 04:49:20.230161 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3177/6289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:19 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1464 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:49:20.965585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-97048ca4-4a26-4f3d-bdc8-c6a46e0b4dc3 req-075d8718-0610-4bb3-8578-e57201308bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c", "tag": "6b034c7e-c6a4-444f-ab51-474a43fc346b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:21.006785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-97048ca4-4a26-4f3d-bdc8-c6a46e0b4dc3 req-075d8718-0610-4bb3-8578-e57201308bd8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:21.013574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-97048ca4-4a26-4f3d-bdc8-c6a46e0b4dc3 req-075d8718-0610-4bb3-8578-e57201308bd8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:21.014910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-97048ca4-4a26-4f3d-bdc8-c6a46e0b4dc3 req-075d8718-0610-4bb3-8578-e57201308bd8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:21.054088 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-97048ca4-4a26-4f3d-bdc8-c6a46e0b4dc3 req-075d8718-0610-4bb3-8578-e57201308bd8 service nova] Creating event network-changed:6b034c7e-c6a4-444f-ab51-474a43fc346b for instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c on n-h2-854925-5 Aug 30 04:49:21.062811 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-97048ca4-4a26-4f3d-bdc8-c6a46e0b4dc3 req-075d8718-0610-4bb3-8578-e57201308bd8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103009 Aug 30 04:49:21.065563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3113/6290] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:49:21.251937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:21.253292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:21.267005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:21.267594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:21.268871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:21.273436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:21.274137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:21.274667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:21.558603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7bc5e93f-39b8-4405-9c07-707d793b8268 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1464 microversion: 2.1 time: 0.311203 Aug 30 04:49:21.561941 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3178/6291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:21 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:49:21.989006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-135903397", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "3efb19ec-1f2d-4ffe-9b9e-859fe399c6ed"}], "key_name": "tempest-TestNetworkBasicOps-307666598", "security_groups": [{"name": "tempest-secgroup-smoke-997936874"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:22.128543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] validate_networks() for [('3efb19ec-1f2d-4ffe-9b9e-859fe399c6ed', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:49:22.454625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:22.455262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:22.467687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:22.468466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:22.469083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:22.470202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:22.470905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:22.471556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:22.528217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:49:22.767145 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a1f9d6e-e42d-42c8-bb27-ed6de079091a tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "DELETE /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 204 len: 0 microversion: 2.1 time: 0.316017 Aug 30 04:49:22.768187 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3179/6292] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:49:22 2022] DELETE /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:49:22.774082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:22.775713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:22.784144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:22.785898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:22.787218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:22.788193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:22.789393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:22.789996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:22.831312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:49:22.831993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:49:22.832678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:49:22.833252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:49:22.833876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:49:22.849929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:22.851541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:22.859096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:22.869303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:22.870380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:22.870993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:22.902125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for project 8002c096e4a74cbea72ac0be290db680. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:49:22.930033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for user 9bf154ac497e4e6e84b10d9a338f085e and project 8002c096e4a74cbea72ac0be290db680. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:49:22.965466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:49:22.968501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:49:23.054894 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3ef9e55-1542-41a8-a7cd-b59ff4f28ac8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.068978 Aug 30 04:49:23.068692 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3114/6293] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:49:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:49:23.074638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:23.075145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:23.083980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:23.084751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:23.085394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:23.086466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:23.087706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:23.088305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:23.226606 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b58671eb-94e8-432f-8ec4-4f2de5e6bfa0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1464 microversion: 2.1 time: 0.456949 Aug 30 04:49:23.227595 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3180/6294] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:22 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1464 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:23.239913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6c5d979-21e2-4ded-b3a4-173b8cd1afdb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:23.240870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6c5d979-21e2-4ded-b3a4-173b8cd1afdb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:23.315482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c6c5d979-21e2-4ded-b3a4-173b8cd1afdb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:23.324818 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6c5d979-21e2-4ded-b3a4-173b8cd1afdb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1247 microversion: 2.1 time: 0.090316 Aug 30 04:49:23.325808 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3181/6295] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:23 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:23.537878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:23.553097 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d9d612db-2e02-4ff2-b378-3ac48cd4da20 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1512 microversion: 2.1 time: 0.478856 Aug 30 04:49:23.554217 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3115/6296] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:23 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1512 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:24.250207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:24.251934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:24.269656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:24.270372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:24.270850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:24.271598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:24.272034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:24.272468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:24.347708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:24.348244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:24.359997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:24.361254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:24.361962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:24.365158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:24.365972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:24.366796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:24.470667 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ac2ce7ad-8063-4856-b33b-9f9b05955707 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1464 microversion: 2.1 time: 0.225234 Aug 30 04:49:24.476079 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3182/6297] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:24 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1464 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:24.507086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:24.517452 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12c89359-5481-4e65-b528-4c09d410cd01 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1299 microversion: 2.1 time: 0.175467 Aug 30 04:49:24.519281 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3116/6298] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:24 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1299 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:49:24.581633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:24.583013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:24.595980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:24.597689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:24.600100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:24.602654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:24.603824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:24.604776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:24.906001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:24.911043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:24.918642 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2de2b303-a5ef-4dad-8790-d0c64accc9f0 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1512 microversion: 2.1 time: 0.345498 Aug 30 04:49:24.922429 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3183/6299] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:24 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:25.499387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:25.499947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:25.504046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:25.516476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:25.516978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:25.517479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:25.518812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:25.530032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:25.530753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:25.534648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:25.540831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:25.542074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:25.554155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:25.558004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:25.558935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:25.559870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:25.564519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:25.565761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:26.105535 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-62105308-b096-4012-bc80-517221100bfc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1464 microversion: 2.1 time: 0.609842 Aug 30 04:49:26.108274 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3117/6300] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:25 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1464 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:49:26.122303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:26.123259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:26.133948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:26.138863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:26.139390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:26.140228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:26.140721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:26.141146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:26.281708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:26.293492 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-17428856-e36a-46ea-a3e8-72040aaaf074 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.756659 Aug 30 04:49:26.294701 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3184/6301] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:25 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:26.301874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4eb38b54-1ed1-4dd0-b244-ce1bca284a70 req-143f203c-a0b0-4be2-8443-ff70c333c912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861d0a45-31a6-4215-8def-9712d5f4c6ff", "name": "network-vif-deleted", "tag": "aee989ea-607c-414f-87f1-eeb2b3852513"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:26.318006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eabb2f9c36d7457e97343142e2487ccf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '754a747b965249349b3a850158553fd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:26.324902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:26.327780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4eb38b54-1ed1-4dd0-b244-ce1bca284a70 req-143f203c-a0b0-4be2-8443-ff70c333c912 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:26.328484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4eb38b54-1ed1-4dd0-b244-ce1bca284a70 req-143f203c-a0b0-4be2-8443-ff70c333c912 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:26.334636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e73cc35-71d6-4971-8965-b54667da1941 tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 200 len: 1303 microversion: 2.1 time: 0.225235 Aug 30 04:49:26.336662 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3118/6302] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:26 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 1303 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:26.338370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4eb38b54-1ed1-4dd0-b244-ce1bca284a70 req-143f203c-a0b0-4be2-8443-ff70c333c912 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:26.348224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b9418789-62b7-4eda-9e21-afdc012fd99f req-ee7c9b01-a543-4e95-9f77-dcaad9f77130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c", "name": "network-vif-plugged", "status": "completed", "tag": "6b034c7e-c6a4-444f-ab51-474a43fc346b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:26.366975 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4eb38b54-1ed1-4dd0-b244-ce1bca284a70 req-143f203c-a0b0-4be2-8443-ff70c333c912 service nova] Creating event network-vif-deleted:aee989ea-607c-414f-87f1-eeb2b3852513 for instance 861d0a45-31a6-4215-8def-9712d5f4c6ff on n-h1-854925-5 Aug 30 04:49:26.371615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9418789-62b7-4eda-9e21-afdc012fd99f req-ee7c9b01-a543-4e95-9f77-dcaad9f77130 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:26.375502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9418789-62b7-4eda-9e21-afdc012fd99f req-ee7c9b01-a543-4e95-9f77-dcaad9f77130 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:26.375963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9418789-62b7-4eda-9e21-afdc012fd99f req-ee7c9b01-a543-4e95-9f77-dcaad9f77130 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:26.379484 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4eb38b54-1ed1-4dd0-b244-ce1bca284a70 req-143f203c-a0b0-4be2-8443-ff70c333c912 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082591 Aug 30 04:49:26.383494 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3185/6303] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:49:26.398693 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b9418789-62b7-4eda-9e21-afdc012fd99f req-ee7c9b01-a543-4e95-9f77-dcaad9f77130 service nova] Creating event network-vif-plugged:6b034c7e-c6a4-444f-ab51-474a43fc346b for instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c on n-h2-854925-5 Aug 30 04:49:26.406020 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b9418789-62b7-4eda-9e21-afdc012fd99f req-ee7c9b01-a543-4e95-9f77-dcaad9f77130 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067765 Aug 30 04:49:26.407799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3119/6304] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:49:26.957591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3473f527-7ebb-4db5-bd05-c281b4c7546c req-81c97eb0-924a-4d50-b9f7-65596aeaaf4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7620fd3-9269-4921-bc0c-aa809f7f6e1f", "tag": "e7aae47d-2c2b-404e-9a9c-4191d1fa6687"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:26.971468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3473f527-7ebb-4db5-bd05-c281b4c7546c req-81c97eb0-924a-4d50-b9f7-65596aeaaf4f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:26.971961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3473f527-7ebb-4db5-bd05-c281b4c7546c req-81c97eb0-924a-4d50-b9f7-65596aeaaf4f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:26.972398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3473f527-7ebb-4db5-bd05-c281b4c7546c req-81c97eb0-924a-4d50-b9f7-65596aeaaf4f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:26.985312 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3473f527-7ebb-4db5-bd05-c281b4c7546c req-81c97eb0-924a-4d50-b9f7-65596aeaaf4f service nova] Creating event network-changed:e7aae47d-2c2b-404e-9a9c-4191d1fa6687 for instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f on n-h2-854925-5 Aug 30 04:49:26.996638 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3473f527-7ebb-4db5-bd05-c281b4c7546c req-81c97eb0-924a-4d50-b9f7-65596aeaaf4f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044681 Aug 30 04:49:26.997833 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3186/6305] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:49:27.139971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:27.140705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:27.149064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:27.149715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:27.150297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:27.151586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:27.152675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:27.153403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:27.316284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:27.317145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:27.331038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:27.332723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:27.333498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:27.334405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:27.334988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:27.335519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:27.942937 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8382602b-c784-44a5-b0f4-e64899456bb6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1464 microversion: 2.1 time: 0.808146 Aug 30 04:49:27.943693 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3120/6306] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:27 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1464 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:27.950689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:27.951550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] [instance: 861d0a45-31a6-4215-8def-9712d5f4c6ff] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:27.959777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:27.960410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:27.960949 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:27.961793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:27.962357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:27.962905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:27.983893 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] HTTP exception thrown: Instance 861d0a45-31a6-4215-8def-9712d5f4c6ff could not be found. Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Request method failure captured: Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff HTTP/1.1 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZXELUyDLMzQxUWk-TB1Is9GkJm5u8PAAR00CHWk2PadfCzP_yvRmwdF2uNi46aSU71zJjSDN5ZwYAEooC7Vxy2DSIc_csOC2qZ4eM-ufzTZBdvR3Ib2iOthdW_NkOuBAY7315sGOvarAgK-InFvlp_UTBmM5qX4JYyMdyrvX26t-yo Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 754a747b965249349b3a850158553fd6 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-VolumesSnapshotTestJSON-674509528 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_754a747b965249349b3a850158553fd6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/754a747b965249349b3a850158553fd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/754a747b965249349b3a850158553fd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/754a747b965249349b3a850158553fd6"}]}] Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-VolumesSnapshotTestJSON-674509528 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 754a747b965249349b3a850158553fd6 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-674509528 Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-VolumesSnapshotTestJSON-674509528-project Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: eabb2f9c36d7457e97343142e2487ccf Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-VolumesSnapshotTestJSON-674509528-project Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 861d0a45-31a6-4215-8def-9712d5f4c6ff could not be found. Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '861d0a45-31a6-4215-8def-9712d5f4c6ff'} Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861d0a45-31a6-4215-8def-9712d5f4c6ff could not be found. Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861d0a45-31a6-4215-8def-9712d5f4c6ff could not be found. Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:49:27.985895 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861d0a45-31a6-4215-8def-9712d5f4c6ff could not be found. Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:27.990203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] Returning 404 to user: Instance 861d0a45-31a6-4215-8def-9712d5f4c6ff could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:49:27.990765 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74b3d079-77fc-453a-bcb7-54df04a2326c tempest-VolumesSnapshotTestJSON-674509528 tempest-VolumesSnapshotTestJSON-674509528-project] 10.222.0.27 "GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff" status: 404 len: 111 microversion: 2.1 time: 0.044645 Aug 30 04:49:27.991475 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3121/6307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:27 2022] GET /compute/v2.1/servers/861d0a45-31a6-4215-8def-9712d5f4c6ff => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:49:28.201860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:28.210245 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e13ce1a-70c5-4782-b587-ccaca663ea0f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.898817 Aug 30 04:49:28.211690 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3187/6308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:27 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:28.964729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:28.965297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:28.975172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:28.975928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:28.976376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:28.977404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:28.977868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:28.978483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.137836 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e4508004-73ec-491b-98cc-d22c6b75ef19 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1649 microversion: 2.1 time: 0.176707 Aug 30 04:49:29.139058 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3122/6309] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:28 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1649 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:29.161104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:29.167372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:29.175000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.178752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.179402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.180311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.180773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.181209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.233141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:29.233718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:29.240857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.241385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.241830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.242748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.243541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.244585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.421780 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5246eee3-ca71-42d0-99dc-3dfccfb9117b tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1649 microversion: 2.1 time: 0.265601 Aug 30 04:49:29.423581 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3188/6310] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:29 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1649 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:29.444719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:29.446207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:29.459394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.459931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.460601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.461292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.466013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.466481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.518745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:29.527935 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-566f67dd-c177-468a-92ac-ae19df52e391 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.299212 Aug 30 04:49:29.528493 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3123/6311] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:29 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:29.625510 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18a708e4-0b2b-4199-a8dd-c1571108cff0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1649 microversion: 2.1 time: 0.186857 Aug 30 04:49:29.626111 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3189/6312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:29 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1649 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:29.647065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:29.647575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:29.654252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.654730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.655175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.655879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.656335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.656886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.685942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:49:29.792134 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2adf8434-dc18-427d-abfd-884dd85cc5c5 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 204 len: 0 microversion: 2.1 time: 0.148784 Aug 30 04:49:29.793218 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3124/6313] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:49:29 2022] DELETE /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:49:29.816456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:29.817082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:29.823598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.824333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.824855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.825801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:29.826327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:29.826818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:29.997465 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfe8465f-3ce9-441e-a37d-acf78f1b2779 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1655 microversion: 2.1 time: 0.186426 Aug 30 04:49:29.998157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3190/6314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:29 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1655 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:30.550263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:30.550971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:30.557573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:30.558340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:30.558777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:30.559484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:30.559944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:30.560372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:30.772035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:30.782481 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb379874-14d4-469e-9b92-33b82b4dd83a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.236942 Aug 30 04:49:30.783079 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3125/6315] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:30 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:49:31.020185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:31.021892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:31.034354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:31.035215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:31.035881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:31.037442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:31.039087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:31.039721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:31.424518 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e313e094-65dc-4c50-a118-45e643a66ac0 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1655 microversion: 2.1 time: 0.409419 Aug 30 04:49:31.425711 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3191/6316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:31 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1655 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:31.804631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:31.805531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:31.826639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:31.827333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:31.828054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:31.828806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:31.829059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-50f80270-4581-40b3-b7e4-612a60ce6a3c req-710f1265-4f84-4b0d-afc2-9acbf381a94e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c", "name": "network-vif-deleted", "tag": "6b034c7e-c6a4-444f-ab51-474a43fc346b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:31.829669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:31.830272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:31.858204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-50f80270-4581-40b3-b7e4-612a60ce6a3c req-710f1265-4f84-4b0d-afc2-9acbf381a94e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:31.858606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-50f80270-4581-40b3-b7e4-612a60ce6a3c req-710f1265-4f84-4b0d-afc2-9acbf381a94e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:31.892095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-50f80270-4581-40b3-b7e4-612a60ce6a3c req-710f1265-4f84-4b0d-afc2-9acbf381a94e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:31.923669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-50f80270-4581-40b3-b7e4-612a60ce6a3c req-710f1265-4f84-4b0d-afc2-9acbf381a94e service nova] Creating event network-vif-deleted:6b034c7e-c6a4-444f-ab51-474a43fc346b for instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c on n-h2-854925-5 Aug 30 04:49:31.936563 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-50f80270-4581-40b3-b7e4-612a60ce6a3c req-710f1265-4f84-4b0d-afc2-9acbf381a94e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111198 Aug 30 04:49:31.943194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3192/6317] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:49:32.144713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:32.166177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-54a7434a-fdf3-4def-8bd1-0b4c2c73b36e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.365520 Aug 30 04:49:32.170706 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3126/6318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:31 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:32.449839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:32.453013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:32.470961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:32.472327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:32.473104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:32.474091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:32.474700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:32.475277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:32.532295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:32.532646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:32.534601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:32.535065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lazy-loading 'fault' on Instance uuid 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:49:32.627723 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-02ebea96-3f73-4d36-ac15-3f78fd671d89 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 200 len: 1454 microversion: 2.1 time: 0.185326 Aug 30 04:49:32.628338 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3193/6319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:32 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:33.193475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:33.194083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:33.197127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:33.199230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=16 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:33.217067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.218757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.225205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.231336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.234146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.236577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.442729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:33.452970 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dcf5c6b9-417c-4364-aaf7-a53f064d9b7f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.263875 Aug 30 04:49:33.454225 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3127/6320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:33 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:33.652112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:33.652865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:33.655073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:33.662480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.663011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.663460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.664196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.664654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.665092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.680505 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] HTTP exception thrown: Instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c could not be found. Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Request method failure captured: Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c HTTP/1.1 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZa3ypq-5lUibSKmFNoXk0N00bbd1-6ERx7ZNlk_TWB4W5INEjvuE-ypJ-vn5z7U3SyTuXwSdvVa3h2RgzOYxJ2ahrcWgHlhETM7oN_M_Wpt_EiQ2z1VV0W3ziiBeBaXlAacI4FVvFl1xVfdxQg8p4B5_9VOqH5_fOxKcy8_QqiB1EI Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: bef65ef671014b478529cf047c6f6c45 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestServerMultinode-1447561841 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef65ef671014b478529cf047c6f6c45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef65ef671014b478529cf047c6f6c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef65ef671014b478529cf047c6f6c45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef65ef671014b478529cf047c6f6c45"}]}] Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestServerMultinode-1447561841 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: bef65ef671014b478529cf047c6f6c45 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestServerMultinode-1447561841 Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestServerMultinode-1447561841-project-admin Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: ad84064031554b95824a73d8cb61dd4f Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestServerMultinode-1447561841-project-admin Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c could not be found. Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c'} Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c could not be found. Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c could not be found. Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:49:33.682227 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c could not be found. Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Returning 404 to user: Instance 2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-db9e733e-1073-4629-9447-c371b6281bbd tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c" status: 404 len: 111 microversion: 2.1 time: 0.035443 Aug 30 04:49:33.688396 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3194/6321] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:33 2022] GET /compute/v2.1/servers/2efbd06b-6a41-4eb0-8cac-9d3bb8735a4c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:49:33.692274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:33.693409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:33.699953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.700438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.700875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.701594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.702048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.702469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.728457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:49:33.822432 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-352395e0-abc4-4d23-8657-3078b1aa43a1 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "DELETE /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 204 len: 0 microversion: 2.1 time: 0.133015 Aug 30 04:49:33.824456 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3128/6322] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:49:33 2022] DELETE /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:49:33.835732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:33.836475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:33.844533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.845558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.846829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.847762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:33.848426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:33.849057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:33.998625 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3d9e3b12-eed4-4f70-be94-af2caad29edc tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1656 microversion: 2.1 time: 0.168921 Aug 30 04:49:33.999215 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3195/6323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:33 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:34.222451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-df2bc286-d160-406a-8f08-87cf0435479c req-14dc2259-d6f4-44d6-a27b-f75425230e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7620fd3-9269-4921-bc0c-aa809f7f6e1f", "name": "network-vif-plugged", "status": "completed", "tag": "e7aae47d-2c2b-404e-9a9c-4191d1fa6687"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:34.237834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-df2bc286-d160-406a-8f08-87cf0435479c req-14dc2259-d6f4-44d6-a27b-f75425230e28 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:34.238516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-df2bc286-d160-406a-8f08-87cf0435479c req-14dc2259-d6f4-44d6-a27b-f75425230e28 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:34.238957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-df2bc286-d160-406a-8f08-87cf0435479c req-14dc2259-d6f4-44d6-a27b-f75425230e28 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:34.264351 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-df2bc286-d160-406a-8f08-87cf0435479c req-14dc2259-d6f4-44d6-a27b-f75425230e28 service nova] Creating event network-vif-plugged:e7aae47d-2c2b-404e-9a9c-4191d1fa6687 for instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f on n-h2-854925-5 Aug 30 04:49:34.272060 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-df2bc286-d160-406a-8f08-87cf0435479c req-14dc2259-d6f4-44d6-a27b-f75425230e28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054206 Aug 30 04:49:34.273464 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3129/6324] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:49:34.475303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:34.476236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:34.491650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:34.492047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:34.492691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:34.493434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:34.493925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:34.494374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:34.715314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:34.724366 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ff2508f0-603f-42a4-9533-ec4e704830ad tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.252818 Aug 30 04:49:34.729289 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3196/6325] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:34 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:35.021998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:35.023235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:35.031016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:35.031993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:35.032603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:35.035332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:35.035988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:35.037048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:35.185938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a178942c-5df1-48d2-a5b8-248633c148c6 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1656 microversion: 2.1 time: 0.169609 Aug 30 04:49:35.186857 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3130/6326] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:35 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:35.753174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:35.753837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:35.769169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:35.769692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:35.770134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:35.770847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:35.771304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:35.771733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:35.982556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:35.992830 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4abd3824-1858-4aad-88b9-d68c4a040a6b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1372 microversion: 2.1 time: 0.244489 Aug 30 04:49:35.994359 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3197/6327] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:35 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1372 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:36.215771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:36.217316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:36.232164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:36.233653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:36.234311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:36.238311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:36.240617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:36.241218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:36.457880 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b2b63af-8b54-4d2a-8ac8-b139e3ba9889 tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 200 len: 1656 microversion: 2.1 time: 0.251711 Aug 30 04:49:36.458776 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3131/6328] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:36 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 1656 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:49:36.482217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1c46ed26-66f7-442e-aa2b-9652abd1256f req-423b62fb-9592-4ae4-b152-1d067a1c471a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ccc61b-8c10-4b51-97fd-e1797bbe2687", "name": "network-vif-deleted", "tag": "1e7ce661-237c-4f17-8112-9489febc185c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:36.497080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c46ed26-66f7-442e-aa2b-9652abd1256f req-423b62fb-9592-4ae4-b152-1d067a1c471a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:36.497595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c46ed26-66f7-442e-aa2b-9652abd1256f req-423b62fb-9592-4ae4-b152-1d067a1c471a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:36.498249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c46ed26-66f7-442e-aa2b-9652abd1256f req-423b62fb-9592-4ae4-b152-1d067a1c471a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:36.517866 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1c46ed26-66f7-442e-aa2b-9652abd1256f req-423b62fb-9592-4ae4-b152-1d067a1c471a service nova] Creating event network-vif-deleted:1e7ce661-237c-4f17-8112-9489febc185c for instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 on n-h1-854925-5 Aug 30 04:49:36.523879 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1c46ed26-66f7-442e-aa2b-9652abd1256f req-423b62fb-9592-4ae4-b152-1d067a1c471a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046114 Aug 30 04:49:36.528572 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3198/6329] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:49:37.013989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:37.014604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:37.030323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:37.030837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:37.031283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:37.032178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:37.032645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:37.033232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:37.080062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:49:37.322096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:37.332321 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9bc89dc3-a9cb-4f05-93bf-b8df6c1efda7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1545 microversion: 2.1 time: 0.322209 Aug 30 04:49:37.333398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3132/6330] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:37 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1545 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:37.364624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:37.365354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:37.383276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:37.384870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:37.385643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:37.386378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:37.386842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:37.387275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:37.479758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:49:37.480376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] [instance: 44ccc61b-8c10-4b51-97fd-e1797bbe2687] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:49:37.489170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:37.489699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:37.490141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:37.490844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:37.491301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:37.496091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:37.522157 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] HTTP exception thrown: Instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 could not be found. Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Request method failure captured: Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 HTTP/1.1 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZa3ypq-5lUibSKmFNoXk0N00bbd1-6ERx7ZNlk_TWB4W5INEjvuE-ypJ-vn5z7U3SyTuXwSdvVa3h2RgzOYxJ2ahrcWgHlhETM7oN_M_Wpt_EiQ2z1VV0W3ziiBeBaXlAacI4FVvFl1xVfdxQg8p4B5_9VOqH5_fOxKcy8_QqiB1EI Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: bef65ef671014b478529cf047c6f6c45 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestServerMultinode-1447561841 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bef65ef671014b478529cf047c6f6c45", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bef65ef671014b478529cf047c6f6c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef65ef671014b478529cf047c6f6c45"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bef65ef671014b478529cf047c6f6c45"}]}] Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestServerMultinode-1447561841 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: bef65ef671014b478529cf047c6f6c45 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestServerMultinode-1447561841 Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestServerMultinode-1447561841-project-admin Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: ad84064031554b95824a73d8cb61dd4f Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestServerMultinode-1447561841-project-admin Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 could not be found. Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '44ccc61b-8c10-4b51-97fd-e1797bbe2687'} Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 could not be found. Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 could not be found. Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:49:37.524383 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:37.528593 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:49:37.528593 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:49:37.528593 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:49:37.528593 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:49:37.528593 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:49:37.528593 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 could not be found. Aug 30 04:49:37.528593 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:49:37.541560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] Returning 404 to user: Instance 44ccc61b-8c10-4b51-97fd-e1797bbe2687 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:49:37.542937 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32418e9d-65ed-4fb6-9d06-9abbc1188d4a tempest-TestServerMultinode-1447561841 tempest-TestServerMultinode-1447561841-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687" status: 404 len: 111 microversion: 2.1 time: 0.067284 Aug 30 04:49:37.544497 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3133/6331] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:37 2022] GET /compute/v2.1/servers/44ccc61b-8c10-4b51-97fd-e1797bbe2687 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:49:37.739996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:49:37.777052 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-58fbf9d1-5132-4641-8105-b31a27cc421e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1545 microversion: 2.1 time: 0.418331 Aug 30 04:49:37.789978 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3199/6332] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:49:37 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1545 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:49:42.130371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ffbdd307-0c8a-4d99-8640-68417ce2b17d req-815b765c-fafc-4fee-871b-2b298011c79b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7620fd3-9269-4921-bc0c-aa809f7f6e1f", "tag": "e7aae47d-2c2b-404e-9a9c-4191d1fa6687"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:49:42.206569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ffbdd307-0c8a-4d99-8640-68417ce2b17d req-815b765c-fafc-4fee-871b-2b298011c79b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:49:42.208120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ffbdd307-0c8a-4d99-8640-68417ce2b17d req-815b765c-fafc-4fee-871b-2b298011c79b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:49:42.214450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ffbdd307-0c8a-4d99-8640-68417ce2b17d req-815b765c-fafc-4fee-871b-2b298011c79b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:49:42.273383 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ffbdd307-0c8a-4d99-8640-68417ce2b17d req-815b765c-fafc-4fee-871b-2b298011c79b service nova] Creating event network-changed:e7aae47d-2c2b-404e-9a9c-4191d1fa6687 for instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f on n-h2-854925-5 Aug 30 04:49:42.314196 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ffbdd307-0c8a-4d99-8640-68417ce2b17d req-815b765c-fafc-4fee-871b-2b298011c79b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202351 Aug 30 04:49:42.316703 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3134/6333] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:50:01.137836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:01.140366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:01.144934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=31 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:01.145863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=78 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:01.152651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:01.153462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:01.154107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:01.155050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:01.155737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:01.156460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:01.216769 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a378479a-6df0-4bfa-958d-a6afc40735b4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f/action" status: 200 len: 24569 microversion: 2.1 time: 0.082306 Aug 30 04:50:01.226157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3200/6334] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:50:01 2022] POST /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f/action => generated 24569 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:50:14.155239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf465920-3276-4a71-8a63-c25360f2dd23 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'create', calling method: .version_select at 0x7fe96a4eac10>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1122821463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbECPV/34+z8g3i/kn2Nu5Uq5SKbzVV8VCyaLUrrl2iso/KPxGOu9VuTX7deRd/Ld+kwtY36uOq/zEjfgeEUkpRoLcK3Ty2ikzZjY+hW74eUV0Z+56HIdiKJ9URWWAi7g=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:14.164993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:14.165784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=7 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:14.180762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-cf465920-3276-4a71-8a63-c25360f2dd23 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for project 8002c096e4a74cbea72ac0be290db680. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:50:14.192780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-cf465920-3276-4a71-8a63-c25360f2dd23 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for user 9bf154ac497e4e6e84b10d9a338f085e and project 8002c096e4a74cbea72ac0be290db680. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:50:14.232962 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf465920-3276-4a71-8a63-c25360f2dd23 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.081889 Aug 30 04:50:14.234711 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3135/6335] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:50:14 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:50:15.828963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1634075147", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "d9988562-a070-47f4-af55-0b82efbbec2f"}], "key_name": "tempest-TestNetworkBasicOps-1122821463", "security_groups": [{"name": "tempest-secgroup-smoke-2146077396"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:15.847313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:15.848389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:16.038840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] validate_networks() for [('d9988562-a070-47f4-af55-0b82efbbec2f', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:50:16.531417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:50:16.532053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:50:16.534739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:50:16.535357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:50:16.535945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:50:16.549441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:16.550664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:16.551302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:16.552208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:16.553031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:16.553680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:16.576417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for project 8002c096e4a74cbea72ac0be290db680. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:50:16.582724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for user 9bf154ac497e4e6e84b10d9a338f085e and project 8002c096e4a74cbea72ac0be290db680. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:50:16.602546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:50:16.605658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:50:16.658215 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52082dbd-880d-4844-a6fa-76542ffeb1f1 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.835218 Aug 30 04:50:16.660759 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3201/6336] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:50:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:50:16.672781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f682b806-d2ed-4e11-a0db-6f1006ed28e9 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:16.674513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f682b806-d2ed-4e11-a0db-6f1006ed28e9 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:16.752151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f682b806-d2ed-4e11-a0db-6f1006ed28e9 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:16.763539 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f682b806-d2ed-4e11-a0db-6f1006ed28e9 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1249 microversion: 2.1 time: 0.096989 Aug 30 04:50:16.764919 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3136/6337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:16 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:17.785996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:17.786549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:17.793164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:17.793780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:17.794345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:17.795079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:17.795541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:17.795970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:17.866840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:17.876121 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-afd13025-7511-4ada-9afd-c59a51861c2e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1301 microversion: 2.1 time: 0.095661 Aug 30 04:50:17.876704 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3202/6338] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:17 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1301 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:18.898781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:18.900008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:18.916775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:18.918792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:18.919424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:18.923030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:18.925100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:18.927695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:19.148253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:19.158181 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0082007a-960a-4e51-8229-c5b3ee18686c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.263736 Aug 30 04:50:19.178021 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3137/6339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:18 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:19.860579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-63e47395-27e5-4593-beea-94c2a9f05d0b req-57e0f1fa-5b8a-42e6-a62e-217e220867bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9beacc85-3b3f-4f1c-8618-eae9255a42e2", "tag": "597b23b9-bff8-49cd-bd48-c6fc88546ea9"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:19.876028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63e47395-27e5-4593-beea-94c2a9f05d0b req-57e0f1fa-5b8a-42e6-a62e-217e220867bd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:19.876783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63e47395-27e5-4593-beea-94c2a9f05d0b req-57e0f1fa-5b8a-42e6-a62e-217e220867bd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:19.877993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-63e47395-27e5-4593-beea-94c2a9f05d0b req-57e0f1fa-5b8a-42e6-a62e-217e220867bd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:19.913523 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-63e47395-27e5-4593-beea-94c2a9f05d0b req-57e0f1fa-5b8a-42e6-a62e-217e220867bd service nova] Creating event network-changed:597b23b9-bff8-49cd-bd48-c6fc88546ea9 for instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 on n-h1-854925-5 Aug 30 04:50:19.933000 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-63e47395-27e5-4593-beea-94c2a9f05d0b req-57e0f1fa-5b8a-42e6-a62e-217e220867bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072864 Aug 30 04:50:19.935899 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3203/6340] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:50:20.182252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:20.183818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:20.193536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:20.194480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:20.195208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:20.198624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:20.199560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:20.200842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:20.370705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:20.384467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-615250c8-398c-4d0b-b0da-9421c1f432c3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.207660 Aug 30 04:50:20.385523 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3138/6341] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:20 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:21.407349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:21.409190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:21.417724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:21.418471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:21.418921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:21.419634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:21.420136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:21.420568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:21.560087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:21.569975 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e9ed1013-1096-4d4f-b3d7-ec8c051de440 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.167270 Aug 30 04:50:21.570735 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3204/6342] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:21 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:22.592696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:22.594180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:22.602853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:22.604155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:22.604832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:22.605794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:22.606482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:22.607137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:22.756367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:22.765033 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9f085814-ed1f-4ad1-aaf1-9cf413df519b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.176357 Aug 30 04:50:22.766050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3139/6343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:22 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:23.788154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:23.788788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:23.795987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:23.796487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:23.796938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:23.797685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:23.798330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:23.799411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:23.954998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:23.963431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b0951f3b-2b38-4361-a416-a5783d9a18d8 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.180876 Aug 30 04:50:23.968171 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3205/6344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:23 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:24.985110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:24.985771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:24.994740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:24.995534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:24.995977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:24.996688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:24.997142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:24.997780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:25.162372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:25.170242 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba5e74fb-c9b2-405d-8f5b-edde4aa8cb17 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.189558 Aug 30 04:50:25.170685 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3140/6345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:24 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:26.015069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-00be52f7-5e5c-4f8a-b578-ec9b021a9640 req-22da1fd5-f5bb-4286-bc79-c03a92a22fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9beacc85-3b3f-4f1c-8618-eae9255a42e2", "name": "network-vif-plugged", "status": "completed", "tag": "597b23b9-bff8-49cd-bd48-c6fc88546ea9"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:26.025200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-00be52f7-5e5c-4f8a-b578-ec9b021a9640 req-22da1fd5-f5bb-4286-bc79-c03a92a22fe1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:26.025731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-00be52f7-5e5c-4f8a-b578-ec9b021a9640 req-22da1fd5-f5bb-4286-bc79-c03a92a22fe1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:26.026181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-00be52f7-5e5c-4f8a-b578-ec9b021a9640 req-22da1fd5-f5bb-4286-bc79-c03a92a22fe1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:26.039464 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-00be52f7-5e5c-4f8a-b578-ec9b021a9640 req-22da1fd5-f5bb-4286-bc79-c03a92a22fe1 service nova] Creating event network-vif-plugged:597b23b9-bff8-49cd-bd48-c6fc88546ea9 for instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 on n-h1-854925-5 Aug 30 04:50:26.045423 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-00be52f7-5e5c-4f8a-b578-ec9b021a9640 req-22da1fd5-f5bb-4286-bc79-c03a92a22fe1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246994 Aug 30 04:50:26.046896 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3206/6346] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:50:26.201181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:26.201904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:26.209246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:26.210065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:26.210882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:26.211998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:26.212788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:26.213413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:26.365055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:26.373917 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b699c967-5ee6-486b-8d02-d00e9bb15644 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.177207 Aug 30 04:50:26.374517 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3141/6347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:26 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:27.395464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:27.396844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:27.399040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:27.400255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:27.407525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:27.408272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:27.409109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:27.410013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:27.410645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:27.411073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:27.572493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:27.587453 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2746ad89-c215-49bd-8c3a-a065132b2e9d tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1375 microversion: 2.1 time: 0.196111 Aug 30 04:50:27.603636 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3207/6348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:27 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1375 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:28.610534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:28.611336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:28.617715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:28.620521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:28.621005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:28.621663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:28.622360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:28.622985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:28.623412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:29.050167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:29.064519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e0a6dd3-2450-4964-83b3-f011abefc1b7 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1548 microversion: 2.1 time: 0.458482 Aug 30 04:50:29.065791 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3142/6349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:28 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1548 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:50:29.087342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:29.089292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:29.098400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:29.099647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:29.100158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:29.100893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:29.101502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:29.101959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:29.250881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:29.260397 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad0ed7d7-48f5-412b-945a-39d6d33316fa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1548 microversion: 2.1 time: 0.178294 Aug 30 04:50:29.261359 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3208/6350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:29 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:30.466212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-854abfc6-bd66-4524-b716-5302692c5022 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Action: 'create', calling method: .version_select at 0x7fe96936d280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1869900284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcxujw4jiwLNyytUI98YiqHyAVlPYAvGjNVSzuk2CtUSratnHg7BAqoiyWrrLzj8zLUAMXFWfd+50N6qxsrfrVHv9y7bw4MY1zIwXDbPdYqU3jL1FPwgZAdMkCHgRaFfA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:30.482177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-854abfc6-bd66-4524-b716-5302692c5022 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Getting quotas for project dc92f536d0984fada835f6fba82bebaf. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:50:30.487916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-854abfc6-bd66-4524-b716-5302692c5022 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Getting quotas for user a80a102aa8bd472e8216e6f4dbbf6879 and project dc92f536d0984fada835f6fba82bebaf. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:50:30.512648 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-854abfc6-bd66-4524-b716-5302692c5022 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.217306 Aug 30 04:50:30.513278 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3143/6351] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:50:30 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:50:38.718619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1132016782-access_point-1292610453", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "0b688ac6-41a5-422c-a255-018fcce3ea72"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1869900284", "security_groups": [{"name": "tempest-secgroup_access--1294200654"}, {"name": "tempest-secgroup_general--2082486071"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:38.998078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] validate_networks() for [('0b688ac6-41a5-422c-a255-018fcce3ea72', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:50:39.257832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=36 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:39.846038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:50:39.847602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:50:39.848345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:50:39.848997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:50:39.849800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:50:39.864553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:39.865475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:39.866186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:39.867279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:39.868290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:39.869051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:39.891925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Getting quotas for project dc92f536d0984fada835f6fba82bebaf. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:50:39.899313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Getting quotas for user a80a102aa8bd472e8216e6f4dbbf6879 and project dc92f536d0984fada835f6fba82bebaf. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:50:39.915448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:50:39.918754 n-d-854925-5 devstack@n-api.service[122403]: WARNING nova.utils [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1132016782-access_point-1292610453 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1132016782-ac Aug 30 04:50:39.920070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:50:40.015340 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-30bc155b-8528-4593-9868-73179ac5e0de tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 1.299210 Aug 30 04:50:40.026862 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3209/6352] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:50:38 2022] POST /compute/v2.1/servers => generated 458 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:50:40.036682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=36 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:40.041024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b8e8064-817e-4f9e-a912-d03fc31fccba tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:40.041608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b8e8064-817e-4f9e-a912-d03fc31fccba tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:40.172223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b8e8064-817e-4f9e-a912-d03fc31fccba tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:40.181888 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b8e8064-817e-4f9e-a912-d03fc31fccba tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1295 microversion: 2.1 time: 0.144799 Aug 30 04:50:40.182503 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3144/6353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:40 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:41.204041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:41.204658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:41.216560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:41.217487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:41.217927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:41.219016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:41.219631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:41.220311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:41.330205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:41.342275 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-34b42123-9a46-42c1-b0c4-886a68e4c13f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1291 microversion: 2.1 time: 0.141960 Aug 30 04:50:41.343509 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3210/6354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:41 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1291 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:42.367771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:42.368402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:42.375531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:42.376030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:42.376477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:42.378293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:42.379035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:42.379487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:42.463515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:42.472761 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08f3342b-98fc-4536-96db-5bbd91de4ff5 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1353 microversion: 2.1 time: 0.108926 Aug 30 04:50:42.473371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3145/6355] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:42 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:43.343212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1a8830c7-9ef3-4499-905a-11de8fb9906a req-b39b8411-1296-4d44-90ef-bd13b70e58d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be791b13-0e41-4cff-939f-6ef3eba2b686", "tag": "124780de-1efe-4efa-91d8-2c5504c5598b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:43.354781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1a8830c7-9ef3-4499-905a-11de8fb9906a req-b39b8411-1296-4d44-90ef-bd13b70e58d5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:43.355580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1a8830c7-9ef3-4499-905a-11de8fb9906a req-b39b8411-1296-4d44-90ef-bd13b70e58d5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:43.356075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1a8830c7-9ef3-4499-905a-11de8fb9906a req-b39b8411-1296-4d44-90ef-bd13b70e58d5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:43.369941 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1a8830c7-9ef3-4499-905a-11de8fb9906a req-b39b8411-1296-4d44-90ef-bd13b70e58d5 service nova] Creating event network-changed:124780de-1efe-4efa-91d8-2c5504c5598b for instance be791b13-0e41-4cff-939f-6ef3eba2b686 on n-h2-854925-5 Aug 30 04:50:43.374782 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1a8830c7-9ef3-4499-905a-11de8fb9906a req-b39b8411-1296-4d44-90ef-bd13b70e58d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035658 Aug 30 04:50:43.375634 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3211/6356] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:50:43.494411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:43.495174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:43.502974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:43.507276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:43.507276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:43.507276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:43.507276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:43.507276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:43.765996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:43.774345 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89a1dca6-a74d-4fd6-b754-2a65af932d09 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1473 microversion: 2.1 time: 0.283712 Aug 30 04:50:43.775142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3146/6357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:43 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1473 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:44.797313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:44.798174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:44.805071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:44.805895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:44.806532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:44.807460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:44.808102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:44.808786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:45.049828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:45.057924 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1e5b2034-dc48-4b1b-9be7-5f6b83a92b58 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1473 microversion: 2.1 time: 0.265911 Aug 30 04:50:45.069018 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3212/6358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:44 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:46.088196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:46.088752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:46.091381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:46.098028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:46.098514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:46.098952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:46.099643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:46.100095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:46.100522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:46.242575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:46.250281 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b01c75d-c1d8-4269-ac2f-bedd687d1052 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1473 microversion: 2.1 time: 0.166115 Aug 30 04:50:46.250855 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3147/6359] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:46 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:47.270933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:47.271546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:47.274392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:47.279773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:47.280256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:47.280696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:47.281413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:47.281869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:47.282298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:47.423831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:47.431645 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9d438547-13e0-4863-9c0c-2b1622c32a97 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1473 microversion: 2.1 time: 0.164663 Aug 30 04:50:47.432229 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3213/6360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:47 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1473 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:48.452104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:48.452701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:48.459591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:48.460081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:48.460520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:48.461219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:48.461702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:48.462131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:48.492306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-557c5739-a887-4c09-a122-fe70b3df29e3 req-63055897-90da-4cfe-b89f-826c7bcee3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be791b13-0e41-4cff-939f-6ef3eba2b686", "name": "network-vif-plugged", "status": "completed", "tag": "124780de-1efe-4efa-91d8-2c5504c5598b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:48.503911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-557c5739-a887-4c09-a122-fe70b3df29e3 req-63055897-90da-4cfe-b89f-826c7bcee3d2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:48.504392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-557c5739-a887-4c09-a122-fe70b3df29e3 req-63055897-90da-4cfe-b89f-826c7bcee3d2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:48.504824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-557c5739-a887-4c09-a122-fe70b3df29e3 req-63055897-90da-4cfe-b89f-826c7bcee3d2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:48.516981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-557c5739-a887-4c09-a122-fe70b3df29e3 req-63055897-90da-4cfe-b89f-826c7bcee3d2 service nova] Creating event network-vif-plugged:124780de-1efe-4efa-91d8-2c5504c5598b for instance be791b13-0e41-4cff-939f-6ef3eba2b686 on n-h2-854925-5 Aug 30 04:50:48.522006 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-557c5739-a887-4c09-a122-fe70b3df29e3 req-63055897-90da-4cfe-b89f-826c7bcee3d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034751 Aug 30 04:50:48.523925 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3214/6361] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:50:48.644216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:48.652171 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf1254e7-84b3-4c56-bf13-214da0badd6f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1473 microversion: 2.1 time: 0.204017 Aug 30 04:50:48.652750 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3148/6362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:48 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1473 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:49.675891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:49.676587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:49.682842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:49.683324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:49.683759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:49.684452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:49.685018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:49.685499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:49.828356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:49.836301 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-521b2022-3514-405f-9905-bfe27fc2632b tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1473 microversion: 2.1 time: 0.166219 Aug 30 04:50:49.836872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3215/6363] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:49 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1473 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:50.856367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:50.856969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:50.859853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:50.865612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:50.866092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:50.866525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:50.867207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:50.867660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:50.868079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:51.010862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:51.020216 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1e35b6f-614a-464a-92c0-fe03b4aedf50 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1646 microversion: 2.1 time: 0.167952 Aug 30 04:50:51.021011 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3149/6364] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:50 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1646 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:51.039817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:51.040444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:51.042453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:51.043283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:50:51.050847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:51.051360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:51.051801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:51.052501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:51.052960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:51.053419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:51.193501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:50:51.201270 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5eb8cfb3-6e64-4382-86f2-4b6486cb9e37 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1646 microversion: 2.1 time: 0.165301 Aug 30 04:50:51.201881 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3216/6365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:51 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1646 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:51.220637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:50:51.221439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:50:51.227787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:51.228282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:51.228997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:51.229731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:51.230193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:51.230625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:51.469625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8bdf968b-368b-4d3f-b4c7-3465506d6819 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1797 microversion: 2.1 time: 0.252544 Aug 30 04:50:51.470258 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3150/6366] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:50:51 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1797 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:50:53.476235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-19483cd4-dc52-46f2-8f1b-ff7209056560 req-fda2f6d6-2210-4fa3-8a82-d92657e6a82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be791b13-0e41-4cff-939f-6ef3eba2b686", "tag": "124780de-1efe-4efa-91d8-2c5504c5598b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:50:53.487054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-19483cd4-dc52-46f2-8f1b-ff7209056560 req-fda2f6d6-2210-4fa3-8a82-d92657e6a82e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:50:53.487549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-19483cd4-dc52-46f2-8f1b-ff7209056560 req-fda2f6d6-2210-4fa3-8a82-d92657e6a82e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:50:53.487972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-19483cd4-dc52-46f2-8f1b-ff7209056560 req-fda2f6d6-2210-4fa3-8a82-d92657e6a82e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:50:53.499343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-19483cd4-dc52-46f2-8f1b-ff7209056560 req-fda2f6d6-2210-4fa3-8a82-d92657e6a82e service nova] Creating event network-changed:124780de-1efe-4efa-91d8-2c5504c5598b for instance be791b13-0e41-4cff-939f-6ef3eba2b686 on n-h2-854925-5 Aug 30 04:50:53.504296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-19483cd4-dc52-46f2-8f1b-ff7209056560 req-fda2f6d6-2210-4fa3-8a82-d92657e6a82e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032279 Aug 30 04:50:53.504887 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3217/6367] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:05.080720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:05.081840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:05.084432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=7 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:05.085207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=36 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:05.091396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:05.091922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:05.092362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:05.093164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:05.093649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:05.094261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:05.120529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:51:05.197681 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4ad4af53-12bf-4d30-a8a6-faa7e82d6396 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 204 len: 0 microversion: 2.1 time: 0.120295 Aug 30 04:51:05.201151 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3151/6368] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:51:05 2022] DELETE /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:51:05.205161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=9 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:05.206733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=38 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:05.210942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:05.211651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:05.218985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:05.219475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:05.219921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:05.220622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:05.221079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:05.221559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:05.357256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:05.366093 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-783c0d4b-6adf-4385-b903-a56fcb6d5be4 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1554 microversion: 2.1 time: 0.163343 Aug 30 04:51:05.366758 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3218/6369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:05 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:51:06.388217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:06.388961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:06.396595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:06.397084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:06.397560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:06.398266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:06.398724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:06.399157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:06.531342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:06.539119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5cc7b90d-53eb-4717-b0bf-c92cf70a4be3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1554 microversion: 2.1 time: 0.155207 Aug 30 04:51:06.539702 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3152/6370] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:06 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:07.481811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ece9e023-2536-4f2d-9737-c236ffe299a8 req-526bae34-4513-4d66-924d-20243cc4ab7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9beacc85-3b3f-4f1c-8618-eae9255a42e2", "name": "network-vif-deleted", "tag": "597b23b9-bff8-49cd-bd48-c6fc88546ea9"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:07.492682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ece9e023-2536-4f2d-9737-c236ffe299a8 req-526bae34-4513-4d66-924d-20243cc4ab7e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:07.493159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ece9e023-2536-4f2d-9737-c236ffe299a8 req-526bae34-4513-4d66-924d-20243cc4ab7e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:07.493613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ece9e023-2536-4f2d-9737-c236ffe299a8 req-526bae34-4513-4d66-924d-20243cc4ab7e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:07.505083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ece9e023-2536-4f2d-9737-c236ffe299a8 req-526bae34-4513-4d66-924d-20243cc4ab7e service nova] Creating event network-vif-deleted:597b23b9-bff8-49cd-bd48-c6fc88546ea9 for instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 on n-h1-854925-5 Aug 30 04:51:07.511098 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ece9e023-2536-4f2d-9737-c236ffe299a8 req-526bae34-4513-4d66-924d-20243cc4ab7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Aug 30 04:51:07.513694 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3219/6371] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:07.560128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:07.560872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:07.568840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:07.569438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:07.569945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:07.570728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:07.571429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:07.571921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:07.644269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:07.652543 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c2e0676a-a2d3-4258-a9fb-aceee4029daa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 200 len: 1334 microversion: 2.1 time: 0.096285 Aug 30 04:51:07.653266 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3153/6372] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:07 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:08.676519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:08.677247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: 9beacc85-3b3f-4f1c-8618-eae9255a42e2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:08.683683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:08.684200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:08.684641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:08.685344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:08.685822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:08.686254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:08.700251 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] HTTP exception thrown: Instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 could not be found. Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Request method failure captured: Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 HTTP/1.1 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZbDwO7v8l34QU8liI58PD8ILPCTFJdkRO6vISpw9_U-5lnwzWN-_8LwY3tvYMFlMfwRndElF6tNKYzAFonmE9cVDR177MHm8ibYeB4jrqaND3BU7tSp27tPWbIfmWuZgQXzk3OktjwH5KevcxNku-J28I2bF6n3GvC1Ar048dQkVtQ Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 8002c096e4a74cbea72ac0be290db680 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8002c096e4a74cbea72ac0be290db680", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8002c096e4a74cbea72ac0be290db680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8002c096e4a74cbea72ac0be290db680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8002c096e4a74cbea72ac0be290db680"}]}] Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 8002c096e4a74cbea72ac0be290db680 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestNetworkBasicOps-1496641033-project Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9bf154ac497e4e6e84b10d9a338f085e Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestNetworkBasicOps-1496641033-project Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 could not be found. Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9beacc85-3b3f-4f1c-8618-eae9255a42e2'} Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 could not be found. Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 could not be found. Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:08.701949 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 could not be found. Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Returning 404 to user: Instance 9beacc85-3b3f-4f1c-8618-eae9255a42e2 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d082d30a-b1ce-4fce-b028-59c83723069b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2" status: 404 len: 111 microversion: 2.1 time: 0.032480 Aug 30 04:51:08.707314 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3220/6373] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:08 2022] GET /compute/v2.1/servers/9beacc85-3b3f-4f1c-8618-eae9255a42e2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:51:08.858789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f87403b8-6165-4e02-bca2-05a6da8cc702 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '.version_select at 0x7fe9694d0700>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:08.879802 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f87403b8-6165-4e02-bca2-05a6da8cc702 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1122821463" status: 202 len: 0 microversion: 2.1 time: 0.024835 Aug 30 04:51:08.880406 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3154/6374] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Aug 30 04:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1122821463 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:51:10.871081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:10.871879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:10.872798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-88209b69-9938-4563-ae97-d5da2deba872 req-8ea3f347-39e2-422c-89a6-0bd19375fbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7620fd3-9269-4921-bc0c-aa809f7f6e1f", "tag": "e7aae47d-2c2b-404e-9a9c-4191d1fa6687"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:10.880271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:10.881030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:10.881646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:10.882441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:10.882992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:10.883515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:10.883901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-88209b69-9938-4563-ae97-d5da2deba872 req-8ea3f347-39e2-422c-89a6-0bd19375fbc7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:10.884589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-88209b69-9938-4563-ae97-d5da2deba872 req-8ea3f347-39e2-422c-89a6-0bd19375fbc7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:10.885227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-88209b69-9938-4563-ae97-d5da2deba872 req-8ea3f347-39e2-422c-89a6-0bd19375fbc7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:10.896572 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-88209b69-9938-4563-ae97-d5da2deba872 req-8ea3f347-39e2-422c-89a6-0bd19375fbc7 service nova] Creating event network-changed:e7aae47d-2c2b-404e-9a9c-4191d1fa6687 for instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f on n-h2-854925-5 Aug 30 04:51:10.901992 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-88209b69-9938-4563-ae97-d5da2deba872 req-8ea3f347-39e2-422c-89a6-0bd19375fbc7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032626 Aug 30 04:51:10.902599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3155/6375] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:51:10.917057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:51:11.008352 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1d5453c-8bf0-4a38-88ca-a5d32dd1386c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 204 len: 0 microversion: 2.1 time: 0.141004 Aug 30 04:51:11.009402 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3221/6376] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:51:10 2022] DELETE /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:51:11.019443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:11.020401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:11.027202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:11.027924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:11.028602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:11.029428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:11.029952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:11.030508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:11.180355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:11.188254 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e5a95e1a-d49b-41c9-8975-b8259c7d02cb tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1669 microversion: 2.1 time: 0.174160 Aug 30 04:51:11.188833 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3156/6377] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:11 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1669 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:12.210448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:12.211146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:12.218071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:12.218554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:12.218985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:12.219704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:12.220158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:12.220584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:12.369132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:12.377120 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8625e058-c261-4daf-bfd6-5c23243ff98e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1669 microversion: 2.1 time: 0.171026 Aug 30 04:51:12.377786 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3222/6378] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:12 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:13.255628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-07999425-775f-4951-bb57-5d10130a0e03 req-bb0a7bad-22e1-4e39-a285-d70897a92aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7620fd3-9269-4921-bc0c-aa809f7f6e1f", "name": "network-vif-deleted", "tag": "e7aae47d-2c2b-404e-9a9c-4191d1fa6687"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:13.266667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-07999425-775f-4951-bb57-5d10130a0e03 req-bb0a7bad-22e1-4e39-a285-d70897a92aa9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:13.267158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-07999425-775f-4951-bb57-5d10130a0e03 req-bb0a7bad-22e1-4e39-a285-d70897a92aa9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:13.267596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-07999425-775f-4951-bb57-5d10130a0e03 req-bb0a7bad-22e1-4e39-a285-d70897a92aa9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:13.279770 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-07999425-775f-4951-bb57-5d10130a0e03 req-bb0a7bad-22e1-4e39-a285-d70897a92aa9 service nova] Creating event network-vif-deleted:e7aae47d-2c2b-404e-9a9c-4191d1fa6687 for instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f on n-h2-854925-5 Aug 30 04:51:13.284694 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-07999425-775f-4951-bb57-5d10130a0e03 req-bb0a7bad-22e1-4e39-a285-d70897a92aa9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033392 Aug 30 04:51:13.285302 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3157/6379] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:13.399799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:13.400538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:13.407591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:13.408080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:13.408523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:13.409223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:13.409714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:13.410150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:13.442768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:13.443264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:13.443706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:13.444161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lazy-loading 'fault' on Instance uuid b7620fd3-9269-4921-bc0c-aa809f7f6e1f {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:51:13.491311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:13.504764 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5bfb8f72-794d-484b-8539-ef2896f45efa tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 200 len: 1337 microversion: 2.1 time: 0.108781 Aug 30 04:51:13.505299 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3223/6380] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:13 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 1337 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:14.527446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:14.528148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: b7620fd3-9269-4921-bc0c-aa809f7f6e1f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:14.535027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:14.535516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:14.536057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:14.536633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:14.537088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:14.537546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:14.550619 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] HTTP exception thrown: Instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f could not be found. Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Request method failure captured: Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f HTTP/1.1 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZbDwO7v8l34QU8liI58PD8ILPCTFJdkRO6vISpw9_U-5lnwzWN-_8LwY3tvYMFlMfwRndElF6tNKYzAFonmE9cVDR177MHm8ibYeB4jrqaND3BU7tSp27tPWbIfmWuZgQXzk3OktjwH5KevcxNku-J28I2bF6n3GvC1Ar048dQkVtQ Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 8002c096e4a74cbea72ac0be290db680 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8002c096e4a74cbea72ac0be290db680", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8002c096e4a74cbea72ac0be290db680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8002c096e4a74cbea72ac0be290db680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8002c096e4a74cbea72ac0be290db680"}]}] Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 8002c096e4a74cbea72ac0be290db680 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkBasicOps-1496641033-project Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9bf154ac497e4e6e84b10d9a338f085e Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkBasicOps-1496641033-project Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f could not be found. Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'b7620fd3-9269-4921-bc0c-aa809f7f6e1f'} Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f could not be found. Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f could not be found. Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:14.552239 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f could not be found. Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Returning 404 to user: Instance b7620fd3-9269-4921-bc0c-aa809f7f6e1f could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-02e5bab3-36b8-4948-b4a0-98f61b0e484e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f" status: 404 len: 111 microversion: 2.1 time: 0.031282 Aug 30 04:51:14.557842 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3158/6381] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:14 2022] GET /compute/v2.1/servers/b7620fd3-9269-4921-bc0c-aa809f7f6e1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:51:14.710737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3002392f-7b72-45b4-aa0a-1aef6ead84d5 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '.version_select at 0x7fe96920fb80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:14.734509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3002392f-7b72-45b4-aa0a-1aef6ead84d5 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-307666598" status: 202 len: 0 microversion: 2.1 time: 0.028036 Aug 30 04:51:14.735339 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3224/6382] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 30 04:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-307666598 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:51:23.163049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-30330aba-d574-445f-9372-a3a9f8167c6c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'create', calling method: .version_select at 0x7fe96a4ea040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-613008003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPN9fkMOD69jLdfP4Ayz8f5pNehoH9sQMl1XqV6eNN4ZcD5H8yX/umrIg0oLqSX7viLXuywEJpHUdbgdgvY1uzqBjPIaYaGGnJCJaCE90xcn/zXU+VQsumof9isH/zVSmw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:23.183998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-30330aba-d574-445f-9372-a3a9f8167c6c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for project 8002c096e4a74cbea72ac0be290db680. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:51:23.191362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-30330aba-d574-445f-9372-a3a9f8167c6c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for user 9bf154ac497e4e6e84b10d9a338f085e and project 8002c096e4a74cbea72ac0be290db680. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:51:23.221772 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-30330aba-d574-445f-9372-a3a9f8167c6c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.062470 Aug 30 04:51:23.222543 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3159/6383] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:51:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:24.367536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-502143099", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "10e23e17-4bdc-494f-916e-dedb69021669"}], "key_name": "tempest-TestNetworkBasicOps-613008003", "security_groups": [{"name": "tempest-secgroup-smoke-1403875094"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:24.378576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:24.486822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] validate_networks() for [('10e23e17-4bdc-494f-916e-dedb69021669', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:51:24.890242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:51:24.890879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:51:24.891536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:51:24.891956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:51:24.892380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:51:24.902163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:24.902663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:24.903098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:24.904048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:24.904671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:24.905111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:24.922782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for project 8002c096e4a74cbea72ac0be290db680. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:51:24.928936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Getting quotas for user 9bf154ac497e4e6e84b10d9a338f085e and project 8002c096e4a74cbea72ac0be290db680. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:51:24.943150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:51:24.945642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:51:24.995770 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27f0a410-4958-486f-97c7-0e02de4e3e28 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.633617 Aug 30 04:51:24.996436 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3225/6384] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:51:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:51:25.005695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:25.010012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a38160b7-460f-4b31-9243-6898da644c02 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:25.010639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a38160b7-460f-4b31-9243-6898da644c02 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:25.080690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a38160b7-460f-4b31-9243-6898da644c02 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:25.094701 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a38160b7-460f-4b31-9243-6898da644c02 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1247 microversion: 2.1 time: 0.090668 Aug 30 04:51:25.095453 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3160/6385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:25 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1247 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:26.117153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:26.118308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:26.124735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:26.125238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:26.125722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:26.127036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:26.127502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:26.128777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:26.195527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:26.205206 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-261ae2d8-2960-46ee-8e28-dfdc352b6192 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1307 microversion: 2.1 time: 0.093179 Aug 30 04:51:26.206680 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3226/6386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:26 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:27.228615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:27.229222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:27.237216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:27.237816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:27.238352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:27.239134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:27.239667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:27.240240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:27.378712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:27.389739 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-24f14882-e478-4bd0-9c63-e93244e99715 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.164823 Aug 30 04:51:27.390436 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3161/6387] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:27 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:27.609747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4f581b3e-b358-4db9-bf68-6ce72b06bacb req-dc144d3c-c626-4c76-bfea-f4fb34ac7c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94890e9-9066-47c1-96b8-e3a924dc8cf2", "tag": "22386376-7499-4834-8e30-5afccf912ff5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:27.623246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4f581b3e-b358-4db9-bf68-6ce72b06bacb req-dc144d3c-c626-4c76-bfea-f4fb34ac7c10 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:27.623831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4f581b3e-b358-4db9-bf68-6ce72b06bacb req-dc144d3c-c626-4c76-bfea-f4fb34ac7c10 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:27.624285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4f581b3e-b358-4db9-bf68-6ce72b06bacb req-dc144d3c-c626-4c76-bfea-f4fb34ac7c10 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:27.636672 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4f581b3e-b358-4db9-bf68-6ce72b06bacb req-dc144d3c-c626-4c76-bfea-f4fb34ac7c10 service nova] Creating event network-changed:22386376-7499-4834-8e30-5afccf912ff5 for instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 on n-h1-854925-5 Aug 30 04:51:27.641794 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4f581b3e-b358-4db9-bf68-6ce72b06bacb req-dc144d3c-c626-4c76-bfea-f4fb34ac7c10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035765 Aug 30 04:51:27.642453 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3227/6388] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:51:28.411686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:28.412305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:28.420054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:28.420544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:28.420982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:28.421701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:28.422150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:28.422576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:28.555012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:28.562606 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2e786e3b-7962-430d-811a-7f5432ec44db tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.155399 Aug 30 04:51:28.563185 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3162/6389] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:28 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:29.584804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:29.585638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:29.591943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:29.592437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:29.592879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:29.593616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:29.594079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:29.594515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:29.738992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:29.747529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-31ac3e4d-23a2-424a-8aad-736775f562f3 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.167936 Aug 30 04:51:29.748129 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3228/6390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:29 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:30.768396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:30.768950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:30.775908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:30.776458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:30.776903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:30.777921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:30.778372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:30.778800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:30.919321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:30.929752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2318cbcc-f281-44dd-b268-e150ac03e14c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.165276 Aug 30 04:51:30.930372 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3163/6391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:30 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:31.950529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:31.951224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:31.959080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:31.959484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:31.960143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:31.960853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:31.962184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:31.962613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:32.248595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:32.257643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc11f9a4-e806-45d5-9159-faeb2233851a tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.311165 Aug 30 04:51:32.258388 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3229/6392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:31 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:33.279118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:33.280574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:33.290829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:33.291765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:33.297498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:33.298579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:33.299230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:33.300325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:33.624753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:33.639445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-791756d4-142d-4698-8e90-e3249e25339e tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.363244 Aug 30 04:51:33.641650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3164/6393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:33 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:34.661278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:34.661925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:34.696221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:34.696755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:34.697475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:34.698351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:34.698853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:34.699291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:34.710489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-003eb373-90d7-492e-859c-789115a4dace req-d0ed667b-afe2-4bf2-b923-36fd1c3c2c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94890e9-9066-47c1-96b8-e3a924dc8cf2", "name": "network-vif-plugged", "status": "completed", "tag": "22386376-7499-4834-8e30-5afccf912ff5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:34.733282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-003eb373-90d7-492e-859c-789115a4dace req-d0ed667b-afe2-4bf2-b923-36fd1c3c2c05 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:34.733790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-003eb373-90d7-492e-859c-789115a4dace req-d0ed667b-afe2-4bf2-b923-36fd1c3c2c05 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:34.734389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-003eb373-90d7-492e-859c-789115a4dace req-d0ed667b-afe2-4bf2-b923-36fd1c3c2c05 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:34.754876 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-003eb373-90d7-492e-859c-789115a4dace req-d0ed667b-afe2-4bf2-b923-36fd1c3c2c05 service nova] Creating event network-vif-plugged:22386376-7499-4834-8e30-5afccf912ff5 for instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 on n-h1-854925-5 Aug 30 04:51:34.767331 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-003eb373-90d7-492e-859c-789115a4dace req-d0ed667b-afe2-4bf2-b923-36fd1c3c2c05 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060402 Aug 30 04:51:34.768938 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3165/6394] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:51:34.913521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:34.936570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:34.941313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:34.949762 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-213b8ab5-c5cb-45ae-ab45-0cd635aebea6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.292243 Aug 30 04:51:34.950666 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3230/6395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:34 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:35.026541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1191426494", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "3bc17003-6eef-467b-9892-28bf4624934b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1869900284", "security_groups": []}, "os:scheduler_hints": {"different_host": ["be791b13-0e41-4cff-939f-6ef3eba2b686"]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:35.091095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] validate_networks() for [('3bc17003-6eef-467b-9892-28bf4624934b', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:51:35.095931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:35.302900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:35.566690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:51:35.567130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:51:35.567792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:51:35.568507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:51:35.568929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:51:35.586814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:35.587351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:35.587800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:35.588555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:35.589066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:35.589798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:35.609585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Getting quotas for project dc92f536d0984fada835f6fba82bebaf. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:51:35.616932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Getting quotas for user a80a102aa8bd472e8216e6f4dbbf6879 and project dc92f536d0984fada835f6fba82bebaf. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:51:35.631776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:51:35.634548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:51:35.690218 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-abc689af-abfa-4f79-8a62-5a0ff3865c0c tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.667914 Aug 30 04:51:35.691469 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3166/6396] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:51:35 2022] POST /compute/v2.1/servers => generated 361 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:51:35.702021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-682cb753-5866-4a9c-af1b-4f755cccb3af tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:35.703258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-682cb753-5866-4a9c-af1b-4f755cccb3af tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:35.706723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:35.812715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-682cb753-5866-4a9c-af1b-4f755cccb3af tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:35.822708 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-682cb753-5866-4a9c-af1b-4f755cccb3af tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1242 microversion: 2.1 time: 0.124531 Aug 30 04:51:35.823843 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3231/6397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:35 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1242 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:35.972166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:35.973450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:35.988025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:35.990146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:35.990711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:35.991978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:35.992981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:35.993634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:36.212494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:36.220985 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-293545a2-f49f-44a1-8411-c22dedf34ebd tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1373 microversion: 2.1 time: 0.254038 Aug 30 04:51:36.221613 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3167/6398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:35 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1373 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:36.845993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:36.849086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:36.860020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:36.860612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:36.861146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:36.862106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:36.863346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:36.863856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:36.938980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:36.947811 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16e76d6b-d86c-46e7-9d2b-5af22ac70b32 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1294 microversion: 2.1 time: 0.108108 Aug 30 04:51:36.948510 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3232/6399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:36 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:37.244134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:37.245376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:37.254854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:37.255559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:37.256178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:37.257693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:37.258327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:37.258968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:37.460954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:37.470062 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-105b795d-c588-4374-85c8-5610e0f84b54 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1545 microversion: 2.1 time: 0.230090 Aug 30 04:51:37.471335 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3168/6400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:37 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1545 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:37.492688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:37.493564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:37.504433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:37.505182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:37.506204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:37.507210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:37.507867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:37.508471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:37.660907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:37.672035 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b4e6045-e3bd-4303-84bc-fdb637e25635 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1545 microversion: 2.1 time: 0.182972 Aug 30 04:51:37.673289 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3233/6401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:37 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1545 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:37.970756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:37.973843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:37.989969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:37.992518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:37.993224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:37.994169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:37.994804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:37.995598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:38.294080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:38.306832 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7a9d5645-e06f-4da4-9991-c8f1b3de090a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.341125 Aug 30 04:51:38.306973 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3169/6402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:37 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:38.721703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-267d27b4-5228-4e8d-8a7a-5755f243faa5 req-cc68ab4a-10bd-40cf-a901-fe46b72b527c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b8d3cb-aa6e-4d43-b076-5f4c2544bb85", "tag": "920ff8d9-5395-4f88-a11f-aceb6bd8ab35"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:38.738200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-267d27b4-5228-4e8d-8a7a-5755f243faa5 req-cc68ab4a-10bd-40cf-a901-fe46b72b527c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:38.739428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-267d27b4-5228-4e8d-8a7a-5755f243faa5 req-cc68ab4a-10bd-40cf-a901-fe46b72b527c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:38.739869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-267d27b4-5228-4e8d-8a7a-5755f243faa5 req-cc68ab4a-10bd-40cf-a901-fe46b72b527c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:38.768339 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-267d27b4-5228-4e8d-8a7a-5755f243faa5 req-cc68ab4a-10bd-40cf-a901-fe46b72b527c service nova] Creating event network-changed:920ff8d9-5395-4f88-a11f-aceb6bd8ab35 for instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 on n-h1-854925-5 Aug 30 04:51:38.776680 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-267d27b4-5228-4e8d-8a7a-5755f243faa5 req-cc68ab4a-10bd-40cf-a901-fe46b72b527c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059150 Aug 30 04:51:38.790316 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3234/6403] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:39.327835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:39.328453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:39.336473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:39.336879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:39.337311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:39.338038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:39.338490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:39.338915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:39.469673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:39.478450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ea495be-8764-4c7a-8b2b-19767756fe05 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.154718 Aug 30 04:51:39.479202 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3170/6404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:39 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:40.053248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-a575a34b-885a-4cf2-863e-50b351e748fb req-af09e6e6-e3e9-40f4-9e27-5b0ca0a509b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94890e9-9066-47c1-96b8-e3a924dc8cf2", "tag": "22386376-7499-4834-8e30-5afccf912ff5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:40.079730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a575a34b-885a-4cf2-863e-50b351e748fb req-af09e6e6-e3e9-40f4-9e27-5b0ca0a509b1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:40.080923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a575a34b-885a-4cf2-863e-50b351e748fb req-af09e6e6-e3e9-40f4-9e27-5b0ca0a509b1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:40.081437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-a575a34b-885a-4cf2-863e-50b351e748fb req-af09e6e6-e3e9-40f4-9e27-5b0ca0a509b1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:40.100449 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-a575a34b-885a-4cf2-863e-50b351e748fb req-af09e6e6-e3e9-40f4-9e27-5b0ca0a509b1 service nova] Creating event network-changed:22386376-7499-4834-8e30-5afccf912ff5 for instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 on n-h1-854925-5 Aug 30 04:51:40.105693 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-a575a34b-885a-4cf2-863e-50b351e748fb req-af09e6e6-e3e9-40f4-9e27-5b0ca0a509b1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198858 Aug 30 04:51:40.106304 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3235/6405] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:40.499582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:40.500144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:40.506978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:40.507462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:40.507900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:40.508595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:40.509053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:40.509509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:40.590550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:40.599122 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0cb3e87b-f05d-4226-93f0-61d867888079 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.103556 Aug 30 04:51:40.599732 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3171/6406] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:40 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:41.621376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:41.622197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:41.629068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:41.629674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:41.630215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:41.630966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:41.631486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:41.631976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:41.719854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:41.728817 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-19533b1c-5fab-43b0-843d-f4acbd3ecbc9 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.112504 Aug 30 04:51:41.729689 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3236/6407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:41 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:42.750721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:42.751650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:42.758722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:42.759224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:42.759699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:42.760645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:42.760861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:42.761343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:42.843496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:42.851812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14fa88bf-1fff-46ea-b3be-1ee3dd5f4a07 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.105081 Aug 30 04:51:42.852396 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3172/6408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:42 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:43.872532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:43.873154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:43.880724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:43.881214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:43.881684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:43.882375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:43.882829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:43.883256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:43.967231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:43.974996 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f245b3c6-906e-44f2-9304-2387524b51bf tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.106457 Aug 30 04:51:43.975567 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3237/6409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:43 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:44.695128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-52b464ed-3c9e-4e3f-ae99-459010a44891 req-11b22a84-1616-4cdf-95dc-9f13582abf23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b8d3cb-aa6e-4d43-b076-5f4c2544bb85", "name": "network-vif-plugged", "status": "completed", "tag": "920ff8d9-5395-4f88-a11f-aceb6bd8ab35"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:44.705786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-52b464ed-3c9e-4e3f-ae99-459010a44891 req-11b22a84-1616-4cdf-95dc-9f13582abf23 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:44.706809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-52b464ed-3c9e-4e3f-ae99-459010a44891 req-11b22a84-1616-4cdf-95dc-9f13582abf23 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:44.707241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-52b464ed-3c9e-4e3f-ae99-459010a44891 req-11b22a84-1616-4cdf-95dc-9f13582abf23 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:44.725077 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-52b464ed-3c9e-4e3f-ae99-459010a44891 req-11b22a84-1616-4cdf-95dc-9f13582abf23 service nova] Creating event network-vif-plugged:920ff8d9-5395-4f88-a11f-aceb6bd8ab35 for instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 on n-h1-854925-5 Aug 30 04:51:44.730309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-52b464ed-3c9e-4e3f-ae99-459010a44891 req-11b22a84-1616-4cdf-95dc-9f13582abf23 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038733 Aug 30 04:51:44.731382 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3173/6410] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:51:44.996144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:44.996767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:45.004311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:45.004793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:45.005230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:45.005945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:45.006402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:45.006838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:45.090256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:45.100125 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-04e7af22-7ee1-4c13-b4ec-b647c41c0166 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.107809 Aug 30 04:51:45.101195 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3238/6411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:44 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:46.118615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:46.119396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:46.124777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:46.125512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:46.133214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:46.133731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:46.134176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:46.134859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:46.135318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:46.135743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:46.217821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:46.226116 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be497a5d-d868-436d-be4e-5d8abb3cf6fa tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1300 microversion: 2.1 time: 0.108498 Aug 30 04:51:46.226751 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3174/6412] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:46 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1300 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:47.247635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:47.248220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:47.250136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:47.256123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.256613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.257050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.257958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.258201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.258624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.341954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:47.350368 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ed6fe47-0245-4014-b05f-5fb9148f5a0d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1473 microversion: 2.1 time: 0.106818 Aug 30 04:51:47.350937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3239/6413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:47 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1473 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:47.370732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:47.371348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:47.378202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.378680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.379114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.379800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.380251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.380673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.465036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:47.473564 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d1117267-a52d-4ec4-bfe4-3ff09d18f19a tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1473 microversion: 2.1 time: 0.106641 Aug 30 04:51:47.474138 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3175/6414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:47 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1473 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:47.492964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:47.493688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:47.499838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.500262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.500706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.501423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.501884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.502313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.582189 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-08fddf05-6c82-43af-a985-52c83d568c60 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1624 microversion: 2.1 time: 0.092432 Aug 30 04:51:47.582767 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3240/6415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:47 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1624 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:47.601899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:47.602620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:47.608854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.609351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.609842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.610535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.610993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.611424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.752337 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-140125c0-f96d-4dab-ba2f-f5eef414f921 tempest-TestSecurityGroupsBasicOps-78565361 tempest-TestSecurityGroupsBasicOps-78565361-project-admin] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1915 microversion: 2.1 time: 0.154070 Aug 30 04:51:47.752881 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3176/6416] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:47 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1915 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:47.816878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:47.817404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:47.823443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.823928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.824388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.825062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.825554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.825984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.851442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:51:47.927669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1666e818-5e06-455f-940a-bbaa55925e65 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "DELETE /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 204 len: 0 microversion: 2.1 time: 0.115234 Aug 30 04:51:47.928614 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3241/6417] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:51:47 2022] DELETE /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:51:47.936544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:47.937186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:47.943727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.944211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.944648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:47.945351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:47.945827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:47.946260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:48.028726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:48.036416 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b734d6ff-e226-4e2d-a168-220be91d6d43 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1479 microversion: 2.1 time: 0.103795 Aug 30 04:51:48.036993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3177/6418] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:47 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1479 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:49.057904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:49.058602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:49.065521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:49.066602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:49.067040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:49.067737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:49.068189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:49.068616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:49.156999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:49.164940 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0368df9f-e34f-498f-95ea-8ce8c087cfc6 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1479 microversion: 2.1 time: 0.111326 Aug 30 04:51:49.165478 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3242/6419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:49 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1479 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:50.159413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b6aa8f94-46f5-46b5-87c1-3624551cb5e3 req-a46731f7-b35e-4c03-b431-9ac19bcd33ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b8d3cb-aa6e-4d43-b076-5f4c2544bb85", "name": "network-vif-deleted", "tag": "920ff8d9-5395-4f88-a11f-aceb6bd8ab35"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:50.170131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6aa8f94-46f5-46b5-87c1-3624551cb5e3 req-a46731f7-b35e-4c03-b431-9ac19bcd33ac service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:50.170616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6aa8f94-46f5-46b5-87c1-3624551cb5e3 req-a46731f7-b35e-4c03-b431-9ac19bcd33ac service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:50.171050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6aa8f94-46f5-46b5-87c1-3624551cb5e3 req-a46731f7-b35e-4c03-b431-9ac19bcd33ac service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:50.184731 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b6aa8f94-46f5-46b5-87c1-3624551cb5e3 req-a46731f7-b35e-4c03-b431-9ac19bcd33ac service nova] Creating event network-vif-deleted:920ff8d9-5395-4f88-a11f-aceb6bd8ab35 for instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 on n-h1-854925-5 Aug 30 04:51:50.187662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:50.188896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:50.191799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b6aa8f94-46f5-46b5-87c1-3624551cb5e3 req-a46731f7-b35e-4c03-b431-9ac19bcd33ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034860 Aug 30 04:51:50.192863 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3178/6420] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:50.198000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:50.198517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:50.198963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:50.199676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:50.200225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:50.200662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:50.220948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:50.272952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:50.282669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b0192498-71e3-43ba-ae7e-a95f8e8a4407 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 200 len: 1327 microversion: 2.1 time: 0.100406 Aug 30 04:51:50.283257 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3243/6421] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:50 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:51.305844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:51.306583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:51.313766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:51.314626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:51.315408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:51.317228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:51.318026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:51.318628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:51.333561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] HTTP exception thrown: Instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 could not be found. Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Request method failure captured: Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 HTTP/1.1 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZcVEnSO1XlwIUDUxP0LTA9Tqq8QLNXg28Ny1lyNTQ2L_84Oqn3-YgIbxni08ie5iK5OtKl6_KmP9u5--PsvxfDOSUdukoY18sawut2B6kECnpR88afVCKO5DFL5qSljRTizFVRpzLA8OAcMHHf62dj4mXepVxMzRlmqseMEcyOI5mw Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: dc92f536d0984fada835f6fba82bebaf Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1132016782 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dc92f536d0984fada835f6fba82bebaf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dc92f536d0984fada835f6fba82bebaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc92f536d0984fada835f6fba82bebaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc92f536d0984fada835f6fba82bebaf"}]}] Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1132016782 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: dc92f536d0984fada835f6fba82bebaf Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1132016782 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestSecurityGroupsBasicOps-1132016782-project Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: a80a102aa8bd472e8216e6f4dbbf6879 Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1132016782-project Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 could not be found. Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '52b8d3cb-aa6e-4d43-b076-5f4c2544bb85'} Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 could not be found. Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 could not be found. Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:51.335240 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 could not be found. Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Returning 404 to user: Instance 52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5dfa0979-4c34-462b-87c7-aa2801851bbb tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85" status: 404 len: 111 microversion: 2.1 time: 0.036640 Aug 30 04:51:51.340331 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3179/6422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:51 2022] GET /compute/v2.1/servers/52b8d3cb-aa6e-4d43-b076-5f4c2544bb85 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:51:55.287296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:55.287830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:55.288383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d9cf7445-8df1-451b-ad11-e6ed42305f37 req-8ac8eb68-8727-4690-bf44-fe3fc76b89cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be791b13-0e41-4cff-939f-6ef3eba2b686", "tag": "124780de-1efe-4efa-91d8-2c5504c5598b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:55.299812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9cf7445-8df1-451b-ad11-e6ed42305f37 req-8ac8eb68-8727-4690-bf44-fe3fc76b89cf service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:55.300014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:55.301095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9cf7445-8df1-451b-ad11-e6ed42305f37 req-8ac8eb68-8727-4690-bf44-fe3fc76b89cf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:55.301232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:55.301774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9cf7445-8df1-451b-ad11-e6ed42305f37 req-8ac8eb68-8727-4690-bf44-fe3fc76b89cf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:55.303470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:55.304237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:55.304720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:55.305164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:55.307233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:51:55.315994 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d9cf7445-8df1-451b-ad11-e6ed42305f37 req-8ac8eb68-8727-4690-bf44-fe3fc76b89cf service nova] Creating event network-changed:124780de-1efe-4efa-91d8-2c5504c5598b for instance be791b13-0e41-4cff-939f-6ef3eba2b686 on n-h2-854925-5 Aug 30 04:51:55.322428 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d9cf7445-8df1-451b-ad11-e6ed42305f37 req-8ac8eb68-8727-4690-bf44-fe3fc76b89cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038301 Aug 30 04:51:55.323023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3180/6423] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:51:55.354503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:51:55.465057 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0bec8675-51e7-4c83-b7bd-e8112100b5ac tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "DELETE /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 204 len: 0 microversion: 2.1 time: 0.183627 Aug 30 04:51:55.465719 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3244/6424] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:51:55 2022] DELETE /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:51:55.475309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:55.476169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:55.482845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:55.483404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:55.483909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:55.484671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:55.485203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:55.485757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:55.726732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:55.735318 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee3938c5-4b98-4634-8d26-df8983e9a04d tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1770 microversion: 2.1 time: 0.265002 Aug 30 04:51:55.735979 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3181/6425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:55 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1770 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:51:56.757887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:56.758592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:56.765354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:56.765851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:56.766288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:56.766974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:56.767424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:56.767851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:57.001027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a80a102aa8bd472e8216e6f4dbbf6879', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc92f536d0984fada835f6fba82bebaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:51:57.009524 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b1b21b3-8260-46a1-84c3-de44d365e27e tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 200 len: 1770 microversion: 2.1 time: 0.256426 Aug 30 04:51:57.010431 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3245/6426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:56 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 1770 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:51:57.385430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d578c3f8-bf90-468f-98ff-1fa69b4c76ea req-fe9d0e85-758a-424b-8752-192879ae5f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be791b13-0e41-4cff-939f-6ef3eba2b686", "name": "network-vif-deleted", "tag": "124780de-1efe-4efa-91d8-2c5504c5598b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:51:57.395671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d578c3f8-bf90-468f-98ff-1fa69b4c76ea req-fe9d0e85-758a-424b-8752-192879ae5f5c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:57.396146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d578c3f8-bf90-468f-98ff-1fa69b4c76ea req-fe9d0e85-758a-424b-8752-192879ae5f5c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:57.396574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d578c3f8-bf90-468f-98ff-1fa69b4c76ea req-fe9d0e85-758a-424b-8752-192879ae5f5c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:57.408503 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d578c3f8-bf90-468f-98ff-1fa69b4c76ea req-fe9d0e85-758a-424b-8752-192879ae5f5c service nova] Creating event network-vif-deleted:124780de-1efe-4efa-91d8-2c5504c5598b for instance be791b13-0e41-4cff-939f-6ef3eba2b686 on n-h2-854925-5 Aug 30 04:51:57.414002 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d578c3f8-bf90-468f-98ff-1fa69b4c76ea req-fe9d0e85-758a-424b-8752-192879ae5f5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Aug 30 04:51:57.414620 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3182/6427] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:51:58.032044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:51:58.032842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] [instance: be791b13-0e41-4cff-939f-6ef3eba2b686] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:51:58.041344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:58.041843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:58.042282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:58.043162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:51:58.043805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:51:58.044367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:51:58.060201 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] HTTP exception thrown: Instance be791b13-0e41-4cff-939f-6ef3eba2b686 could not be found. Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Request method failure captured: Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 HTTP/1.1 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZcVEnSO1XlwIUDUxP0LTA9Tqq8QLNXg28Ny1lyNTQ2L_84Oqn3-YgIbxni08ie5iK5OtKl6_KmP9u5--PsvxfDOSUdukoY18sawut2B6kECnpR88afVCKO5DFL5qSljRTizFVRpzLA8OAcMHHf62dj4mXepVxMzRlmqseMEcyOI5mw Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: dc92f536d0984fada835f6fba82bebaf Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1132016782 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dc92f536d0984fada835f6fba82bebaf", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dc92f536d0984fada835f6fba82bebaf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc92f536d0984fada835f6fba82bebaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dc92f536d0984fada835f6fba82bebaf"}]}] Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1132016782 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: dc92f536d0984fada835f6fba82bebaf Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1132016782 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestSecurityGroupsBasicOps-1132016782-project Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: a80a102aa8bd472e8216e6f4dbbf6879 Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1132016782-project Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance be791b13-0e41-4cff-939f-6ef3eba2b686 could not be found. Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'be791b13-0e41-4cff-939f-6ef3eba2b686'} Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be791b13-0e41-4cff-939f-6ef3eba2b686 could not be found. Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be791b13-0e41-4cff-939f-6ef3eba2b686 could not be found. Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:58.062104 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be791b13-0e41-4cff-939f-6ef3eba2b686 could not be found. Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Returning 404 to user: Instance be791b13-0e41-4cff-939f-6ef3eba2b686 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-216dd42d-37a3-42da-9ae2-6d60693d106f tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686" status: 404 len: 111 microversion: 2.1 time: 0.036748 Aug 30 04:51:58.068290 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3246/6428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:51:58 2022] GET /compute/v2.1/servers/be791b13-0e41-4cff-939f-6ef3eba2b686 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:52:01.494818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae900209-4144-4158-802c-a248021cf466 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] Calling method '.version_select at 0x7fe9694d0f70>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:01.515841 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae900209-4144-4158-802c-a248021cf466 tempest-TestSecurityGroupsBasicOps-1132016782 tempest-TestSecurityGroupsBasicOps-1132016782-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1869900284" status: 202 len: 0 microversion: 2.1 time: 0.026326 Aug 30 04:52:01.516613 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3183/6429] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Aug 30 04:52:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1869900284 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:52:13.206491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:13.209143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:13.211643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:13.212302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:13.223323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:13.224085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:13.224834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:13.225790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:13.226417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:13.227002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:13.323222 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a4e953a6-edd0-4043-9e46-1137aa6b4b1c tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2/action" status: 200 len: 24560 microversion: 2.1 time: 0.121071 Aug 30 04:52:13.323874 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3247/6430] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:52:13 2022] POST /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2/action => generated 24560 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:52:13.462123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=9 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:13.462913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:13.695071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-84340779-3ffd-46bd-aa09-d2acbd169c13 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Action: 'create', calling method: .version_select at 0x7fe968f02d30>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2031275076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCci6yMTIp3Ag1fnsXprMPtKbd+wvNEshJj7MYSLzpQVYEe99gUjAdNfAM6nfArbSvHlS7IvVul/pkh5upeJPIKzEV4HNxeroIGlfmgs5/nDoouOYXqfWfVyIow3tD4i+w=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:13.714493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-84340779-3ffd-46bd-aa09-d2acbd169c13 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Getting quotas for project a4710066b8924d09a9230ccc47b9bcfe. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:52:13.722208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-84340779-3ffd-46bd-aa09-d2acbd169c13 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Getting quotas for user 3e0f819766f54d1cb7cf06d06fabeb0d and project a4710066b8924d09a9230ccc47b9bcfe. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:52:13.751288 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-84340779-3ffd-46bd-aa09-d2acbd169c13 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.295663 Aug 30 04:52:13.752514 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3184/6431] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:52:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:52:14.787969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-304407785", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2031275076", "security_groups": [{"name": "tempest-secgroup-smoke-1915400658"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b0268838-e183-4d06-aa1a-257d71a45476"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:14.900819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] validate_networks() for [('b0268838-e183-4d06-aa1a-257d71a45476', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:52:15.299387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Getting quotas for project a4710066b8924d09a9230ccc47b9bcfe. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:52:15.306160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Getting quotas for user 3e0f819766f54d1cb7cf06d06fabeb0d and project a4710066b8924d09a9230ccc47b9bcfe. Resources: dict_keys(['metadata_items']) {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:52:15.321094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:52:15.321820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:52:15.322581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:52:15.323155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:52:15.323713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:52:15.332707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:15.333472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:15.334073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:15.334983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:15.335612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:15.336218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:15.354316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Getting quotas for project a4710066b8924d09a9230ccc47b9bcfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:52:15.360219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Getting quotas for user 3e0f819766f54d1cb7cf06d06fabeb0d and project a4710066b8924d09a9230ccc47b9bcfe. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:52:15.376003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:52:15.379302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:52:15.433911 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9599ad8-9f03-4359-ac51-8bbcc15695d1 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650195 Aug 30 04:52:15.434979 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3248/6432] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:52:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:52:15.446832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ab2cba9-76a7-4f8f-b854-69be29012348 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:15.448232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ab2cba9-76a7-4f8f-b854-69be29012348 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:15.516327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5ab2cba9-76a7-4f8f-b854-69be29012348 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:15.524783 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ab2cba9-76a7-4f8f-b854-69be29012348 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1302 microversion: 2.1 time: 0.083324 Aug 30 04:52:15.525790 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3185/6433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:15 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:52:16.547407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:16.548051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:16.558570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:16.559911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:16.560412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:16.561180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:16.562184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:16.562801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:16.645891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:16.656523 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5703de55-1e4b-487b-9765-4cfda65a9f91 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1372 microversion: 2.1 time: 0.113950 Aug 30 04:52:16.658355 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3249/6434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:16 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:17.679906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:17.681430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:17.691789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:17.692964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:17.693997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:17.694984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:17.696414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:17.697417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:17.873571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:17.881413 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0170d74d-4fb3-421a-bc4e-7a724caac967 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1428 microversion: 2.1 time: 0.206079 Aug 30 04:52:17.882108 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3186/6435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:17 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1428 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:52:17.914205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e3103d26-f211-475a-8fac-c87d3febe35b req-9499bbf2-3027-46cc-a869-cd8faa523260 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44726e74-53d8-481f-9500-847541eaeec9", "tag": "91a3f94a-1854-4040-b7de-7bf73c1a87a0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:17.925567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e3103d26-f211-475a-8fac-c87d3febe35b req-9499bbf2-3027-46cc-a869-cd8faa523260 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:17.927033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e3103d26-f211-475a-8fac-c87d3febe35b req-9499bbf2-3027-46cc-a869-cd8faa523260 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:17.927477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e3103d26-f211-475a-8fac-c87d3febe35b req-9499bbf2-3027-46cc-a869-cd8faa523260 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:17.941092 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e3103d26-f211-475a-8fac-c87d3febe35b req-9499bbf2-3027-46cc-a869-cd8faa523260 service nova] Creating event network-changed:91a3f94a-1854-4040-b7de-7bf73c1a87a0 for instance 44726e74-53d8-481f-9500-847541eaeec9 on n-h2-854925-5 Aug 30 04:52:17.946692 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e3103d26-f211-475a-8fac-c87d3febe35b req-9499bbf2-3027-46cc-a869-cd8faa523260 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037009 Aug 30 04:52:17.947308 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3250/6436] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:52:18.908683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:18.909317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:18.917062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:18.917594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:18.918037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:18.918739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:18.919196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:18.919634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:19.053691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:19.061426 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-94ee9815-c533-4f36-ac43-0192b205ec4e tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1428 microversion: 2.1 time: 0.156683 Aug 30 04:52:19.062005 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3187/6437] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:18 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1428 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:20.083902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:20.084631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:20.091350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:20.091838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:20.092289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:20.092966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:20.093442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:20.093869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:20.224119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:20.231987 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-832c3e41-bce4-43e8-b695-d709ecce1d90 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1428 microversion: 2.1 time: 0.153815 Aug 30 04:52:20.232559 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3251/6438] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:20 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1428 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:21.252345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:21.253077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:21.260105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:21.260589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:21.261024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:21.261771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:21.262228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:21.262658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:21.397918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:21.406023 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-83732d1a-0937-4e01-aef9-c170a1adc04d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1428 microversion: 2.1 time: 0.157583 Aug 30 04:52:21.406630 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3188/6439] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:21 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1428 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:22.427440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:22.428060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:22.434884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:22.435364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:22.435799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:22.436480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:22.436930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:22.437366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:22.572645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:22.580448 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8ca311a0-8de0-435d-b510-e3c6135369e3 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1428 microversion: 2.1 time: 0.157514 Aug 30 04:52:22.581023 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3252/6440] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:22 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1428 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:22.858893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-39e41070-0d79-438d-b30d-5021b132ffba req-aac74f06-8f38-4546-b3a9-9bdc8e86590d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44726e74-53d8-481f-9500-847541eaeec9", "name": "network-vif-plugged", "status": "completed", "tag": "91a3f94a-1854-4040-b7de-7bf73c1a87a0"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:22.869600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-39e41070-0d79-438d-b30d-5021b132ffba req-aac74f06-8f38-4546-b3a9-9bdc8e86590d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:22.870083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-39e41070-0d79-438d-b30d-5021b132ffba req-aac74f06-8f38-4546-b3a9-9bdc8e86590d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:22.870498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-39e41070-0d79-438d-b30d-5021b132ffba req-aac74f06-8f38-4546-b3a9-9bdc8e86590d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:22.881825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-39e41070-0d79-438d-b30d-5021b132ffba req-aac74f06-8f38-4546-b3a9-9bdc8e86590d service nova] Creating event network-vif-plugged:91a3f94a-1854-4040-b7de-7bf73c1a87a0 for instance 44726e74-53d8-481f-9500-847541eaeec9 on n-h2-854925-5 Aug 30 04:52:22.886829 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-39e41070-0d79-438d-b30d-5021b132ffba req-aac74f06-8f38-4546-b3a9-9bdc8e86590d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032186 Aug 30 04:52:22.887591 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3189/6441] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:52:23.599999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:23.600615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:23.607868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:23.608349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:23.608787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:23.609518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:23.609973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:23.610398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:23.740192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:23.747961 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a919b51a-3d1f-4095-b8cb-92585676e8b8 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1428 microversion: 2.1 time: 0.151893 Aug 30 04:52:23.748544 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3253/6442] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:23 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:24.770145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:24.770853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:24.777030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:24.777554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:24.778000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:24.778690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:24.779144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:24.779569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:24.920505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:24.928274 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f71a73b0-0c4f-4423-be3d-7f4f155b9281 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1608 microversion: 2.1 time: 0.163861 Aug 30 04:52:24.928860 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3190/6443] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:24 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1608 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:24.949803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:24.950446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:24.957931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:24.958411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:24.958845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:24.959530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:24.959978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:24.960399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:25.088618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:25.096417 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0d93920-6120-4c3c-a06a-b6924c7d75ae tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1608 microversion: 2.1 time: 0.150540 Aug 30 04:52:25.097004 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3254/6444] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:24 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1608 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:25.116104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:25.116748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:25.129634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:25.130133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:25.130573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:25.131292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:25.131753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:25.132184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:25.277155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:25.285101 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-55882fb5-e780-4586-9aef-08e53db9f341 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1608 microversion: 2.1 time: 0.172974 Aug 30 04:52:25.285706 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3191/6445] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:25 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1608 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:27.268247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e6799fbc-7119-45bd-a6d2-1011748b27d6 req-8b78b0c5-b701-4feb-b108-51441f03c10f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44726e74-53d8-481f-9500-847541eaeec9", "tag": "91a3f94a-1854-4040-b7de-7bf73c1a87a0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:27.273813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:27.274497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:27.282282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6799fbc-7119-45bd-a6d2-1011748b27d6 req-8b78b0c5-b701-4feb-b108-51441f03c10f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:27.282766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6799fbc-7119-45bd-a6d2-1011748b27d6 req-8b78b0c5-b701-4feb-b108-51441f03c10f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:27.283206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6799fbc-7119-45bd-a6d2-1011748b27d6 req-8b78b0c5-b701-4feb-b108-51441f03c10f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:27.298038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e6799fbc-7119-45bd-a6d2-1011748b27d6 req-8b78b0c5-b701-4feb-b108-51441f03c10f service nova] Creating event network-changed:91a3f94a-1854-4040-b7de-7bf73c1a87a0 for instance 44726e74-53d8-481f-9500-847541eaeec9 on n-h2-854925-5 Aug 30 04:52:27.303614 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e6799fbc-7119-45bd-a6d2-1011748b27d6 req-8b78b0c5-b701-4feb-b108-51441f03c10f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039036 Aug 30 04:52:27.304243 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3255/6446] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:52:43.962772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:43.964965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:43.966954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:43.968306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:43.969060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=32 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:43.976498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:43.976970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:43.977438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:43.978139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:43.978598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:43.979025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:44.056733 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2425d865-37a9-4f0e-a07c-c6ce7ed982d0 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "POST /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2/action" status: 200 len: 32628 microversion: 2.1 time: 0.098405 Aug 30 04:52:44.057530 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3192/6447] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:52:43 2022] POST /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2/action => generated 32628 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 04:52:45.079984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:45.081021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=40 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:52:45.086116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:45.086711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:45.087400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-beae91e1-d71a-4331-b205-be8c7a230a04 req-a4567d15-74e8-4e1a-83f5-41df02914137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f94890e9-9066-47c1-96b8-e3a924dc8cf2", "tag": "22386376-7499-4834-8e30-5afccf912ff5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:45.093973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:45.094490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:45.094931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:45.095640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:45.096096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:45.096524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:45.099383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-beae91e1-d71a-4331-b205-be8c7a230a04 req-a4567d15-74e8-4e1a-83f5-41df02914137 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:45.100068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-beae91e1-d71a-4331-b205-be8c7a230a04 req-a4567d15-74e8-4e1a-83f5-41df02914137 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:45.100601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-beae91e1-d71a-4331-b205-be8c7a230a04 req-a4567d15-74e8-4e1a-83f5-41df02914137 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:45.115149 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-beae91e1-d71a-4331-b205-be8c7a230a04 req-a4567d15-74e8-4e1a-83f5-41df02914137 service nova] Creating event network-changed:22386376-7499-4834-8e30-5afccf912ff5 for instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 on n-h1-854925-5 Aug 30 04:52:45.120824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-beae91e1-d71a-4331-b205-be8c7a230a04 req-a4567d15-74e8-4e1a-83f5-41df02914137 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040427 Aug 30 04:52:45.121956 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3193/6448] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:52:45.123593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:52:45.205987 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8b9ce60-1656-4e85-b3d4-b2bf786f04d6 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 204 len: 0 microversion: 2.1 time: 0.127490 Aug 30 04:52:45.211097 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3256/6449] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:52:45 2022] DELETE /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:52:45.218137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:45.218850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:45.228397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:45.228893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:45.229367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:45.230104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:45.230562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:45.231118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:45.370848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:45.379103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e9790d9c-e065-4f13-9c89-b98a9e434133 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1670 microversion: 2.1 time: 0.165988 Aug 30 04:52:45.379684 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3194/6450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:45 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:46.402452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:46.403144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:46.410078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:46.410562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:46.410994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:46.411684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:46.412764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:46.413192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:46.556748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:46.565001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-95c56284-73ac-4357-b009-19176f3cb8ab tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1670 microversion: 2.1 time: 0.166793 Aug 30 04:52:46.565637 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3257/6451] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:46 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:47.586788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:47.587399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:47.594338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:47.594819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:47.595253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:47.595937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:47.596383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:47.596805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:47.742209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf154ac497e4e6e84b10d9a338f085e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8002c096e4a74cbea72ac0be290db680', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:52:47.750123 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a62b0e9e-91dd-47b3-bd0a-9a5926a2945f tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 200 len: 1670 microversion: 2.1 time: 0.167248 Aug 30 04:52:47.750725 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3195/6452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:47 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:52:47.830664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f41365b0-32a8-4546-90f8-18d2a5511b21 req-171b43b4-f739-4003-88db-707bfe5e6b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f94890e9-9066-47c1-96b8-e3a924dc8cf2", "name": "network-vif-deleted", "tag": "22386376-7499-4834-8e30-5afccf912ff5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:52:47.842089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f41365b0-32a8-4546-90f8-18d2a5511b21 req-171b43b4-f739-4003-88db-707bfe5e6b2d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:47.842588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f41365b0-32a8-4546-90f8-18d2a5511b21 req-171b43b4-f739-4003-88db-707bfe5e6b2d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:47.843225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f41365b0-32a8-4546-90f8-18d2a5511b21 req-171b43b4-f739-4003-88db-707bfe5e6b2d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:47.860299 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f41365b0-32a8-4546-90f8-18d2a5511b21 req-171b43b4-f739-4003-88db-707bfe5e6b2d service nova] Creating event network-vif-deleted:22386376-7499-4834-8e30-5afccf912ff5 for instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 on n-h1-854925-5 Aug 30 04:52:47.865432 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f41365b0-32a8-4546-90f8-18d2a5511b21 req-171b43b4-f739-4003-88db-707bfe5e6b2d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038681 Aug 30 04:52:47.866043 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3258/6453] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:52:48.771084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:48.771729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] [instance: f94890e9-9066-47c1-96b8-e3a924dc8cf2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:52:48.778826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:48.779316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:48.779751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:48.780868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:52:48.781235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:52:48.781687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:52:48.796682 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] HTTP exception thrown: Instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 could not be found. Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Request method failure captured: Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 HTTP/1.1 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZbDwO7v8l34QU8liI58PD8ILPCTFJdkRO6vISpw9_U-5lnwzWN-_8LwY3tvYMFlMfwRndElF6tNKYzAFonmE9cVDR177MHm8ibYeB4jrqaND3BU7tSp27tPWbIfmWuZgQXzk3OktjwH5KevcxNku-J28I2bF6n3GvC1Ar048dQkVtQ Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 8002c096e4a74cbea72ac0be290db680 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8002c096e4a74cbea72ac0be290db680", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8002c096e4a74cbea72ac0be290db680"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8002c096e4a74cbea72ac0be290db680"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8002c096e4a74cbea72ac0be290db680"}]}] Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 8002c096e4a74cbea72ac0be290db680 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkBasicOps-1496641033 Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkBasicOps-1496641033-project Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9bf154ac497e4e6e84b10d9a338f085e Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkBasicOps-1496641033-project Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 could not be found. Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'f94890e9-9066-47c1-96b8-e3a924dc8cf2'} Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 could not be found. Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 could not be found. Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:52:48.798636 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 could not be found. Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Returning 404 to user: Instance f94890e9-9066-47c1-96b8-e3a924dc8cf2 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3f3a8d50-2558-4355-99f5-14e5e516283b tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2" status: 404 len: 111 microversion: 2.1 time: 0.033027 Aug 30 04:52:48.804024 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3196/6454] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:52:48 2022] GET /compute/v2.1/servers/f94890e9-9066-47c1-96b8-e3a924dc8cf2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:52:48.970847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90e87fa1-031e-4e71-a5fa-eaff612d9b56 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] Calling method '.version_select at 0x7fe9691725e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:52:48.993890 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-90e87fa1-031e-4e71-a5fa-eaff612d9b56 tempest-TestNetworkBasicOps-1496641033 tempest-TestNetworkBasicOps-1496641033-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-613008003" status: 202 len: 0 microversion: 2.1 time: 0.028093 Aug 30 04:52:48.994371 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3259/6455] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 30 04:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-613008003 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:53:04.079350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:04.080387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:04.085554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=10 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:04.086463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=20 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:04.090902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:04.091616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:04.092050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:04.092796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:04.093451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:04.093905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:04.120486 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d28a67bc-06ef-4d42-b45c-3e0ad9706084 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044584 Aug 30 04:53:04.121655 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3197/6456] 10.222.0.27 () {58 vars in 1293 bytes} [Tue Aug 30 04:53:04 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9/os-server-password => generated 116 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:05.197232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-268766542", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "999836ae-284f-46bf-8eb0-31273b97d5ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:05.208553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:05.210025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:05.262621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:53:06.010160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:53:06.010583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:53:06.011351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:53:06.011766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:53:06.012210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:53:06.022687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:06.023175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:06.023610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:06.024367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:06.024819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:06.025244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:06.042806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:53:06.048440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:53:06.109117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:53:06.111339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='999836ae-284f-46bf-8eb0-31273b97d5ec',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:53:06.252770 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b1d21db-bde9-4382-81d3-4ed538af3003 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.059611 Aug 30 04:53:06.253495 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3260/6457] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:53:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:53:06.265277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee6efaaf-5dd3-46b6-b973-ff4b1b669e5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:06.265923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee6efaaf-5dd3-46b6-b973-ff4b1b669e5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:06.332700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee6efaaf-5dd3-46b6-b973-ff4b1b669e5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:06.340630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee6efaaf-5dd3-46b6-b973-ff4b1b669e5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1056 microversion: 2.1 time: 0.079596 Aug 30 04:53:06.341218 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3198/6458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:06 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1056 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:53:07.363823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:07.364496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:07.372027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:07.372520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:07.372960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:07.373687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:07.374145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:07.374641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:07.437205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:07.445110 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e102532-a975-49cf-a76d-054f2ea9408c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1154 microversion: 2.1 time: 0.085267 Aug 30 04:53:07.453813 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3261/6459] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:07 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1154 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:08.466933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:08.467707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:08.476577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:08.482094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:08.483092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:08.484077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:08.484731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:08.485415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:08.670762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:08.680820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c964859-e5c2-4fa8-9220-90a383889456 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1214 microversion: 2.1 time: 0.218133 Aug 30 04:53:08.682084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3199/6460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:08 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:09.121256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-685b4116-c9db-4d90-93c1-afee7f23d26e req-52a3726c-cbc0-4d33-9fac-d83ab115e9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "544ade35-81de-4305-b7c8-6abbea9a8d39", "tag": "615a49ab-5556-4a69-979f-22419eb1a6d3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:09.152360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-685b4116-c9db-4d90-93c1-afee7f23d26e req-52a3726c-cbc0-4d33-9fac-d83ab115e9b4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:09.153958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-685b4116-c9db-4d90-93c1-afee7f23d26e req-52a3726c-cbc0-4d33-9fac-d83ab115e9b4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:09.154517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-685b4116-c9db-4d90-93c1-afee7f23d26e req-52a3726c-cbc0-4d33-9fac-d83ab115e9b4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:09.167597 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-685b4116-c9db-4d90-93c1-afee7f23d26e req-52a3726c-cbc0-4d33-9fac-d83ab115e9b4 service nova] Creating event network-changed:615a49ab-5556-4a69-979f-22419eb1a6d3 for instance 544ade35-81de-4305-b7c8-6abbea9a8d39 on n-h1-854925-5 Aug 30 04:53:09.172758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-685b4116-c9db-4d90-93c1-afee7f23d26e req-52a3726c-cbc0-4d33-9fac-d83ab115e9b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063382 Aug 30 04:53:09.173533 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3262/6461] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:53:09.704409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:09.705043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:09.712555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:09.713047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:09.713742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:09.714453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:09.714911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:09.715342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:09.859188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:09.867920 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6738f387-f2c0-415b-9653-aee674042343 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1214 microversion: 2.1 time: 0.167751 Aug 30 04:53:09.868505 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3200/6462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:09 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:10.890744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:10.891444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:10.899052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:10.899544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:10.899981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:10.900683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:10.901138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:10.901582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:11.043592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:11.051887 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-830e4522-c560-4c11-8984-99fd5c2f7ed4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1214 microversion: 2.1 time: 0.166404 Aug 30 04:53:11.053192 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3263/6463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:10 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:12.073798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:12.074421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:12.081679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:12.082173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:12.082620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:12.083322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:12.084465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:12.084950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:12.222165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:12.230001 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0844b555-02e6-468d-91e0-dba040849be5 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1214 microversion: 2.1 time: 0.160239 Aug 30 04:53:12.230654 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3201/6464] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:12 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:13.252231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:13.252877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:13.260198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:13.260716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:13.261162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:13.261896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:13.262356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:13.262786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:13.391290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:13.399677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b05df17-8e1c-4a57-968d-e47415c53ae4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.152511 Aug 30 04:53:13.400254 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3264/6465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:13 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:14.420652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:14.421269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:14.428223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:14.429042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:14.429180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:14.429864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:14.430326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:14.430757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:14.576618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:14.584467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4cbcfad7-5199-4c10-aac0-035192ee5081 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.167690 Aug 30 04:53:14.586197 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3202/6466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:14 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:15.608253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:15.608895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:15.615858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:15.616339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:15.616776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:15.617494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:15.617945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:15.618369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:15.743435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:15.751060 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86ab0c46-00a9-4020-996c-dabaedb4c1b3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.146976 Aug 30 04:53:15.751629 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3265/6467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:15 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:16.771682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:16.772395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:16.775124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:16.780553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:16.781044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:16.781530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:16.782228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:16.782682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:16.783109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:16.922176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:16.929921 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-193fa036-4b1d-4e0c-92ed-564136372ee6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.162169 Aug 30 04:53:16.930558 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3203/6468] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:16 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:17.950369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:17.951000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:17.952950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:17.953632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:17.960721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:17.961201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:17.961669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:17.962350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:17.962800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:17.963224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:18.099929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:18.107965 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-51f17670-e9db-4f3a-b64a-6e057cc915d9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.161506 Aug 30 04:53:18.108539 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3266/6469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:17 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:19.128072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:19.128704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:19.135901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:19.136391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:19.136838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:19.137584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:19.138041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:19.138478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:19.267289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:19.275087 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f97e2f1a-b4f1-4a79-af2b-432d10e893af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.150928 Aug 30 04:53:19.275675 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3204/6470] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:19 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:20.295176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:20.295787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:20.302677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:20.303185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:20.303624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:20.304308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:20.304785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:20.305209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:20.435941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:20.443633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-455a5633-0661-447a-8b18-5844a36f5ecb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.152310 Aug 30 04:53:20.444736 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3267/6471] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:20 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:21.464634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:21.465206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:21.472652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:21.473139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:21.473677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:21.474377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:21.474837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:21.475963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:21.604697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:21.612656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bb24730f-c793-47f2-b5db-c5d154700cfe tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.152041 Aug 30 04:53:21.613248 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3205/6472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:21 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:22.633551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:22.634160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:22.641004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:22.641529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:22.641966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:22.642657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:22.643102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:22.643522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:22.775634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:22.783266 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2e9a5f8-2bd9-467c-8965-96ac8d1d8e43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.153757 Aug 30 04:53:22.783833 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3268/6473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:22 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:23.160052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d51d15a9-c11a-464b-8493-3f6035133c23 req-6003beb5-539e-4389-92b9-cca36c537ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544ade35-81de-4305-b7c8-6abbea9a8d39", "name": "network-vif-plugged", "status": "completed", "tag": "615a49ab-5556-4a69-979f-22419eb1a6d3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:23.172303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d51d15a9-c11a-464b-8493-3f6035133c23 req-6003beb5-539e-4389-92b9-cca36c537ad3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:23.172910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d51d15a9-c11a-464b-8493-3f6035133c23 req-6003beb5-539e-4389-92b9-cca36c537ad3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:23.173419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d51d15a9-c11a-464b-8493-3f6035133c23 req-6003beb5-539e-4389-92b9-cca36c537ad3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:23.185338 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d51d15a9-c11a-464b-8493-3f6035133c23 req-6003beb5-539e-4389-92b9-cca36c537ad3 service nova] Creating event network-vif-plugged:615a49ab-5556-4a69-979f-22419eb1a6d3 for instance 544ade35-81de-4305-b7c8-6abbea9a8d39 on n-h1-854925-5 Aug 30 04:53:23.190520 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d51d15a9-c11a-464b-8493-3f6035133c23 req-6003beb5-539e-4389-92b9-cca36c537ad3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034673 Aug 30 04:53:23.191200 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3206/6474] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:23.803455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:23.804056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:23.810848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:23.811338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:23.811776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:23.812463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:23.812918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:23.813360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:23.945902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:23.954387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d6621d97-6eb8-467c-aee6-e8906cfe1fdc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1202 microversion: 2.1 time: 0.154944 Aug 30 04:53:23.955012 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3269/6475] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:23 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:24.977157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:24.977838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:24.984369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:24.984854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:24.985292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:24.986006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:24.986462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:24.986892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.118021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:25.125796 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bbeaedc5-8714-45c3-a2ea-916375470adb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1389 microversion: 2.1 time: 0.154456 Aug 30 04:53:25.126371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3207/6476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:24 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:25.145413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:25.146030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:25.159729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.160220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.160658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.161439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.161891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.162319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.299225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:25.307333 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-72396ff0-cc75-45d6-a62c-fe95cb91c9e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1389 microversion: 2.1 time: 0.165853 Aug 30 04:53:25.307911 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3270/6477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:25 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:25.330237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:25.330862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:25.337435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.337918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.338357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.339041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.339493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.339921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.472049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:25.480525 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f7ef6415-a429-4fd8-ba16-5f39dab2a601 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1389 microversion: 2.1 time: 0.154154 Aug 30 04:53:25.481079 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3208/6478] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:25 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1389 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:25.500520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:25.500975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:25.507478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.508321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.509111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.510353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.511206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.511718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.548457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:53:25.624297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd4633b9-a507-4563-8472-5280d8e72d31 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 204 len: 0 microversion: 2.1 time: 0.127184 Aug 30 04:53:25.625067 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3271/6479] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:53:25 2022] DELETE /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:53:25.634299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:25.634924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:25.641236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.641774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.642216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.642924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:25.643391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:25.643821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:25.778854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:25.786951 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b656dcc-695d-490d-9fe1-fa795a2292b1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1395 microversion: 2.1 time: 0.157520 Aug 30 04:53:25.788050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3209/6480] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:25 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1395 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:26.811717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:26.812436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:26.822294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:26.822786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:26.823231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:26.823928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:26.824382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:26.825067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:26.971473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:26.979404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f5e24f23-8b66-424f-beb5-d48fb350df43 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1395 microversion: 2.1 time: 0.174166 Aug 30 04:53:26.979993 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3272/6481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:26 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1395 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:28.001227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:28.001825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:28.009152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:28.009673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:28.010335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:28.011051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:28.011498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:28.011925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:28.113801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d970e62f-c59c-47d2-b642-14ee18beb54e req-2af07cd9-66d6-46eb-b8d0-c07645a451b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "544ade35-81de-4305-b7c8-6abbea9a8d39", "name": "network-vif-deleted", "tag": "615a49ab-5556-4a69-979f-22419eb1a6d3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:28.128017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d970e62f-c59c-47d2-b642-14ee18beb54e req-2af07cd9-66d6-46eb-b8d0-c07645a451b3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:28.128500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d970e62f-c59c-47d2-b642-14ee18beb54e req-2af07cd9-66d6-46eb-b8d0-c07645a451b3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:28.128931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d970e62f-c59c-47d2-b642-14ee18beb54e req-2af07cd9-66d6-46eb-b8d0-c07645a451b3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:28.143128 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d970e62f-c59c-47d2-b642-14ee18beb54e req-2af07cd9-66d6-46eb-b8d0-c07645a451b3 service nova] Creating event network-vif-deleted:615a49ab-5556-4a69-979f-22419eb1a6d3 for instance 544ade35-81de-4305-b7c8-6abbea9a8d39 on n-h1-854925-5 Aug 30 04:53:28.149367 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d970e62f-c59c-47d2-b642-14ee18beb54e req-2af07cd9-66d6-46eb-b8d0-c07645a451b3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039847 Aug 30 04:53:28.155252 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3273/6482] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:28.244363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:28.254160 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-361348cb-a73e-4297-a634-4bfc1d7f4f42 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1353 microversion: 2.1 time: 0.256711 Aug 30 04:53:28.254921 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3210/6483] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:27 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1353 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:29.275431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:29.276046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:29.283377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:29.283867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:29.284336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:29.285132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:29.285608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:29.286037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:29.413138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:29.421064 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18769c9d-ac22-4bdd-88b1-72b32502cfbd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1187 microversion: 2.1 time: 0.150084 Aug 30 04:53:29.421662 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3274/6484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:29 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1187 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:30.442175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:30.442953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:30.450498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:30.450994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:30.451438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:30.452142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:30.452600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:30.453038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:30.518320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:30.527015 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e9c4d71e-0433-472b-845a-b0e9c0d4ff19 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1187 microversion: 2.1 time: 0.089019 Aug 30 04:53:30.527705 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3211/6485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:30 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1187 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:31.556883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:31.557522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:31.564174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:31.564595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:31.565137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:31.565858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:31.566311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:31.566736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:31.629292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:31.637278 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f07b6c26-fa96-4c58-8e14-100354a575a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1187 microversion: 2.1 time: 0.085056 Aug 30 04:53:31.637900 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3275/6486] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:31 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:32.657712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:32.658330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:32.665149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:32.665665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:32.666112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:32.666801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:32.667255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:32.667703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:32.698688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:32.699170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:32.699608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:32.700055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lazy-loading 'fault' on Instance uuid 544ade35-81de-4305-b7c8-6abbea9a8d39 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:53:32.741622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:32.749901 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0f10450f-a48f-4116-a1fc-9e3c9a02dae9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 200 len: 1192 microversion: 2.1 time: 0.096097 Aug 30 04:53:32.750501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3212/6487] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:32 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:33.771780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:33.773250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 544ade35-81de-4305-b7c8-6abbea9a8d39] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:33.780229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:33.780708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:33.781144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:33.781871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:33.782324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:33.782752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:33.796849 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 544ade35-81de-4305-b7c8-6abbea9a8d39 could not be found. Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 HTTP/1.1 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 544ade35-81de-4305-b7c8-6abbea9a8d39 could not be found. Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '544ade35-81de-4305-b7c8-6abbea9a8d39'} Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 544ade35-81de-4305-b7c8-6abbea9a8d39 could not be found. Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 544ade35-81de-4305-b7c8-6abbea9a8d39 could not be found. Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:53:33.798544 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 544ade35-81de-4305-b7c8-6abbea9a8d39 could not be found. Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 544ade35-81de-4305-b7c8-6abbea9a8d39 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad4bef0e-a32b-4d0d-b611-08640e89d91b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39" status: 404 len: 111 microversion: 2.1 time: 0.032101 Aug 30 04:53:33.804572 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3276/6488] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:33 2022] GET /compute/v2.1/servers/544ade35-81de-4305-b7c8-6abbea9a8d39 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:53:38.730677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1244308884", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "eba25127-0a69-4cbb-a0e6-633552dd7b38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:38.742308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=37 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:38.794048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:53:39.214459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:53:39.215031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:53:39.215734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:53:39.216348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:53:39.216763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:53:39.225912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:39.226392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:39.226827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:39.227548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:39.228000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:39.228422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:39.235460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=87 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:39.246693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:53:39.251900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:53:39.311638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:53:39.313896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eba25127-0a69-4cbb-a0e6-633552dd7b38',volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:53:39.449511 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2683c3fd-a6ab-4421-850e-6c6374a745d4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722577 Aug 30 04:53:39.450272 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3213/6489] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:53:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:53:39.461995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6fc4fde-d77f-4d97-92e9-061d2d552047 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:39.462958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6fc4fde-d77f-4d97-92e9-061d2d552047 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:39.466371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:39.527862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6fc4fde-d77f-4d97-92e9-061d2d552047 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:39.540177 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6fc4fde-d77f-4d97-92e9-061d2d552047 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1057 microversion: 2.1 time: 0.082917 Aug 30 04:53:39.553998 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3277/6490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:39 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1057 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:40.567331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:40.568389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:40.575855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:40.576326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:40.576763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:40.577529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:40.578152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:40.578585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:40.650500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:40.659136 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c4c05a6f-d97c-49f2-b097-cd91b2724f0b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1163 microversion: 2.1 time: 0.096711 Aug 30 04:53:40.659731 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3214/6491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:40 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1163 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:41.680057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:41.681294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:41.693813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:41.694640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:41.695075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:41.695963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:41.696578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:41.697191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:41.701632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:41.848933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:41.860355 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e806bd8d-c82f-4888-91ec-3e602580e1cd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1215 microversion: 2.1 time: 0.184107 Aug 30 04:53:41.861274 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3278/6492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:41 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1215 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:42.205208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ad642f48-287b-4d9c-8aca-bd6621206c35 req-65dcb093-edc6-4a54-9b5e-f43d837ae467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fa0d4d-342f-475c-989e-17104bc3ca3c", "tag": "f2cd1dac-0958-49ab-8e1c-5c927254d3b1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:42.219499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ad642f48-287b-4d9c-8aca-bd6621206c35 req-65dcb093-edc6-4a54-9b5e-f43d837ae467 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:42.219991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ad642f48-287b-4d9c-8aca-bd6621206c35 req-65dcb093-edc6-4a54-9b5e-f43d837ae467 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:42.221062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ad642f48-287b-4d9c-8aca-bd6621206c35 req-65dcb093-edc6-4a54-9b5e-f43d837ae467 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:42.238937 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ad642f48-287b-4d9c-8aca-bd6621206c35 req-65dcb093-edc6-4a54-9b5e-f43d837ae467 service nova] Creating event network-changed:f2cd1dac-0958-49ab-8e1c-5c927254d3b1 for instance 22fa0d4d-342f-475c-989e-17104bc3ca3c on n-h1-854925-5 Aug 30 04:53:42.246175 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ad642f48-287b-4d9c-8aca-bd6621206c35 req-65dcb093-edc6-4a54-9b5e-f43d837ae467 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052248 Aug 30 04:53:42.246798 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3215/6493] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:42.881824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:42.883123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:42.890335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:42.890821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:42.891258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:42.892079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:42.892651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:42.893094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:43.041811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:43.050295 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a5c0dca0-c961-4b6f-a8eb-0175f983696d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1215 microversion: 2.1 time: 0.172855 Aug 30 04:53:43.050890 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3279/6494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:42 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:44.073546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:44.074199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:44.080604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:44.081038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:44.081517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:44.082203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:44.082652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:44.083073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:44.215180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:44.223100 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-76682ffc-e3fe-4d88-9269-5da23e5318a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1215 microversion: 2.1 time: 0.155467 Aug 30 04:53:44.223676 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3216/6495] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:44 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:45.244144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:45.244780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:45.251794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:45.252361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:45.252809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:45.253546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:45.254002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:45.254435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:45.391125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:45.400264 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c5ea539-ae3d-4124-b4bf-4addbc185f87 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1215 microversion: 2.1 time: 0.160073 Aug 30 04:53:45.400860 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3280/6496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:45 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:46.420175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:46.420786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:46.427762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:46.428243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:46.428675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:46.429379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:46.429835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:46.430260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:46.559742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:46.567411 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4fe5d9b6-43dc-4471-b04b-7eed2ecc4369 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.151331 Aug 30 04:53:46.568018 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3217/6497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:46 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:47.588681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:47.589241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:47.596239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:47.596726 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:47.597164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:47.597878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:47.598332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:47.598758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:47.724852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:47.733511 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f3f0ab1c-76cb-41e7-b52f-a5a21a539282 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.149429 Aug 30 04:53:47.734093 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3281/6498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:47 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:48.754176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:48.754798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:48.762714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:48.763206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:48.763650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:48.764345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:48.764803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:48.765232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:48.894307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:48.902147 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f707eb30-2b96-4ace-ba37-cd46e8f75b1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.151849 Aug 30 04:53:48.902941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3218/6499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:48 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:49.923486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:49.924297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:49.927097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:49.933190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:49.933704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:49.934151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:49.934850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:49.935310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:49.935746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:50.064784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:50.073627 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9e2f9e57-2908-4ec0-9391-421461788e57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.154102 Aug 30 04:53:50.074218 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3282/6500] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:49 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:51.095561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:51.096208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:51.098247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:51.098918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:53:51.105690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:51.106183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:51.106632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:51.107336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:51.108072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:51.108506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:51.234507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:51.242280 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a1a6b333-d5c3-4fb7-b934-e1b2d2a8b65e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.150643 Aug 30 04:53:51.242858 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3219/6501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:51 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:52.263167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:52.263778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:52.270590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:52.271051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:52.271485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:52.272173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:52.272626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:52.273051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:52.407416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:52.415190 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b015694-b8fb-4e9c-81ac-455aee340703 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.155863 Aug 30 04:53:52.415755 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3283/6502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:52 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:53.435535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:53.436156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:53.442805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:53.443287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:53.443731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:53.444935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:53.445421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:53.445856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:53.575049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:53.582837 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7478d9a-475d-40bd-82c0-7e9676df4356 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.151260 Aug 30 04:53:53.583421 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3220/6503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:53 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:54.603567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:54.604179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:54.611346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:54.611832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:54.612265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:54.612953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:54.613430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:54.613854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:54.748545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:54.756337 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2a4322c1-2083-4a4f-9b5c-4a1bd1273c8b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.157311 Aug 30 04:53:54.757440 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3284/6504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:54 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:55.777723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:55.778284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:55.785056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:55.785577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:55.786015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:55.786705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:55.787157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:55.787581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:55.916651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:55.924477 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-391f817f-7966-44ff-bf71-f471bb7589c9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.150769 Aug 30 04:53:55.925053 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3221/6505] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:55 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:56.944362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:56.945029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:56.952589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:56.953067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:56.953533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:56.954218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:56.954666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:56.955090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:57.085782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:57.093780 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb5929be-e631-4b45-b3fe-7a707f436f86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.153321 Aug 30 04:53:57.094357 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3285/6506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:56 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:57.267954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b9097d6d-57d0-484e-8fe7-e64e03d2a837 req-e52cf086-63e7-4ab6-bacd-a6699bc9de69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fa0d4d-342f-475c-989e-17104bc3ca3c", "name": "network-vif-plugged", "status": "completed", "tag": "f2cd1dac-0958-49ab-8e1c-5c927254d3b1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:53:57.278597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9097d6d-57d0-484e-8fe7-e64e03d2a837 req-e52cf086-63e7-4ab6-bacd-a6699bc9de69 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:57.279084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9097d6d-57d0-484e-8fe7-e64e03d2a837 req-e52cf086-63e7-4ab6-bacd-a6699bc9de69 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:57.279522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b9097d6d-57d0-484e-8fe7-e64e03d2a837 req-e52cf086-63e7-4ab6-bacd-a6699bc9de69 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:57.290721 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b9097d6d-57d0-484e-8fe7-e64e03d2a837 req-e52cf086-63e7-4ab6-bacd-a6699bc9de69 service nova] Creating event network-vif-plugged:f2cd1dac-0958-49ab-8e1c-5c927254d3b1 for instance 22fa0d4d-342f-475c-989e-17104bc3ca3c on n-h1-854925-5 Aug 30 04:53:57.296279 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b9097d6d-57d0-484e-8fe7-e64e03d2a837 req-e52cf086-63e7-4ab6-bacd-a6699bc9de69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032008 Aug 30 04:53:57.296875 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3222/6507] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:53:58.114902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:58.115603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:58.122387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:58.122867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:58.123300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:58.123986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:58.124435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:58.124869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:58.253838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:58.261771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-32978c24-0f85-47c9-80c9-5e8c9e107167 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1203 microversion: 2.1 time: 0.150762 Aug 30 04:53:58.262389 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3286/6508] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:58 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:59.283179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:59.283881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:59.290142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.290620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.291587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.292267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.292724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.293147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.423760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:59.431625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f8536da-552c-48fd-bfd1-787ed96a6eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1390 microversion: 2.1 time: 0.153519 Aug 30 04:53:59.432211 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3223/6509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:59 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:59.452038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:59.452654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:59.459549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.460021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.460484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.461174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.461682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.462116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.592746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:59.600822 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-393adb37-89cc-44e3-85fc-94375b5710f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1390 microversion: 2.1 time: 0.153180 Aug 30 04:53:59.601426 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3287/6510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:59 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:59.621176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:59.622048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:59.628075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.628557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.628993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.629697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.630151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.630575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.758671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:53:59.767093 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e1f40210-5dbe-42a9-b7a3-4cccda1ab4aa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1390 microversion: 2.1 time: 0.150272 Aug 30 04:53:59.767672 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3224/6511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:59 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:53:59.786494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:59.787018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:59.792974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.793426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.793863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.794549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.794999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.795421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.819423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:53:59.895612 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df242507-b708-453b-9723-a977dae1d2f1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 204 len: 0 microversion: 2.1 time: 0.112682 Aug 30 04:53:59.896502 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3288/6512] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:53:59 2022] DELETE /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:53:59.904818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:53:59.905571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:53:59.911985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.912476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.912920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:53:59.913647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:53:59.914111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:53:59.914541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:00.040810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:00.049150 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-391a9773-28c8-4a8d-9315-89052f3ecbf0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1396 microversion: 2.1 time: 0.148264 Aug 30 04:54:00.049689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3225/6513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:53:59 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1396 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:01.071126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:01.071826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:01.080626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:01.081108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:01.081585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:01.082279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:01.082733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:01.083160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:01.213412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:01.221558 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bbd6ac3f-5b25-44ee-b723-ff39abb5665d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1396 microversion: 2.1 time: 0.154962 Aug 30 04:54:01.222133 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3289/6514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:01 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:02.248367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:02.249535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:02.256692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:02.257505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:02.258260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:02.259152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:02.259607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:02.261411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:02.308858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4040f7b1-85f6-41d3-a438-ef969ee1ccfa req-e1d737f9-cefa-4459-b2fd-e130f1df07db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fa0d4d-342f-475c-989e-17104bc3ca3c", "name": "network-vif-deleted", "tag": "f2cd1dac-0958-49ab-8e1c-5c927254d3b1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:54:02.321114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4040f7b1-85f6-41d3-a438-ef969ee1ccfa req-e1d737f9-cefa-4459-b2fd-e130f1df07db service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:02.321926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4040f7b1-85f6-41d3-a438-ef969ee1ccfa req-e1d737f9-cefa-4459-b2fd-e130f1df07db service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:02.323136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4040f7b1-85f6-41d3-a438-ef969ee1ccfa req-e1d737f9-cefa-4459-b2fd-e130f1df07db service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:02.336929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:02.340267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4040f7b1-85f6-41d3-a438-ef969ee1ccfa req-e1d737f9-cefa-4459-b2fd-e130f1df07db service nova] Creating event network-vif-deleted:f2cd1dac-0958-49ab-8e1c-5c927254d3b1 for instance 22fa0d4d-342f-475c-989e-17104bc3ca3c on n-h1-854925-5 Aug 30 04:54:02.346359 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6ae6467-f596-4c74-97f8-e1bd21513a2d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1188 microversion: 2.1 time: 0.105638 Aug 30 04:54:02.349660 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4040f7b1-85f6-41d3-a438-ef969ee1ccfa req-e1d737f9-cefa-4459-b2fd-e130f1df07db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141155 Aug 30 04:54:02.354143 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3226/6515] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:54:02.358560 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3290/6516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:02 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1188 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:54:03.371130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:03.371796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:03.378115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:03.378607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:03.379082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:03.379776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:03.380233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:03.380661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:03.442630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:03.451557 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d2b55c4-ae42-4b6b-9c49-e52c8aa39cb0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1188 microversion: 2.1 time: 0.086104 Aug 30 04:54:03.452232 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3227/6517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:03 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:04.472566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:04.473185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:04.480219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:04.480707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:04.481150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:04.481877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:04.482333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:04.482760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:04.549407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:04.557627 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e095d4f-e471-40ba-80ef-861193a92f73 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1188 microversion: 2.1 time: 0.089260 Aug 30 04:54:04.558215 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3291/6518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:04 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1188 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:05.579013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:05.579549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:05.586549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:05.587036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:05.587478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:05.588207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:05.588663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:05.589091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:05.650471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:05.658387 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dddacdb6-b06a-4d9c-95eb-07b99ca3f6c0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1188 microversion: 2.1 time: 0.083359 Aug 30 04:54:05.658964 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3228/6519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:05 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1188 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:06.678683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:06.679302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:06.685842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:06.686347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:06.686811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:06.687516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:06.687975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:06.688407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:06.719856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:06.720241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:06.720684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:06.721135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lazy-loading 'fault' on Instance uuid 22fa0d4d-342f-475c-989e-17104bc3ca3c {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:54:06.762151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:06.764436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:06.771216 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4f762922-8eb7-43bc-91ff-b7d9cf631d7e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 200 len: 1193 microversion: 2.1 time: 0.096713 Aug 30 04:54:06.771802 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3292/6520] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:06 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:07.792603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:07.793247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 22fa0d4d-342f-475c-989e-17104bc3ca3c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:07.800122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:07.800610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:07.801050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:07.801781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:07.802239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:07.802672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:07.816637 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 22fa0d4d-342f-475c-989e-17104bc3ca3c could not be found. Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c HTTP/1.1 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 22fa0d4d-342f-475c-989e-17104bc3ca3c could not be found. Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '22fa0d4d-342f-475c-989e-17104bc3ca3c'} Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fa0d4d-342f-475c-989e-17104bc3ca3c could not be found. Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fa0d4d-342f-475c-989e-17104bc3ca3c could not be found. Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:54:07.818354 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fa0d4d-342f-475c-989e-17104bc3ca3c could not be found. Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 22fa0d4d-342f-475c-989e-17104bc3ca3c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-71e1e33c-26c5-4a18-ac5f-f9a9baa56825 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c" status: 404 len: 111 microversion: 2.1 time: 0.031614 Aug 30 04:54:07.824099 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3229/6521] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:07 2022] GET /compute/v2.1/servers/22fa0d4d-342f-475c-989e-17104bc3ca3c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:54:28.705579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-914735399", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "15f56d40-a7da-4b8e-991c-b86d31a6ca0d", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:54:28.716901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:28.798942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:54:29.176249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:54:29.176675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:54:29.177183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:54:29.177654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:54:29.178084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:54:29.188848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:29.189351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:29.189811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:29.190544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:29.191000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:29.191431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:29.208710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:54:29.214069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:54:29.226318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:54:29.228881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='15f56d40-a7da-4b8e-991c-b86d31a6ca0d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:54:29.299774 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-348c1f44-b802-4fcd-8478-4eb6ec5ea4c3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598553 Aug 30 04:54:29.300423 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3293/6522] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:54:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:54:29.311896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-765ac78e-04c2-4cc3-a69d-d9bbd0f67caa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:29.312541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-765ac78e-04c2-4cc3-a69d-d9bbd0f67caa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:29.315407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:29.316249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=81 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:29.371671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-765ac78e-04c2-4cc3-a69d-d9bbd0f67caa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:29.378569 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-765ac78e-04c2-4cc3-a69d-d9bbd0f67caa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1056 microversion: 2.1 time: 0.070625 Aug 30 04:54:29.379145 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3230/6523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:29 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1056 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:30.399316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:30.399936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:30.407395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:30.408777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:30.409457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:30.410558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:30.411130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:30.411750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:30.484205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:30.492380 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-354ea90b-0f57-441e-9874-2b111bb83c9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1126 microversion: 2.1 time: 0.097953 Aug 30 04:54:30.492957 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3294/6524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:30 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1126 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:54:31.514699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:31.515731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:31.526000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:31.527074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:31.527793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:31.528724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:31.529367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:31.530020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:31.695662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:31.699574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b71f68fe-feb7-41ea-9f57-463161199979 req-bf868bc0-0f42-4607-9c91-de22f2b05bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b96d454-1e83-4fc4-881b-8dc469641bc1", "tag": "4b383657-ee15-41e9-987c-58e31e7c3e92"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:54:31.706806 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2192f86b-d460-4507-ab9c-8744e94eb28e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.196727 Aug 30 04:54:31.708906 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3231/6525] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:31 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:31.711733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b71f68fe-feb7-41ea-9f57-463161199979 req-bf868bc0-0f42-4607-9c91-de22f2b05bdb service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:31.712512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b71f68fe-feb7-41ea-9f57-463161199979 req-bf868bc0-0f42-4607-9c91-de22f2b05bdb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:31.713287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b71f68fe-feb7-41ea-9f57-463161199979 req-bf868bc0-0f42-4607-9c91-de22f2b05bdb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:31.726971 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b71f68fe-feb7-41ea-9f57-463161199979 req-bf868bc0-0f42-4607-9c91-de22f2b05bdb service nova] Creating event network-changed:4b383657-ee15-41e9-987c-58e31e7c3e92 for instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 on n-h1-854925-5 Aug 30 04:54:31.732387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b71f68fe-feb7-41ea-9f57-463161199979 req-bf868bc0-0f42-4607-9c91-de22f2b05bdb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036540 Aug 30 04:54:31.733358 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3295/6526] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:54:32.728250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:32.729094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:32.736461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:32.736955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:32.737418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:32.738120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:32.738585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:32.739047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:32.879343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:32.887290 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c7cf145-a4c2-4597-a100-1047c422f212 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.163031 Aug 30 04:54:32.887868 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3232/6527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:32 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:33.914854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:33.915722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:33.922239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:33.922694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:33.923143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:33.923841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:33.924318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:33.924739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:34.091882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:34.100110 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fbbedde2-e6c3-4fe9-8ba6-e8a0e51467c6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.191651 Aug 30 04:54:34.101211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3296/6528] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:33 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:35.125249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:35.126352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:35.135285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:35.136913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:35.136913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:35.137608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:35.138036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:35.138835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:35.345684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:35.357989 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-92a33ee3-5a7b-4858-8074-3efe6499986b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.237727 Aug 30 04:54:35.358837 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3233/6529] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:35 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:36.383334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:36.384492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:36.395228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:36.396145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:36.397141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:36.398297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:36.401810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:36.402317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:36.562168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:36.571217 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7275e87-0560-4708-968c-4bf7943afac1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.192751 Aug 30 04:54:36.571825 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3297/6530] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:36 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:37.591517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:37.592269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:37.599804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:37.600507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:37.601188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:37.602138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:37.602612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:37.603038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:37.734529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:37.743127 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-57c8e776-14f5-41a1-b7b3-69f70cb45723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.155998 Aug 30 04:54:37.743990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3234/6531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:37 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:38.764211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:38.764830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:38.772013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:38.772820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:38.772942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:38.773638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:38.774093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:38.775068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:38.909425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:38.917931 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-672a59b8-7a30-468c-91f7-6bcb713962ec tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.157597 Aug 30 04:54:38.918537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3298/6532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:38 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:39.938996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:39.939624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:39.943411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:39.948863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:39.949377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:39.949822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:39.950523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:39.950989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:39.951414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:40.091778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:40.100584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec4ab333-dbe9-48a8-91f7-1653cd76d452 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.165532 Aug 30 04:54:40.101260 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3235/6533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:39 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:41.124190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:41.124957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:41.127748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:41.128473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:41.136330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:41.136859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:41.137308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:41.138097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:41.138557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:41.138994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:41.267845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:41.275514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3447473f-efc6-46c8-bebd-6a29d6cc02d1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.157462 Aug 30 04:54:41.276087 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3299/6534] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:41 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:42.296119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:42.296673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:42.303759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:42.304250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:42.304686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:42.306272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:42.306810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:42.307244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:42.444075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:42.451883 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-004874de-8bd8-409d-a4e1-9f9440a11c5f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.159767 Aug 30 04:54:42.452642 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3236/6535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:42 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:43.473040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:43.473622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:43.480536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:43.481027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:43.481500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:43.482203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:43.482940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:43.483379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:43.617590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:43.626219 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e731c796-eff2-4f13-934f-e6af8fc6e0a4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.157171 Aug 30 04:54:43.626806 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3300/6536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:43 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:44.646504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:44.647136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:44.654880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:44.655368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:44.655805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:44.656504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:44.656964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:44.657422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:44.796780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:44.804520 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0cca7ce-2918-46ab-af66-32d3700986f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1168 microversion: 2.1 time: 0.161974 Aug 30 04:54:44.805103 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3237/6537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:44 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:45.826184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:45.827015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:45.833793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:45.834278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:45.834719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:45.835412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:45.835870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:45.836306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:45.965700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:45.973446 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8d558aa9-a5c8-475d-b4b9-f8c70791139e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.151200 Aug 30 04:54:45.974022 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3301/6538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:45 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:46.996074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:46.996688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:47.003691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:47.004179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:47.004615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:47.005299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:47.005782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:47.006222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:47.132650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:47.140904 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-932c417f-c3bd-449e-a407-3787fb58f51a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.149279 Aug 30 04:54:47.141501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3238/6539] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:46 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:48.161806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:48.162362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:48.169453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:48.169940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:48.170383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:48.171071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:48.171528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:48.171959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:48.300287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:48.308646 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-93d94d02-c1a8-4bec-99ca-31c6e849c4c2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.150808 Aug 30 04:54:48.309219 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3302/6540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:48 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:49.329837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:49.330476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:49.337969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:49.338445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:49.338910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:49.339591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:49.340045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:49.340469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:49.469575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:49.477495 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b80c52f6-7c5f-4ee4-ba21-ed4cf11f1eac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.151555 Aug 30 04:54:49.478080 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3239/6541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:49 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:50.498450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:50.499142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:50.506191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:50.506676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:50.507115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:50.507799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:50.508253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:50.508818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:50.642418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:50.650798 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-13d0af17-436e-4d98-9d0f-0c39bf4df77f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.156260 Aug 30 04:54:50.651378 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3303/6542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:50 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:51.671790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:51.672363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:51.679340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:51.679815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:51.680252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:51.681574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:51.682026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:51.682449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:51.814778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:51.822653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d70991a-7f50-40cc-9477-a007ffe2fef4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.154845 Aug 30 04:54:51.823232 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3240/6543] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:51 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:52.844298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:52.844908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:52.851907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:52.853035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:52.853506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:52.854191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:52.854642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:52.855067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:52.984821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:52.992568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7dd08e9d-ca35-4cad-9ecc-0328d60009c7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.152149 Aug 30 04:54:52.993154 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3304/6544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:52 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:54.013476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:54.014079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:54.020735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:54.021218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:54.021693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:54.022383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:54.022841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:54.023270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:54.154448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:54.162295 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cec39e00-73a1-41ff-89f2-dbd83f1a2722 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.152715 Aug 30 04:54:54.162795 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3241/6545] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:54 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:55.183778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:55.184390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:55.191217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:55.191692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:55.192127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:55.192810 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:55.193260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:55.193706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:55.321631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:55.329315 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd21f6dd-633a-408f-9fa7-dfdccdb77a59 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.149962 Aug 30 04:54:55.329908 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3305/6546] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:55 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:55.578660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-bd2ad924-29a0-425c-a4b0-2ac279fc7321 req-e09fcb0f-caa2-4aac-bcde-15bfb280dd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b96d454-1e83-4fc4-881b-8dc469641bc1", "name": "network-vif-plugged", "status": "completed", "tag": "4b383657-ee15-41e9-987c-58e31e7c3e92"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:54:55.590508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bd2ad924-29a0-425c-a4b0-2ac279fc7321 req-e09fcb0f-caa2-4aac-bcde-15bfb280dd02 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:55.590927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bd2ad924-29a0-425c-a4b0-2ac279fc7321 req-e09fcb0f-caa2-4aac-bcde-15bfb280dd02 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:55.591360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bd2ad924-29a0-425c-a4b0-2ac279fc7321 req-e09fcb0f-caa2-4aac-bcde-15bfb280dd02 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:55.602788 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-bd2ad924-29a0-425c-a4b0-2ac279fc7321 req-e09fcb0f-caa2-4aac-bcde-15bfb280dd02 service nova] Creating event network-vif-plugged:4b383657-ee15-41e9-987c-58e31e7c3e92 for instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 on n-h1-854925-5 Aug 30 04:54:55.608223 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-bd2ad924-29a0-425c-a4b0-2ac279fc7321 req-e09fcb0f-caa2-4aac-bcde-15bfb280dd02 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033325 Aug 30 04:54:55.608988 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3242/6547] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:54:56.350551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:56.351158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:56.358840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:56.359328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:56.359777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:56.360468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:56.360924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:56.361374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:56.490470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:56.498215 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5f9dad8f-ce92-4ab5-8c17-832fbf521490 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1202 microversion: 2.1 time: 0.151632 Aug 30 04:54:56.498790 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3306/6548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:56 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:57.520740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:57.521500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:57.528298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:57.528777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:57.529210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:57.529918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:57.530396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:57.530822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:57.658318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:57.666752 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f17ab0af-c287-43a6-89d9-f87d8df179f6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1388 microversion: 2.1 time: 0.151135 Aug 30 04:54:57.667340 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3243/6549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:57 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:57.686212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:57.686863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:57.693761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:57.694253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:57.694687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:57.695375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:57.696376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:57.696813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:57.831382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:57.841164 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c8b0b576-27e9-4a04-a093-3f3468771053 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1388 microversion: 2.1 time: 0.158763 Aug 30 04:54:57.841802 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3307/6550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:57 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1388 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:57.861670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:57.862212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:57.868239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:57.868721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:57.869162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:57.869889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:57.870361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:57.870783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:58.001478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:58.013353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0b188586-ef0b-4527-ae1d-f752ff9a63f8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1388 microversion: 2.1 time: 0.155757 Aug 30 04:54:58.013978 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3244/6551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:57 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:58.092599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:58.093126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:58.099128 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:58.099614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:58.100239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:58.100936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:58.101437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:58.102485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:58.129349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:54:58.204946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2a50924-ed70-4b0a-94d7-9594cbe54c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 204 len: 0 microversion: 2.1 time: 0.116088 Aug 30 04:54:58.205587 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3308/6552] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:54:58 2022] DELETE /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 04:54:58.214430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:58.215155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:58.221249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:58.221849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:58.222362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:58.223171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:58.223633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:58.224065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:58.352884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:58.361104 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-27efec57-8c00-482f-9416-2a8cb04b66ca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1394 microversion: 2.1 time: 0.151323 Aug 30 04:54:58.361723 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3245/6553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:58 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1394 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:54:59.383403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:54:59.384600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:54:59.387420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:59.393358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:59.393849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:59.394295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:59.395023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:54:59.395480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:54:59.395911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:54:59.400594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:54:59.528872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:54:59.536771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0f95395b-6d33-4076-a94f-a66ced7befca tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1394 microversion: 2.1 time: 0.157681 Aug 30 04:54:59.537371 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3309/6554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:54:59 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1394 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:00.558076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:00.558656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:00.561302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=35 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:00.566882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:00.567377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:00.567815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:00.568552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:00.569008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:00.569479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:00.572589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=87 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:00.707383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:00.715908 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-27dbe446-bfcf-4d7f-91c7-c577c0206f0c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1394 microversion: 2.1 time: 0.162044 Aug 30 04:55:00.716489 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3246/6555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:00 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1394 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:00.955651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-857c1fff-cc21-4edd-9a1a-106287ae9355 req-d7fbc99b-a3fc-412a-aeb6-c862e3739efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b96d454-1e83-4fc4-881b-8dc469641bc1", "name": "network-vif-deleted", "tag": "4b383657-ee15-41e9-987c-58e31e7c3e92"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:00.968979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-857c1fff-cc21-4edd-9a1a-106287ae9355 req-d7fbc99b-a3fc-412a-aeb6-c862e3739efe service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:00.969521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-857c1fff-cc21-4edd-9a1a-106287ae9355 req-d7fbc99b-a3fc-412a-aeb6-c862e3739efe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:00.970164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-857c1fff-cc21-4edd-9a1a-106287ae9355 req-d7fbc99b-a3fc-412a-aeb6-c862e3739efe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:00.985460 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-857c1fff-cc21-4edd-9a1a-106287ae9355 req-d7fbc99b-a3fc-412a-aeb6-c862e3739efe service nova] Creating event network-vif-deleted:4b383657-ee15-41e9-987c-58e31e7c3e92 for instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 on n-h1-854925-5 Aug 30 04:55:00.991085 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-857c1fff-cc21-4edd-9a1a-106287ae9355 req-d7fbc99b-a3fc-412a-aeb6-c862e3739efe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039221 Aug 30 04:55:00.993589 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3310/6556] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:55:01.737777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:01.738449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:01.745623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:01.746120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:01.746564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:01.747272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:01.747736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:01.748173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:01.812439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:01.820797 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1949f3db-6d8d-49b2-998d-7d03c03aaed7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1187 microversion: 2.1 time: 0.087001 Aug 30 04:55:01.822002 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3247/6557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:01 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:02.844157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:02.844978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:02.851317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:02.851804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:02.852245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:02.853539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:02.853996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:02.854426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:02.929134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:02.937165 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-74b13954-f4e0-4a02-8b40-02df063f519b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1187 microversion: 2.1 time: 0.098215 Aug 30 04:55:02.937772 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3311/6558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:02 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1187 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:03.958506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:03.959121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:03.966362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:03.966854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:03.967297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:03.968002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:03.968458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:03.968885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:04.037769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:04.046417 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2a35571d-01cd-4cc6-82e5-3bfa36c033dc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1187 microversion: 2.1 time: 0.091976 Aug 30 04:55:04.047008 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3248/6559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:03 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1187 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:05.067312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:05.067700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:05.074674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:05.075178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:05.075676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:05.076470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:05.077018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:05.077482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:05.169786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:05.178680 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8e217094-0a5f-4765-8294-6223ed754c46 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 200 len: 1187 microversion: 2.1 time: 0.115741 Aug 30 04:55:05.191787 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3312/6560] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:05 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 1187 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:06.200539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:06.201169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:06.208123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:06.208650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:06.209055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:06.209784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:06.210245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:06.210675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:06.225078 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 HTTP/1.1 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9b96d454-1e83-4fc4-881b-8dc469641bc1'} Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:55:06.227061 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bc91c217-d598-461a-9ce8-319f283dbfee tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 404 len: 111 microversion: 2.1 time: 0.032753 Aug 30 04:55:06.233070 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3249/6561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:06 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:55:08.370676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:08.371258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:08.378923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:08.379349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:08.379818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:08.380536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:08.380995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:08.381461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:08.396819 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 HTTP/1.1 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '9b96d454-1e83-4fc4-881b-8dc469641bc1'} Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:55:08.398578 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d473a22-5141-40fb-bcce-c7ea81d98cba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 404 len: 111 microversion: 2.1 time: 0.034164 Aug 30 04:55:08.406957 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3313/6562] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:55:08 2022] DELETE /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:55:08.412029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:08.412675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 9b96d454-1e83-4fc4-881b-8dc469641bc1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:08.419834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:08.420384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:08.420824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:08.421552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:08.422004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:08.422430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:08.436800 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 HTTP/1.1 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9b96d454-1e83-4fc4-881b-8dc469641bc1'} Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:55:08.438391 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 9b96d454-1e83-4fc4-881b-8dc469641bc1 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eda2f567-4b1c-43a2-8c8d-5b966fd3582c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1" status: 404 len: 111 microversion: 2.1 time: 0.031732 Aug 30 04:55:08.443190 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3250/6563] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:08 2022] GET /compute/v2.1/servers/9b96d454-1e83-4fc4-881b-8dc469641bc1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:55:28.045113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1054420138", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "461101c0-ff1a-4f6b-9cd1-4376923d7e05", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:28.055907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=9 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:28.056565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=21 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:28.109610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:55:28.462585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:55:28.463012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:55:28.463494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:55:28.463905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:55:28.464349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:55:28.473230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:28.473695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:28.474137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:28.474871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:28.475329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:28.475762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:28.492575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:55:28.497863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:55:28.554851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:55:28.557016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='461101c0-ff1a-4f6b-9cd1-4376923d7e05',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:55:28.684339 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d91185cb-2e17-4e53-91b9-d6f3bbdf552a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642992 Aug 30 04:55:28.684998 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3314/6564] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:55:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:55:28.696329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3970369f-8f48-4dc9-ad3a-04b21058068d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:28.696961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3970369f-8f48-4dc9-ad3a-04b21058068d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:28.699485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=9 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:28.700324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=21 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:28.701150 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:55:28.701296 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 04:55:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 (ip 10.222.0.27) !!! Aug 30 04:55:28.758050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3970369f-8f48-4dc9-ad3a-04b21058068d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:28.765954 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3970369f-8f48-4dc9-ad3a-04b21058068d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1071 microversion: 2.1 time: 0.074178 Aug 30 04:55:28.766527 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3251/6565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:28 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1071 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:29.786949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:29.787574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:29.795052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:29.795543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:29.795983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:29.796692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:29.797148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:29.797814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:29.865558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:29.874977 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-501ac18f-9122-4b92-ab6b-0847ab5c3101 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1187 microversion: 2.1 time: 0.092284 Aug 30 04:55:29.875552 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3315/6566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:29 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:30.895827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:30.896753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:30.904823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:30.905655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:30.906660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:30.907591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:30.908458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:30.909317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:31.058065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:31.067475 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1e8cfe57-af01-4682-bd6a-e71aee7c22f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1229 microversion: 2.1 time: 0.175452 Aug 30 04:55:31.068269 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3252/6567] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:30 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1229 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:31.099878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b4e367c5-5bd2-4be6-82ef-ef9bf95654a4 req-7974d6ae-b3be-43c5-89c5-b2d91d925c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725753a3-643d-4948-a72e-7262e6b72a06", "tag": "696f4481-1109-4c86-8115-8d9e7f86cec3"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:31.112563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b4e367c5-5bd2-4be6-82ef-ef9bf95654a4 req-7974d6ae-b3be-43c5-89c5-b2d91d925c5d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:31.113694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b4e367c5-5bd2-4be6-82ef-ef9bf95654a4 req-7974d6ae-b3be-43c5-89c5-b2d91d925c5d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:31.114345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b4e367c5-5bd2-4be6-82ef-ef9bf95654a4 req-7974d6ae-b3be-43c5-89c5-b2d91d925c5d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:31.127524 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b4e367c5-5bd2-4be6-82ef-ef9bf95654a4 req-7974d6ae-b3be-43c5-89c5-b2d91d925c5d service nova] Creating event network-changed:696f4481-1109-4c86-8115-8d9e7f86cec3 for instance 725753a3-643d-4948-a72e-7262e6b72a06 on n-h1-854925-5 Aug 30 04:55:31.132841 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b4e367c5-5bd2-4be6-82ef-ef9bf95654a4 req-7974d6ae-b3be-43c5-89c5-b2d91d925c5d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036815 Aug 30 04:55:31.134257 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3316/6568] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:55:32.090059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:32.091663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:32.106741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:32.107271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:32.107726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:32.108502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:32.108963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:32.109430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:32.243581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:32.251324 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bba5db98-c682-4ac6-a7ca-9ba18393725d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1229 microversion: 2.1 time: 0.166938 Aug 30 04:55:32.251836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3253/6569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:32 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1229 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:33.274703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:33.275295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:33.281526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:33.282010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:33.282444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:33.283130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:33.283581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:33.284005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:33.428565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:33.436743 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-590684d9-f3c5-4147-b90f-14f8e91990a0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1229 microversion: 2.1 time: 0.168066 Aug 30 04:55:33.437340 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3317/6570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:33 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:34.457471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:34.458092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:34.466091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:34.466588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:34.467025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:34.467734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:34.468188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:34.468645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:34.604812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:34.613180 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-937122ac-a0ce-4d22-901e-e36f6865cdf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1229 microversion: 2.1 time: 0.159764 Aug 30 04:55:34.613804 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3254/6571] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:34 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:35.635009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:35.635558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:35.642078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:35.642556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:35.642993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:35.643678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:35.644125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:35.644549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:36.071333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:36.079032 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-90efe7cc-f286-463c-88a6-3a9e85d68d8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.448205 Aug 30 04:55:36.079601 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3318/6572] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:35 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:37.100220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:37.100840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:37.108611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:37.109108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:37.109563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:37.110255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:37.110715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:37.111145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:37.238443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:37.246177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9a3c35e-3a98-42bb-b25e-9f2d9f5d4b26 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.149992 Aug 30 04:55:37.246748 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3255/6573] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:37 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:38.266527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:38.267134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:38.273995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:38.274473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:38.274907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:38.275591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:38.276041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:38.276462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:38.405199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:38.412894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fcbb278f-264d-43ea-9bd9-04c3412b76a7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.150314 Aug 30 04:55:38.413483 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3319/6574] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:38 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:39.431854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:39.436738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:39.437427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:39.443763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:39.444249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:39.444855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:39.446353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:39.446813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:39.447245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:39.577486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:39.587116 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-393b3289-40ea-459b-9cac-8b44eb29dbd7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.157387 Aug 30 04:55:39.587865 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3256/6575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:39 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:55:40.607870 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:40.608508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:40.610521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:40.611209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:40.617929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:40.618417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:40.618859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:40.619559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:40.620017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:40.620450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:40.749776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:40.757754 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d69f9203-444b-43ad-8f79-9e9d8ae474e0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.154037 Aug 30 04:55:40.758335 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3320/6576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:40 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:41.780325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:41.781044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:41.787817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:41.788298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:41.788734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:41.789445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:41.789898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:41.790912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:41.916390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:41.924404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-413b0ee5-44ad-4959-b1d7-8bd388126d9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.148059 Aug 30 04:55:41.924992 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3257/6577] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:41 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:42.944997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:42.945731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:42.953863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:42.954346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:42.954782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:42.955463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:42.955913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:42.956337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:43.081946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:43.089771 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a0b069fc-d4da-411b-aefb-6d644bcf6158 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.148813 Aug 30 04:55:43.090345 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3321/6578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:42 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:44.110718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:44.111341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:44.119085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:44.119569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:44.120011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:44.120706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:44.121161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:44.121628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:44.257082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:44.265308 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dd0fec6-9b7a-46ce-8d22-6a91b9c6fd1c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.158713 Aug 30 04:55:44.265944 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3258/6579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:44 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:45.286164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:45.286729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:45.294263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:45.294744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:45.295181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:45.295863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:45.296316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:45.296746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:45.423925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:45.431802 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-13a7ac85-6906-4b1d-93a9-95ad3448f6c1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.149635 Aug 30 04:55:45.432379 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3322/6580] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:45 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:45.873470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-602c2bab-c769-4329-a307-95e08ed1d525 req-6b85fda7-826f-44cd-8955-d5fef8370e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725753a3-643d-4948-a72e-7262e6b72a06", "name": "network-vif-plugged", "status": "completed", "tag": "696f4481-1109-4c86-8115-8d9e7f86cec3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:45.883030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-602c2bab-c769-4329-a307-95e08ed1d525 req-6b85fda7-826f-44cd-8955-d5fef8370e57 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:45.884038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-602c2bab-c769-4329-a307-95e08ed1d525 req-6b85fda7-826f-44cd-8955-d5fef8370e57 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:45.884527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-602c2bab-c769-4329-a307-95e08ed1d525 req-6b85fda7-826f-44cd-8955-d5fef8370e57 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:45.895522 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-602c2bab-c769-4329-a307-95e08ed1d525 req-6b85fda7-826f-44cd-8955-d5fef8370e57 service nova] Creating event network-vif-plugged:696f4481-1109-4c86-8115-8d9e7f86cec3 for instance 725753a3-643d-4948-a72e-7262e6b72a06 on n-h1-854925-5 Aug 30 04:55:45.901106 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-602c2bab-c769-4329-a307-95e08ed1d525 req-6b85fda7-826f-44cd-8955-d5fef8370e57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096881 Aug 30 04:55:45.901747 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3259/6581] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:55:46.452190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:46.452902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:46.459993 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:46.460475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:46.460908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:46.461622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:46.462075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:46.462500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:46.594078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:46.601733 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b9aecbf-c8ef-4aeb-9d8e-a94ce5bf3a3d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1217 microversion: 2.1 time: 0.153378 Aug 30 04:55:46.602834 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3323/6582] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:46 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:47.624255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:47.624960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:47.631307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:47.631795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:47.632241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:47.632939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:47.633433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:47.633871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:47.765182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:47.773092 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73d5b311-4b93-4438-8ccc-c14deac0a481 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1404 microversion: 2.1 time: 0.153962 Aug 30 04:55:47.773717 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3260/6583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:47 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:47.794061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:47.794707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:47.801529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:47.802012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:47.802454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:47.803146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:47.803601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:47.804029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:47.939392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:47.947658 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8648c89c-1aa9-41d6-9d7e-54744848e714 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1404 microversion: 2.1 time: 0.158132 Aug 30 04:55:47.948228 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3324/6584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:47 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:47.968020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1589712295"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:47.970419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:47.976428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:47.976916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:47.977383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:47.978079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:47.978535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:47.978967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:48.068856 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.api [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Attempting to quiesce instance before volume snapshot. Aug 30 04:55:48.089504 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.api [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 30 04:55:48.159615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Creating snapshot from volume 461101c0-ff1a-4f6b-9cd1-4376923d7e05. {{(pid=122402) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Aug 30 04:55:48.986800 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-98e89add-a82b-4c90-970f-940529c75b61 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06/action" status: 202 len: 0 microversion: 2.1 time: 1.022736 Aug 30 04:55:48.987689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3261/6585] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 04:55:47 2022] POST /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06/action => generated 0 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 04:55:50.143406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1656821902", "imageRef": "4235bc68-f195-4f6c-8894-9ad8ca1c5307", "flavorRef": "452", "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:50.203455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:55:50.574766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:55:50.575198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:55:50.575677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:55:50.576139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:55:50.576556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:55:50.585548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:50.586030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:50.586474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:50.587208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:50.587662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:50.588091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:50.604827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:55:50.610487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:55:50.623286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:55:50.625936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='246b0862-0577-4b01-9b49-ce48cd37aee2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:55:50.701184 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-74d8f41c-855f-4654-8f83-c916c3b3b529 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561682 Aug 30 04:55:50.701869 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3325/6586] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:55:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:55:50.714707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-168f29eb-e19d-4d72-89e9-6d8aa9832326 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:50.715451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-168f29eb-e19d-4d72-89e9-6d8aa9832326 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:50.771832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-168f29eb-e19d-4d72-89e9-6d8aa9832326 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:50.779584 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-168f29eb-e19d-4d72-89e9-6d8aa9832326 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1230 microversion: 2.1 time: 0.070477 Aug 30 04:55:50.780295 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3262/6587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:50 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1230 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:51.801749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:51.803096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:51.809999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:51.810589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:51.811029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:51.811819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:51.812276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:51.812772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:51.877958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:51.886343 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-32166fa7-62b5-466a-be1e-e9a8a277e398 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1300 microversion: 2.1 time: 0.089768 Aug 30 04:55:51.886935 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3326/6588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:51 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:52.911146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:52.913108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:52.920978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:52.921525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:52.921979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:52.922698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:52.923166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:52.923607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:53.080572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:53.090839 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a7e0e908-367f-4600-8533-f8565ec51e5e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.183590 Aug 30 04:55:53.091433 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3263/6589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:52 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:53.157433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-520601ce-68d7-4753-baf0-74ed5d909f4c req-e9f86370-df5c-4e77-b47a-87d5f98a323c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c660c21d-9c6e-4321-98b2-947b989a9a4b", "tag": "d5b866a3-8442-484e-b9c1-e87b9df447f7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:55:53.169237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-520601ce-68d7-4753-baf0-74ed5d909f4c req-e9f86370-df5c-4e77-b47a-87d5f98a323c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:53.169762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-520601ce-68d7-4753-baf0-74ed5d909f4c req-e9f86370-df5c-4e77-b47a-87d5f98a323c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:53.170193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-520601ce-68d7-4753-baf0-74ed5d909f4c req-e9f86370-df5c-4e77-b47a-87d5f98a323c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:53.182426 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-520601ce-68d7-4753-baf0-74ed5d909f4c req-e9f86370-df5c-4e77-b47a-87d5f98a323c service nova] Creating event network-changed:d5b866a3-8442-484e-b9c1-e87b9df447f7 for instance c660c21d-9c6e-4321-98b2-947b989a9a4b on n-h2-854925-5 Aug 30 04:55:53.188613 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-520601ce-68d7-4753-baf0-74ed5d909f4c req-e9f86370-df5c-4e77-b47a-87d5f98a323c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034421 Aug 30 04:55:53.189554 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3327/6590] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:55:54.111607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:54.112322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:54.120250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:54.121033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:54.121524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:54.122260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:54.122734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:54.123365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:54.260873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:54.271265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb84b98c-79a6-4b1d-a568-b9bdb0418c5b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.163613 Aug 30 04:55:54.271972 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3264/6591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:54 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:55.298484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:55.299176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:55.310717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:55.311388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:55.312025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:55.312905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:55.313566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:55.314509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:55.467738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:55.478818 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2051e964-92ae-4291-849b-20116998b5a8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.187225 Aug 30 04:55:55.479640 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3328/6592] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:55 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:56.515182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:56.516710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:56.529685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:56.531055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:56.531754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:56.532687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:56.533984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:56.534844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:56.707958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:56.717267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32e09167-0cee-4aaa-a4f4-4a20bc12b723 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.211906 Aug 30 04:55:56.718153 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3265/6593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:56 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:57.741894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:57.742485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:57.752476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:57.753127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:57.753703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:57.754306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:57.754751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:57.755251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:57.959274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:57.967086 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-534fdc01-d6c6-48c3-86e3-102a28077029 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.230688 Aug 30 04:55:57.967938 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3329/6594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:57 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:55:58.990673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:55:58.991411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:55:58.994478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=35 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.001169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:59.001169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:59.001656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:59.002846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:55:59.002846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:55:59.003248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:55:59.005822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:55:59.155776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:55:59.163812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fca92d3f-bcc3-470a-9a14-d21854ef44e7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.177136 Aug 30 04:55:59.164765 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3266/6595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:55:58 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:00.184670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:00.185286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:00.188144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:00.194566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:00.195055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:00.196108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:00.196801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:00.197255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:00.197769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:00.200974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=81 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:00.340307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:00.348090 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1d89edf-a45c-4c49-bec9-f5a1f7e5fca2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.167990 Aug 30 04:56:00.348695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3330/6596] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:00 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:01.369466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:01.370125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:01.372895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:01.380458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:01.381391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:01.382255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:01.384045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:01.384919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:01.385757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:01.527802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:01.535653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3693b49c-8272-4e23-aafe-0eee6783cb80 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.170048 Aug 30 04:56:01.536438 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3267/6597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:01 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:02.555965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:02.556514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:02.558529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:02.559204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:02.566115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:02.566601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:02.567033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:02.567736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:02.568189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:02.568631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:02.706510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:02.714823 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b3478cad-974c-4bdf-8b8e-221ae687f74b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.162905 Aug 30 04:56:02.715406 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3331/6598] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:02 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:03.736285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:03.736842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:03.744250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:03.744762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:03.745216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:03.745968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:03.746440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:03.746885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:03.886187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:03.894729 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-35544b92-3aa5-4125-8563-65412bba536f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.162459 Aug 30 04:56:03.895402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3268/6599] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:03 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:04.917276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:04.917918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:04.925452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:04.925942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:04.926383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:04.927093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:04.927554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:04.928008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:05.075750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:05.083923 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-24b88dec-78ef-42f6-bd29-fbfde1e566d7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.171096 Aug 30 04:56:05.084521 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3332/6600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:04 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:06.105485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:06.106123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:06.113053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:06.113698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:06.114156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:06.114869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:06.115344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:06.115791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:06.254481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:06.262338 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3bc0758a-bfed-426b-86f3-4dd9fbd3fedd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1342 microversion: 2.1 time: 0.161148 Aug 30 04:56:06.262929 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3269/6601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:06 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1342 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:07.284200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:07.284782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:07.291379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:07.291869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:07.292314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:07.293012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:07.293501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:07.293937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:07.420955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:07.429086 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ceb9377b-9b8b-4b28-9773-e045bbe84848 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.149651 Aug 30 04:56:07.430300 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3333/6602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:07 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:08.451230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:08.451863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:08.458846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:08.459352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:08.459811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:08.460519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:08.460995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:08.461477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:08.596710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:08.604799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef98084b-f6b4-4d66-bc42-fb170c376c93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.157552 Aug 30 04:56:08.605362 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3270/6603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:08 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:09.627256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:09.627890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:09.635675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:09.636190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:09.636630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:09.637356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:09.637812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:09.638241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:09.774492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:09.782758 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4c12b03d-7b39-4958-95e4-5599ac74ea97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.159566 Aug 30 04:56:09.783544 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3334/6604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:09 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:56:10.803955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:10.804601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:10.811674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:10.812191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:10.812728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:10.813470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:10.813940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:10.814380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:10.959053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:10.968821 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e64f8fa1-a89c-4454-9808-c8e60de7aba7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.168701 Aug 30 04:56:10.969500 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3271/6605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:10 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:11.992749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:11.993663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:12.001256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:12.001862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:12.002352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:12.003116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:12.003626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:12.004132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:12.140401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:12.149508 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4a8f2361-68f9-4a19-9e85-60e31265a6b0 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.161702 Aug 30 04:56:12.150183 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3335/6606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:11 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:13.171764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:13.172331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:13.179963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:13.180467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:13.180924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:13.181658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:13.182129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:13.182573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:13.319078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:13.326784 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d63aabba-90e5-490b-a2f2-36b9326aeabc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.159009 Aug 30 04:56:13.327369 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3272/6607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:13 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:14.347743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:14.348356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:14.356250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:14.356739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:14.357182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:14.357899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:14.358352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:14.358780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:14.491912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:14.499581 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad55eb5d-1567-4c6d-9de3-82bcd0827b4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.155712 Aug 30 04:56:14.500153 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3336/6608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:14 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:15.525282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:15.526178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:15.533695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:15.534193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:15.534688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:15.535439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:15.535953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:15.536465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:15.675990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:15.683965 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a4140599-61a5-495c-9b0a-740551464edb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.166296 Aug 30 04:56:15.684546 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3273/6609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:15 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:15.964169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-134d9aec-efa6-4ecb-ae6d-af3820480f5c req-33e089c7-1e33-4ea1-b411-f0c9bd310e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c660c21d-9c6e-4321-98b2-947b989a9a4b", "name": "network-vif-plugged", "status": "completed", "tag": "d5b866a3-8442-484e-b9c1-e87b9df447f7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:56:15.975886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-134d9aec-efa6-4ecb-ae6d-af3820480f5c req-33e089c7-1e33-4ea1-b411-f0c9bd310e91 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:15.976328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-134d9aec-efa6-4ecb-ae6d-af3820480f5c req-33e089c7-1e33-4ea1-b411-f0c9bd310e91 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:15.976897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-134d9aec-efa6-4ecb-ae6d-af3820480f5c req-33e089c7-1e33-4ea1-b411-f0c9bd310e91 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:15.990780 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-134d9aec-efa6-4ecb-ae6d-af3820480f5c req-33e089c7-1e33-4ea1-b411-f0c9bd310e91 service nova] Creating event network-vif-plugged:d5b866a3-8442-484e-b9c1-e87b9df447f7 for instance c660c21d-9c6e-4321-98b2-947b989a9a4b on n-h2-854925-5 Aug 30 04:56:15.996772 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-134d9aec-efa6-4ecb-ae6d-af3820480f5c req-33e089c7-1e33-4ea1-b411-f0c9bd310e91 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037126 Aug 30 04:56:15.997381 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3337/6610] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:56:16.707100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:16.708065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:16.717831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:16.718426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:16.718955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:16.719784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:16.720255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:16.720700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:16.867783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:16.877855 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3e0b9725-b871-4a03-b82e-3780602a3e00 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1376 microversion: 2.1 time: 0.176626 Aug 30 04:56:16.878516 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3274/6611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:16 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:17.911799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:17.914147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:17.921946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:17.922437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:17.922880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:17.923574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:17.924031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:17.924459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.079260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:18.088041 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10cb35c8-0aa0-4052-91aa-cc82d92f57d8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1562 microversion: 2.1 time: 0.185016 Aug 30 04:56:18.088645 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3338/6612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:17 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1562 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:56:18.109809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:18.110581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:18.118272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:18.118943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:18.119528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.120279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:18.120760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:18.121314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.269179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:18.278364 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa487a4e-ca7c-40c1-a519-4c6851619ddb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1562 microversion: 2.1 time: 0.173082 Aug 30 04:56:18.279158 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3275/6613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:18 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1562 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:18.364201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:18.364741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:18.370957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:18.371441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:18.371881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.372600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:18.373136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:18.373591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.400980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:56:18.494056 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dccdf20a-9724-463c-bfaf-8985acdc55cc tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 204 len: 0 microversion: 2.1 time: 0.133571 Aug 30 04:56:18.494562 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3339/6614] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:56:18 2022] DELETE /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:18.508569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:18.509632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:18.517044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:18.517575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:18.518204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.519091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:18.519571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:18.520213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:18.663174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:18.672362 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e3c6e8f9-7d91-4187-9a6e-2426bb2e83db tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1568 microversion: 2.1 time: 0.171681 Aug 30 04:56:18.673091 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3276/6615] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:18 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:19.696070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:19.696692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:19.703830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:19.704320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:19.704762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:19.705502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:19.705959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:19.706391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:19.841625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:19.849532 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2e161d9d-7ec3-48a7-bd1a-cf0deea1ccf4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1568 microversion: 2.1 time: 0.158357 Aug 30 04:56:19.850103 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3340/6616] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:19 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:20.466624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a9b79697-ce5e-4b81-a4a8-ea63500d6e66 req-2506cf14-0157-479c-bb9d-51fcb9fb95cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c660c21d-9c6e-4321-98b2-947b989a9a4b", "name": "network-vif-deleted", "tag": "d5b866a3-8442-484e-b9c1-e87b9df447f7"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:56:20.479833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a9b79697-ce5e-4b81-a4a8-ea63500d6e66 req-2506cf14-0157-479c-bb9d-51fcb9fb95cb service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:20.480778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a9b79697-ce5e-4b81-a4a8-ea63500d6e66 req-2506cf14-0157-479c-bb9d-51fcb9fb95cb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:20.481518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a9b79697-ce5e-4b81-a4a8-ea63500d6e66 req-2506cf14-0157-479c-bb9d-51fcb9fb95cb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:20.495002 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a9b79697-ce5e-4b81-a4a8-ea63500d6e66 req-2506cf14-0157-479c-bb9d-51fcb9fb95cb service nova] Creating event network-vif-deleted:d5b866a3-8442-484e-b9c1-e87b9df447f7 for instance c660c21d-9c6e-4321-98b2-947b989a9a4b on n-h2-854925-5 Aug 30 04:56:20.500825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a9b79697-ce5e-4b81-a4a8-ea63500d6e66 req-2506cf14-0157-479c-bb9d-51fcb9fb95cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039060 Aug 30 04:56:20.502039 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3277/6617] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:56:20.871333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:20.871992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:20.879541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:20.880032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:20.880470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:20.881165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:20.881655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:20.882081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:20.959402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:20.967894 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64f3c3d8-f407-4cbb-98e0-0b3107003177 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1361 microversion: 2.1 time: 0.100459 Aug 30 04:56:20.968557 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3341/6618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:20 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1361 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:21.991427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:21.992143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:21.998416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:21.999007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:21.999560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:22.000313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:22.000774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:22.001205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:22.071371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:22.079979 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8877e1a-63fb-40cb-8db0-0e632ba05c4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1361 microversion: 2.1 time: 0.093814 Aug 30 04:56:22.080610 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3278/6619] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:21 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:23.102089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:23.102943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:23.110244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:23.110747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:23.111170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:23.111860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:23.112311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:23.112734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:23.179640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:23.187432 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28eac221-4733-4b49-93e5-cf7d5e251a13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1361 microversion: 2.1 time: 0.089324 Aug 30 04:56:23.188000 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3342/6620] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:23 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:24.208234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:24.208862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:24.215738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:24.216230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:24.216684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:24.217420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:24.217890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:24.218335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:24.281832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:24.290264 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa0f9edd-b3b0-4ed0-af5e-41478619b500 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 200 len: 1361 microversion: 2.1 time: 0.086017 Aug 30 04:56:24.290835 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3279/6621] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:24 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 1361 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:25.311232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:25.312010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:25.319292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:25.320001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:25.320445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:25.321151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:25.321650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:25.322079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:25.336526 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b HTTP/1.1 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c660c21d-9c6e-4321-98b2-947b989a9a4b'} Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:25.338292 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7398d0d8-12cb-48ea-8c8b-afa6d0a47422 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 404 len: 111 microversion: 2.1 time: 0.032390 Aug 30 04:56:25.344308 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3343/6622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:25 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:56:29.632531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:29.633068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:29.635546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=28 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.640900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:29.641432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:29.641881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:29.642582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:29.643050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:29.643492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:29.646218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=80 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:29.671848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:56:29.747620 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e5c3ea13-0045-498c-a4f4-606cfcd1d0fb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 204 len: 0 microversion: 2.1 time: 0.118484 Aug 30 04:56:29.748476 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3280/6623] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:56:29 2022] DELETE /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:56:29.758233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:29.758883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:29.766309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:29.766797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:29.767235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:29.767926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:29.768381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:29.768807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:29.901047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:29.909195 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-44af0214-1ccc-47b6-8dda-7a920c7562d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1410 microversion: 2.1 time: 0.156050 Aug 30 04:56:29.910254 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3344/6624] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:29 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1410 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:30.932352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:30.933073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:30.939998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:30.940488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:30.940934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:30.941670 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:30.942134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:30.942572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:31.070960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:31.078782 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9e2a172-b2fc-406b-8f34-6999d3f19738 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1410 microversion: 2.1 time: 0.151764 Aug 30 04:56:31.079337 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3281/6625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:30 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:32.100633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:32.101917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:32.104703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.116461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:32.117232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:32.117842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:32.118819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:32.119167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:32.119694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:32.123647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:32.270707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:32.279132 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b352be66-e8e6-4ec0-9c8e-e45722430a09 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1410 microversion: 2.1 time: 0.183364 Aug 30 04:56:32.279714 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3345/6626] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:32 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1410 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:32.438325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f7f6faab-1adf-422e-a7ec-4d7bfbc615e4 req-a1c89608-c7c5-4e5f-875e-b199881106e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725753a3-643d-4948-a72e-7262e6b72a06", "name": "network-vif-deleted", "tag": "696f4481-1109-4c86-8115-8d9e7f86cec3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:56:32.449996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f7f6faab-1adf-422e-a7ec-4d7bfbc615e4 req-a1c89608-c7c5-4e5f-875e-b199881106e2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:32.450492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f7f6faab-1adf-422e-a7ec-4d7bfbc615e4 req-a1c89608-c7c5-4e5f-875e-b199881106e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:32.450940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f7f6faab-1adf-422e-a7ec-4d7bfbc615e4 req-a1c89608-c7c5-4e5f-875e-b199881106e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:32.463063 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f7f6faab-1adf-422e-a7ec-4d7bfbc615e4 req-a1c89608-c7c5-4e5f-875e-b199881106e2 service nova] Creating event network-vif-deleted:696f4481-1109-4c86-8115-8d9e7f86cec3 for instance 725753a3-643d-4948-a72e-7262e6b72a06 on n-h1-854925-5 Aug 30 04:56:32.469679 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f7f6faab-1adf-422e-a7ec-4d7bfbc615e4 req-a1c89608-c7c5-4e5f-875e-b199881106e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034589 Aug 30 04:56:32.470360 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3282/6627] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:56:33.300490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:33.301099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:33.311116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:33.311617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:33.312062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:33.312787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:33.313278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:33.313816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:33.380419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:33.389293 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ae59d7f-bb8f-4b9f-87d6-f396bac304de tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1202 microversion: 2.1 time: 0.092458 Aug 30 04:56:33.389612 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3346/6628] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:33 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:34.411583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:34.413071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:34.420522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:34.421016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:34.421510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:34.422216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:34.422686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:34.423250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:34.486184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:34.494680 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3b828c45-b802-466a-aa73-feae1f436f7b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1202 microversion: 2.1 time: 0.087533 Aug 30 04:56:34.495257 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3283/6629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:34 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:35.515395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:35.516006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:35.523721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:35.524209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:35.524643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:35.525365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:35.525824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:35.526246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:35.592385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:35.600400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6849e813-dc3d-4122-b94f-1b80e0cf34af tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1202 microversion: 2.1 time: 0.088931 Aug 30 04:56:35.600971 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3347/6630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:35 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1202 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:36.620981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:36.622498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:36.632289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:36.633552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:36.634535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:36.635680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:36.636775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:36.637619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:36.709676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:36.718603 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c243da16-d605-4b57-b2ac-2686fb2fe03e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 200 len: 1202 microversion: 2.1 time: 0.101721 Aug 30 04:56:36.719179 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3284/6631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:36 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 1202 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:37.741586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:37.742177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:37.749246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:37.749767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:37.750208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:37.750904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:37.751358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:37.751790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:37.765367 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 HTTP/1.1 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '725753a3-643d-4948-a72e-7262e6b72a06'} Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:37.766913 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a739431-cd64-43b6-bff2-a21e7ebae7e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 404 len: 111 microversion: 2.1 time: 0.031653 Aug 30 04:56:37.771753 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3348/6632] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:37 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:56:39.921553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:39.922101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:39.929148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:39.929683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:39.930213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:39.930934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:39.931401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:39.931841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:39.949638 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b HTTP/1.1 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c660c21d-9c6e-4321-98b2-947b989a9a4b'} Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:56:39.951121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-48dfea69-7117-4187-b817-4eb09c50d8a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 404 len: 111 microversion: 2.1 time: 0.035093 Aug 30 04:56:39.956244 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3285/6633] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:56:39 2022] DELETE /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:56:39.962012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:39.962903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c660c21d-9c6e-4321-98b2-947b989a9a4b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:39.970422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:39.970924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:39.971376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:39.972093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:39.972769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:39.973208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:39.988742 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b HTTP/1.1 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c660c21d-9c6e-4321-98b2-947b989a9a4b'} Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:39.990402 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance c660c21d-9c6e-4321-98b2-947b989a9a4b could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8d3fdcf0-1552-4ec3-bdf3-6f16043a4a85 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b" status: 404 len: 111 microversion: 2.1 time: 0.034450 Aug 30 04:56:39.995429 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3349/6634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:39 2022] GET /compute/v2.1/servers/c660c21d-9c6e-4321-98b2-947b989a9a4b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:56:40.451196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:40.451806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:40.457843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:40.458371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:40.458833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:40.459684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:40.460160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:40.460608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:40.474119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 HTTP/1.1 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '725753a3-643d-4948-a72e-7262e6b72a06'} Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:56:40.475675 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3f392a6-3753-46e7-a857-e7d3d80994d3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 404 len: 111 microversion: 2.1 time: 0.029806 Aug 30 04:56:40.481095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3286/6635] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:56:40 2022] DELETE /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:56:40.486258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:40.486989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 725753a3-643d-4948-a72e-7262e6b72a06] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:40.493596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:40.494082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:40.494515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:40.495204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:40.495657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:40.496084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:40.512261 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 HTTP/1.1 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '725753a3-643d-4948-a72e-7262e6b72a06'} Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:56:40.513937 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 725753a3-643d-4948-a72e-7262e6b72a06 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38c3f493-031f-4e4f-9ec9-19cda3cfec21 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06" status: 404 len: 111 microversion: 2.1 time: 0.033078 Aug 30 04:56:40.519229 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3350/6636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:40 2022] GET /compute/v2.1/servers/725753a3-643d-4948-a72e-7262e6b72a06 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:56:40.586402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-33d9b4ca-0102-4195-a905-f725e3f89694 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: .version_select at 0x7fe968e4af70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1782850955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMyb81Fr1CbsJ0lO7zBXfjZaa9nQPN0n9dJ742PJV78bfISDXqJ9/aIRhg20+Zy9VTUXInmx0YGCpdm8ggfpGReZaGFaOuLG0GXqGX8BWX7rqBMn8VywlUf2QVCshPM0PQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:56:40.603220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-33d9b4ca-0102-4195-a905-f725e3f89694 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:56:40.608323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-33d9b4ca-0102-4195-a905-f725e3f89694 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:56:40.635188 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-33d9b4ca-0102-4195-a905-f725e3f89694 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.052675 Aug 30 04:56:40.635790 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3287/6637] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 04:56:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:56:56.805003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1256627098", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782850955", "security_groups": [{"name": "tempest-secgroup-smoke-105167585"}], "block_device_mapping_v2": [{"uuid": "a765df42-5407-4b9b-a3fb-64554bab14d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:56:56.816054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=11 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.816695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=23 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:56.925582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:56:57.288316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:56:57.288763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:56:57.289237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:56:57.289671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:56:57.290083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:56:57.298724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:57.299204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:57.299639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:57.300393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:57.300846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:57.301272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:57.318224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:56:57.323406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:56:57.381543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:56:57.383682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a765df42-5407-4b9b-a3fb-64554bab14d8',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:56:57.511137 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1935f401-8a24-4ca1-b505-dc92fdeac9ac tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.709942 Aug 30 04:56:57.511788 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3351/6638] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:56:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:56:57.522420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c7ce2d6e-8a17-43cf-93b9-bdfcff919b1d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:57.523050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c7ce2d6e-8a17-43cf-93b9-bdfcff919b1d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:57.525880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.526704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.527179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:56:57.592484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c7ce2d6e-8a17-43cf-93b9-bdfcff919b1d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:57.600118 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c7ce2d6e-8a17-43cf-93b9-bdfcff919b1d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1095 microversion: 2.1 time: 0.081548 Aug 30 04:56:57.600714 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3288/6639] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:57 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:58.623242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:58.624031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:58.631772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:58.632271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:58.632714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:58.633450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:58.633911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:58.634344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:58.700846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:58.714456 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-70a154f2-1a05-4290-b5a5-f38a526c5b17 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1193 microversion: 2.1 time: 0.096322 Aug 30 04:56:58.718476 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3352/6640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:58 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:56:59.736227 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:56:59.736932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:56:59.743775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:59.744517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:59.744970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:59.745774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:56:59.746417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:56:59.746858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:56:59.911400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:56:59.931261 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4cf3d286-f033-40c0-b617-fe12a20cfe3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1278 microversion: 2.1 time: 0.198722 Aug 30 04:56:59.932236 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3289/6641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:56:59 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:00.263123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c2297a28-91bc-486e-a69a-4b8f95ce9453 req-3f5af957-bbb6-4f46-9133-aa53dd101a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78a0eb8-7a06-40d3-a45a-0ce1eed86002", "tag": "b42af9a9-58c6-416a-bdd5-7d5fe446e588"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:57:00.275008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c2297a28-91bc-486e-a69a-4b8f95ce9453 req-3f5af957-bbb6-4f46-9133-aa53dd101a14 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:00.275937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c2297a28-91bc-486e-a69a-4b8f95ce9453 req-3f5af957-bbb6-4f46-9133-aa53dd101a14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:00.276355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c2297a28-91bc-486e-a69a-4b8f95ce9453 req-3f5af957-bbb6-4f46-9133-aa53dd101a14 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:00.289700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c2297a28-91bc-486e-a69a-4b8f95ce9453 req-3f5af957-bbb6-4f46-9133-aa53dd101a14 service nova] Creating event network-changed:b42af9a9-58c6-416a-bdd5-7d5fe446e588 for instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 on n-h1-854925-5 Aug 30 04:57:00.295322 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c2297a28-91bc-486e-a69a-4b8f95ce9453 req-3f5af957-bbb6-4f46-9133-aa53dd101a14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036124 Aug 30 04:57:00.296477 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3353/6642] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 04:57:00.953606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:00.954229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:00.962302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:00.962972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:00.963457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:00.964175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:00.964697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:00.965140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:01.133456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:01.142178 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2cf99556-997e-4494-b56d-ec69200f8458 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1278 microversion: 2.1 time: 0.192634 Aug 30 04:57:01.156902 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3290/6643] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:00 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:02.166251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:02.167011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:02.173405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:02.173892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:02.174509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:02.175083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:02.175546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:02.175976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:02.307921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:02.315726 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-55c7995b-88d5-496e-9f59-febfe1ea0523 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1278 microversion: 2.1 time: 0.155345 Aug 30 04:57:02.316333 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3354/6644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:02 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:03.336414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:03.337048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:03.344328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:03.344834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:03.345291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:03.346031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:03.346504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:03.346948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:03.492369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:03.500819 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd088f94-7aa0-465c-b641-0974ba420aaf tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1278 microversion: 2.1 time: 0.168306 Aug 30 04:57:03.501440 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3291/6645] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:03 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:04.522372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:04.522990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:04.529900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:04.530385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:04.530824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:04.531510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:04.531965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:04.532393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:04.664202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:04.673748 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0d815e74-b9dc-48d8-af50-afe64da593ff tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.155979 Aug 30 04:57:04.674340 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3355/6646] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:04 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:05.696050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:05.696585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:05.703601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:05.704096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:05.704544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:05.705241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:05.705732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:05.706172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:05.833785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:05.842368 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d0ef729-9b5f-4010-84a8-979eb228cad8 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.150289 Aug 30 04:57:05.842943 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3292/6647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:05 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:06.863944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:06.864548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:06.871389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:06.871876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:06.872317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:06.873009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:06.873494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:06.873926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:07.010118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:07.017850 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f99aa265-224a-4157-b117-75f2a1b2b39b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.157988 Aug 30 04:57:07.018421 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3356/6648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:06 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:07.639207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:07.639826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:07.642595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.648973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:07.649503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:07.649960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:07.650675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:07.651142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:07.651585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:07.679790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:57:07.755672 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25a501a2-28d1-40b5-aef5-d9706614f50d tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 204 len: 0 microversion: 2.1 time: 0.120080 Aug 30 04:57:07.756273 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3293/6649] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:57:07 2022] DELETE /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:57:07.766889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:07.767510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:07.769691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.770493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:57:07.777146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:07.777670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:07.778112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:07.778807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:07.779289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:07.779717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:07.915333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:07.923155 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da980a0b-3a5c-4887-9935-831916b20baf tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1732 microversion: 2.1 time: 0.160628 Aug 30 04:57:07.923725 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3357/6650] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:07 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:08.039822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:08.040542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:08.046500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:08.046998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:08.047452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:08.048152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:08.048621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:08.049065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:08.185659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:08.193472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0cc8d952-671c-4305-8a70-948250c8bc11 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.157932 Aug 30 04:57:08.194657 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3294/6651] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:08 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:08.943829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:08.944440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:08.951480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:08.951967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:08.952408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:08.953096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:08.953600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:08.954016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:09.215281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:09.216155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:09.219203 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 04:57:09.219366 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 04:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 (ip 10.222.0.27) !!! Aug 30 04:57:09.227093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:09.227602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:09.228057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:09.229463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:09.229939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:09.230384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:09.411044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:09.419677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aa895611-2c8e-422e-8866-b2915ceddf8f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1732 microversion: 2.1 time: 0.479703 Aug 30 04:57:09.420282 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3358/6652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:08 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1732 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:09.420724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:09.428802 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e31484ab-68eb-41fc-9498-7f435ee364f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.217471 Aug 30 04:57:09.429644 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3295/6653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:09 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:09.959396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bd46fb81-9762-40ed-b6d1-74f28f109298 req-3f2f2b3b-0c43-410c-a868-2405a15539d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44726e74-53d8-481f-9500-847541eaeec9", "name": "network-vif-deleted", "tag": "91a3f94a-1854-4040-b7de-7bf73c1a87a0"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:57:09.972624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bd46fb81-9762-40ed-b6d1-74f28f109298 req-3f2f2b3b-0c43-410c-a868-2405a15539d8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:09.973231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bd46fb81-9762-40ed-b6d1-74f28f109298 req-3f2f2b3b-0c43-410c-a868-2405a15539d8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:09.973695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bd46fb81-9762-40ed-b6d1-74f28f109298 req-3f2f2b3b-0c43-410c-a868-2405a15539d8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:09.988400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bd46fb81-9762-40ed-b6d1-74f28f109298 req-3f2f2b3b-0c43-410c-a868-2405a15539d8 service nova] Creating event network-vif-deleted:91a3f94a-1854-4040-b7de-7bf73c1a87a0 for instance 44726e74-53d8-481f-9500-847541eaeec9 on n-h2-854925-5 Aug 30 04:57:09.995268 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bd46fb81-9762-40ed-b6d1-74f28f109298 req-3f2f2b3b-0c43-410c-a868-2405a15539d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039678 Aug 30 04:57:09.996505 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3359/6654] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:57:10.441577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:10.443178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:10.452126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:10.453255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:10.454036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:10.454922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:10.455655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:10.456294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:10.456685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:10.458674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:10.468964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:10.470159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:10.470716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:10.471725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:10.472648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:10.473223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:10.505063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:10.507494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:10.508533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:10.509283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lazy-loading 'fault' on Instance uuid 44726e74-53d8-481f-9500-847541eaeec9 {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 04:57:10.564927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e0f819766f54d1cb7cf06d06fabeb0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4710066b8924d09a9230ccc47b9bcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:10.572845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2a06354d-4b37-40e0-bf5f-2aa0ed045501 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 200 len: 1388 microversion: 2.1 time: 0.135215 Aug 30 04:57:10.573584 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3296/6655] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:10 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 1388 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:10.657708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:10.665777 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfd33ea3-970c-4244-971d-08185f684c3a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.220168 Aug 30 04:57:10.666330 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3360/6656] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:10 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:57:11.594523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:11.595149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:11.602777 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:11.603269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:11.603718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:11.604414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:11.604878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:11.605315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:11.619153 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] HTTP exception thrown: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Request method failure captured: Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 HTTP/1.1 Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZd3WDyy1wVNolwnXfGwBoGj2WyhXzSFGoraPjdNhwPt4kgdqZ5L554Qd-sxMlMzwvdIhQ34mMMK2jawTXFRX-0-lq30n2l2QA1oENhuG4rreHdmcomrnbzgaKh9NE4Zw21hf5boDlBMfSFM-tXQPExUvXoZ0WMVDzTq44bufkOm5sM Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: a4710066b8924d09a9230ccc47b9bcfe Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestServerBasicOps-571353853 Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a4710066b8924d09a9230ccc47b9bcfe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a4710066b8924d09a9230ccc47b9bcfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4710066b8924d09a9230ccc47b9bcfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4710066b8924d09a9230ccc47b9bcfe"}]}] Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestServerBasicOps-571353853 Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: a4710066b8924d09a9230ccc47b9bcfe Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestServerBasicOps-571353853 Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestServerBasicOps-571353853-project Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 3e0f819766f54d1cb7cf06d06fabeb0d Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestServerBasicOps-571353853-project Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '44726e74-53d8-481f-9500-847541eaeec9'} Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:11.620801 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Returning 404 to user: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f8b19e4d-145e-4241-964e-c187e4331d52 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 404 len: 111 microversion: 2.1 time: 0.031652 Aug 30 04:57:11.626333 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3297/6657] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:11 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:57:11.691714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:11.692361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:11.699329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:11.699821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:11.700264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:11.700964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:11.701450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:11.701890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:11.923579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:11.931336 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6cdfba83-4adf-426d-ba37-12960e699e4a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.243583 Aug 30 04:57:11.931913 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3361/6658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:11 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:12.161255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:12.161780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:12.167801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:12.168290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:12.168739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:12.169459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:12.169926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:12.170363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:12.183610 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] HTTP exception thrown: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Request method failure captured: Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 HTTP/1.1 Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZd3WDyy1wVNolwnXfGwBoGj2WyhXzSFGoraPjdNhwPt4kgdqZ5L554Qd-sxMlMzwvdIhQ34mMMK2jawTXFRX-0-lq30n2l2QA1oENhuG4rreHdmcomrnbzgaKh9NE4Zw21hf5boDlBMfSFM-tXQPExUvXoZ0WMVDzTq44bufkOm5sM Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: a4710066b8924d09a9230ccc47b9bcfe Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestServerBasicOps-571353853 Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a4710066b8924d09a9230ccc47b9bcfe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a4710066b8924d09a9230ccc47b9bcfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4710066b8924d09a9230ccc47b9bcfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4710066b8924d09a9230ccc47b9bcfe"}]}] Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestServerBasicOps-571353853 Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: a4710066b8924d09a9230ccc47b9bcfe Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestServerBasicOps-571353853 Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestServerBasicOps-571353853-project Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 3e0f819766f54d1cb7cf06d06fabeb0d Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestServerBasicOps-571353853-project Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '44726e74-53d8-481f-9500-847541eaeec9'} Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:57:12.185140 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Returning 404 to user: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-54015dae-34c8-4c8b-90ef-dc5097d28025 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "DELETE /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 404 len: 111 microversion: 2.1 time: 0.029247 Aug 30 04:57:12.189938 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3298/6659] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:57:12 2022] DELETE /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:57:12.195655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:12.196280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] [instance: 44726e74-53d8-481f-9500-847541eaeec9] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:12.202385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:12.202883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:12.203328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:12.204036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:12.204494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:12.204964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:12.219267 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] HTTP exception thrown: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Request method failure captured: Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 HTTP/1.1 Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZd3WDyy1wVNolwnXfGwBoGj2WyhXzSFGoraPjdNhwPt4kgdqZ5L554Qd-sxMlMzwvdIhQ34mMMK2jawTXFRX-0-lq30n2l2QA1oENhuG4rreHdmcomrnbzgaKh9NE4Zw21hf5boDlBMfSFM-tXQPExUvXoZ0WMVDzTq44bufkOm5sM Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a4710066b8924d09a9230ccc47b9bcfe Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestServerBasicOps-571353853 Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a4710066b8924d09a9230ccc47b9bcfe", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a4710066b8924d09a9230ccc47b9bcfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4710066b8924d09a9230ccc47b9bcfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a4710066b8924d09a9230ccc47b9bcfe"}]}] Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestServerBasicOps-571353853 Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a4710066b8924d09a9230ccc47b9bcfe Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestServerBasicOps-571353853 Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestServerBasicOps-571353853-project Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 3e0f819766f54d1cb7cf06d06fabeb0d Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestServerBasicOps-571353853-project Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '44726e74-53d8-481f-9500-847541eaeec9'} Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:57:12.220991 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Returning 404 to user: Instance 44726e74-53d8-481f-9500-847541eaeec9 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e5af2698-2a09-4dfe-9808-ee7a7cf535a5 tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9" status: 404 len: 111 microversion: 2.1 time: 0.031232 Aug 30 04:57:12.226696 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3362/6660] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:12 2022] GET /compute/v2.1/servers/44726e74-53d8-481f-9500-847541eaeec9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 04:57:12.382731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08d66b7c-7d31-49e2-be12-2d29fab5069f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] Calling method '.version_select at 0x7fe968dba8b0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:12.414210 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08d66b7c-7d31-49e2-be12-2d29fab5069f tempest-TestServerBasicOps-571353853 tempest-TestServerBasicOps-571353853-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2031275076" status: 202 len: 0 microversion: 2.1 time: 0.036040 Aug 30 04:57:12.423993 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3299/6661] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 30 04:57:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2031275076 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 04:57:12.951951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:12.953440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:12.960306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:12.960796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:12.961263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:12.962271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:12.963061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:12.963500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:13.096938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:13.106148 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78cf64ed-4537-4e7e-b0ce-bc16a0b1c25f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.157973 Aug 30 04:57:13.106816 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3363/6662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:12 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:14.126603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:14.127351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:14.135874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:14.136376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:14.136835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:14.137574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:14.138048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:14.138495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:14.285160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:14.294942 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-90870ea6-70b4-4186-b943-dd473c31dc81 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.172040 Aug 30 04:57:14.296359 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3300/6663] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:14 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:14.385255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b3d20c30-4613-4db6-a1df-877fb86a422e req-9c561b73-1ab4-4378-8315-942caeb78bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78a0eb8-7a06-40d3-a45a-0ce1eed86002", "name": "network-vif-plugged", "status": "completed", "tag": "b42af9a9-58c6-416a-bdd5-7d5fe446e588"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:57:14.397444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3d20c30-4613-4db6-a1df-877fb86a422e req-9c561b73-1ab4-4378-8315-942caeb78bed service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:14.398301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3d20c30-4613-4db6-a1df-877fb86a422e req-9c561b73-1ab4-4378-8315-942caeb78bed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:14.398957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b3d20c30-4613-4db6-a1df-877fb86a422e req-9c561b73-1ab4-4378-8315-942caeb78bed service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:14.416709 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b3d20c30-4613-4db6-a1df-877fb86a422e req-9c561b73-1ab4-4378-8315-942caeb78bed service nova] Creating event network-vif-plugged:b42af9a9-58c6-416a-bdd5-7d5fe446e588 for instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 on n-h1-854925-5 Aug 30 04:57:14.422988 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b3d20c30-4613-4db6-a1df-877fb86a422e req-9c561b73-1ab4-4378-8315-942caeb78bed service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047422 Aug 30 04:57:14.424628 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3364/6664] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:57:15.316470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:15.317091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:15.323745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:15.324245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:15.324696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:15.325424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:15.325893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:15.326335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:15.485522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:15.494812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-42ddf3b7-3c13-4534-91bb-12175b85403f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1266 microversion: 2.1 time: 0.182147 Aug 30 04:57:15.495799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3301/6665] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:15 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:16.517247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:16.518019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:16.524356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:16.524849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:16.525298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:16.526023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:16.526485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:16.526918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:16.766677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:16.774557 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4f51892-f87e-4442-a492-bede185cdc5c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1452 microversion: 2.1 time: 0.262568 Aug 30 04:57:16.775136 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3365/6666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:16 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1452 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:16.794865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:57:16.795495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:57:16.802281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:16.803365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:16.803823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:16.804524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:16.804992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:16.805456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:17.020938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:57:17.029583 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-134b8a1f-21ed-421e-87e8-dd61315cde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1452 microversion: 2.1 time: 0.238590 Aug 30 04:57:17.045349 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3302/6667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:57:16 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1452 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:57:18.832534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1fe11be7-6ca2-4ce6-b7f4-473de0537f05 req-4a3ef351-bd5a-4db0-b3de-379255b10068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c78a0eb8-7a06-40d3-a45a-0ce1eed86002", "tag": "b42af9a9-58c6-416a-bdd5-7d5fe446e588"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:57:18.854036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1fe11be7-6ca2-4ce6-b7f4-473de0537f05 req-4a3ef351-bd5a-4db0-b3de-379255b10068 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:57:18.854521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1fe11be7-6ca2-4ce6-b7f4-473de0537f05 req-4a3ef351-bd5a-4db0-b3de-379255b10068 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:57:18.854960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1fe11be7-6ca2-4ce6-b7f4-473de0537f05 req-4a3ef351-bd5a-4db0-b3de-379255b10068 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:57:18.874580 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1fe11be7-6ca2-4ce6-b7f4-473de0537f05 req-4a3ef351-bd5a-4db0-b3de-379255b10068 service nova] Creating event network-changed:b42af9a9-58c6-416a-bdd5-7d5fe446e588 for instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 on n-h1-854925-5 Aug 30 04:57:18.884603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1fe11be7-6ca2-4ce6-b7f4-473de0537f05 req-4a3ef351-bd5a-4db0-b3de-379255b10068 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056906 Aug 30 04:57:18.886271 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3366/6668] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:59:16.658700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:16.659541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:16.845128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:16.845706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:16.852310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:16.852809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:16.853266 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:16.853998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:16.854467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:16.854912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:16.880114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 04:59:16.959919 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3448f02-e8e5-4c34-854f-82618c56110c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 204 len: 0 microversion: 2.1 time: 0.303943 Aug 30 04:59:16.960775 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3303/6669] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 04:59:16 2022] DELETE /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 04:59:16.967481 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 04:59:16.969540 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 04:59:16.969687 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 04:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 (ip 10.222.0.27) !!! Aug 30 04:59:16.970801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:16.971571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=72 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:16.972710 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 30 04:59:16.977571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:16.978284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:16.989599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:16.990095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:16.990544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:16.991249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:16.991711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:16.992147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:17.271165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:17.278949 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7ec69e0b-4769-4a4f-8fb0-582db8f31f8c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1577 microversion: 2.1 time: 0.313814 Aug 30 04:59:17.279521 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3367/6670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:16 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1577 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:18.301536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:18.302175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:18.309196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:18.309720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:18.310175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:18.310870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:18.311369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:18.311864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:18.504509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:18.512448 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ef3c83a5-e061-4dfc-9580-51fde5e8060a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1577 microversion: 2.1 time: 0.215862 Aug 30 04:59:18.513023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3304/6671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:18 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1577 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:19.533770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:19.534313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:19.542949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:19.543448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:19.543894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:19.544634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:19.545064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:19.545524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:19.551887 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34840. Aug 30 04:59:19.701797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:19.713522 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc5c7cc7-c413-4cbc-bcb1-88e3e56ffb97 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1577 microversion: 2.1 time: 0.180475 Aug 30 04:59:19.714132 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3368/6672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:19 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1577 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:20.520840 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b46029c5-4bd5-4c6c-b140-974051f65931 req-375dd547-9066-4e39-b027-42dfcfacb7dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c78a0eb8-7a06-40d3-a45a-0ce1eed86002", "name": "network-vif-deleted", "tag": "b42af9a9-58c6-416a-bdd5-7d5fe446e588"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:59:20.559720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b46029c5-4bd5-4c6c-b140-974051f65931 req-375dd547-9066-4e39-b027-42dfcfacb7dd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:20.560233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b46029c5-4bd5-4c6c-b140-974051f65931 req-375dd547-9066-4e39-b027-42dfcfacb7dd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:20.560691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b46029c5-4bd5-4c6c-b140-974051f65931 req-375dd547-9066-4e39-b027-42dfcfacb7dd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:20.585430 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b46029c5-4bd5-4c6c-b140-974051f65931 req-375dd547-9066-4e39-b027-42dfcfacb7dd service nova] Creating event network-vif-deleted:b42af9a9-58c6-416a-bdd5-7d5fe446e588 for instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 on n-h1-854925-5 Aug 30 04:59:20.592068 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b46029c5-4bd5-4c6c-b140-974051f65931 req-375dd547-9066-4e39-b027-42dfcfacb7dd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151717 Aug 30 04:59:20.597076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3305/6673] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:59:20.741865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:20.742483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:20.749789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:20.750286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:20.750727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:20.751432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:20.751887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:20.752317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:20.817525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:20.826239 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb9eebbe-fa7c-4f15-aacc-55a8eee4993c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1226 microversion: 2.1 time: 0.089275 Aug 30 04:59:20.826920 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3369/6674] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:20 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:21.850174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:21.851002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:21.857229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:21.857753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:21.858204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:21.858967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:21.859433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:21.859869 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:21.931937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:21.940706 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da8fc8b3-ad38-48da-abef-47a0fc8c0274 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1226 microversion: 2.1 time: 0.096618 Aug 30 04:59:21.941518 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3306/6675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:21 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:22.961772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:22.962387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:22.969739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:22.970232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:22.970672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:22.971367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:22.971823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:22.972253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:23.035635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:23.043645 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b3298666-def3-40e9-ad61-f344918ba226 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1226 microversion: 2.1 time: 0.085759 Aug 30 04:59:23.044213 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3370/6676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:22 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:24.064585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:24.065223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:24.071843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:24.072348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:24.072807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:24.073553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:24.074029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:24.074479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:24.139573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:24.147519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a32e7840-e19d-4174-8174-17bce658e8a6 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 200 len: 1226 microversion: 2.1 time: 0.087717 Aug 30 04:59:24.148105 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3307/6677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:24 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:25.169596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:25.170125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:25.177053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:25.177579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:25.178028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:25.178732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:25.179193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:25.179632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:25.193442 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 HTTP/1.1 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c78a0eb8-7a06-40d3-a45a-0ce1eed86002'} Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 04:59:25.195650 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2b78770-f26d-4885-bb88-17156190ad12 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 404 len: 111 microversion: 2.1 time: 0.031522 Aug 30 04:59:25.200199 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3371/6678] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:25 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 04:59:25.245392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1034864910", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782850955", "security_groups": [{"name": "tempest-secgroup-smoke-105167585"}], "block_device_mapping_v2": [{"uuid": "a765df42-5407-4b9b-a3fb-64554bab14d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:59:25.358211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 04:59:26.074188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 04:59:26.074629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 04:59:26.075122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 04:59:26.075579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 04:59:26.076006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 04:59:26.085748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:26.086352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:26.086817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:26.087569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:26.088044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:26.088492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:26.106007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 04:59:26.111260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 04:59:26.169487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 04:59:26.171698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a765df42-5407-4b9b-a3fb-64554bab14d8',volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 04:59:26.301957 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59297245-45a9-440b-beee-b4e4af7bdd86 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.060410 Aug 30 04:59:26.302903 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3308/6679] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 04:59:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 04:59:26.313660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d98fb5d2-4490-4d6c-945d-b72bd1377057 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:26.314288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d98fb5d2-4490-4d6c-945d-b72bd1377057 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:26.368531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d98fb5d2-4490-4d6c-945d-b72bd1377057 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:26.379581 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d98fb5d2-4490-4d6c-945d-b72bd1377057 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1095 microversion: 2.1 time: 0.069880 Aug 30 04:59:26.380330 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3372/6680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:26 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:27.400463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:27.401758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:27.410757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:27.411421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:27.411930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:27.412988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:27.413801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:27.414259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:27.488614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:27.496910 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7505d0c-ec3c-41e0-b87a-df94028a4076 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1211 microversion: 2.1 time: 0.100629 Aug 30 04:59:27.497506 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3309/6681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:27 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:28.518880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:28.519501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:28.527095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:28.527593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:28.528038 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:28.528750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:28.529210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:28.529677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:28.674761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:28.683574 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86666e2f-3161-434f-a31d-d661344593e9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1278 microversion: 2.1 time: 0.169455 Aug 30 04:59:28.684715 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3373/6682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:28 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:28.708849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-160ceeb3-c4b8-4436-96a5-8dd90f6a30dc req-a979e4fc-860e-4b0f-a5e2-fd4e474a93db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b52d94-7257-43af-924c-5f7df083171c", "tag": "a86b4166-00ed-42a2-b272-c8e5e287407c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:59:28.739566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-160ceeb3-c4b8-4436-96a5-8dd90f6a30dc req-a979e4fc-860e-4b0f-a5e2-fd4e474a93db service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:28.740262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-160ceeb3-c4b8-4436-96a5-8dd90f6a30dc req-a979e4fc-860e-4b0f-a5e2-fd4e474a93db service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:28.740809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-160ceeb3-c4b8-4436-96a5-8dd90f6a30dc req-a979e4fc-860e-4b0f-a5e2-fd4e474a93db service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:28.752940 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-160ceeb3-c4b8-4436-96a5-8dd90f6a30dc req-a979e4fc-860e-4b0f-a5e2-fd4e474a93db service nova] Creating event network-changed:a86b4166-00ed-42a2-b272-c8e5e287407c for instance d5b52d94-7257-43af-924c-5f7df083171c on n-h2-854925-5 Aug 30 04:59:28.758538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-160ceeb3-c4b8-4436-96a5-8dd90f6a30dc req-a979e4fc-860e-4b0f-a5e2-fd4e474a93db service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053515 Aug 30 04:59:28.759514 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3310/6683] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:59:29.704996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:29.705655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:29.712877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:29.713400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:29.713844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:29.714547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:29.715000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:29.715425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:29.854255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:29.862644 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4ea8d9fe-40ee-4984-b20c-2092240402a9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1278 microversion: 2.1 time: 0.162442 Aug 30 04:59:29.863323 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3374/6684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:29 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:30.885615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:30.886339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:30.893172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:30.893693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:30.894150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:30.895000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:30.895473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:30.895917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:31.031976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:31.040001 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8f33ff7-0af3-4137-98a4-627c0db3eb93 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1278 microversion: 2.1 time: 0.159818 Aug 30 04:59:31.040812 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3311/6685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:30 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:32.060404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:32.061031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:32.068215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:32.068715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:32.069166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:32.069918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:32.070392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:32.070832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:32.206092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:32.214665 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64d87ae5-ceae-48ef-aefb-88da5e1b97e2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1278 microversion: 2.1 time: 0.158228 Aug 30 04:59:32.231747 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3375/6686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:32 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:33.244152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:33.244743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:33.252241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:33.252737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:33.253197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:33.253996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:33.254467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:33.254914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:33.388895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:33.397605 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-292c9f39-e40e-4eb7-9de3-bfbbdb0daa9a tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.157366 Aug 30 04:59:33.398181 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3312/6687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:33 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:34.418323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:34.418944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:34.425833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:34.426316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:34.426757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:34.427449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:34.427913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:34.428344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:34.558997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:34.567286 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bcc8fe2e-ae03-41ad-a6d8-45209a1f5eaa tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.152874 Aug 30 04:59:34.573809 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3376/6688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:34 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:35.587024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:35.587688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:35.595090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:35.595587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:35.596029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:35.596721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:35.597184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:35.597765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:35.729696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:35.738245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2ea118a9-a025-4703-ac6e-3eab374f368e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.155085 Aug 30 04:59:35.738822 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3313/6689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:35 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:59:36.759590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:36.760208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:36.762682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:36.768645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:36.769138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:36.769606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:36.770306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:36.770762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:36.771214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:36.899901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:36.911404 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-215cc38b-f543-4910-bfdc-7574cec65bdd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.155777 Aug 30 04:59:36.912009 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3377/6690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:36 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:37.932714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:37.933359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:37.935358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:37.936066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:37.943992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:37.944519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:37.944972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:37.945697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:37.946160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:37.946599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:38.080245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:38.087889 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9796e4af-7047-42c0-980c-5135bdfdde13 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.159369 Aug 30 04:59:38.088469 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3314/6691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:37 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:39.110654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:39.111527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:39.121191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:39.121730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:39.122175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:39.122876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:39.123331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:39.124377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:39.264216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:39.272738 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-80e5d2e7-a2f6-4817-8f51-8ddffb478e29 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.166534 Aug 30 04:59:39.273341 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3378/6692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:39 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:40.293910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:40.294439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:40.301805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:40.302306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:40.302762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:40.303465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:40.303937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:40.304383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:40.435950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:40.445934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-828ccdf3-7667-4472-aafe-9e0d6ad9bd9d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.155817 Aug 30 04:59:40.446546 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3315/6693] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:40 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:41.466935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:41.467631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:41.474891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:41.475384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:41.475828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:41.476538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:41.477002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:41.477465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:41.610320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:41.618401 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-afa33980-d7de-4b57-8c5b-a204ed0b39ea tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.155423 Aug 30 04:59:41.618976 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3379/6694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:41 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:42.639453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:42.640086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:42.647106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:42.647607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:42.648062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:42.648775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:42.649245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:42.649711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:42.789835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:42.798139 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f870a32-9bd6-4a8d-ae09-c4d9fa7cbb89 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.162625 Aug 30 04:59:42.798720 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3316/6695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:42 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:42.805663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b52d94-7257-43af-924c-5f7df083171c", "name": "network-vif-plugged", "status": "completed", "tag": "a86b4166-00ed-42a2-b272-c8e5e287407c"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:59:42.818883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:42.819414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:42.820057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:42.831695 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] Creating event network-vif-plugged:a86b4166-00ed-42a2-b272-c8e5e287407c for instance d5b52d94-7257-43af-924c-5f7df083171c on n-h2-854925-5 Aug 30 04:59:42.835172 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] [79f96258-f667-45cb-ad1c-b389396cfa9e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 04:59:43.819820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:43.820364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:43.827210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:43.827705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:43.828152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:43.828849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:43.829314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:43.829772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:43.843320 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] [79f96258-f667-45cb-ad1c-b389396cfa9e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 34928. Aug 30 04:59:43.846805 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-276ad8ed-275e-46ee-a582-49b3da18dfab req-ed00db48-4a19-45ad-930c-d6fb394fb09f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.045246 Aug 30 04:59:43.847695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3380/6696] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 04:59:43.967935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:43.976139 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b0018f02-0261-4f3e-a499-5e85d9365721 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.160365 Aug 30 04:59:43.976732 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3317/6697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:43 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:59:45.001314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:45.002002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:45.009946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:45.010441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:45.010887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:45.011592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:45.012059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:45.012487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:45.146990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:45.155445 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0101d19-5931-474e-824d-198f02319156 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1266 microversion: 2.1 time: 0.161324 Aug 30 04:59:45.156024 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3381/6698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:44 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:46.176784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:46.177456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:46.184373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:46.184875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:46.185353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:46.186065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:46.186537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:46.186983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:46.313841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:46.321477 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b958326-5c37-4aa1-8b0a-dc76967f65a1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1453 microversion: 2.1 time: 0.148696 Aug 30 04:59:46.322052 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3318/6699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:46 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 04:59:46.341588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 04:59:46.342939 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 04:59:46.350078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:46.350600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:46.351049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:46.351747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:46.352207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:46.352640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:46.496612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 04:59:46.504449 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d30355c6-76c6-44c6-a308-d6785cae5b08 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1453 microversion: 2.1 time: 0.166879 Aug 30 04:59:46.505023 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3382/6700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 04:59:46 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 04:59:48.154112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cfdb3dcd-2190-4802-9b3f-0f6bbfc60005 req-1e9e9e92-3b80-4046-af85-6b9e1dfcf20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b52d94-7257-43af-924c-5f7df083171c", "tag": "a86b4166-00ed-42a2-b272-c8e5e287407c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 04:59:48.160668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:48.166240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cfdb3dcd-2190-4802-9b3f-0f6bbfc60005 req-1e9e9e92-3b80-4046-af85-6b9e1dfcf20c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 04:59:48.166738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cfdb3dcd-2190-4802-9b3f-0f6bbfc60005 req-1e9e9e92-3b80-4046-af85-6b9e1dfcf20c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 04:59:48.167181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cfdb3dcd-2190-4802-9b3f-0f6bbfc60005 req-1e9e9e92-3b80-4046-af85-6b9e1dfcf20c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 04:59:48.171263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 04:59:48.180056 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cfdb3dcd-2190-4802-9b3f-0f6bbfc60005 req-1e9e9e92-3b80-4046-af85-6b9e1dfcf20c service nova] Creating event network-changed:a86b4166-00ed-42a2-b272-c8e5e287407c for instance d5b52d94-7257-43af-924c-5f7df083171c on n-h2-854925-5 Aug 30 04:59:48.185569 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cfdb3dcd-2190-4802-9b3f-0f6bbfc60005 req-1e9e9e92-3b80-4046-af85-6b9e1dfcf20c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035077 Aug 30 04:59:48.186985 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3319/6701] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 04:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:01:30.703389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=34 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:30.704174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=82 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:30.709627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-568886315", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1782850955", "security_groups": [{"name": "tempest-secgroup-smoke-105167585"}], "block_device_mapping_v2": [{"uuid": "7aa9c872-7453-42ad-819f-86f4e5f2312a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "79faa593-1579-4205-b3a0-8c1522777838"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:01:30.822214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] validate_networks() for [('79faa593-1579-4205-b3a0-8c1522777838', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:01:31.246950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:01:31.247379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:01:31.247858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:01:31.248385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:01:31.248807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:01:31.257654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:31.258141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:31.258585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:31.259328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:31.259867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:31.260301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:31.277560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:01:31.282888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Getting quotas for user d27ea4b3012643f2802ce3d1d30d7836 and project e54c35ffc8ad457eae9f5ef16033cfa2. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:01:31.340235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:01:31.342373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7aa9c872-7453-42ad-819f-86f4e5f2312a',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:01:31.470677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-154383a3-cb8f-4ba0-aed0-3ee5243348f4 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.769302 Aug 30 05:01:31.471932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3383/6702] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:01:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:01:31.480662 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:01:31.481539 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:01:31.482493 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:01:31.482655 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:01:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 (ip 10.222.0.27) !!! Aug 30 05:01:31.492693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9f090573-7f58-4b55-b177-ad3f3504418d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:31.493443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9f090573-7f58-4b55-b177-ad3f3504418d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:31.555892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9f090573-7f58-4b55-b177-ad3f3504418d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:31.563896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9f090573-7f58-4b55-b177-ad3f3504418d tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1094 microversion: 2.1 time: 0.085132 Aug 30 05:01:31.564477 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3320/6703] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:31 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:01:32.584249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:32.585437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:32.593162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:32.593927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:32.594344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:32.595102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:32.595612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:32.596083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:32.659898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:32.669069 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4b1c383-2363-4922-a3c2-6025bcfca5b7 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1210 microversion: 2.1 time: 0.088751 Aug 30 05:01:32.669704 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3384/6704] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:32 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:33.691383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:33.692140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:33.701755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:33.702374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:33.702904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:33.703692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:33.704247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:33.704759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:33.728946 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 35050. Aug 30 05:01:33.733805 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 35052. Aug 30 05:01:33.852234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:33.863472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a7d22eb5-f09c-409d-a702-5eb986e25049 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1277 microversion: 2.1 time: 0.176016 Aug 30 05:01:33.864095 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3321/6705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:33 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:34.059080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6e4158dd-3eb8-4ced-beec-e675216b383e req-b428b188-66f3-4d11-94ab-f8c556e7c9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565aa51c-c200-4ee0-8f6f-ec57a1ae1281", "tag": "1cce603e-fb56-4483-93bf-a1dfe6a0786a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:01:34.072648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6e4158dd-3eb8-4ced-beec-e675216b383e req-b428b188-66f3-4d11-94ab-f8c556e7c9f2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:34.073166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6e4158dd-3eb8-4ced-beec-e675216b383e req-b428b188-66f3-4d11-94ab-f8c556e7c9f2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:34.073931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6e4158dd-3eb8-4ced-beec-e675216b383e req-b428b188-66f3-4d11-94ab-f8c556e7c9f2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:34.089313 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6e4158dd-3eb8-4ced-beec-e675216b383e req-b428b188-66f3-4d11-94ab-f8c556e7c9f2 service nova] Creating event network-changed:1cce603e-fb56-4483-93bf-a1dfe6a0786a for instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 on n-h1-854925-5 Aug 30 05:01:34.094653 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6e4158dd-3eb8-4ced-beec-e675216b383e req-b428b188-66f3-4d11-94ab-f8c556e7c9f2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040034 Aug 30 05:01:34.095499 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3385/6706] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:01:34.884206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:34.884961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:34.892234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:34.892812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:34.893353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:34.894151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:34.894786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:34.895233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:35.043795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:35.052528 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d22021bb-c81e-485c-bc3f-18ff852afd1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1277 microversion: 2.1 time: 0.172265 Aug 30 05:01:35.053351 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3322/6707] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:34 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:36.075354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:36.075982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:36.082232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:36.082715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:36.083151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:36.083839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:36.084295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:36.085417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:36.218120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:36.226364 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f39e7c40-ff5a-4fc6-a91a-f9bc81a3940b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1277 microversion: 2.1 time: 0.156219 Aug 30 05:01:36.226957 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3386/6708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:36 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:37.246797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:37.247352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:37.255369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:37.255879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:37.256377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:37.257646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:37.258124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:37.258570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:37.394575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:37.402680 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7cf55a0d-92df-449a-b916-5243a4158c1e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1277 microversion: 2.1 time: 0.159997 Aug 30 05:01:37.403267 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3323/6709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:37 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:38.423807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:38.424427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:38.431439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:38.431932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:38.432383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:38.433083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:38.433647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:38.434080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:38.566686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:38.575230 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eabef80d-d103-40e7-8b42-51e1174b235e tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.155361 Aug 30 05:01:38.575807 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3387/6710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:38 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:39.595947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:39.596825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:39.604354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:39.604848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:39.605302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:39.606125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:39.606544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:39.606987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:39.756985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:39.765164 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-16e6e9a2-b173-4a7b-b19f-e31376de26f2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.173091 Aug 30 05:01:39.765774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3324/6711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:39 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:40.786719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:40.787333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:40.794866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:40.795353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:40.795792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:40.796481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:40.796938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:40.797387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:40.941921 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:40.949900 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2836d828-62c0-452f-ac8f-3a54dabef464 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.167143 Aug 30 05:01:40.950491 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3388/6712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:40 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:41.972734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:41.973387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:41.976666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:41.982167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:41.982690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:41.983143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:41.983851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:41.984315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:41.984755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:42.123868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:42.131785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c0e75b7-6071-489a-af87-c8789595db18 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.163178 Aug 30 05:01:42.132366 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3325/6713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:41 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:43.152966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:43.153665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:43.155707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:43.156379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:01:43.164120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:43.164551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:43.164994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:43.165718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:43.166177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:43.166609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:43.310654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:43.318614 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a18c2ac3-4f9e-4b62-b848-2242eacdfaef tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.169684 Aug 30 05:01:43.319207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3389/6714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:43 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:44.339454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:44.340103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:44.347447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:44.347952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:44.348412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:44.349155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:44.349675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:44.350128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:44.480909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:44.488717 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d83cba9e-7a06-4b78-ad46-acdc4e5ba76c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.153337 Aug 30 05:01:44.489296 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3326/6715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:44 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:45.510251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:45.510867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:45.517889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:45.518373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:45.518812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:45.519499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:45.519954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:45.520380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:45.649264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:45.656992 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f84f69dd-2da1-4553-829a-488869373bb1 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.151533 Aug 30 05:01:45.657724 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3390/6716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:45 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:46.678221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:46.678882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:46.685934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:46.686438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:46.686897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:46.687610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:46.688084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:46.688534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:46.823129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:46.830872 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d3ef95c7-6257-4cea-8ffc-9653fed78344 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.156570 Aug 30 05:01:46.831468 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3327/6717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:46 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:47.852159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:47.852794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:47.859853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:47.860389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:47.860837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:47.861575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:47.862043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:47.862486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:47.998149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:48.006250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b462077d-9d26-45e8-bbdc-751717b6edd2 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.158658 Aug 30 05:01:48.006891 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3391/6718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:47 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:49.028333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:49.028963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:49.035894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:49.036398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:49.036854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:49.037613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:49.038087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:49.038533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:49.170582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:49.178472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4f025cea-5d7d-470e-9bd3-8609da3b750b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.154045 Aug 30 05:01:49.179056 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3328/6719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:49 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:01:49.743866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-fcb2048e-7df5-455b-aeef-71ca8a6b693b req-2ba6e98e-3441-4248-b34b-07c63b66201d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565aa51c-c200-4ee0-8f6f-ec57a1ae1281", "name": "network-vif-plugged", "status": "completed", "tag": "1cce603e-fb56-4483-93bf-a1dfe6a0786a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:01:49.753501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fcb2048e-7df5-455b-aeef-71ca8a6b693b req-2ba6e98e-3441-4248-b34b-07c63b66201d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:49.753986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fcb2048e-7df5-455b-aeef-71ca8a6b693b req-2ba6e98e-3441-4248-b34b-07c63b66201d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:49.754455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fcb2048e-7df5-455b-aeef-71ca8a6b693b req-2ba6e98e-3441-4248-b34b-07c63b66201d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:49.765893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-fcb2048e-7df5-455b-aeef-71ca8a6b693b req-2ba6e98e-3441-4248-b34b-07c63b66201d service nova] Creating event network-vif-plugged:1cce603e-fb56-4483-93bf-a1dfe6a0786a for instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 on n-h1-854925-5 Aug 30 05:01:49.770827 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-fcb2048e-7df5-455b-aeef-71ca8a6b693b req-2ba6e98e-3441-4248-b34b-07c63b66201d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110477 Aug 30 05:01:49.771440 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3392/6720] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:01:50.198550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:50.199182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:50.206122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:50.206620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:50.207075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:50.207781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:50.208246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:50.208690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:50.335965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:50.343842 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20169829-4800-424f-ad6c-87b65261bd27 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.149290 Aug 30 05:01:50.344434 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3329/6721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:50 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:01:51.365633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:51.366339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:51.373018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:51.373549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:51.374005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:51.374720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:51.375175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:51.375603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:51.511770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:51.519650 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5aaccac6-a157-4a6d-ae41-6a1d69252ae3 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1265 microversion: 2.1 time: 0.159300 Aug 30 05:01:51.520227 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3393/6722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:51 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:52.540020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:52.540659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:52.548206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:52.548712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:52.549172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:52.549945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:52.550423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:52.550881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:52.684683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:52.692514 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5e0027d3-a3c9-445b-a9ea-00be71666676 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1451 microversion: 2.1 time: 0.156456 Aug 30 05:01:52.693104 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3330/6723] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:52 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:52.714002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:01:52.714619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:01:52.721770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:52.722257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:52.722695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:52.723386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:52.723840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:52.724267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:52.853305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:01:52.861866 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea1f6a89-dc4c-4b30-b0d9-47408c57bf4f tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1451 microversion: 2.1 time: 0.152417 Aug 30 05:01:52.862463 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3394/6724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:01:52 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:01:54.433068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3dba2c5b-56f4-4c64-a7a2-cc0ce3c21876 req-467c7b40-2a78-4f84-9ee8-bb6cc7c9b05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565aa51c-c200-4ee0-8f6f-ec57a1ae1281", "tag": "1cce603e-fb56-4483-93bf-a1dfe6a0786a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:01:54.443267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3dba2c5b-56f4-4c64-a7a2-cc0ce3c21876 req-467c7b40-2a78-4f84-9ee8-bb6cc7c9b05d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:01:54.443765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3dba2c5b-56f4-4c64-a7a2-cc0ce3c21876 req-467c7b40-2a78-4f84-9ee8-bb6cc7c9b05d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:01:54.444209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3dba2c5b-56f4-4c64-a7a2-cc0ce3c21876 req-467c7b40-2a78-4f84-9ee8-bb6cc7c9b05d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:01:54.456458 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3dba2c5b-56f4-4c64-a7a2-cc0ce3c21876 req-467c7b40-2a78-4f84-9ee8-bb6cc7c9b05d service nova] Creating event network-changed:1cce603e-fb56-4483-93bf-a1dfe6a0786a for instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 on n-h1-854925-5 Aug 30 05:01:54.461908 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3dba2c5b-56f4-4c64-a7a2-cc0ce3c21876 req-467c7b40-2a78-4f84-9ee8-bb6cc7c9b05d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033159 Aug 30 05:01:54.463206 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3331/6725] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:26.534933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=27 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:26.537243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:26.537884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=63 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:26.539127 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:03:26.539248 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:03:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 30 05:03:26.544240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-1f2ba790-0fbc-42fe-9937-9a2a2058646b req-99b0b571-51a3-4fa9-ba19-211b7b1c0966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "565aa51c-c200-4ee0-8f6f-ec57a1ae1281", "tag": "1cce603e-fb56-4483-93bf-a1dfe6a0786a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:26.550165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=60 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:03:26.552299 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:03:26.552299 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:03:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 (ip 10.222.0.27) !!! Aug 30 05:03:26.557208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:26.557937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:26.566548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:26.574368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1f2ba790-0fbc-42fe-9937-9a2a2058646b req-99b0b571-51a3-4fa9-ba19-211b7b1c0966 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:26.574862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1f2ba790-0fbc-42fe-9937-9a2a2058646b req-99b0b571-51a3-4fa9-ba19-211b7b1c0966 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:26.575306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-1f2ba790-0fbc-42fe-9937-9a2a2058646b req-99b0b571-51a3-4fa9-ba19-211b7b1c0966 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:26.577955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:26.578404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:26.579127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:26.579584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:26.580013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:26.594920 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-1f2ba790-0fbc-42fe-9937-9a2a2058646b req-99b0b571-51a3-4fa9-ba19-211b7b1c0966 service nova] Creating event network-changed:1cce603e-fb56-4483-93bf-a1dfe6a0786a for instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 on n-h1-854925-5 Aug 30 05:03:26.600858 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-1f2ba790-0fbc-42fe-9937-9a2a2058646b req-99b0b571-51a3-4fa9-ba19-211b7b1c0966 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067722 Aug 30 05:03:26.601700 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3332/6726] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:26.607613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:03:26.700514 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-99533c4e-cdd6-42b7-aff5-08abe3b09bfb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 204 len: 0 microversion: 2.1 time: 0.170382 Aug 30 05:03:26.701431 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3395/6727] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:03:26 2022] DELETE /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:03:26.711525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:26.712238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:26.719105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:26.719589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:26.720480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:26.721390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:26.721861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:26.722297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:26.865892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:26.874449 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0235dbe4-c346-4127-979f-ef5a9cda6d3b tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1575 microversion: 2.1 time: 0.168601 Aug 30 05:03:26.875042 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3333/6728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:26 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1575 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:27.897293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:27.898051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:27.906246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:27.906747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:27.907192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:27.907910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:27.908371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:27.908804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:28.042745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:28.050620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4ead68f-1ff7-43c2-a057-b26e8397f399 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1575 microversion: 2.1 time: 0.158291 Aug 30 05:03:28.051194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3396/6729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:27 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:28.979338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a8c3d1a9-5a30-40aa-aaae-9e4764f18182 req-d2f5e26e-29f8-430d-9566-9e7a1f507da0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "565aa51c-c200-4ee0-8f6f-ec57a1ae1281", "name": "network-vif-deleted", "tag": "1cce603e-fb56-4483-93bf-a1dfe6a0786a"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:28.990467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a8c3d1a9-5a30-40aa-aaae-9e4764f18182 req-d2f5e26e-29f8-430d-9566-9e7a1f507da0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:28.990957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a8c3d1a9-5a30-40aa-aaae-9e4764f18182 req-d2f5e26e-29f8-430d-9566-9e7a1f507da0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:28.991422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a8c3d1a9-5a30-40aa-aaae-9e4764f18182 req-d2f5e26e-29f8-430d-9566-9e7a1f507da0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.006143 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a8c3d1a9-5a30-40aa-aaae-9e4764f18182 req-d2f5e26e-29f8-430d-9566-9e7a1f507da0 service nova] Creating event network-vif-deleted:1cce603e-fb56-4483-93bf-a1dfe6a0786a for instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 on n-h1-854925-5 Aug 30 05:03:29.012244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a8c3d1a9-5a30-40aa-aaae-9e4764f18182 req-d2f5e26e-29f8-430d-9566-9e7a1f507da0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036863 Aug 30 05:03:29.013054 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3334/6730] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:03:29.077377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:29.078018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:29.084907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:29.085434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:29.085887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.086593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:29.087056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:29.087490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:29.154063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:29.162541 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-54e870a1-eb1c-4432-bb13-42d4c78739dd tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1225 microversion: 2.1 time: 0.093864 Aug 30 05:03:29.163240 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3397/6731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:29 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:30.183999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:30.184609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:30.191831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:30.192888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:30.193371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:30.194077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:30.194541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:30.195143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:30.261620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:30.269428 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d88b32e-5804-488c-91f3-deca6a9298ab tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1225 microversion: 2.1 time: 0.089938 Aug 30 05:03:30.270007 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3335/6732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:30 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:31.291131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:31.291774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:31.298733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:31.299217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:31.299659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:31.300346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:31.300800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:31.301227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:31.363394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:31.372203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b6a9021b-8233-41fb-9114-0834a9a9ac40 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1225 microversion: 2.1 time: 0.084954 Aug 30 05:03:31.372796 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3398/6733] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:31 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:32.394291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:32.394960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:32.401897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:32.402393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:32.402847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:32.403547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:32.404009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:32.404473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:32.466835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:32.475799 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-509eac8b-8237-4632-8af6-695a7a106746 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1225 microversion: 2.1 time: 0.085452 Aug 30 05:03:32.476478 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3336/6734] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:32 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:33.496099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:33.496783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:33.504085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:33.505400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:33.505982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:33.506817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:33.507333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:33.507910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:33.540874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:33.541394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:33.541843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:33.542299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lazy-loading 'fault' on Instance uuid 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:03:33.585295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:33.595765 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-22e100cc-27c0-4db7-84b7-abfa61b2c450 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 200 len: 1230 microversion: 2.1 time: 0.103145 Aug 30 05:03:33.596365 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3399/6735] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:33 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:03:34.616867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:34.617550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: 565aa51c-c200-4ee0-8f6f-ec57a1ae1281] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:34.623858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:34.624359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:34.624821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:34.625560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:34.626038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:34.626487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:34.640545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 could not be found. Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 HTTP/1.1 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 could not be found. Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '565aa51c-c200-4ee0-8f6f-ec57a1ae1281'} Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 could not be found. Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 could not be found. Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:34.642246 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 could not be found. Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance 565aa51c-c200-4ee0-8f6f-ec57a1ae1281 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14b24b5c-df60-408b-b7a9-9b503ba06563 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281" status: 404 len: 111 microversion: 2.1 time: 0.031588 Aug 30 05:03:34.646389 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3337/6736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:34 2022] GET /compute/v2.1/servers/565aa51c-c200-4ee0-8f6f-ec57a1ae1281 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:03:40.875386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:40.876233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:40.877212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5a3d4a09-07bb-4976-a173-edbb43944824 req-1ef39586-c0ca-4fa3-b7d3-9ad7fbe069e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b52d94-7257-43af-924c-5f7df083171c", "tag": "a86b4166-00ed-42a2-b272-c8e5e287407c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:40.884347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:40.885364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:40.886020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:40.886952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:40.887476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:40.888155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:40.888367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5a3d4a09-07bb-4976-a173-edbb43944824 req-1ef39586-c0ca-4fa3-b7d3-9ad7fbe069e5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:40.888864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5a3d4a09-07bb-4976-a173-edbb43944824 req-1ef39586-c0ca-4fa3-b7d3-9ad7fbe069e5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:40.889309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5a3d4a09-07bb-4976-a173-edbb43944824 req-1ef39586-c0ca-4fa3-b7d3-9ad7fbe069e5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:40.902409 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5a3d4a09-07bb-4976-a173-edbb43944824 req-1ef39586-c0ca-4fa3-b7d3-9ad7fbe069e5 service nova] Creating event network-changed:a86b4166-00ed-42a2-b272-c8e5e287407c for instance d5b52d94-7257-43af-924c-5f7df083171c on n-h2-854925-5 Aug 30 05:03:40.910247 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5a3d4a09-07bb-4976-a173-edbb43944824 req-1ef39586-c0ca-4fa3-b7d3-9ad7fbe069e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034425 Aug 30 05:03:40.911082 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3338/6737] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:40.916064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:03:41.007899 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dafe9faf-942a-4f44-bff0-bfba40f07737 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 204 len: 0 microversion: 2.1 time: 0.135957 Aug 30 05:03:41.008898 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3400/6738] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:03:40 2022] DELETE /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:03:41.017920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:41.018650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:41.026019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:41.026558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:41.027018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:41.027735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:41.028207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:41.028655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:41.168189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:41.176190 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a5d48264-871a-4803-987e-41c1376b0507 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1578 microversion: 2.1 time: 0.162602 Aug 30 05:03:41.177269 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3339/6739] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:41 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:42.199085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:42.199710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:42.206583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:42.207075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:42.207509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:42.208196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:42.208652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:42.209080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:42.347510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:42.355457 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25645199-315f-460e-9192-9658c8ddc1ae tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1578 microversion: 2.1 time: 0.160798 Aug 30 05:03:42.356242 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3401/6740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:42 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:43.161308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-05f66453-1190-4926-bea3-c5a8cc277a57 req-21efa904-278d-4fc9-9443-9d45392c1962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b52d94-7257-43af-924c-5f7df083171c", "name": "network-vif-deleted", "tag": "a86b4166-00ed-42a2-b272-c8e5e287407c"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:03:43.170908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-05f66453-1190-4926-bea3-c5a8cc277a57 req-21efa904-278d-4fc9-9443-9d45392c1962 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:43.171476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-05f66453-1190-4926-bea3-c5a8cc277a57 req-21efa904-278d-4fc9-9443-9d45392c1962 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:43.172080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-05f66453-1190-4926-bea3-c5a8cc277a57 req-21efa904-278d-4fc9-9443-9d45392c1962 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:43.183265 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-05f66453-1190-4926-bea3-c5a8cc277a57 req-21efa904-278d-4fc9-9443-9d45392c1962 service nova] Creating event network-vif-deleted:a86b4166-00ed-42a2-b272-c8e5e287407c for instance d5b52d94-7257-43af-924c-5f7df083171c on n-h2-854925-5 Aug 30 05:03:43.188444 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-05f66453-1190-4926-bea3-c5a8cc277a57 req-21efa904-278d-4fc9-9443-9d45392c1962 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108529 Aug 30 05:03:43.189064 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3340/6741] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:03:43.378619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:43.379819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:43.387501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:43.388100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:43.388772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:43.389669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:43.390204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:43.390714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:43.457945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:43.466826 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-686d718a-a157-47bc-9d1e-280912054fe9 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1226 microversion: 2.1 time: 0.092180 Aug 30 05:03:43.477877 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3402/6742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:43 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:44.491328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:44.492305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:44.499179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:44.499677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:44.500128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:44.500856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:44.501319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:44.501780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:44.565171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:44.573014 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6aa77c9e-1d8a-462c-be0b-144a51c6fe35 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1226 microversion: 2.1 time: 0.088302 Aug 30 05:03:44.573617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3341/6743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:44 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:45.593055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:45.593717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:45.601680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:45.602175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:45.602627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:45.603337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:45.603802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:45.604247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:45.673404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:45.682782 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79f9367c-2105-4715-b582-711ef337e22c tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1226 microversion: 2.1 time: 0.093679 Aug 30 05:03:45.683371 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3403/6744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:45 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:46.703589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:46.704219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:46.711407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:46.711713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:46.712149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:46.712846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:46.713308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:46.713766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:46.779197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd27ea4b3012643f2802ce3d1d30d7836', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54c35ffc8ad457eae9f5ef16033cfa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:03:46.787809 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6dc9cc1b-a864-442c-a14a-bd2e227dc4ba tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 200 len: 1226 microversion: 2.1 time: 0.088075 Aug 30 05:03:46.788430 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3342/6745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:46 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:03:47.808461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:47.809016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: d5b52d94-7257-43af-924c-5f7df083171c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:47.815974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:47.816500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:47.816950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:47.817692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:47.818157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:47.818598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:47.831990 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance d5b52d94-7257-43af-924c-5f7df083171c could not be found. Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c HTTP/1.1 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance d5b52d94-7257-43af-924c-5f7df083171c could not be found. Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'd5b52d94-7257-43af-924c-5f7df083171c'} Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b52d94-7257-43af-924c-5f7df083171c could not be found. Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b52d94-7257-43af-924c-5f7df083171c could not be found. Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:47.834790 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b52d94-7257-43af-924c-5f7df083171c could not be found. Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance d5b52d94-7257-43af-924c-5f7df083171c could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2dd3229-22ff-490b-b9e9-2e29bd2521eb tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c" status: 404 len: 111 microversion: 2.1 time: 0.032172 Aug 30 05:03:47.838475 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3404/6746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:47 2022] GET /compute/v2.1/servers/d5b52d94-7257-43af-924c-5f7df083171c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:03:48.278358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:48.278854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:48.286260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:48.286755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:48.287207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:48.287990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:48.288450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:48.288886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:48.302534 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 HTTP/1.1 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c78a0eb8-7a06-40d3-a45a-0ce1eed86002'} Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:03:48.304245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-932a442a-a603-4356-a7fa-fc4f9bf59c75 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 404 len: 111 microversion: 2.1 time: 0.031276 Aug 30 05:03:48.308382 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3343/6747] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:03:48 2022] DELETE /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:03:48.314478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:48.315102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] [instance: c78a0eb8-7a06-40d3-a45a-0ce1eed86002] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:03:48.321673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:48.322166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:48.322615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:48.323310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:03:48.323776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:03:48.324211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:03:48.338210 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] HTTP exception thrown: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Request method failure captured: Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 HTTP/1.1 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZeqeqqaBEEGmjN161SbYnCNTC77qo-UpkYniMkWIX1iznqIEL9e8z5ItFaxtvez_SzfMGQhv59SgDUrJg3Cr1GODC3N8pIeN9ffZFfg1RsWluBlDkPDX3erZeA1Swl87VTX0y8bKCscvI20SDe7sPKc9Azfu_GeI9OcsUkGF4203z8 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e54c35ffc8ad457eae9f5ef16033cfa2", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e54c35ffc8ad457eae9f5ef16033cfa2"}]}] Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e54c35ffc8ad457eae9f5ef16033cfa2 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestVolumeBootPattern-426080952 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: d27ea4b3012643f2802ce3d1d30d7836 Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestVolumeBootPattern-426080952-project Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c78a0eb8-7a06-40d3-a45a-0ce1eed86002'} Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:03:48.339763 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Returning 404 to user: Instance c78a0eb8-7a06-40d3-a45a-0ce1eed86002 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb0f1ceb-8c26-4f57-88b5-88bfee7bcd71 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002" status: 404 len: 111 microversion: 2.1 time: 0.030627 Aug 30 05:03:48.343719 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3405/6748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:03:48 2022] GET /compute/v2.1/servers/c78a0eb8-7a06-40d3-a45a-0ce1eed86002 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:03:51.749608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6065912e-893b-4df1-9e1c-a4181cb98c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] Calling method '.version_select at 0x7fe96a259ca0>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:03:51.776542 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6065912e-893b-4df1-9e1c-a4181cb98c57 tempest-TestVolumeBootPattern-426080952 tempest-TestVolumeBootPattern-426080952-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782850955" status: 202 len: 0 microversion: 2.1 time: 0.030903 Aug 30 05:03:51.790364 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3344/6749] 10.222.0.27 () {58 vars in 1263 bytes} [Tue Aug 30 05:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1782850955 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:04:09.711151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:09.711894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:09.827904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-552007792", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:09.882285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] validate_networks() for None {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:04:10.152836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:04:10.153263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:04:10.153765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:04:10.154212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:04:10.154634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:04:10.163379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:10.163865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:10.164306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:10.165040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:10.165523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:10.165963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:10.183946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Getting quotas for project 23a5bce6f84541cf83266bdb73fbd526. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:04:10.189097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Getting quotas for user dc3cd9c1917047e0ae7dc0586c8b1d48 and project 23a5bce6f84541cf83266bdb73fbd526. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:04:10.201811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:04:10.204141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:04:10.245921 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [0a8c58ef-5139-44af-9d55-b1972496b802] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:04:11.254408 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [0a8c58ef-5139-44af-9d55-b1972496b802] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 35320. Aug 30 05:04:11.258125 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-809e073e-cbe4-4a6b-a09d-213c60aed1e5 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552887 Aug 30 05:04:11.258774 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3406/6750] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:04:11.269898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=48 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:11.272043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:11.279486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f8f0b4df-e358-4fcb-9884-56ee8c49f0ed tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:11.279680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f8f0b4df-e358-4fcb-9884-56ee8c49f0ed tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:11.334827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f8f0b4df-e358-4fcb-9884-56ee8c49f0ed tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:11.341963 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f8f0b4df-e358-4fcb-9884-56ee8c49f0ed tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1221 microversion: 2.1 time: 0.074109 Aug 30 05:04:11.342559 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3345/6751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:11 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:12.363465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:12.364906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:12.372051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:12.372545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:12.373375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:12.374073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:12.374544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:12.375075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:12.792362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:12.800112 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4fffdbf3-4c71-496b-a049-4b8024a1b027 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1281 microversion: 2.1 time: 0.441479 Aug 30 05:04:12.800687 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3407/6752] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:12 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1281 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:13.820476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:13.821033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:13.828161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:13.829068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:13.829209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:13.829858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:13.830336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:13.830784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:14.059060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:14.066815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-119ae70a-9a4d-4a4f-a721-e8376c412570 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1321 microversion: 2.1 time: 0.250333 Aug 30 05:04:14.067405 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3346/6753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:13 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:14.161888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0914f97b-2aeb-42e6-855a-46e029bb51c3 req-50f67101-e82d-4b45-8da5-eaa1a5f52ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54051f56-c98f-4595-9090-921100b09f00", "tag": "415686f4-898b-4260-a5bb-8ddd5cbe67b7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:14.172959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0914f97b-2aeb-42e6-855a-46e029bb51c3 req-50f67101-e82d-4b45-8da5-eaa1a5f52ec5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:14.173477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0914f97b-2aeb-42e6-855a-46e029bb51c3 req-50f67101-e82d-4b45-8da5-eaa1a5f52ec5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:14.173915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0914f97b-2aeb-42e6-855a-46e029bb51c3 req-50f67101-e82d-4b45-8da5-eaa1a5f52ec5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:14.185638 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0914f97b-2aeb-42e6-855a-46e029bb51c3 req-50f67101-e82d-4b45-8da5-eaa1a5f52ec5 service nova] Creating event network-changed:415686f4-898b-4260-a5bb-8ddd5cbe67b7 for instance 54051f56-c98f-4595-9090-921100b09f00 on n-h2-854925-5 Aug 30 05:04:14.190865 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0914f97b-2aeb-42e6-855a-46e029bb51c3 req-50f67101-e82d-4b45-8da5-eaa1a5f52ec5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033613 Aug 30 05:04:14.191864 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3408/6754] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:15.087569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:15.088205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:15.095616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:15.096124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:15.096584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:15.097294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:15.097796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:15.098246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:15.226058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:15.233713 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7251b45-a37d-45b5-8123-2071a59e509e tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1321 microversion: 2.1 time: 0.150075 Aug 30 05:04:15.234288 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3347/6755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:15 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:16.256584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:16.257292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:16.263593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:16.264089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:16.264533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:16.265230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:16.265713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:16.266151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:16.393582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:16.401920 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1e506a30-2936-40b6-8e8c-ab0b2048537d tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1321 microversion: 2.1 time: 0.151062 Aug 30 05:04:16.402488 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3409/6756] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:16 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:17.422928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:17.423564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:17.431044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:17.431544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:17.432000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:17.432704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:17.433173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:17.433652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:17.565433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:17.573213 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df811a42-ab9f-4f80-8fda-04d90ef3466c tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1321 microversion: 2.1 time: 0.154221 Aug 30 05:04:17.573884 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3348/6757] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:17 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:18.594229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:18.595104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:18.605685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:18.606577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:18.607460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:18.608188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:18.608647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:18.609098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:18.843617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:18.851525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a861feb3-5c84-4e09-9aee-c6783e79b8a1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1321 microversion: 2.1 time: 0.261243 Aug 30 05:04:18.852099 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3410/6758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:18 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:19.872922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:19.873746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:19.881159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:19.881686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:19.882141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:19.882844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:19.883313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:19.883757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:20.085466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:20.093365 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f167117c-cf26-4bdc-8631-202774b085d1 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1321 microversion: 2.1 time: 0.224914 Aug 30 05:04:20.093967 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3349/6759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:19 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:20.112572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cf1cb5e3-e902-4d05-ba95-8e16d94809e5 req-26009df1-4fb0-409f-9e59-e992b8bbebfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54051f56-c98f-4595-9090-921100b09f00", "name": "network-vif-plugged", "status": "completed", "tag": "415686f4-898b-4260-a5bb-8ddd5cbe67b7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:20.124479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cf1cb5e3-e902-4d05-ba95-8e16d94809e5 req-26009df1-4fb0-409f-9e59-e992b8bbebfc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:20.124981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cf1cb5e3-e902-4d05-ba95-8e16d94809e5 req-26009df1-4fb0-409f-9e59-e992b8bbebfc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:20.125433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cf1cb5e3-e902-4d05-ba95-8e16d94809e5 req-26009df1-4fb0-409f-9e59-e992b8bbebfc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:20.137357 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cf1cb5e3-e902-4d05-ba95-8e16d94809e5 req-26009df1-4fb0-409f-9e59-e992b8bbebfc service nova] Creating event network-vif-plugged:415686f4-898b-4260-a5bb-8ddd5cbe67b7 for instance 54051f56-c98f-4595-9090-921100b09f00 on n-h2-854925-5 Aug 30 05:04:20.142578 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cf1cb5e3-e902-4d05-ba95-8e16d94809e5 req-26009df1-4fb0-409f-9e59-e992b8bbebfc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034030 Aug 30 05:04:20.143670 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3411/6760] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:21.114037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:21.114660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:21.121718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:21.122222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:21.122678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:21.123421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:21.123894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:21.124337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:21.258463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:21.266261 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1407bf10-4c3d-479e-8382-502226336889 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1321 microversion: 2.1 time: 0.156076 Aug 30 05:04:21.266855 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3350/6761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:21 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:22.288474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:22.289092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:22.291095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:22.291753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:22.298826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.299306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.299744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:22.300432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.301569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.301999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:22.436506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:22.444425 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd342149-00e2-4f2a-9b6e-c20ae8401013 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1470 microversion: 2.1 time: 0.160798 Aug 30 05:04:22.445396 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3412/6762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:22 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:22.468382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:22.522823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c84bfce5-2dd6-47f3-b40f-8e02de92bb27 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Calling method '.version_select at 0x7fe968dd7820>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:22.592253 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c84bfce5-2dd6-47f3-b40f-8e02de92bb27 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/e3c17ee84119497e8c30a32a00456bed" status: 200 len: 371 microversion: 2.1 time: 0.128349 Aug 30 05:04:22.592817 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3351/6763] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 05:04:22 2022] GET /compute/v2.1/os-quota-sets/e3c17ee84119497e8c30a32a00456bed => generated 371 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:22.604873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a919b915-fa89-4340-9f2e-273ac3e6a4ef tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1059972803", "id": 1957720768, "os-flavor-access:is_public": "True"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:22.622591 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a919b915-fa89-4340-9f2e-273ac3e6a4ef tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021329 Aug 30 05:04:22.623165 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3413/6764] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:04:22 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:22.634867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1957720768"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:22.637221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:22.643423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.643956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.644416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:22.646026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.646618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.647079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:22.732711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e0b11e43883d4e60bca54af7bdab5f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c17ee84119497e8c30a32a00456bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:22.739066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] [instance: 54051f56-c98f-4595-9090-921100b09f00] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1059972803 {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:04:22.745577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.746080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.746533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:22.747277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.747748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.748194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:22.772093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Getting quotas for project 23a5bce6f84541cf83266bdb73fbd526. Resources: {'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:04:22.776677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Getting quotas for user dc3cd9c1917047e0ae7dc0586c8b1d48 and project 23a5bce6f84541cf83266bdb73fbd526. Resources: {'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:04:22.788612 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.api [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] ram quota exceeded for e3c17ee84119497e8c30a32a00456bed, tried to resize instance. Aug 30 05:04:22.789170 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Request method failure captured: Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00/action HTTP/1.1 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 39 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZpJRl0eAdgubIbb8NHwJMlAKbztHPL_U3d17uFB8YMLtD7PyaCwiNExKYy8DBQyCJqH-aZm-6drne1mQy07KiYxNE80A7WAmstJHaJZSHCCGSPyROXv4QCajM48CMu8-BfbeC6km6QLoU9Mj-UHjY_52VT2t11tKzHG5fsyf8yFJUw Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e3c17ee84119497e8c30a32a00456bed Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-91650261 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,admin,member Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,admin,member Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3c17ee84119497e8c30a32a00456bed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3c17ee84119497e8c30a32a00456bed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3c17ee84119497e8c30a32a00456bed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3c17ee84119497e8c30a32a00456bed"}]}] Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersAdminNegativeTestJSON-91650261 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e3c17ee84119497e8c30a32a00456bed Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-91650261 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersAdminNegativeTestJSON-91650261-project-admin Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: e0b11e43883d4e60bca54af7bdab5f69 Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersAdminNegativeTestJSON-91650261-project-admin Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: {"resize": {"flavorRef": "1957720768"}} Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '54051f56-c98f-4595-9090-921100b09f00', 'body': {'resize': {'flavorRef': '1957720768'}}} Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:04:22.791307 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f705304d-c1e1-4c03-af6e-8e56e5a09a15 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00/action" status: 403 len: 118 microversion: 2.1 time: 0.161841 Aug 30 05:04:22.794932 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3352/6765] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:04:22 2022] POST /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00/action => generated 118 bytes in 163 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:04:22.801702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9ee15f6-5ff1-4b39-b3fb-01ccf731a3d0 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:22.819422 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a9ee15f6-5ff1-4b39-b3fb-01ccf731a3d0 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/1957720768" status: 202 len: 0 microversion: 2.1 time: 0.021436 Aug 30 05:04:22.820122 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3414/6766] 10.222.0.27 () {58 vars in 1161 bytes} [Tue Aug 30 05:04:22 2022] DELETE /compute/v2.1/flavors/1957720768 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:04:22.827931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f14e3f22-de82-4baa-b51f-7df698531a71 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:22.848727 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f14e3f22-de82-4baa-b51f-7df698531a71 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024449 Aug 30 05:04:22.849363 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3353/6767] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 05:04:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:04:22.868720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0345f289-62a9-4bc3-9ac3-b6a67b8f0800 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Calling method '.version_select at 0x7fe9690c7af0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:22.939296 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0345f289-62a9-4bc3-9ac3-b6a67b8f0800 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "GET /compute/v2.1/os-quota-sets/e3c17ee84119497e8c30a32a00456bed" status: 200 len: 371 microversion: 2.1 time: 0.074213 Aug 30 05:04:22.939874 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3415/6768] 10.222.0.27 () {58 vars in 1242 bytes} [Tue Aug 30 05:04:22 2022] GET /compute/v2.1/os-quota-sets/e3c17ee84119497e8c30a32a00456bed => generated 371 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:22.951633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-702a180f-9433-4f5b-be08-b656d72465b6 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-583855356", "id": 137224449, "os-flavor-access:is_public": "True"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:22.969996 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-702a180f-9433-4f5b-be08-b656d72465b6 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.021701 Aug 30 05:04:22.970775 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3354/6769] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:04:22 2022] POST /compute/v2.1/flavors => generated 433 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:22.985873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "137224449"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:22.988249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:22.994475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.994961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.995412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:22.996110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:22.996569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:22.997014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:23.082853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e0b11e43883d4e60bca54af7bdab5f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c17ee84119497e8c30a32a00456bed', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:23.089185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] [instance: 54051f56-c98f-4595-9090-921100b09f00] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-583855356 {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:04:23.096014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:23.096500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:23.096944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:23.097731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:23.098192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:23.098626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:23.124045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Getting quotas for project 23a5bce6f84541cf83266bdb73fbd526. Resources: {'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:04:23.129655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Getting quotas for user dc3cd9c1917047e0ae7dc0586c8b1d48 and project 23a5bce6f84541cf83266bdb73fbd526. Resources: {'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:04:23.141608 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.compute.api [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] cores quota exceeded for e3c17ee84119497e8c30a32a00456bed, tried to resize instance. Aug 30 05:04:23.142152 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Request method failure captured: Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00/action HTTP/1.1 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 38 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZpJRl0eAdgubIbb8NHwJMlAKbztHPL_U3d17uFB8YMLtD7PyaCwiNExKYy8DBQyCJqH-aZm-6drne1mQy07KiYxNE80A7WAmstJHaJZSHCCGSPyROXv4QCajM48CMu8-BfbeC6km6QLoU9Mj-UHjY_52VT2t11tKzHG5fsyf8yFJUw Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e3c17ee84119497e8c30a32a00456bed Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-91650261 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,admin,member Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,admin,member Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e3c17ee84119497e8c30a32a00456bed", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e3c17ee84119497e8c30a32a00456bed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3c17ee84119497e8c30a32a00456bed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e3c17ee84119497e8c30a32a00456bed"}]}] Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersAdminNegativeTestJSON-91650261 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e3c17ee84119497e8c30a32a00456bed Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-91650261 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersAdminNegativeTestJSON-91650261-project-admin Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: e0b11e43883d4e60bca54af7bdab5f69 Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersAdminNegativeTestJSON-91650261-project-admin Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: {"resize": {"flavorRef": "137224449"}} Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '54051f56-c98f-4595-9090-921100b09f00', 'body': {'resize': {'flavorRef': '137224449'}}} Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3876, in _check_quota_for_upsize Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:04:23.144236 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4242, in resize Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3894, in _check_quota_for_upsize Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5dcf1979-844c-42b7-b9f6-25628d0a3efa tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "POST /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00/action" status: 403 len: 113 microversion: 2.1 time: 0.165857 Aug 30 05:04:23.148794 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3416/6770] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:04:22 2022] POST /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00/action => generated 113 bytes in 167 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:04:23.156255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22a18705-bdd4-4507-802e-fa45a63f58f0 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:23.172969 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22a18705-bdd4-4507-802e-fa45a63f58f0 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "DELETE /compute/v2.1/flavors/137224449" status: 202 len: 0 microversion: 2.1 time: 0.020337 Aug 30 05:04:23.173578 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3355/6771] 10.222.0.27 () {58 vars in 1158 bytes} [Tue Aug 30 05:04:23 2022] DELETE /compute/v2.1/flavors/137224449 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:04:23.181947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4e9597d-c7f6-4f0a-a4aa-6fe2fee4e778 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:23.202414 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4e9597d-c7f6-4f0a-a4aa-6fe2fee4e778 tempest-ServersAdminNegativeTestJSON-91650261 tempest-ServersAdminNegativeTestJSON-91650261-project-admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024074 Aug 30 05:04:23.202975 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3417/6772] 10.222.0.27 () {58 vars in 1146 bytes} [Tue Aug 30 05:04:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:23.222383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:23.222897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:23.229172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:23.229710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:23.230200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:23.230904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:23.231377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:23.231819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:23.258233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:04:23.343043 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-517dccb6-de01-4b6b-ab8f-00c49a656abf tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "DELETE /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 204 len: 0 microversion: 2.1 time: 0.124456 Aug 30 05:04:23.345856 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3356/6773] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:04:23 2022] DELETE /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:04:23.356457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:23.357100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:23.365798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:23.366300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:23.366752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:23.367468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:23.367924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:23.368362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:23.508323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:23.516560 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5ab4a186-6da0-4d78-a477-18a046c3493a tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1476 microversion: 2.1 time: 0.165840 Aug 30 05:04:23.517232 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3418/6774] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:23 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:24.537505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:24.538213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:24.545694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:24.546202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:24.546663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:24.547434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:24.547903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:24.548346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:24.690385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc3cd9c1917047e0ae7dc0586c8b1d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23a5bce6f84541cf83266bdb73fbd526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:24.698790 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6eb7c320-5a98-4ed2-8b69-b6b1dd35c1ef tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 200 len: 1476 microversion: 2.1 time: 0.165709 Aug 30 05:04:24.699364 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3357/6775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:24 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:25.177266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-39e0f97e-f105-421b-801d-0d1da50dd1cd req-cca355a2-1ac0-4e7b-8287-64955d288a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54051f56-c98f-4595-9090-921100b09f00", "name": "network-vif-deleted", "tag": "415686f4-898b-4260-a5bb-8ddd5cbe67b7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:25.188361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-39e0f97e-f105-421b-801d-0d1da50dd1cd req-cca355a2-1ac0-4e7b-8287-64955d288a3e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:25.189152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-39e0f97e-f105-421b-801d-0d1da50dd1cd req-cca355a2-1ac0-4e7b-8287-64955d288a3e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:25.189781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-39e0f97e-f105-421b-801d-0d1da50dd1cd req-cca355a2-1ac0-4e7b-8287-64955d288a3e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:25.202149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-39e0f97e-f105-421b-801d-0d1da50dd1cd req-cca355a2-1ac0-4e7b-8287-64955d288a3e service nova] Creating event network-vif-deleted:415686f4-898b-4260-a5bb-8ddd5cbe67b7 for instance 54051f56-c98f-4595-9090-921100b09f00 on n-h2-854925-5 Aug 30 05:04:25.207703 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-39e0f97e-f105-421b-801d-0d1da50dd1cd req-cca355a2-1ac0-4e7b-8287-64955d288a3e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035140 Aug 30 05:04:25.208490 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3419/6776] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:25.719376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:25.720260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] [instance: 54051f56-c98f-4595-9090-921100b09f00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:25.727895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:25.728396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:25.728849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:25.729582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:25.730051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:25.730497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:26.003184 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] HTTP exception thrown: Instance 54051f56-c98f-4595-9090-921100b09f00 could not be found. Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Request method failure captured: Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 HTTP/1.1 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZpJ8VGKHoRe65T0eT_0tN_QmXA2Dsh3qNXq3N2j5FbhkxE6NejfU8DeP33lbmwZYVRDYPxFtT8VCPM2PhoW_EjYY0atzKvUyG5bsR0ndFYaMsors3vnYUCa14Y0HReBOJih_Y6TpgDmXmEGgZbvXJnIphcpRaxd2zUxNPzwpm5RcEQ Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 23a5bce6f84541cf83266bdb73fbd526 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1526218439 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_23a5bce6f84541cf83266bdb73fbd526", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/23a5bce6f84541cf83266bdb73fbd526"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23a5bce6f84541cf83266bdb73fbd526"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/23a5bce6f84541cf83266bdb73fbd526"}]}] Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1526218439 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 23a5bce6f84541cf83266bdb73fbd526 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1526218439 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersAdminNegativeTestJSON-1526218439-project Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: dc3cd9c1917047e0ae7dc0586c8b1d48 Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1526218439-project Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 54051f56-c98f-4595-9090-921100b09f00 could not be found. Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '54051f56-c98f-4595-9090-921100b09f00'} Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54051f56-c98f-4595-9090-921100b09f00 could not be found. Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54051f56-c98f-4595-9090-921100b09f00 could not be found. Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:26.005444 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54051f56-c98f-4595-9090-921100b09f00 could not be found. Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] Returning 404 to user: Instance 54051f56-c98f-4595-9090-921100b09f00 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c4c49a20-1561-409a-9dbc-717766ee48b3 tempest-ServersAdminNegativeTestJSON-1526218439 tempest-ServersAdminNegativeTestJSON-1526218439-project] 10.222.0.27 "GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00" status: 404 len: 111 microversion: 2.1 time: 0.291453 Aug 30 05:04:26.009585 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3358/6777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:25 2022] GET /compute/v2.1/servers/54051f56-c98f-4595-9090-921100b09f00 => generated 111 bytes in 293 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:04:32.279147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-320407211", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "35420577-74fc-4f08-a25f-59ab8219f92a"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:32.336264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] validate_networks() for [('35420577-74fc-4f08-a25f-59ab8219f92a', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:04:32.730120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:04:32.730557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:04:32.731074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:04:32.731496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:04:32.731919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:04:32.742043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:32.742541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:32.742992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:32.743739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:32.744203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:32.744643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:32.761748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Getting quotas for project 609d563beff44f1bbfe02ad91f84cada. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:04:32.767155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Getting quotas for user b5d50fb40fab46d7b63ffbce1b9205dc and project 609d563beff44f1bbfe02ad91f84cada. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:04:32.780376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:04:32.783097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:04:32.829540 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e460bfce-7a13-48d0-92d0-1920e2e9a52d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700105 Aug 30 05:04:32.830352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3420/6778] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:04:32.841704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dbcce050-c350-4c24-b7de-c27a3f360df9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:32.842355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dbcce050-c350-4c24-b7de-c27a3f360df9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:32.850381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:32.851361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:32.907925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dbcce050-c350-4c24-b7de-c27a3f360df9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:32.920898 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dbcce050-c350-4c24-b7de-c27a3f360df9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1214 microversion: 2.1 time: 0.083094 Aug 30 05:04:32.921881 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3359/6779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:32 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:33.947130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:33.947778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:33.958175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:33.958917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:33.959500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:33.961468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:33.961937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:33.962385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:34.080213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:34.089613 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7befffff-edca-4c0b-802e-34106c3b456a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1274 microversion: 2.1 time: 0.148399 Aug 30 05:04:34.104917 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3421/6780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:33 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1274 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:35.112092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:35.113477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:35.124932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:35.125467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:35.125914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:35.126827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:35.127294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:35.127734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:35.354590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:35.363251 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be339505-5d80-45b8-b7b3-710058c331df tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1314 microversion: 2.1 time: 0.254776 Aug 30 05:04:35.364017 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3360/6781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:35 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:35.517101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0c6a62a1-20f7-4ac9-abb5-751fa6cbe56c req-0118644c-e564-4152-9add-f5ad2140d4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eaaee50-584b-4fb6-a614-172ce73ff9b6", "tag": "c9b8198a-77b1-45e1-ad4e-daed019d8c63"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:35.534284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c6a62a1-20f7-4ac9-abb5-751fa6cbe56c req-0118644c-e564-4152-9add-f5ad2140d4fb service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:35.535331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c6a62a1-20f7-4ac9-abb5-751fa6cbe56c req-0118644c-e564-4152-9add-f5ad2140d4fb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:35.535937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c6a62a1-20f7-4ac9-abb5-751fa6cbe56c req-0118644c-e564-4152-9add-f5ad2140d4fb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:35.555373 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0c6a62a1-20f7-4ac9-abb5-751fa6cbe56c req-0118644c-e564-4152-9add-f5ad2140d4fb service nova] Creating event network-changed:c9b8198a-77b1-45e1-ad4e-daed019d8c63 for instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 on n-h2-854925-5 Aug 30 05:04:35.560311 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0c6a62a1-20f7-4ac9-abb5-751fa6cbe56c req-0118644c-e564-4152-9add-f5ad2140d4fb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048272 Aug 30 05:04:35.560930 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3422/6782] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:36.388103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:36.388725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:36.396259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:36.397017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:36.397555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:36.398249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:36.398710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:36.399145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:36.527184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:36.534815 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-071b1ac5-aa4d-458c-adbc-8b530533bcdc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1314 microversion: 2.1 time: 0.151180 Aug 30 05:04:36.535387 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3361/6783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:36 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:37.557301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:37.558655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:37.564936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:37.565455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:37.566592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:37.567317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:37.567775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:37.568210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:37.702142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:37.710628 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3528144f-def6-4882-8fdd-610844cdeefa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1314 microversion: 2.1 time: 0.158491 Aug 30 05:04:37.711310 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3423/6784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:37 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:38.732540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:38.733160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:38.740100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:38.740596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:38.741044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:38.741931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:38.742407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:38.742844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:38.871793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:38.880877 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f289a2c0-3f20-49f9-812c-87a68115309b tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1314 microversion: 2.1 time: 0.152884 Aug 30 05:04:38.881485 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3362/6785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:38 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:39.901977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:39.902618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:39.905620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:39.910981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:39.911419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:39.911860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:39.912574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:39.913035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:39.913503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:39.918627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=68 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:40.205291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9bbb8637-7b5a-4d92-aa60-4a0fe469e7a6 req-21ec7530-2e4e-4fe7-92d5-3a6457b52a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaee50-584b-4fb6-a614-172ce73ff9b6", "name": "network-vif-plugged", "status": "completed", "tag": "c9b8198a-77b1-45e1-ad4e-daed019d8c63"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:40.219250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9bbb8637-7b5a-4d92-aa60-4a0fe469e7a6 req-21ec7530-2e4e-4fe7-92d5-3a6457b52a4b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:40.220349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9bbb8637-7b5a-4d92-aa60-4a0fe469e7a6 req-21ec7530-2e4e-4fe7-92d5-3a6457b52a4b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:40.221122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9bbb8637-7b5a-4d92-aa60-4a0fe469e7a6 req-21ec7530-2e4e-4fe7-92d5-3a6457b52a4b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:40.235333 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9bbb8637-7b5a-4d92-aa60-4a0fe469e7a6 req-21ec7530-2e4e-4fe7-92d5-3a6457b52a4b service nova] Creating event network-vif-plugged:c9b8198a-77b1-45e1-ad4e-daed019d8c63 for instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 on n-h2-854925-5 Aug 30 05:04:40.242475 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9bbb8637-7b5a-4d92-aa60-4a0fe469e7a6 req-21ec7530-2e4e-4fe7-92d5-3a6457b52a4b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040999 Aug 30 05:04:40.243486 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3363/6786] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:04:40.382089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:40.389953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-93ca7ae6-627f-4d27-aad1-54235f9ce7d1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1314 microversion: 2.1 time: 0.491963 Aug 30 05:04:40.390536 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3424/6787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:39 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:41.411778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:41.413204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:41.416228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:41.422045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:41.422635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:41.423302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:41.424028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:41.424617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:41.425896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:41.432413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:41.573364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:41.581395 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fa19278c-a700-4e6f-aa72-8baafa491de5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1501 microversion: 2.1 time: 0.173934 Aug 30 05:04:41.581980 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3364/6788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:41 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1501 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:41.602278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:04:41.604945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:41.612045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:41.613185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:41.613668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:41.614362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:41.614814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:41.615241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:41.642976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:41.649468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Old instance type m1.heat2, new instance type m1.heat {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:04:41.655872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:04:41.656296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:04:41.656877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:04:41.657291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:04:41.657731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:04:41.720666 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-caafff37-dc32-464d-985c-b8c71e88cff3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "POST /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6/action" status: 202 len: 0 microversion: 2.1 time: 0.122289 Aug 30 05:04:41.721549 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3425/6789] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:04:41 2022] POST /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:04:41.730411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:41.731094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:41.737054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:41.737666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:41.738681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:41.739398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:41.739873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:41.740318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:41.874966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:41.883211 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51825572-0ebc-4dcc-81e5-9bb2c89a44ee tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1510 microversion: 2.1 time: 0.156888 Aug 30 05:04:41.883830 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3365/6790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:41 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:42.903893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=5 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:42.904660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:42.910551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:42.911179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:42.920071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:42.920565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:42.921011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:42.921800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:42.922260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:42.922747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:43.059332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:43.067180 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f5235e8e-2ace-44b4-94ce-6e97bf2a57fa tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1510 microversion: 2.1 time: 0.164821 Aug 30 05:04:43.067766 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3426/6791] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:42 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:44.088565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:44.089196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:44.092003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:04:44.098030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:44.098553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:44.099019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:44.099795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:44.100273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:44.100778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:44.232528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:44.240933 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-163b0e27-3b0d-49c6-809b-3a22a4064860 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.156275 Aug 30 05:04:44.241545 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3366/6792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:44 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:45.262716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:45.263249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:45.270850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:45.271339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:45.271784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:45.272485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:45.272950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:45.273416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:45.406040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:45.413731 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ea03728-a6b2-42fe-a971-97e629d902e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.155027 Aug 30 05:04:45.414302 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3427/6793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:45 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:46.434643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:46.435273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:46.442268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:46.442767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:46.443220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:46.443920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:46.444390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:46.444834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:46.578234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:46.586446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e21dc8a6-b685-40b3-9969-590ed9ee17f5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.155902 Aug 30 05:04:46.587024 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3367/6794] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:46 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:47.608192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:47.608845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:47.616590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:47.617075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:47.617540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:47.618233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:47.618715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:47.619144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:47.746620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:47.754625 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1ee2a793-15f1-4950-82a0-3e31381541e0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.150336 Aug 30 05:04:47.755208 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3428/6795] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:47 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:48.776297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:48.776932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:48.783806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:48.784304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:48.784759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:48.785524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:48.785993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:48.786436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:48.917944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:48.925712 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5788107a-e39f-4031-a8d6-e184d61ea60c tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.153340 Aug 30 05:04:48.926291 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3368/6796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:48 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:49.946816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:49.947370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:49.953914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:49.954395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:49.954834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:49.955572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:49.956026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:49.956453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:50.088236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:50.096303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e9e68a0a-7a9c-478b-8bc3-e1e06082bdb4 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.153642 Aug 30 05:04:50.096884 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3429/6797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:49 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:51.118428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:51.119059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:51.126253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:51.126735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:51.127208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:51.127912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:51.128379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:51.128816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:51.257549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:51.265299 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d32e62f-58c6-48c5-8271-d745a5157b12 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.151420 Aug 30 05:04:51.265952 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3369/6798] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:51 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:52.286141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:52.286759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:52.293401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:52.293887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:52.294322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:52.295013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:52.295465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:52.295894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:52.430236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:52.438018 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ecc34af7-4d7e-47ac-a523-10ab7092b391 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.155763 Aug 30 05:04:52.438594 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3430/6799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:52 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:53.460654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:53.461310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:53.468235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:53.468740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:53.469191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:53.470207 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:53.470673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:53.471112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:53.602008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:53.609757 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2f9fa262-8911-4201-b91c-db736e7834e1 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.153668 Aug 30 05:04:53.610334 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3370/6800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:53 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:54.630250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:54.630868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:54.637989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:54.638506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:54.638943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:54.639634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:54.640083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:54.640509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:54.774172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:54.781931 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e2084170-a870-4924-b66a-f2bb6159fa7a tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.155607 Aug 30 05:04:54.782500 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3431/6801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:54 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:55.803057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:55.804272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:55.811281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:55.811780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:55.812241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:55.812946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:55.813445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:55.813891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:55.945683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:55.953512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c99f418-dc4c-4ce9-a1a9-78c117418d99 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.154338 Aug 30 05:04:55.954109 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3371/6802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:55 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:56.974306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:56.974929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:56.981835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:56.982313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:56.982755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:56.983454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:56.983916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:56.984350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:57.114000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:57.122300 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c031057e-fa69-4a4e-a8e8-b1090dd725d5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.152018 Aug 30 05:04:57.122878 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3432/6803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:56 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:58.143857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:58.144482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:58.151934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:58.152427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:58.152876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:58.153599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:58.154063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:58.154503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:58.287039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:58.294868 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c2b36454-78ab-4329-849e-fc927c02f976 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.154945 Aug 30 05:04:58.295447 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3372/6804] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:58 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:04:59.316339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:04:59.316879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:04:59.323884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:59.324373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:59.324814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:59.325546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:04:59.326004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:04:59.326434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:04:59.455615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:04:59.464107 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dc1cc41a-5031-4662-a198-01ddbbb0d7db tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.151798 Aug 30 05:04:59.464691 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3433/6805] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:04:59 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:00.486129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:00.486773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:00.494547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:00.495054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:00.495511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:00.496222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:00.496690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:00.497134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:00.628233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:00.636061 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e340e41-9565-4ebb-85f4-70f45ac438f9 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.154040 Aug 30 05:05:00.636634 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3373/6806] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:00 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:01.656899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:01.657593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:01.665176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:01.665627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:01.666072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:01.666772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:01.667232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:01.667668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:01.795378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:01.803285 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5bd57cf-f1ae-4732-bf96-6ea01e928bb5 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.150330 Aug 30 05:05:01.804550 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3434/6807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:01 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:02.825721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:02.826361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:02.833367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:02.833882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:02.834340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:02.835052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:02.835534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:02.835985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:02.964767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:02.972796 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7fc408f2-c302-4898-876f-dda7c08617e3 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.151078 Aug 30 05:05:02.973398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3374/6808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:02 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:05:03.993295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:03.993881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:04.000951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:04.001463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:04.001907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:04.002604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:04.003058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:04.003486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:04.135901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:04.143672 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a692ec6f-1031-49ff-b505-3f470a13938d tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.154431 Aug 30 05:05:04.144252 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3435/6809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:03 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:05.166902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:05.167445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:05.173546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:05.174047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:05.174502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:05.175205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:05.175713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:05.176153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:05.302516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:05.310235 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-47e17c90-eee5-4ab9-81af-e46698a867ed tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.148284 Aug 30 05:05:05.310805 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3375/6810] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:05 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:06.331237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:06.331854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:06.338468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:06.338950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:06.339387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:06.340071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:06.340524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:06.340953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:06.478042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:06.485853 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d889992e-2b57-4f59-8028-c3e51f101e61 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.158665 Aug 30 05:05:06.486431 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3436/6811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:06 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:07.508231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:07.508862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:07.516534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:07.517031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:07.517518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:07.518225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:07.518693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:07.519137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:07.650892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:07.658725 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b2ea1c9-28d3-4828-8636-4a8849eb44a6 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.155041 Aug 30 05:05:07.659306 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3376/6812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:07 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:08.680224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:08.680846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:08.688397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:08.688888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:08.689351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:08.690049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:08.690509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:08.690945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:08.817866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:08.826534 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a388b8ea-e3a9-4ff7-bfe7-d9d672fec729 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.150323 Aug 30 05:05:08.827131 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3437/6813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:08 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:09.848148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:09.848735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:09.856347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:09.856841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:09.857296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:09.858017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:09.858485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:09.858922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:09.990829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:09.998517 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a197d0e2-0a87-47fa-aa6b-a16d3f1a8819 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1515 microversion: 2.1 time: 0.154689 Aug 30 05:05:09.999100 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3377/6814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:09 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:11.020003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:11.020651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:11.023372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=32 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:11.029247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:11.029759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:11.030205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:11.030956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:11.031359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:11.031791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:11.034602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:11.168845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:11.177218 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-289fec8b-af8a-4935-8746-3fb6a41752bc tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1514 microversion: 2.1 time: 0.161175 Aug 30 05:05:11.177864 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3438/6815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:11 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:11.449114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7f65240d-aefd-4df9-b5dd-9d2dcefc058a req-63b5f520-f4ba-4339-bfcf-1fff7edae2d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaee50-584b-4fb6-a614-172ce73ff9b6", "name": "network-vif-unplugged", "status": "completed", "tag": "c9b8198a-77b1-45e1-ad4e-daed019d8c63"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:11.455270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=29 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:11.463462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7f65240d-aefd-4df9-b5dd-9d2dcefc058a req-63b5f520-f4ba-4339-bfcf-1fff7edae2d2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:11.463956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7f65240d-aefd-4df9-b5dd-9d2dcefc058a req-63b5f520-f4ba-4339-bfcf-1fff7edae2d2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:11.464400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7f65240d-aefd-4df9-b5dd-9d2dcefc058a req-63b5f520-f4ba-4339-bfcf-1fff7edae2d2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:11.467221 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=84 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:11.477479 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7f65240d-aefd-4df9-b5dd-9d2dcefc058a req-63b5f520-f4ba-4339-bfcf-1fff7edae2d2 service nova] Creating event network-vif-unplugged:c9b8198a-77b1-45e1-ad4e-daed019d8c63 for instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 on n-h1-854925-5 Aug 30 05:05:11.483618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-7f65240d-aefd-4df9-b5dd-9d2dcefc058a req-63b5f520-f4ba-4339-bfcf-1fff7edae2d2 service nova] Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:05:11.494762 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7f65240d-aefd-4df9-b5dd-9d2dcefc058a req-63b5f520-f4ba-4339-bfcf-1fff7edae2d2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119737 Aug 30 05:05:11.495389 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3378/6816] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:12.199281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:12.199816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:12.206855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:12.207344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:12.207785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:12.208481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:12.208941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:12.209405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:12.341398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:12.349443 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c18005d4-2ed0-45cb-a137-400611d0798e tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1512 microversion: 2.1 time: 0.154709 Aug 30 05:05:12.350018 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3439/6817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:12 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:13.372686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:13.373425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:13.379652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:13.380144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:13.380591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:13.381283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:13.381774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:13.382214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:13.510595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ff6990fd-91b2-4383-9116-b7fa6c6fd562 req-6141847f-6085-4138-b136-32bc5ba98dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eaaee50-584b-4fb6-a614-172ce73ff9b6", "tag": "c9b8198a-77b1-45e1-ad4e-daed019d8c63"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:13.511070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:13.518518 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7b5f2b6a-d19d-4c0e-982f-10bb3d34e200 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1512 microversion: 2.1 time: 0.151429 Aug 30 05:05:13.519092 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3379/6818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:13 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:13.521011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ff6990fd-91b2-4383-9116-b7fa6c6fd562 req-6141847f-6085-4138-b136-32bc5ba98dad service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:13.521576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ff6990fd-91b2-4383-9116-b7fa6c6fd562 req-6141847f-6085-4138-b136-32bc5ba98dad service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:13.522051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ff6990fd-91b2-4383-9116-b7fa6c6fd562 req-6141847f-6085-4138-b136-32bc5ba98dad service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:13.533809 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ff6990fd-91b2-4383-9116-b7fa6c6fd562 req-6141847f-6085-4138-b136-32bc5ba98dad service nova] Creating event network-changed:c9b8198a-77b1-45e1-ad4e-daed019d8c63 for instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 on n-h1-854925-5 Aug 30 05:05:13.539319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-ff6990fd-91b2-4383-9116-b7fa6c6fd562 req-6141847f-6085-4138-b136-32bc5ba98dad service nova] Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:05:13.550198 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ff6990fd-91b2-4383-9116-b7fa6c6fd562 req-6141847f-6085-4138-b136-32bc5ba98dad service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043898 Aug 30 05:05:13.551058 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3440/6819] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:05:14.539727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:14.540353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:14.547873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:14.548377 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:14.548834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:14.549559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:14.550024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:14.550466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:14.685477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:14.693103 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64638e1c-9f34-4952-9634-53c3670ee6d0 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1512 microversion: 2.1 time: 0.157413 Aug 30 05:05:14.693714 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3380/6820] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:14 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:15.715770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:15.716405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:15.722857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:15.723337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:15.723771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:15.724453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:15.724910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:15.725353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:15.853999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:15.863990 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-984de777-27ed-4ff0-a2d3-00085ddd4520 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1509 microversion: 2.1 time: 0.151999 Aug 30 05:05:15.863990 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3441/6821] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:15 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:15.883989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:15.884534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:15.891528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:15.892023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:15.892490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:15.893191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:15.893689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:15.894136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:15.924919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:05:15.974778 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.compute.api [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Found an unconfirmed migration during delete, id: 16, status: finished Aug 30 05:05:17.347836 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8eecdba2-229a-479e-8e87-104a52871697 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 204 len: 0 microversion: 2.1 time: 1.467007 Aug 30 05:05:17.348787 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3381/6822] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:05:15 2022] DELETE /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 0 bytes in 1469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:05:17.356984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:17.357629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:17.364793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:17.365282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:17.365767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:17.366461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:17.366918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:17.367358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:17.496141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:17.503856 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91768fdc-a599-4d5c-a8e2-e6ab19c4f245 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1501 microversion: 2.1 time: 0.150782 Aug 30 05:05:17.504421 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3442/6823] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:17 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:18.526673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:18.527397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:18.534738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:18.535239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:18.535697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:18.536411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:18.536883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:18.537354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:18.681630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5d50fb40fab46d7b63ffbce1b9205dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '609d563beff44f1bbfe02ad91f84cada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:18.689705 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee681d81-0d6b-4bc0-9575-ec19543e69c2 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 200 len: 1501 microversion: 2.1 time: 0.167903 Aug 30 05:05:18.690925 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3382/6824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:18 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:18.763007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8603efa8-3b50-4294-91d5-a3f901d5662c req-f99b4819-1f88-4981-9d4f-47d2f449870b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaee50-584b-4fb6-a614-172ce73ff9b6", "name": "network-vif-plugged", "status": "completed", "tag": "c9b8198a-77b1-45e1-ad4e-daed019d8c63"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:18.773476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8603efa8-3b50-4294-91d5-a3f901d5662c req-f99b4819-1f88-4981-9d4f-47d2f449870b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:18.773974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8603efa8-3b50-4294-91d5-a3f901d5662c req-f99b4819-1f88-4981-9d4f-47d2f449870b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:18.774409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8603efa8-3b50-4294-91d5-a3f901d5662c req-f99b4819-1f88-4981-9d4f-47d2f449870b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:18.787033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8603efa8-3b50-4294-91d5-a3f901d5662c req-f99b4819-1f88-4981-9d4f-47d2f449870b service nova] Creating event network-vif-plugged:c9b8198a-77b1-45e1-ad4e-daed019d8c63 for instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 on n-h1-854925-5 Aug 30 05:05:18.792953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8603efa8-3b50-4294-91d5-a3f901d5662c req-f99b4819-1f88-4981-9d4f-47d2f449870b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033653 Aug 30 05:05:18.793598 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3443/6825] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:19.428003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-013f6976-694e-4388-bf8f-bab941d55aa4 req-bc6cbf0a-63d4-4766-b11d-e0ae2da25d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eaaee50-584b-4fb6-a614-172ce73ff9b6", "name": "network-vif-deleted", "tag": "c9b8198a-77b1-45e1-ad4e-daed019d8c63"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:19.439382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-013f6976-694e-4388-bf8f-bab941d55aa4 req-bc6cbf0a-63d4-4766-b11d-e0ae2da25d6c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:19.439992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-013f6976-694e-4388-bf8f-bab941d55aa4 req-bc6cbf0a-63d4-4766-b11d-e0ae2da25d6c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:19.440504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-013f6976-694e-4388-bf8f-bab941d55aa4 req-bc6cbf0a-63d4-4766-b11d-e0ae2da25d6c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:19.452924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-013f6976-694e-4388-bf8f-bab941d55aa4 req-bc6cbf0a-63d4-4766-b11d-e0ae2da25d6c service nova] Creating event network-vif-deleted:c9b8198a-77b1-45e1-ad4e-daed019d8c63 for instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 on n-h1-854925-5 Aug 30 05:05:19.458985 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-013f6976-694e-4388-bf8f-bab941d55aa4 req-bc6cbf0a-63d4-4766-b11d-e0ae2da25d6c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034872 Aug 30 05:05:19.459885 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3383/6826] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:19.712395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:19.713768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:19.720228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:19.720717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:19.721161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:19.721886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:19.722347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:19.722819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:19.735980 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] HTTP exception thrown: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Request method failure captured: Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 HTTP/1.1 Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZpf4QbtjHwOec9EgFPaQTd44mO4g0WZjwSqxmtuvUoqOIgGYovj6SQl1gzLrHgvsbGzUv8pDnwlixcuE9eyN8duif-2gAEUL5C_qjZK7bhyfyQ18Uo6IQmEUnkfs1ps-6uCJaH6HsjQwIGxcKfXtcgmM2b-X6WaTcVhU4aGp497-gM Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 609d563beff44f1bbfe02ad91f84cada Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_609d563beff44f1bbfe02ad91f84cada", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/609d563beff44f1bbfe02ad91f84cada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/609d563beff44f1bbfe02ad91f84cada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/609d563beff44f1bbfe02ad91f84cada"}]}] Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 609d563beff44f1bbfe02ad91f84cada Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-1988534705-project Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5d50fb40fab46d7b63ffbce1b9205dc Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-1988534705-project Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '3eaaee50-584b-4fb6-a614-172ce73ff9b6'} Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:19.737668 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Returning 404 to user: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-192b54c6-751d-4823-9c1c-27fcd4bb49b7 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 404 len: 111 microversion: 2.1 time: 0.031163 Aug 30 05:05:19.742057 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3444/6827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:19 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:05:19.755716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:19.756316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:19.763052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:19.763547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:19.763997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:19.764694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:19.765161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:19.765633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:19.782005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] HTTP exception thrown: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Request method failure captured: Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 HTTP/1.1 Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZpf4QbtjHwOec9EgFPaQTd44mO4g0WZjwSqxmtuvUoqOIgGYovj6SQl1gzLrHgvsbGzUv8pDnwlixcuE9eyN8duif-2gAEUL5C_qjZK7bhyfyQ18Uo6IQmEUnkfs1ps-6uCJaH6HsjQwIGxcKfXtcgmM2b-X6WaTcVhU4aGp497-gM Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 609d563beff44f1bbfe02ad91f84cada Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_609d563beff44f1bbfe02ad91f84cada", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/609d563beff44f1bbfe02ad91f84cada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/609d563beff44f1bbfe02ad91f84cada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/609d563beff44f1bbfe02ad91f84cada"}]}] Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 609d563beff44f1bbfe02ad91f84cada Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-DeleteServersTestJSON-1988534705-project Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b5d50fb40fab46d7b63ffbce1b9205dc Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-DeleteServersTestJSON-1988534705-project Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '3eaaee50-584b-4fb6-a614-172ce73ff9b6'} Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:05:19.783745 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Returning 404 to user: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-21e7452b-e156-4c2f-8e06-b2aa5c96e070 tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 404 len: 111 microversion: 2.1 time: 0.035326 Aug 30 05:05:19.790879 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3384/6828] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:05:19 2022] DELETE /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:05:19.794893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:19.795511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] [instance: 3eaaee50-584b-4fb6-a614-172ce73ff9b6] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:19.802012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:19.802521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:19.802956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:19.803644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:19.804095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:19.804520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:19.817729 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] HTTP exception thrown: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Request method failure captured: Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 HTTP/1.1 Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZpf4QbtjHwOec9EgFPaQTd44mO4g0WZjwSqxmtuvUoqOIgGYovj6SQl1gzLrHgvsbGzUv8pDnwlixcuE9eyN8duif-2gAEUL5C_qjZK7bhyfyQ18Uo6IQmEUnkfs1ps-6uCJaH6HsjQwIGxcKfXtcgmM2b-X6WaTcVhU4aGp497-gM Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 609d563beff44f1bbfe02ad91f84cada Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_609d563beff44f1bbfe02ad91f84cada", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/609d563beff44f1bbfe02ad91f84cada"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/609d563beff44f1bbfe02ad91f84cada"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/609d563beff44f1bbfe02ad91f84cada"}]}] Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 609d563beff44f1bbfe02ad91f84cada Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-DeleteServersTestJSON-1988534705 Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-DeleteServersTestJSON-1988534705-project Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b5d50fb40fab46d7b63ffbce1b9205dc Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-DeleteServersTestJSON-1988534705-project Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '3eaaee50-584b-4fb6-a614-172ce73ff9b6'} Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:05:19.819263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] Returning 404 to user: Instance 3eaaee50-584b-4fb6-a614-172ce73ff9b6 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a2778290-0063-4272-8e15-97da8f8ec9ae tempest-DeleteServersTestJSON-1988534705 tempest-DeleteServersTestJSON-1988534705-project] 10.222.0.27 "GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6" status: 404 len: 111 microversion: 2.1 time: 0.029973 Aug 30 05:05:19.824036 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3445/6829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:19 2022] GET /compute/v2.1/servers/3eaaee50-584b-4fb6-a614-172ce73ff9b6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:05:28.512336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1065154046", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "13c746be-0a4f-481c-a1f8-600e00f11e66"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:28.569974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] validate_networks() for [('13c746be-0a4f-481c-a1f8-600e00f11e66', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:05:29.028129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:05:29.028563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:05:29.029049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:05:29.029498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:05:29.029920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:05:29.038859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:29.039348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:29.039793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:29.040527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:29.040987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:29.041463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:29.059323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Getting quotas for project a7426b8bc3874581a547b50dfc740095. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:05:29.064532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Getting quotas for user b075fbcd6ab046c8b18aae38c063d788 and project a7426b8bc3874581a547b50dfc740095. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:05:29.077190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:05:29.079535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:05:29.128982 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6813b542-6794-469d-b68f-aebe96298c27 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743452 Aug 30 05:05:29.135990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3385/6830] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:05:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:05:29.141479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-43770d48-ba39-44c7-8d35-0be4f7bf892b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:29.142263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-43770d48-ba39-44c7-8d35-0be4f7bf892b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:29.196540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43770d48-ba39-44c7-8d35-0be4f7bf892b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:29.205611 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-43770d48-ba39-44c7-8d35-0be4f7bf892b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1218 microversion: 2.1 time: 0.068027 Aug 30 05:05:29.206195 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3446/6831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:29 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:30.228530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:30.229788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:30.237699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:30.238867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:30.239708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:30.241214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:30.241862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:30.242458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:30.327392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:30.339386 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f08d6536-1815-44d7-99e3-1af755b84030 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1278 microversion: 2.1 time: 0.116383 Aug 30 05:05:30.340618 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3386/6832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:30 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:31.361698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:31.362334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:31.364514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=33 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:31.372217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:31.372712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:31.373153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:31.374619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:31.375054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:31.375494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:31.533181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:31.546539 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d854279b-e111-458c-b201-68f3b4323517 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.188736 Aug 30 05:05:31.547166 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3447/6833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:31 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:31.632366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e6e9f102-fbb9-45f7-8e36-6266def79e26 req-64d47ba2-1847-4baf-8627-4dfc01532b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e8d264-d07d-4d49-a148-479d4c787f55", "tag": "79327bbc-9972-4545-a182-46346f364f7f"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:31.646861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e6e9f102-fbb9-45f7-8e36-6266def79e26 req-64d47ba2-1847-4baf-8627-4dfc01532b49 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:31.647363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e6e9f102-fbb9-45f7-8e36-6266def79e26 req-64d47ba2-1847-4baf-8627-4dfc01532b49 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:31.647811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e6e9f102-fbb9-45f7-8e36-6266def79e26 req-64d47ba2-1847-4baf-8627-4dfc01532b49 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:31.660716 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e6e9f102-fbb9-45f7-8e36-6266def79e26 req-64d47ba2-1847-4baf-8627-4dfc01532b49 service nova] Creating event network-changed:79327bbc-9972-4545-a182-46346f364f7f for instance 30e8d264-d07d-4d49-a148-479d4c787f55 on n-h1-854925-5 Aug 30 05:05:31.668599 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e6e9f102-fbb9-45f7-8e36-6266def79e26 req-64d47ba2-1847-4baf-8627-4dfc01532b49 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047544 Aug 30 05:05:31.669298 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3387/6834] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:32.568304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:32.568856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:32.576397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:32.576891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:32.577343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:32.578059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:32.578522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:32.578986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:32.707506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:32.716375 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6561c262-730b-464c-a37a-83486636f1ed tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.152158 Aug 30 05:05:32.716961 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3448/6835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:32 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:33.738462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:33.739412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:33.746478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:33.746973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:33.747428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:33.748226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:33.748895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:33.749245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:33.887734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:33.895551 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-679c8b2b-5403-4ea9-b20b-5c8b4bffaf55 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.162338 Aug 30 05:05:33.896129 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3388/6836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:33 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:34.916191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:34.916817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:34.923926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:34.924929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:34.925085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:34.925693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:34.926163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:34.926598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:35.057597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:35.066891 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41936768-1827-46e6-ab96-7378ca58d387 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.154702 Aug 30 05:05:35.067469 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3449/6837] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:34 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:36.091474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:36.092033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:36.099232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:36.099729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:36.100188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:36.100893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:36.101386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:36.101834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:36.233617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:36.241445 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-67c91b6b-0fec-4b08-8f90-7f711d59730c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.153961 Aug 30 05:05:36.242017 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3389/6838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:36 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:37.262471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:37.263097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:37.269850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:37.270338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:37.270782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:37.271478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:37.271936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:37.272379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:37.404314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:37.412396 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a7446d21-2438-41b4-b474-930c145200f1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.154196 Aug 30 05:05:37.412988 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3450/6839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:37 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:38.432950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:38.433599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:38.440470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:38.440964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:38.441450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:38.442152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:38.442618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:38.443084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:38.570003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:38.578210 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c5f4747-d852-4953-9334-8d462b87edb9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.149254 Aug 30 05:05:38.578776 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3390/6840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:38 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:38.846199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-1c137840-92be-4a48-9500-b16fe99ec8b5 req-6c647955-d229-431a-9e12-0414fe975436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e8d264-d07d-4d49-a148-479d4c787f55", "name": "network-vif-plugged", "status": "completed", "tag": "79327bbc-9972-4545-a182-46346f364f7f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:38.857599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c137840-92be-4a48-9500-b16fe99ec8b5 req-6c647955-d229-431a-9e12-0414fe975436 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:38.858313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c137840-92be-4a48-9500-b16fe99ec8b5 req-6c647955-d229-431a-9e12-0414fe975436 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:38.858759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-1c137840-92be-4a48-9500-b16fe99ec8b5 req-6c647955-d229-431a-9e12-0414fe975436 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:38.872599 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-1c137840-92be-4a48-9500-b16fe99ec8b5 req-6c647955-d229-431a-9e12-0414fe975436 service nova] Creating event network-vif-plugged:79327bbc-9972-4545-a182-46346f364f7f for instance 30e8d264-d07d-4d49-a148-479d4c787f55 on n-h1-854925-5 Aug 30 05:05:38.878373 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-1c137840-92be-4a48-9500-b16fe99ec8b5 req-6c647955-d229-431a-9e12-0414fe975436 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035761 Aug 30 05:05:38.879505 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3451/6841] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:05:39.600342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:39.600990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:39.604715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:39.605648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:39.612550 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:39.613060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:39.613547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:39.614272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:39.614746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:39.615195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:39.765802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:39.773770 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-770d36c8-f9b2-470d-9012-c0ea1f772b48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1318 microversion: 2.1 time: 0.177475 Aug 30 05:05:39.774621 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3391/6842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:39 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:40.792002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:40.797194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:40.797942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:40.804593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:40.805101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:40.805580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:40.806266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:40.806722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:40.807170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:40.938488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:40.946425 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f021c5b5-6dca-4fbf-a79f-8357e24cb4fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1509 microversion: 2.1 time: 0.155965 Aug 30 05:05:40.946995 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3452/6843] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:40 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:40.967297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:40.967934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:40.975073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:40.975572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:40.976034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:40.976796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:40.977208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:40.978279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.110861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:41.118653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-339f7883-20e7-45c6-885f-3c877d207d51 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1509 microversion: 2.1 time: 0.155400 Aug 30 05:05:41.119221 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3392/6844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:40 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:41.140302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:41.143372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:41.145290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=32 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:41.151353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.151888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.152339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.153052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.153557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.153995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.220708 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a38c89e2-e399-44f1-874c-105656f01552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "PUT /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1081 microversion: 2.1 time: 0.085921 Aug 30 05:05:41.221581 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3453/6845] 10.222.0.27 () {60 vars in 1256 bytes} [Tue Aug 30 05:05:41 2022] PUT /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1081 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:41.238074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:41.238626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:41.244641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.245140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.245624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.246333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.246804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.247251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.374023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:41.382084 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4386e4a1-ead8-4d82-8694-9ae28a27d1b6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1507 microversion: 2.1 time: 0.147933 Aug 30 05:05:41.382659 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3393/6846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:41 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:41.402255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:41.402890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:41.409023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.409560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.410010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.410707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.411168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.411603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.543581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:41.551282 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c391a9f-204a-4520-b3a1-b9afe212d0d5 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1507 microversion: 2.1 time: 0.153017 Aug 30 05:05:41.551865 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3454/6847] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:41 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:41.571888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:05:41.574241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:41.576117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:41.581581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.582085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.582541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.583248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.583719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.584167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.589063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:05:41.615165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:41.621776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Old instance type m1.heat2, new instance type m1.heat {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:05:41.628344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:05:41.628803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:05:41.629287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:05:41.629734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:05:41.630179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:05:41.691432 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ede0617-f0a9-4dc1-b13c-e0e4db738bf9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "POST /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55/action" status: 202 len: 0 microversion: 2.1 time: 0.124022 Aug 30 05:05:41.692214 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3394/6848] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:05:41 2022] POST /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:05:41.700608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:41.701224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:41.707867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.708475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.709030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.709873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:41.710369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:41.710808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:41.841662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:41.849953 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7aaf10a9-fabe-4132-873c-95851d292444 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1518 microversion: 2.1 time: 0.153735 Aug 30 05:05:41.850567 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3455/6849] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:41 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:42.872275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:42.873059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:42.879359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:42.879923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:42.880424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:42.881165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:42.881679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:42.882238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:43.014749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:43.022515 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2be6d87-0a1d-4aac-8e9e-8c22de286297 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1518 microversion: 2.1 time: 0.155171 Aug 30 05:05:43.023287 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3395/6850] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:42 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:44.044656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:44.045393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:44.052369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:44.052862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:44.053307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:44.054034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:44.054497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:44.054935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:44.192674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:44.200652 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9afb313b-67d2-4158-a328-22eddc68bded tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.160542 Aug 30 05:05:44.201231 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3456/6851] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:44 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:05:45.222201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:45.222804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:45.229751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:45.230252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:45.230711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:45.231422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:45.231903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:45.232354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:45.358062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:45.365904 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f4269f0-8824-47ef-8310-edb0084af537 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.148026 Aug 30 05:05:45.366484 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3396/6852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:45 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:46.390944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:46.391566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:46.398653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:46.399144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:46.400214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:46.400907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:46.401459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:46.401892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:46.535983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:46.543734 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-627ee5db-4797-4cb9-a79f-bcfc9d1ca1fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.156758 Aug 30 05:05:46.544303 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3457/6853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:46 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:47.564494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:47.565276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:47.572249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:47.572747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:47.573203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:47.573942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:47.574417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:47.574863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:47.706398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:47.714925 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d4f92ce4-06da-41d9-a4e1-0446568544b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.154358 Aug 30 05:05:47.715508 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3397/6854] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:47 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:48.736124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:48.736738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:48.743748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:48.744233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:48.744665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:48.745372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:48.745830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:48.746262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:48.875150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:48.883442 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad72432c-6812-447d-83a9-585bdf9e2dc6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.151292 Aug 30 05:05:48.884774 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3458/6855] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:48 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:49.905486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:49.906186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:49.913184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:49.913720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:49.914256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:49.915913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:49.916387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:49.916834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:50.047537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:50.055283 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e488569f-22e9-4d15-9e60-9337c0e1b004 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.153799 Aug 30 05:05:50.055865 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3398/6856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:49 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:51.079798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:51.080415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:51.087200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:51.087691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:51.088141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:51.088838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:51.089299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:51.089758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:51.224299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:51.232001 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d44afa32-0f02-4ab6-8301-3b1835989fbc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.156242 Aug 30 05:05:51.232573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3459/6857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:51 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:05:52.253242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:52.253891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:52.261418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:52.261915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:52.262365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:52.263060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:52.263524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:52.263963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:52.396235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:52.404529 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0000dff-6a46-43bb-a584-bccd91d2d871 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.155186 Aug 30 05:05:52.405109 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3399/6858] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:52 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:53.425880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:53.426533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:53.433443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:53.433929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:53.434369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:53.435057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:53.435507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:53.435930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:53.574863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:53.582602 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-282a1b84-c7c1-4d6f-986a-b0ac620afc4b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.160653 Aug 30 05:05:53.583177 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3460/6859] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:53 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:54.604673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:54.605346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:54.612215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:54.612707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:54.613160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:54.613888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:54.614373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:54.614808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:54.747297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:54.755391 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ad652ed1-6826-46d9-b060-c8f15d1b337a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.155061 Aug 30 05:05:54.756046 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3400/6860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:54 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:55.777010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:55.777716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:55.784905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:55.785408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:55.785847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:55.786534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:55.786985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:55.787410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:55.916538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:55.924363 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-78a6833d-d48b-4ba4-8615-397c31e414b2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.151871 Aug 30 05:05:55.924926 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3461/6861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:55 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:56.945095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:56.945756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:56.952698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:56.953194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:56.953680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:56.954382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:56.954856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:56.955304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:57.082797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:57.090580 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8e696e6-9953-4979-8f3e-ee77057159ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.149451 Aug 30 05:05:57.091155 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3401/6862] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:56 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:58.112314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:58.112940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:58.120497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:58.120986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:58.121459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:58.122160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:58.122622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:58.123057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:58.256246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:58.264022 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47eef668-8767-4ed6-9f6d-d0fc8d4e17d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.155737 Aug 30 05:05:58.264587 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3462/6863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:58 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:05:59.284508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:05:59.285081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:05:59.292613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:59.293116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:59.293599 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:59.294311 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:05:59.294783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:05:59.295231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:05:59.425519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:05:59.433687 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5813863e-b3fd-4d29-aa31-dd83f57d4589 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.153127 Aug 30 05:05:59.434275 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3402/6864] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:05:59 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:00.454879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:00.455506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:00.462574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:00.463064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:00.463532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:00.464230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:00.464692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:00.465123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:00.487130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:00.603394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:00.611118 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ee4ce262-b233-4585-bed5-94d3f416b9bd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.160196 Aug 30 05:06:00.611694 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3463/6865] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:00 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:01.631654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:01.632282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:01.640059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:01.640552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:01.641010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:01.641737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:01.642204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:01.642645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:01.772860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:01.780640 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dd552df4-3ced-456b-a00e-d71a48bc5124 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.152969 Aug 30 05:06:01.781229 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3403/6866] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:01 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:02.801575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:02.802219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:02.809714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:02.810195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:02.810630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:02.811323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:02.811773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:02.812200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:02.945343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:02.953205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fda5c5fd-96b1-4e4b-aa5e-ae62f3932a0a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.155613 Aug 30 05:06:02.953806 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3464/6867] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:02 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:03.974814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:03.975361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:03.981525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:03.982029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:03.982489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:03.983197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:03.983669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:03.984117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:04.114344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:04.122669 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6c5751df-db2a-4509-bf18-5e4de95d30f0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.152296 Aug 30 05:06:04.123241 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3404/6868] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:03 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:05.144214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:05.144866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:05.152386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:05.152874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:05.153316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:05.154034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:05.154489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:05.154920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:05.288688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:05.296717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41225042-7065-425a-a853-ae388c04ffdb tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.156497 Aug 30 05:06:05.297296 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3465/6869] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:05 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:06.317809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:06.318435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:06.325876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:06.326372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:06.326821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:06.327523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:06.327984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:06.328424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:06.458697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:06.466459 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f7a8e94b-6b06-4ab2-9dc8-02f81020b3fa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.152593 Aug 30 05:06:06.467046 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3405/6870] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:06 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:07.487518 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:07.488130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:07.494742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:07.495222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:07.495655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:07.496343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:07.496792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:07.497223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:07.626283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:07.634525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-59053be4-889c-4a5e-99d8-7cbb37d0d6d9 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.150560 Aug 30 05:06:07.635102 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3466/6871] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:07 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:08.655649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:08.656281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:08.663264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:08.663763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:08.664218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:08.665582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:08.666053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:08.666498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:08.797043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:08.804939 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03b8d118-d57a-4eca-80b1-02d5e3c186fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.153233 Aug 30 05:06:08.805563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3406/6872] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:08 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:06:09.827108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:09.827686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:09.834557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:09.835039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:09.835476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:09.836174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:09.836665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:09.837096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:09.965905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:09.973972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-348c3c51-ac1a-46f9-9ea8-e4a5fa5123ab tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1523 microversion: 2.1 time: 0.150910 Aug 30 05:06:09.974547 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3467/6873] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:09 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:10.995453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:10.996235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:11.003240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:11.003835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:11.004357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:11.005509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:11.005629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:11.006055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:11.240394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:11.248511 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f5ef27c9-6ce6-4972-9e4e-adb1e273650c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1522 microversion: 2.1 time: 0.257627 Aug 30 05:06:11.249475 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3407/6874] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:10 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:11.336536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bb307672-d112-4be5-8368-884c50193453 req-cbff36cf-cd10-406e-9d1b-e40a8b38b7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e8d264-d07d-4d49-a148-479d4c787f55", "name": "network-vif-unplugged", "status": "completed", "tag": "79327bbc-9972-4545-a182-46346f364f7f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:11.342211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=30 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:11.349597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb307672-d112-4be5-8368-884c50193453 req-cbff36cf-cd10-406e-9d1b-e40a8b38b7c0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:11.350083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb307672-d112-4be5-8368-884c50193453 req-cbff36cf-cd10-406e-9d1b-e40a8b38b7c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:11.350515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb307672-d112-4be5-8368-884c50193453 req-cbff36cf-cd10-406e-9d1b-e40a8b38b7c0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:11.362448 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bb307672-d112-4be5-8368-884c50193453 req-cbff36cf-cd10-406e-9d1b-e40a8b38b7c0 service nova] Creating event network-vif-unplugged:79327bbc-9972-4545-a182-46346f364f7f for instance 30e8d264-d07d-4d49-a148-479d4c787f55 on n-h2-854925-5 Aug 30 05:06:11.368784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-bb307672-d112-4be5-8368-884c50193453 req-cbff36cf-cd10-406e-9d1b-e40a8b38b7c0 service nova] Instance 30e8d264-d07d-4d49-a148-479d4c787f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:06:11.380100 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bb307672-d112-4be5-8368-884c50193453 req-cbff36cf-cd10-406e-9d1b-e40a8b38b7c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047418 Aug 30 05:06:11.380725 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3468/6875] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:12.270535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:12.271160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:12.273998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=32 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:12.279763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:12.280259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:12.280711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:12.281429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:12.281897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:12.282338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:12.286397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:12.415700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:12.423446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8f4b367a-787d-4eb4-bb32-ac831fa9a518 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1520 microversion: 2.1 time: 0.156793 Aug 30 05:06:12.424028 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3408/6876] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:12 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:13.409423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bf23f321-7cd8-4a22-9bba-a76c3a647f16 req-61cd8319-8580-4cd7-8747-309c497ca129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30e8d264-d07d-4d49-a148-479d4c787f55", "tag": "79327bbc-9972-4545-a182-46346f364f7f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:13.419583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bf23f321-7cd8-4a22-9bba-a76c3a647f16 req-61cd8319-8580-4cd7-8747-309c497ca129 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:13.420070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bf23f321-7cd8-4a22-9bba-a76c3a647f16 req-61cd8319-8580-4cd7-8747-309c497ca129 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:13.420514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bf23f321-7cd8-4a22-9bba-a76c3a647f16 req-61cd8319-8580-4cd7-8747-309c497ca129 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:13.432963 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bf23f321-7cd8-4a22-9bba-a76c3a647f16 req-61cd8319-8580-4cd7-8747-309c497ca129 service nova] Creating event network-changed:79327bbc-9972-4545-a182-46346f364f7f for instance 30e8d264-d07d-4d49-a148-479d4c787f55 on n-h2-854925-5 Aug 30 05:06:13.439846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-bf23f321-7cd8-4a22-9bba-a76c3a647f16 req-61cd8319-8580-4cd7-8747-309c497ca129 service nova] Instance 30e8d264-d07d-4d49-a148-479d4c787f55 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:06:13.443760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:13.445114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:13.452616 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bf23f321-7cd8-4a22-9bba-a76c3a647f16 req-61cd8319-8580-4cd7-8747-309c497ca129 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048260 Aug 30 05:06:13.453250 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3469/6877] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:06:13.457030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:13.457583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:13.458040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:13.458765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:13.459234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:13.459678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:13.682995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:13.691128 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6a7360da-a61b-4e72-b7ae-2f1fa369467f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1520 microversion: 2.1 time: 0.251390 Aug 30 05:06:13.691716 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3409/6878] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:13 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:14.714174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:14.714822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:14.721404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:14.721890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:14.722333 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:14.723023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:14.723479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:14.723911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:14.854011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:14.862146 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3457556f-d302-42e9-bf35-3417544534f7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1517 microversion: 2.1 time: 0.153778 Aug 30 05:06:14.862735 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3470/6879] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:14 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:14.883971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:14.884728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:14.892244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:14.892758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:14.893217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:14.893965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:14.894435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:14.894888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:14.962928 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8582a4c9-c53a-45ae-8186-e17bc4a7a3e1 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "POST /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55/action" status: 204 len: 0 microversion: 2.1 time: 0.082425 Aug 30 05:06:14.963615 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3410/6880] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:06:14 2022] POST /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:06:14.975044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:14.975897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:14.983808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:14.984434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:14.984885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:14.985633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:14.986092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:14.986581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:15.454561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:15.462636 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-be5b0aa5-3f3a-4b37-ba0e-a2e22fb52d32 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1517 microversion: 2.1 time: 0.492447 Aug 30 05:06:15.463219 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3471/6881] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:14 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1517 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:16.485421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:16.486456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:16.494403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:16.494853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:16.495313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:16.496063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:16.496556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:16.497011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:16.630228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:16.639461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-4687a86f-ec65-41f2-b912-24d24f545b9e req-c0f8ae7b-d9d4-4187-8cb0-7c649017989d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e8d264-d07d-4d49-a148-479d4c787f55", "name": "network-vif-plugged", "status": "completed", "tag": "79327bbc-9972-4545-a182-46346f364f7f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:16.642844 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f5687789-291b-4f3a-a98e-86c31921c84c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1509 microversion: 2.1 time: 0.162234 Aug 30 05:06:16.643438 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3411/6882] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:16 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:16.651320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4687a86f-ec65-41f2-b912-24d24f545b9e req-c0f8ae7b-d9d4-4187-8cb0-7c649017989d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:16.651811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4687a86f-ec65-41f2-b912-24d24f545b9e req-c0f8ae7b-d9d4-4187-8cb0-7c649017989d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:16.652255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-4687a86f-ec65-41f2-b912-24d24f545b9e req-c0f8ae7b-d9d4-4187-8cb0-7c649017989d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:16.664972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-4687a86f-ec65-41f2-b912-24d24f545b9e req-c0f8ae7b-d9d4-4187-8cb0-7c649017989d service nova] Creating event network-vif-plugged:79327bbc-9972-4545-a182-46346f364f7f for instance 30e8d264-d07d-4d49-a148-479d4c787f55 on n-h2-854925-5 Aug 30 05:06:16.666406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:16.667045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:16.670073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-4687a86f-ec65-41f2-b912-24d24f545b9e req-c0f8ae7b-d9d4-4187-8cb0-7c649017989d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038348 Aug 30 05:06:16.670712 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3472/6883] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:16.674517 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:16.675029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:16.675488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:16.676209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:16.676681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:16.677128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:16.810102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:16.817924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a21e1c9d-4314-49a4-94f6-01b39c349e8b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1509 microversion: 2.1 time: 0.155993 Aug 30 05:06:16.818508 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3412/6884] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:16 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:06:16.841926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e2f8798f-b673-45f9-a2b8-aee58ab5f2ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'create', calling method: .version_select at 0x7fe9691d2310>, body: {"keypair": {"name": "tempest-keypair-768726453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMb47IcWDlF2gq4i4mxU6qnXvI/u/NLcMxONpgq5XMI3di6T1ynDlYGjKKL9wr7B9kdOtpU5MODSdb5T9dk6wn4RaI6YWKwvknUsciYnQ5CD6srt+UKamnPEqB9DQ/u3Og=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:16.858316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e2f8798f-b673-45f9-a2b8-aee58ab5f2ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Getting quotas for project a7426b8bc3874581a547b50dfc740095. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:06:16.863409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e2f8798f-b673-45f9-a2b8-aee58ab5f2ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Getting quotas for user b075fbcd6ab046c8b18aae38c063d788 and project a7426b8bc3874581a547b50dfc740095. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:06:16.890382 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e2f8798f-b673-45f9-a2b8-aee58ab5f2ce tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052708 Aug 30 05:06:16.890996 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3473/6885] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:06:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:06:18.069916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:18.070559 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:18.077576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:18.078079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:18.078571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:18.079280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:18.079835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:18.080284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:18.207354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:18.215636 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0ba2be7f-656d-444a-8c99-1f87b73f5552 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 200 len: 1509 microversion: 2.1 time: 0.149674 Aug 30 05:06:18.216212 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3413/6886] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:18 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:18.237591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:18.238238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:18.245404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:18.245888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:18.246328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:18.247011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:18.247459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:18.247880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:18.272643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:06:18.351783 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d06a6a79-76e5-4981-b0e1-71a0c09b13ec tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "DELETE /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 204 len: 0 microversion: 2.1 time: 0.118626 Aug 30 05:06:18.353046 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3474/6887] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:06:18 2022] DELETE /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:06:18.406297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1348116571", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "13c746be-0a4f-481c-a1f8-600e00f11e66"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:18.459238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] validate_networks() for [('13c746be-0a4f-481c-a1f8-600e00f11e66', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:06:18.825848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:06:18.826312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:06:18.826806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:06:18.827258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:06:18.827690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:06:18.836781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:18.837285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:18.837772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:18.838521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:18.838992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:18.839439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:18.856387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Getting quotas for project a7426b8bc3874581a547b50dfc740095. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:06:18.861714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Getting quotas for user b075fbcd6ab046c8b18aae38c063d788 and project a7426b8bc3874581a547b50dfc740095. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:06:18.874337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:06:18.876712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:06:18.922469 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c85e29fd-8d5b-4ed8-aebe-c4c711315516 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.520065 Aug 30 05:06:18.923352 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3414/6888] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:06:18.935039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dad7ebf5-6ce5-41fc-8ccc-91e3caeff964 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:18.935749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dad7ebf5-6ce5-41fc-8ccc-91e3caeff964 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:19.068750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dad7ebf5-6ce5-41fc-8ccc-91e3caeff964 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:19.075895 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dad7ebf5-6ce5-41fc-8ccc-91e3caeff964 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1218 microversion: 2.1 time: 0.145630 Aug 30 05:06:19.076476 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3475/6889] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:18 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:20.097351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:20.098740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:20.108171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:20.108683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:20.109356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:20.110324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:20.110799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:20.111252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:20.190155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:20.208088 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3ab31502-d0e4-48d1-86ed-9c5cb28c704b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1270 microversion: 2.1 time: 0.115772 Aug 30 05:06:20.208681 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3415/6890] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:20 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:20.247565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d8e12580-d600-416c-b1f2-bc292968c7d8 req-b78c2f56-a791-43e8-a3a4-06c1df60cb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30e8d264-d07d-4d49-a148-479d4c787f55", "name": "network-vif-deleted", "tag": "79327bbc-9972-4545-a182-46346f364f7f"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:20.266502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d8e12580-d600-416c-b1f2-bc292968c7d8 req-b78c2f56-a791-43e8-a3a4-06c1df60cb0d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:20.267010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d8e12580-d600-416c-b1f2-bc292968c7d8 req-b78c2f56-a791-43e8-a3a4-06c1df60cb0d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:20.267457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d8e12580-d600-416c-b1f2-bc292968c7d8 req-b78c2f56-a791-43e8-a3a4-06c1df60cb0d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:20.279740 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d8e12580-d600-416c-b1f2-bc292968c7d8 req-b78c2f56-a791-43e8-a3a4-06c1df60cb0d service nova] Creating event network-vif-deleted:79327bbc-9972-4545-a182-46346f364f7f for instance 30e8d264-d07d-4d49-a148-479d4c787f55 on n-h2-854925-5 Aug 30 05:06:20.286311 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d8e12580-d600-416c-b1f2-bc292968c7d8 req-b78c2f56-a791-43e8-a3a4-06c1df60cb0d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042668 Aug 30 05:06:20.287256 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3476/6891] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:21.229314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:21.230656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:21.237762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:21.238258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:21.238708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:21.239419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:21.239945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:21.240387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:21.379317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:21.387382 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e52c2d5e-dbaa-4cf3-acf7-63bd0794507d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1318 microversion: 2.1 time: 0.162642 Aug 30 05:06:21.388056 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3416/6892] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:21 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:21.549434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-843c890c-068a-40bd-ae98-6cf249895540 req-52ca3c25-52ab-4aec-b7da-15ad2c6fee70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c9c118-29ac-40e2-b289-c3859108e357", "tag": "ed621073-22ef-4ed8-a9db-32603912e122"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:21.560143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-843c890c-068a-40bd-ae98-6cf249895540 req-52ca3c25-52ab-4aec-b7da-15ad2c6fee70 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:21.560546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-843c890c-068a-40bd-ae98-6cf249895540 req-52ca3c25-52ab-4aec-b7da-15ad2c6fee70 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:21.560977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-843c890c-068a-40bd-ae98-6cf249895540 req-52ca3c25-52ab-4aec-b7da-15ad2c6fee70 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:21.573313 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-843c890c-068a-40bd-ae98-6cf249895540 req-52ca3c25-52ab-4aec-b7da-15ad2c6fee70 service nova] Creating event network-changed:ed621073-22ef-4ed8-a9db-32603912e122 for instance 01c9c118-29ac-40e2-b289-c3859108e357 on n-h2-854925-5 Aug 30 05:06:21.578068 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-843c890c-068a-40bd-ae98-6cf249895540 req-52ca3c25-52ab-4aec-b7da-15ad2c6fee70 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033719 Aug 30 05:06:21.578676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3477/6893] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:22.408617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:22.409244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:22.416138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:22.416631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:22.417181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:22.418080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:22.418655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:22.419198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:22.586047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:22.593677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f57b806c-0ce1-4ae5-a2f2-9c2bb1168a48 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1318 microversion: 2.1 time: 0.188942 Aug 30 05:06:22.594515 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3417/6894] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:22 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:23.615360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:23.616085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:23.622953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:23.623444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:23.623886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:23.624583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:23.625044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:23.625505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:23.862857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:23.871937 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-943e9c84-538a-4115-9b78-a72335448abd tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1318 microversion: 2.1 time: 0.261650 Aug 30 05:06:23.872461 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3478/6895] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:23 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:24.892419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:24.893044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:24.900597 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:24.901134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:24.901604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:24.902328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:24.902890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:24.903340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:25.115947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:25.123686 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3517c97-5c77-4976-ab6d-4102569d9c9e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1318 microversion: 2.1 time: 0.235278 Aug 30 05:06:25.124260 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3418/6896] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:24 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:06:26.144541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:26.145221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:26.152187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:26.152671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:26.153116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:26.153831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:26.154290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:26.154722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:26.282243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:26.290373 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7cc4751e-aa7b-4fe4-a977-3f96b7ce9d1a tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1318 microversion: 2.1 time: 0.149859 Aug 30 05:06:26.290945 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3479/6897] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:26 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:26.656308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d1d47602-864c-4f3a-82bc-43402fb9cd62 req-be41b320-da68-4af0-a0a8-b145d24bd2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c9c118-29ac-40e2-b289-c3859108e357", "name": "network-vif-plugged", "status": "completed", "tag": "ed621073-22ef-4ed8-a9db-32603912e122"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:26.669728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d1d47602-864c-4f3a-82bc-43402fb9cd62 req-be41b320-da68-4af0-a0a8-b145d24bd2c2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:26.670396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d1d47602-864c-4f3a-82bc-43402fb9cd62 req-be41b320-da68-4af0-a0a8-b145d24bd2c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:26.670849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d1d47602-864c-4f3a-82bc-43402fb9cd62 req-be41b320-da68-4af0-a0a8-b145d24bd2c2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:26.684291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d1d47602-864c-4f3a-82bc-43402fb9cd62 req-be41b320-da68-4af0-a0a8-b145d24bd2c2 service nova] Creating event network-vif-plugged:ed621073-22ef-4ed8-a9db-32603912e122 for instance 01c9c118-29ac-40e2-b289-c3859108e357 on n-h2-854925-5 Aug 30 05:06:26.689544 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d1d47602-864c-4f3a-82bc-43402fb9cd62 req-be41b320-da68-4af0-a0a8-b145d24bd2c2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036949 Aug 30 05:06:26.690180 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3419/6898] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:27.311329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:27.311955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:27.318912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:27.319403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:27.319843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:27.321102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:27.321594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:27.322028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:27.455413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:27.463134 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb61e8dd-e6f3-4f89-96ad-e9f883b6913b tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1318 microversion: 2.1 time: 0.155744 Aug 30 05:06:27.463703 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3480/6899] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:27 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:28.485235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:28.485972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:28.492134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.492723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.493155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:28.493876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.494342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.494779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:28.621783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:28.629648 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8cf3ef6d-8079-438f-a69a-423994ea9b61 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1508 microversion: 2.1 time: 0.149544 Aug 30 05:06:28.630242 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3420/6900] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:28 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:28.650155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:28.650770 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:28.657596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.658077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.658517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:28.659204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.659660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.660084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:28.790041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:28.797946 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dd1628f9-8b0e-401d-b54c-1fae8fbf0750 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1508 microversion: 2.1 time: 0.151688 Aug 30 05:06:28.798525 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3481/6901] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:28 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:28.818497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:28.821569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:28.827551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.828042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.828495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:28.829190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.829685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.830128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:28.849687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:28.858844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:28.864568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Old instance type m1.heat2, new instance type m1.heat {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:06:28.869776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:28.872128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:06:28.872560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:06:28.873043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:06:28.873497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:06:28.873922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:06:28.937213 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b60519e6-c929-4994-bc2f-dd6ae0cd475d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "POST /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357/action" status: 202 len: 0 microversion: 2.1 time: 0.122701 Aug 30 05:06:28.937862 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3421/6902] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:06:28 2022] POST /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:06:28.946463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:28.947083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:28.953295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.954238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.954238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:28.954927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:28.955379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:28.955813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:29.076111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:29.094020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:29.102869 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b1c8862-7ad1-4e88-921a-b1cc2c72bbe6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1515 microversion: 2.1 time: 0.160815 Aug 30 05:06:29.103465 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3482/6903] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:28 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:30.125651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:30.126416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:30.134077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:30.134722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:30.135192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:30.135924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:30.136790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:30.136903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:30.277537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:30.285861 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3cee9763-0e26-4cba-afc3-72fb8a9ed572 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1515 microversion: 2.1 time: 0.165098 Aug 30 05:06:30.286448 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3422/6904] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:30 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:06:31.308673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:31.309314 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:31.316054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:31.316534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:31.316967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:31.317681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:31.318139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:31.318560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:31.322436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:31.449556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:31.457187 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c3402f8e-88d4-4188-afc9-0173b33fde9d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.153068 Aug 30 05:06:31.457792 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3483/6905] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:31 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:32.478537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:32.479163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:32.486148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:32.486640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:32.487091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:32.487786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:32.488252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:32.488693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:32.510602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:32.622586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:32.630313 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-908912e6-a673-4ee6-84d4-2c4992e9e41e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.155771 Aug 30 05:06:32.630886 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3423/6906] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:32 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:33.652233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:33.652903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:33.660132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:33.660618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:33.661064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:33.661799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:33.662262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:33.662695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:33.796860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:33.805217 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26a9d999-5ea1-4bf7-9aed-8fa5883fbf56 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.156996 Aug 30 05:06:33.805873 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3484/6907] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:33 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:34.826565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:34.827105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:34.833259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:34.833787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:34.834242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:34.834946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:34.835414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:34.836360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:34.969444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:34.977182 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6fcf9fe3-5581-45f8-9377-3036676cb91c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.154930 Aug 30 05:06:34.977804 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3424/6908] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:34 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:35.997536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:35.998088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:36.004751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:36.005230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:36.005695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:36.006383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:36.006837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:36.007262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:36.144278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:36.152095 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8720c7d8-70dc-4c1e-8d8f-2b210dcc8860 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.158541 Aug 30 05:06:36.152665 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3485/6909] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:35 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:37.173920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:37.174476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:37.181721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:37.182230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:37.182692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:37.183408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:37.183883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:37.184332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:37.312146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:37.320041 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-77df1937-7d5d-40aa-b59d-6ad06ecbddbf tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.150864 Aug 30 05:06:37.321144 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3425/6910] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:37 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:38.342164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:38.342820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:38.350204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:38.350690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:38.351132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:38.352523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:38.352982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:38.353443 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:38.481366 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:38.489073 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a7ad274-a340-473f-b0ad-60fd6c9349e0 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.150870 Aug 30 05:06:38.489695 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3486/6911] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:38 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:39.511294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:39.512237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:39.519841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:39.520264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:39.520717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:39.521457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:39.521924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:39.522366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:39.659416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:39.668125 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a305089-1e65-4b23-9d07-cbeddf093883 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.161850 Aug 30 05:06:39.668944 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3426/6912] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:39 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:40.690507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:40.691126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:40.698812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:40.699292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:40.699725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:40.700409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:40.700892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:40.701452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:40.827645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:40.835344 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b8dfa4bc-0d40-4b63-9100-ec923973dcdc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.148782 Aug 30 05:06:40.835917 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3487/6913] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:40 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:41.856516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:41.857143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:41.864340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:41.864841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:41.866637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:41.867927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:41.868396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:41.869566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:42.007484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:42.015268 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-25014219-0dbb-4cbe-a26c-c0ff333482b7 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.162724 Aug 30 05:06:42.015845 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3427/6914] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:41 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:43.036002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:43.036652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:43.039447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:43.044962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:43.045475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:43.045922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:43.046619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:43.047081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:43.047512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:43.180449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:43.188164 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cf1c6fa5-6659-4d7d-b76b-d2da72cd8dfa tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.156111 Aug 30 05:06:43.188739 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3488/6915] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:43 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:44.209627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:44.210432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:44.213624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:06:44.219369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:44.219884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:44.220344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:44.221055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:44.221555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:44.222006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:44.353706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:44.361519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ed1487f7-b23a-4133-94d5-6bfb3ddbde82 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.155873 Aug 30 05:06:44.362124 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3428/6916] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:44 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:45.383441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:45.384057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:45.390996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:45.391480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:45.391918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:45.392608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:45.393059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:45.393520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:45.522146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:45.529937 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-89fc63cd-f3ba-4c67-9caf-71f0b8bd1575 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.151032 Aug 30 05:06:45.530550 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3489/6917] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:45 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:46.551157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:46.551788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:46.559228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:46.559722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:46.560171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:46.560866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:46.561347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:46.561817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:46.693988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:46.702362 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4fa0bb31-85a2-4f4b-ae53-d1db6037e45f tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.155122 Aug 30 05:06:46.702956 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3429/6918] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:46 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:47.726286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:47.726906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:47.733898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:47.734386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:47.734827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:47.735525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:47.735983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:47.736415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:47.867183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:47.874905 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f9e2614-822b-4546-874c-951fc6c36565 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.154663 Aug 30 05:06:47.875486 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3490/6919] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:47 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:48.896302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:48.896962 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:48.899708 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:06:48.899839 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 (ip 10.222.0.27) !!! Aug 30 05:06:48.907005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:48.907507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:48.907960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:48.908673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:48.909138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:48.909983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:49.040062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:49.047813 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-404799bf-038c-4687-8c71-1c945ef887cc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.155629 Aug 30 05:06:49.048399 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3430/6920] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:48 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:50.068559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:50.069082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:50.076435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:50.076925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:50.077384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:50.078083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:50.078630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:50.079076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:50.211625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:50.219772 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c402ccff-f0d9-4edc-95da-7762d5f787fc tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.154971 Aug 30 05:06:50.220363 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3491/6921] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:50 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:51.240256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:51.240811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:51.248292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:51.248782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:51.249232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:51.249960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:51.250423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:51.250863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:51.388701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:51.396627 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-915f1262-317a-45cc-891d-5b5727324e53 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.160392 Aug 30 05:06:51.397202 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3431/6922] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:51 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:52.418273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:52.418886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:52.425807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:52.426287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:52.426725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:52.427413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:52.427865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:52.428291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:52.554731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:52.562457 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91f9980f-4942-4fcc-82bf-0f90e3a6ceb3 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.148129 Aug 30 05:06:52.563034 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3492/6923] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:52 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:53.583427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:53.584055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:53.591001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:53.591496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:53.591948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:53.592645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:53.593107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:53.593582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:53.724387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:53.732823 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e03aafc9-91f0-4843-abe9-f89e580c768c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.153350 Aug 30 05:06:53.733421 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3432/6924] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:53 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:54.754338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:54.755041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:54.763288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:54.763789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:54.764241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:54.765053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:54.765540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:54.765992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:54.896989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:54.905436 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16c729e8-b039-4cd7-83da-19653c7f1533 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.155023 Aug 30 05:06:54.906058 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3493/6925] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:54 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:55.926528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:55.927163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:55.934205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:55.934700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:55.935154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:55.935855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:55.936322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:55.936765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:56.067898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:56.076259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f651c11e-3ab8-4fee-b435-5c66926256fe tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.153656 Aug 30 05:06:56.076835 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3433/6926] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:55 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:57.097849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:57.098488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:57.106092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:57.106587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:57.107030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:57.107723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:57.108183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:57.108612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:57.239480 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:57.247178 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cc62025b-d4cd-4660-8b92-8c687123c72e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1520 microversion: 2.1 time: 0.153630 Aug 30 05:06:57.247758 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3494/6927] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:57 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:06:58.258229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-04a0f807-ef57-4306-b9bb-196cdedb5fc2 req-886ed643-f557-46f7-963e-4c2296341b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c9c118-29ac-40e2-b289-c3859108e357", "name": "network-vif-unplugged", "status": "completed", "tag": "ed621073-22ef-4ed8-a9db-32603912e122"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:06:58.267910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:58.268581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:58.269252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-04a0f807-ef57-4306-b9bb-196cdedb5fc2 req-886ed643-f557-46f7-963e-4c2296341b73 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:58.270092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-04a0f807-ef57-4306-b9bb-196cdedb5fc2 req-886ed643-f557-46f7-963e-4c2296341b73 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:58.270569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-04a0f807-ef57-4306-b9bb-196cdedb5fc2 req-886ed643-f557-46f7-963e-4c2296341b73 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:58.278721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:58.279545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:58.279996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:58.280710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:58.281177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:58.281643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:58.284159 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-04a0f807-ef57-4306-b9bb-196cdedb5fc2 req-886ed643-f557-46f7-963e-4c2296341b73 service nova] Creating event network-vif-unplugged:ed621073-22ef-4ed8-a9db-32603912e122 for instance 01c9c118-29ac-40e2-b289-c3859108e357 on n-h1-854925-5 Aug 30 05:06:58.291957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-04a0f807-ef57-4306-b9bb-196cdedb5fc2 req-886ed643-f557-46f7-963e-4c2296341b73 service nova] Instance 01c9c118-29ac-40e2-b289-c3859108e357 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:06:58.305194 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-04a0f807-ef57-4306-b9bb-196cdedb5fc2 req-886ed643-f557-46f7-963e-4c2296341b73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101831 Aug 30 05:06:58.306193 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3434/6928] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:06:58.422599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:58.431406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-015904e7-470e-437b-b79e-ed6ce6730365 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1519 microversion: 2.1 time: 0.167460 Aug 30 05:06:58.431994 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3495/6929] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:58 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:06:59.453736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:06:59.454402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:06:59.460691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:59.461181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:59.461661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:59.462358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:06:59.462824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:06:59.463263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:06:59.596187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:06:59.603973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1a4deb9b-729d-40b5-9929-b0c9b9167cf8 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1517 microversion: 2.1 time: 0.155583 Aug 30 05:06:59.604556 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3435/6930] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:06:59 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:00.321699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-51c1307e-75fe-47a8-a987-f11f33f2b112 req-ebff7f3e-985d-495d-a09d-268aab017955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c9c118-29ac-40e2-b289-c3859108e357", "tag": "ed621073-22ef-4ed8-a9db-32603912e122"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:00.331917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-51c1307e-75fe-47a8-a987-f11f33f2b112 req-ebff7f3e-985d-495d-a09d-268aab017955 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:00.332400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-51c1307e-75fe-47a8-a987-f11f33f2b112 req-ebff7f3e-985d-495d-a09d-268aab017955 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:00.332836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-51c1307e-75fe-47a8-a987-f11f33f2b112 req-ebff7f3e-985d-495d-a09d-268aab017955 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:00.344919 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-51c1307e-75fe-47a8-a987-f11f33f2b112 req-ebff7f3e-985d-495d-a09d-268aab017955 service nova] Creating event network-changed:ed621073-22ef-4ed8-a9db-32603912e122 for instance 01c9c118-29ac-40e2-b289-c3859108e357 on n-h1-854925-5 Aug 30 05:07:00.350211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-51c1307e-75fe-47a8-a987-f11f33f2b112 req-ebff7f3e-985d-495d-a09d-268aab017955 service nova] Instance 01c9c118-29ac-40e2-b289-c3859108e357 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:07:00.361408 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-51c1307e-75fe-47a8-a987-f11f33f2b112 req-ebff7f3e-985d-495d-a09d-268aab017955 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043473 Aug 30 05:07:00.361997 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3496/6931] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:07:00.625054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:00.625731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:00.633317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:00.633862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:00.634323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:00.635042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:00.635514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:00.635965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:00.777800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:00.785744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-db2f3977-dde1-42f6-ac18-ecf78974a03e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1517 microversion: 2.1 time: 0.164761 Aug 30 05:07:00.786342 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3436/6932] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:00 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:01.807562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:01.808271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:01.814458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:01.814943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:01.815385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:01.816070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:01.816532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:01.816959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:01.821024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=82 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:01.963812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:01.972184 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-96610309-f2f5-4979-8cc7-14d338ea34b4 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1517 microversion: 2.1 time: 0.169755 Aug 30 05:07:01.972705 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3497/6933] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:01 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:02.994070 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:02.994700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:03.001701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:03.002192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:03.002641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:03.003340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:03.003807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:03.004246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:03.006916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=79 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:03.132573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:03.140432 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd27afde-b4ca-4156-b605-7ed33d855f3d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1514 microversion: 2.1 time: 0.150959 Aug 30 05:07:03.141224 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3437/6934] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:02 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:03.162214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:03.162732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:03.170301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:03.170844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:03.171281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:03.171978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:03.172427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:03.173014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:03.233434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b22ce98-1cc5-4b96-996e-5bd5748bc655 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "POST /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357/action" status: 204 len: 0 microversion: 2.1 time: 0.074964 Aug 30 05:07:03.234295 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3498/6935] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:07:03 2022] POST /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:07:03.242704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:03.243422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:03.249938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:03.250569 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:03.251069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:03.251876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:03.252530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:03.252980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:03.393209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:03.402346 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e121bce-4d05-4cc2-bed5-a020e1e9cf75 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1514 microversion: 2.1 time: 0.163924 Aug 30 05:07:03.402933 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3438/6936] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:03 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:04.424632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:04.425499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:04.432334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.432818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.433252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.433989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.434441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.434867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.571249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:04.579065 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-63d1e3c2-0383-4786-8278-1eb94960b926 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1506 microversion: 2.1 time: 0.159789 Aug 30 05:07:04.579640 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3499/6937] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:04 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:04.602500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:04.603130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:04.609272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.609808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.610261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.610981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.611666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.612177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.742000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:04.749833 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3677fef2-a3c3-45a8-ad97-f1b8c04d3762 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1506 microversion: 2.1 time: 0.152111 Aug 30 05:07:04.750419 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3439/6938] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:04 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:04.769685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:04.770306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:04.776805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.777295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.777760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.778452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.778907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.779334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.910552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:04.918717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6245bb80-9b00-41d2-8d44-29eb7071ca14 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1506 microversion: 2.1 time: 0.153001 Aug 30 05:07:04.919284 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3500/6939] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:04 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:04.938274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:04.938835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:04.944902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.945898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.946348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.947049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:04.947516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:04.947953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:04.973574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:07:05.046595 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-90f5c6ca-b9bd-42cb-a6b7-8f1146df083c tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 204 len: 0 microversion: 2.1 time: 0.111830 Aug 30 05:07:05.047207 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3440/6940] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:07:04 2022] DELETE /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:07:05.062744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:05.063250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:05.069249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:05.070882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:05.071327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:05.072018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:05.072473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:05.072902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:05.101898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:07:05.147843 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.compute.api [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Instance is already in deleting state, ignoring this request Aug 30 05:07:05.149350 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d56c53e-47ee-4252-8baf-6c73a8752ac6 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "DELETE /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 204 len: 0 microversion: 2.1 time: 0.090474 Aug 30 05:07:05.149940 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3501/6941] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:07:05 2022] DELETE /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:07:05.158529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:05.159480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:05.165461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:05.165959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:05.166416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:05.167120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:05.167581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:05.168023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:05.313680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:05.322802 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c8f32e3-8757-4935-ac27-403d853024f2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1512 microversion: 2.1 time: 0.168537 Aug 30 05:07:05.323398 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3441/6942] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:05 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:05.349389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-93bc273a-2c2f-4d61-8e7d-02c3ded02532 req-7761b3dc-d940-49d9-a450-8a904b27d3ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c9c118-29ac-40e2-b289-c3859108e357", "name": "network-vif-plugged", "status": "completed", "tag": "ed621073-22ef-4ed8-a9db-32603912e122"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:05.359141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-93bc273a-2c2f-4d61-8e7d-02c3ded02532 req-7761b3dc-d940-49d9-a450-8a904b27d3ff service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:05.359618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-93bc273a-2c2f-4d61-8e7d-02c3ded02532 req-7761b3dc-d940-49d9-a450-8a904b27d3ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:05.360047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-93bc273a-2c2f-4d61-8e7d-02c3ded02532 req-7761b3dc-d940-49d9-a450-8a904b27d3ff service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:05.371421 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-93bc273a-2c2f-4d61-8e7d-02c3ded02532 req-7761b3dc-d940-49d9-a450-8a904b27d3ff service nova] Creating event network-vif-plugged:ed621073-22ef-4ed8-a9db-32603912e122 for instance 01c9c118-29ac-40e2-b289-c3859108e357 on n-h1-854925-5 Aug 30 05:07:05.376525 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-93bc273a-2c2f-4d61-8e7d-02c3ded02532 req-7761b3dc-d940-49d9-a450-8a904b27d3ff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090001 Aug 30 05:07:05.377101 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3502/6943] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:07:06.343653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:06.344549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:06.352036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:06.352540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:06.353000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:06.353763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:06.354238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:06.354683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:06.487029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b075fbcd6ab046c8b18aae38c063d788', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7426b8bc3874581a547b50dfc740095', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:06.494924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3b4ffaa-4a5a-453f-9ccb-4514645cb03d tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 200 len: 1512 microversion: 2.1 time: 0.155231 Aug 30 05:07:06.495502 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3442/6944] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:06 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:07.112628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d261547c-3bf3-431c-a43b-67b1d80825ea req-5619a6dc-62e3-490e-875c-d13d193b7452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c9c118-29ac-40e2-b289-c3859108e357", "name": "network-vif-deleted", "tag": "ed621073-22ef-4ed8-a9db-32603912e122"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:07.123990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d261547c-3bf3-431c-a43b-67b1d80825ea req-5619a6dc-62e3-490e-875c-d13d193b7452 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:07.124467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d261547c-3bf3-431c-a43b-67b1d80825ea req-5619a6dc-62e3-490e-875c-d13d193b7452 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:07.124900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d261547c-3bf3-431c-a43b-67b1d80825ea req-5619a6dc-62e3-490e-875c-d13d193b7452 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:07.137757 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d261547c-3bf3-431c-a43b-67b1d80825ea req-5619a6dc-62e3-490e-875c-d13d193b7452 service nova] Creating event network-vif-deleted:ed621073-22ef-4ed8-a9db-32603912e122 for instance 01c9c118-29ac-40e2-b289-c3859108e357 on n-h1-854925-5 Aug 30 05:07:07.143666 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d261547c-3bf3-431c-a43b-67b1d80825ea req-5619a6dc-62e3-490e-875c-d13d193b7452 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035253 Aug 30 05:07:07.144305 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3503/6945] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:07:07.516698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:07.517340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 01c9c118-29ac-40e2-b289-c3859108e357] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:07.524470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:07.524966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:07.525453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:07.526170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:07.526856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:07.527059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:07.541436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] HTTP exception thrown: Instance 01c9c118-29ac-40e2-b289-c3859108e357 could not be found. Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Request method failure captured: Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 HTTP/1.1 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZqYqY0ab9SPqOHT2Ce6V9CcJtFKfVM19cMwiY5EwJ8FeRw40IYXB2ROQeXviT4SDmciEg1vOvTuzcOB0hH68ONBdH1PTUwRFJOYO4bmUz522DRvPaWmSdZml9gtn3Z9SQqWo8eHbquG2kPenj6De4T-QKAxd-Es7VQDCmlzWrE8tys Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: a7426b8bc3874581a547b50dfc740095 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7426b8bc3874581a547b50dfc740095", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7426b8bc3874581a547b50dfc740095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7426b8bc3874581a547b50dfc740095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7426b8bc3874581a547b50dfc740095"}]}] Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: a7426b8bc3874581a547b50dfc740095 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiskConfigTestJSON-740373829-project Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b075fbcd6ab046c8b18aae38c063d788 Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiskConfigTestJSON-740373829-project Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 01c9c118-29ac-40e2-b289-c3859108e357 could not be found. Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '01c9c118-29ac-40e2-b289-c3859108e357'} Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c9c118-29ac-40e2-b289-c3859108e357 could not be found. Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c9c118-29ac-40e2-b289-c3859108e357 could not be found. Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:07:07.543121 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c9c118-29ac-40e2-b289-c3859108e357 could not be found. Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Returning 404 to user: Instance 01c9c118-29ac-40e2-b289-c3859108e357 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b72425cf-42dc-435e-929e-c7c3549241d2 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357" status: 404 len: 111 microversion: 2.1 time: 0.032059 Aug 30 05:07:07.547302 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3443/6946] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:07 2022] GET /compute/v2.1/servers/01c9c118-29ac-40e2-b289-c3859108e357 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:07:07.553741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb446744-212c-410d-93c0-3fe03b2cf16e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '.version_select at 0x7fe96a39ae50>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:07.573735 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb446744-212c-410d-93c0-3fe03b2cf16e tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768726453" status: 202 len: 0 microversion: 2.1 time: 0.024090 Aug 30 05:07:07.574297 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3504/6947] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 05:07:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768726453 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:07:08.178664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:08.179310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:08.185268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:08.185803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:08.186262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:08.186987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:08.187444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:08.187926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:08.202695 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] HTTP exception thrown: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Request method failure captured: Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 HTTP/1.1 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZqYqY0ab9SPqOHT2Ce6V9CcJtFKfVM19cMwiY5EwJ8FeRw40IYXB2ROQeXviT4SDmciEg1vOvTuzcOB0hH68ONBdH1PTUwRFJOYO4bmUz522DRvPaWmSdZml9gtn3Z9SQqWo8eHbquG2kPenj6De4T-QKAxd-Es7VQDCmlzWrE8tys Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: a7426b8bc3874581a547b50dfc740095 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7426b8bc3874581a547b50dfc740095", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7426b8bc3874581a547b50dfc740095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7426b8bc3874581a547b50dfc740095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7426b8bc3874581a547b50dfc740095"}]}] Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: a7426b8bc3874581a547b50dfc740095 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerDiskConfigTestJSON-740373829-project Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: b075fbcd6ab046c8b18aae38c063d788 Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerDiskConfigTestJSON-740373829-project Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '30e8d264-d07d-4d49-a148-479d4c787f55'} Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:07:08.204281 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Returning 404 to user: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-58a99aa7-d70b-40c6-b866-6a4ed3c05c59 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "DELETE /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 404 len: 111 microversion: 2.1 time: 0.031405 Aug 30 05:07:08.208749 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3444/6948] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:07:08 2022] DELETE /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:07:08.215999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:08.216738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] [instance: 30e8d264-d07d-4d49-a148-479d4c787f55] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:08.223792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:08.226566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:08.226566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:08.226566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:08.226566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:08.226566 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:08.239332 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] HTTP exception thrown: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Request method failure captured: Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 HTTP/1.1 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZqYqY0ab9SPqOHT2Ce6V9CcJtFKfVM19cMwiY5EwJ8FeRw40IYXB2ROQeXviT4SDmciEg1vOvTuzcOB0hH68ONBdH1PTUwRFJOYO4bmUz522DRvPaWmSdZml9gtn3Z9SQqWo8eHbquG2kPenj6De4T-QKAxd-Es7VQDCmlzWrE8tys Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: a7426b8bc3874581a547b50dfc740095 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a7426b8bc3874581a547b50dfc740095", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a7426b8bc3874581a547b50dfc740095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7426b8bc3874581a547b50dfc740095"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a7426b8bc3874581a547b50dfc740095"}]}] Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: a7426b8bc3874581a547b50dfc740095 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-740373829 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerDiskConfigTestJSON-740373829-project Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: b075fbcd6ab046c8b18aae38c063d788 Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerDiskConfigTestJSON-740373829-project Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '30e8d264-d07d-4d49-a148-479d4c787f55'} Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:07:08.240998 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] Returning 404 to user: Instance 30e8d264-d07d-4d49-a148-479d4c787f55 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cfc68612-873a-4014-93d2-134189c09d17 tempest-ServerDiskConfigTestJSON-740373829 tempest-ServerDiskConfigTestJSON-740373829-project] 10.222.0.27 "GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55" status: 404 len: 111 microversion: 2.1 time: 0.031873 Aug 30 05:07:08.245609 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3505/6949] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:08 2022] GET /compute/v2.1/servers/30e8d264-d07d-4d49-a148-479d4c787f55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:07:16.803331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74f82b4a-0a42-452e-b3c3-2118d61cc5a7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'create', calling method: .version_select at 0x7fe968e45820>, body: {"keypair": {"name": "tempest-keypair-202857827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsdSBjmyuMVupco88ETNR1yd644ec0gu56YCTqx6gWXGF+VACK5Q68jo5DLh3Uctd2QkzWbsipTrOq1WXuXu2fxU+DG3VO1pZJoxNo72MUHbXAfXFyNLDb7VwqLqDYLGQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:16.809004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:16.823102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-74f82b4a-0a42-452e-b3c3-2118d61cc5a7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for project 631d9b92b5974998ac654501c994c0a0. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:07:16.828466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-74f82b4a-0a42-452e-b3c3-2118d61cc5a7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for user 97a814523f7e493e9816a6ebae35f885 and project 631d9b92b5974998ac654501c994c0a0. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:07:16.858427 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74f82b4a-0a42-452e-b3c3-2118d61cc5a7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.182813 Aug 30 05:07:16.859040 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3445/6950] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:07:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:07:18.116943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1697417436", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48111861-387a-4a32-b304-48b570ee81c1"}], "security_groups": [{"name": "tempest-securitygroup--967763685"}], "key_name": "tempest-keypair-202857827", "user_data": "}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:18.126737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:18.226818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] validate_networks() for [('48111861-387a-4a32-b304-48b570ee81c1', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:07:18.231083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:18.656555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:07:18.657011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:07:18.657622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:07:18.658042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:07:18.658466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:07:18.668523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:18.669017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:18.669500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:18.670236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:18.670698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:18.671130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:18.688684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:07:18.693999 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for user 97a814523f7e493e9816a6ebae35f885 and project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:07:18.706565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:07:18.708901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:07:18.758875 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d1291f4d-2922-4ed5-8009-12b15efd0c6d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.646178 Aug 30 05:07:18.759744 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3506/6951] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:07:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:07:18.768439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:18.773919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bb5bc640-39a5-4c87-96be-aa4efa7f536f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:18.774909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bb5bc640-39a5-4c87-96be-aa4efa7f536f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:18.837903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bb5bc640-39a5-4c87-96be-aa4efa7f536f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:18.844966 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bb5bc640-39a5-4c87-96be-aa4efa7f536f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1238 microversion: 2.1 time: 0.078140 Aug 30 05:07:18.853011 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3446/6952] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:18 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:19.868612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:19.869157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:19.889713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:19.891751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:19.893584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:19.895750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:19.897885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:19.909981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:20.018751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:20.030753 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbdff5b8-f66f-48c2-9d67-d91fefd77252 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1308 microversion: 2.1 time: 0.168115 Aug 30 05:07:20.031351 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3507/6953] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:19 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1308 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:21.051494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:21.052128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:21.060117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:21.060622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:21.062158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:21.062886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:21.063798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:21.064249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:21.209026 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:21.217074 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-422a335f-751f-4cd7-89c2-aa47ae884a93 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1363 microversion: 2.1 time: 0.169466 Aug 30 05:07:21.217761 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3447/6954] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:21 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:21.274600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3e487e87-9a16-420b-b807-71cf362ccc62 req-b218e9bb-fb8f-4809-8262-6f08fb4a282b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5d96c3-f186-4712-8158-03ce1b3b3b9c", "tag": "5e3f9a56-b2cc-4182-9fb4-542a26a93a1e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:21.293145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3e487e87-9a16-420b-b807-71cf362ccc62 req-b218e9bb-fb8f-4809-8262-6f08fb4a282b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:21.293799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3e487e87-9a16-420b-b807-71cf362ccc62 req-b218e9bb-fb8f-4809-8262-6f08fb4a282b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:21.294482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3e487e87-9a16-420b-b807-71cf362ccc62 req-b218e9bb-fb8f-4809-8262-6f08fb4a282b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:21.307250 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3e487e87-9a16-420b-b807-71cf362ccc62 req-b218e9bb-fb8f-4809-8262-6f08fb4a282b service nova] Creating event network-changed:5e3f9a56-b2cc-4182-9fb4-542a26a93a1e for instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c on n-h2-854925-5 Aug 30 05:07:21.312274 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3e487e87-9a16-420b-b807-71cf362ccc62 req-b218e9bb-fb8f-4809-8262-6f08fb4a282b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041745 Aug 30 05:07:21.313039 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3508/6955] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:07:22.239118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:22.239751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:22.247110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:22.247638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:22.248093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:22.248794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:22.249297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:22.249761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:22.380328 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:22.388856 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd310a73-e457-4aa7-8662-54c9b3cb0188 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1363 microversion: 2.1 time: 0.153648 Aug 30 05:07:22.390799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3448/6956] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:22 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:23.417730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:23.418433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:23.424568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:23.425047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:23.425517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:23.426199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:23.426657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:23.427082 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:23.560344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:23.568310 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-def64df8-c381-4392-a151-95e53376819d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1363 microversion: 2.1 time: 0.156018 Aug 30 05:07:23.568872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3509/6957] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:23 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:24.590101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:24.590829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:24.598411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:24.598986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:24.599437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:24.600201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:24.600667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:24.601638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:24.735430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:24.744211 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7f89dc7d-297e-42c6-92f7-85afe885a1d2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1363 microversion: 2.1 time: 0.158562 Aug 30 05:07:24.744867 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3449/6958] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:24 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:25.764450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:25.765095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:25.772053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:25.772528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:25.772963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:25.773679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:25.774131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:25.774554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:25.928292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:25.937044 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e3732f7-cc4a-4841-a0f2-02f1ebcdc97b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1363 microversion: 2.1 time: 0.176507 Aug 30 05:07:25.941362 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3510/6959] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:25 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:26.886990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-60619343-c697-41a5-970d-912232ff9eb4 req-209f727a-605f-49f9-b0f8-57a90529e4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5d96c3-f186-4712-8158-03ce1b3b3b9c", "name": "network-vif-plugged", "status": "completed", "tag": "5e3f9a56-b2cc-4182-9fb4-542a26a93a1e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:26.898975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60619343-c697-41a5-970d-912232ff9eb4 req-209f727a-605f-49f9-b0f8-57a90529e4ae service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:26.899449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60619343-c697-41a5-970d-912232ff9eb4 req-209f727a-605f-49f9-b0f8-57a90529e4ae service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:26.900154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-60619343-c697-41a5-970d-912232ff9eb4 req-209f727a-605f-49f9-b0f8-57a90529e4ae service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:26.918185 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-60619343-c697-41a5-970d-912232ff9eb4 req-209f727a-605f-49f9-b0f8-57a90529e4ae service nova] Creating event network-vif-plugged:5e3f9a56-b2cc-4182-9fb4-542a26a93a1e for instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c on n-h2-854925-5 Aug 30 05:07:26.923370 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-60619343-c697-41a5-970d-912232ff9eb4 req-209f727a-605f-49f9-b0f8-57a90529e4ae service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040868 Aug 30 05:07:26.924228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3450/6960] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:07:26.959487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:26.960114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:26.968277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:26.968779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:26.969554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:26.970271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:26.970734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:26.971171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:27.112074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:27.120381 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7bb8440e-a838-428d-b2a6-1357aea7ffa3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1363 microversion: 2.1 time: 0.165906 Aug 30 05:07:27.120964 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3511/6961] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:26 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:28.143093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:28.143842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:28.150595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:28.151095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:28.151553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:28.152260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:28.152735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:28.153178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:28.288845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:28.296751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d93d75d5-6f17-4afe-95e3-a28969476823 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1363 microversion: 2.1 time: 0.158884 Aug 30 05:07:28.297363 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3451/6962] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:28 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:29.317798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:29.318416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:29.321405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:29.322069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:29.327932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:29.328420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:29.328860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:29.329582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:29.330045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:29.330491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:29.461961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:07:29.469962 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-52c61b0c-785e-48ae-807a-a86b6ea01a09 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1550 microversion: 2.1 time: 0.156260 Aug 30 05:07:29.470538 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3512/6963] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:07:29 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:07:29.490394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:07:29.490901 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:07:29.492875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:07:29.499267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:29.499767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:29.500216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:29.500918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:29.501413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:29.501857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:29.577803 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8d6f93fc-ca28-402c-90ed-e86b33a59acc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091256 Aug 30 05:07:29.578462 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3452/6964] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 05:07:29 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:07:30.939872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-6bef5eeb-55dc-48a2-ac85-bc96337b3e7f req-a89a8aef-f46c-4980-b902-7e10dd77a512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5d96c3-f186-4712-8158-03ce1b3b3b9c", "tag": "5e3f9a56-b2cc-4182-9fb4-542a26a93a1e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:07:30.949683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6bef5eeb-55dc-48a2-ac85-bc96337b3e7f req-a89a8aef-f46c-4980-b902-7e10dd77a512 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:07:30.950254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6bef5eeb-55dc-48a2-ac85-bc96337b3e7f req-a89a8aef-f46c-4980-b902-7e10dd77a512 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:07:30.950786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-6bef5eeb-55dc-48a2-ac85-bc96337b3e7f req-a89a8aef-f46c-4980-b902-7e10dd77a512 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:07:30.962803 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-6bef5eeb-55dc-48a2-ac85-bc96337b3e7f req-a89a8aef-f46c-4980-b902-7e10dd77a512 service nova] Creating event network-changed:5e3f9a56-b2cc-4182-9fb4-542a26a93a1e for instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c on n-h2-854925-5 Aug 30 05:07:30.967892 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-6bef5eeb-55dc-48a2-ac85-bc96337b3e7f req-a89a8aef-f46c-4980-b902-7e10dd77a512 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092464 Aug 30 05:07:30.968579 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3513/6965] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:08:04.619555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:04.620395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=30 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:04.624757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:04.625404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:04.632688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:04.633191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:04.633673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:04.635039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:04.635509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:04.635955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:04.772730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:04.780578 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82457760-5f68-4e43-8150-6fa17ac0e4fc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1668 microversion: 2.1 time: 0.163651 Aug 30 05:08:04.781165 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3453/6966] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:04 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:04.801291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:04.802063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=36 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:04.807590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:04.808292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:04.815814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:04.816298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:04.816737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:04.817454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:04.817911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:04.818340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:04.956885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:04.964717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ca3211b-2caa-4be3-bcca-0c66f17607b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1668 microversion: 2.1 time: 0.166238 Aug 30 05:08:04.965281 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3514/6967] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:04 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1668 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:04.985218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:04.985963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:04.994912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:04.995405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:04.995854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:04.996555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:04.997018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:04.997489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:05.123793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:05.131728 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-deb3356b-a0cc-4d75-aa61-a5d7e484b047 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1668 microversion: 2.1 time: 0.150461 Aug 30 05:08:05.132324 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3454/6968] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:04 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:05.151666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:05.154047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:05.162571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:05.162996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:05.163429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:05.164117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:05.164569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:05.164994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:05.193247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:05.200412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Old instance type m1.heat2, new instance type m1.heat {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:08:05.209402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:08:05.210172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:08:05.211032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:08:05.211466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:08:05.212450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:08:05.278484 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-867c7c3b-f120-4bba-adae-7e958599b460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c/action" status: 202 len: 0 microversion: 2.1 time: 0.130705 Aug 30 05:08:05.279125 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3515/6969] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:08:05 2022] POST /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:08:05.287308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:05.288155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:05.294876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:05.295372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:05.295827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:05.296534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:05.297000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:05.297475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:05.435304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:05.446613 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8c1d245c-7115-4a29-b6d4-065db33e77a1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1677 microversion: 2.1 time: 0.162910 Aug 30 05:08:05.447699 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3455/6970] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:05 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:08:06.467390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:06.467932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:06.474815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:06.475300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:06.475761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:06.476481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:06.476932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:06.477381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:06.607264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:06.615032 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6e1cebac-a7eb-49ba-96ef-c2d27007cfe2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1677 microversion: 2.1 time: 0.151732 Aug 30 05:08:06.615608 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3516/6971] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:06 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:07.637592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:07.638224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:07.645165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:07.645700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:07.646147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:07.646847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:07.647315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:07.647757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:07.782972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:07.790875 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51a70d46-2451-4505-bfc7-13719150563c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.157959 Aug 30 05:08:07.791453 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3456/6972] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:07 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:08.812097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:08.812705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:08.819546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:08.820023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:08.820459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:08.821660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:08.822238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:08.822664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:08.959572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:08.968140 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a2cd5cf-8001-4fcd-8e40-9e40e8c26f83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.160001 Aug 30 05:08:08.968718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3517/6973] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:08 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:09.989371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:09.990009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:09.996953 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:09.997493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:09.998050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:09.998757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:09.999230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:09.999679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:10.126897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:10.135149 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-08d22166-23fe-47ec-bf7d-8f41b130556a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.149768 Aug 30 05:08:10.135722 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3457/6974] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:09 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:11.156572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:11.157197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:11.164115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:11.164605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:11.165049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:11.165784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:11.166247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:11.166680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:11.301184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:11.309524 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8cd8a3c9-2b5f-4185-806e-e0803b3641a8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.156865 Aug 30 05:08:11.310101 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3518/6975] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:11 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:12.330931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:12.331601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:12.339024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:12.339529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:12.339988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:12.340696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:12.341171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:12.341729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:12.472741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:12.480634 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-49f7358a-3abb-4df7-809c-20fe103c98b9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.153639 Aug 30 05:08:12.481216 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3458/6976] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:12 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:13.501597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:13.502221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:13.509057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:13.509574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:13.510020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:13.510720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:13.511197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:13.511626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:13.640138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:13.647972 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e5771af7-ded6-4239-a014-bad73af034f4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.150388 Aug 30 05:08:13.648549 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3519/6977] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:13 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:14.670103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:14.670755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:14.678064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:14.678566 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:14.679017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:14.679717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:14.680493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:14.680934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:14.817459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:14.825897 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4dab53fd-2585-45ed-a3b4-beb92131aa11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.159944 Aug 30 05:08:14.826479 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3459/6978] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:14 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:15.847049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:15.847715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:15.855109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:15.855603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:15.856045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:15.856748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:15.857205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:15.857692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:15.985387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:15.993229 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0696d5f8-ef85-4826-82bb-108ed0797a0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.150300 Aug 30 05:08:15.994382 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3520/6979] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:15 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:17.014757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:17.015389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:17.022313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:17.022826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:17.023270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:17.023973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:17.024444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:17.024888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:17.156423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:17.164344 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-76aa76aa-a9ef-475c-89e8-ceeeafdf6dab tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.153514 Aug 30 05:08:17.165062 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3460/6980] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:17 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:18.186644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:18.187290 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:18.194282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:18.194773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:18.195213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:18.195911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:18.196398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:18.197534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:18.326420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:18.334310 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0d0189f6-15f0-436f-80a0-6c7824faa70d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1682 microversion: 2.1 time: 0.151731 Aug 30 05:08:18.334888 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3521/6981] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:18 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:19.356556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:19.357184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:19.364153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:19.364651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:19.365105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:19.365841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:19.366314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:19.366757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:19.502126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:19.510024 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-96b259d4-d9af-42ca-b4c5-8dd5cf9008c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1681 microversion: 2.1 time: 0.157863 Aug 30 05:08:19.510612 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3461/6982] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:19 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:19.706452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-61313240-c982-4355-893f-46b5d565bd06 req-6b8780f3-b812-4063-9b5a-0495d396dd77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5d96c3-f186-4712-8158-03ce1b3b3b9c", "name": "network-vif-unplugged", "status": "completed", "tag": "5e3f9a56-b2cc-4182-9fb4-542a26a93a1e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:19.717687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-61313240-c982-4355-893f-46b5d565bd06 req-6b8780f3-b812-4063-9b5a-0495d396dd77 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:19.718091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-61313240-c982-4355-893f-46b5d565bd06 req-6b8780f3-b812-4063-9b5a-0495d396dd77 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:19.718687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-61313240-c982-4355-893f-46b5d565bd06 req-6b8780f3-b812-4063-9b5a-0495d396dd77 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:19.740943 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-61313240-c982-4355-893f-46b5d565bd06 req-6b8780f3-b812-4063-9b5a-0495d396dd77 service nova] Creating event network-vif-unplugged:5e3f9a56-b2cc-4182-9fb4-542a26a93a1e for instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c on n-h1-854925-5 Aug 30 05:08:19.746559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-61313240-c982-4355-893f-46b5d565bd06 req-6b8780f3-b812-4063-9b5a-0495d396dd77 service nova] Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:08:19.757856 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-61313240-c982-4355-893f-46b5d565bd06 req-6b8780f3-b812-4063-9b5a-0495d396dd77 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055357 Aug 30 05:08:19.758405 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3522/6983] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:08:20.532090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:20.532637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:20.539845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:20.540359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:20.540830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:20.541589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:20.542068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:20.542525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:20.685573 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:20.693814 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-38ecc707-57b6-4146-a51e-bd12be7ec9c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1681 microversion: 2.1 time: 0.165919 Aug 30 05:08:20.695289 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3462/6984] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:20 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:21.717776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:21.718479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:21.724882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:21.725408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:21.725963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:21.726684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:21.727149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:21.727595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:21.777272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-578f5871-5cc0-4a96-88c2-3869817dd2f6 req-a8f1de0a-6c5e-468f-8797-2d178da9cb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c5d96c3-f186-4712-8158-03ce1b3b3b9c", "tag": "5e3f9a56-b2cc-4182-9fb4-542a26a93a1e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:21.787561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-578f5871-5cc0-4a96-88c2-3869817dd2f6 req-a8f1de0a-6c5e-468f-8797-2d178da9cb13 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:21.788055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-578f5871-5cc0-4a96-88c2-3869817dd2f6 req-a8f1de0a-6c5e-468f-8797-2d178da9cb13 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:21.788503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-578f5871-5cc0-4a96-88c2-3869817dd2f6 req-a8f1de0a-6c5e-468f-8797-2d178da9cb13 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:21.800744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-578f5871-5cc0-4a96-88c2-3869817dd2f6 req-a8f1de0a-6c5e-468f-8797-2d178da9cb13 service nova] Creating event network-changed:5e3f9a56-b2cc-4182-9fb4-542a26a93a1e for instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c on n-h1-854925-5 Aug 30 05:08:21.806104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-578f5871-5cc0-4a96-88c2-3869817dd2f6 req-a8f1de0a-6c5e-468f-8797-2d178da9cb13 service nova] Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:08:21.817625 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-578f5871-5cc0-4a96-88c2-3869817dd2f6 req-a8f1de0a-6c5e-468f-8797-2d178da9cb13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044414 Aug 30 05:08:21.818246 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3463/6985] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:08:21.869173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:21.877643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9910a307-cf4c-4fc3-858e-071e894880c0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1679 microversion: 2.1 time: 0.165483 Aug 30 05:08:21.878230 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3523/6986] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:21 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:22.901515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:22.902257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:22.908899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:22.909589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:22.910057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:22.910775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:22.911252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:22.911726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:23.052141 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:23.062179 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1203e5ef-fa5d-4abb-a63f-677e1f4ec036 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1679 microversion: 2.1 time: 0.166573 Aug 30 05:08:23.062769 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3464/6987] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:22 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:24.083834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:24.084379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:24.094530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:24.095025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:24.095473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:24.096179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:24.096641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:24.097078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:24.233581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:24.241288 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-08170e2c-91fa-4e0f-a222-239436113ce4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1679 microversion: 2.1 time: 0.161484 Aug 30 05:08:24.241897 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3524/6988] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:24 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:25.262618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:25.263500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:25.272675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:25.273359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:25.273817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:25.274535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:25.275021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:25.276024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:25.412985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:25.421053 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd283971-dcdc-417d-ba2a-b79477cb4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1676 microversion: 2.1 time: 0.162829 Aug 30 05:08:25.421684 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3465/6989] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:25 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:25.442009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:25.442502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:25.450059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:25.450551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:25.451001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:25.451706 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:25.452165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:25.452600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:25.511151 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ba281f7b-396b-40c6-b153-f1940facdfce tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c/action" status: 204 len: 0 microversion: 2.1 time: 0.072965 Aug 30 05:08:25.511813 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3525/6990] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:08:25 2022] POST /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:08:25.520218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:25.521126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:25.528125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:25.528619 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:25.529069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:25.529804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:25.530279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:25.530740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:25.670668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:25.679505 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb2a7b13-0407-4122-9027-d7eb2d1285c5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1676 microversion: 2.1 time: 0.163307 Aug 30 05:08:25.680406 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3466/6991] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:25 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:08:26.703539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:26.704263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:26.710826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:26.711318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:26.711760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:26.712494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:26.713651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:26.714084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:26.853246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:26.861601 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9843f4b-3cc7-400a-99ae-e55b47a32fbb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1668 microversion: 2.1 time: 0.163077 Aug 30 05:08:26.862354 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3526/6992] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:26 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:26.882425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:26.883053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:26.897879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:26.898661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:26.899297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:26.900050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:26.901120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:26.901752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.046243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:27.054154 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-61dc4573-03e0-46c4-84f9-c8734a075cac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1668 microversion: 2.1 time: 0.175991 Aug 30 05:08:27.054755 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3467/6993] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:26 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:27.075061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:27.075684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:27.081647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:27.082142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:27.082586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.083288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:27.083787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:27.084311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.213057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:27.221272 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c5cc488a-5bdf-4fa6-8c4d-a8fc84747460 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1668 microversion: 2.1 time: 0.150632 Aug 30 05:08:27.221908 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3527/6994] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:27 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:27.241441 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:27.241963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:27.248475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:27.248981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:27.249470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.250189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:27.250664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:27.251115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.276800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:08:27.311835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:27.358007 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d745711-435e-4f5d-8f88-ccc648d4994b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 204 len: 0 microversion: 2.1 time: 0.120106 Aug 30 05:08:27.358584 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3468/6995] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:08:27 2022] DELETE /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:08:27.367828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:27.368542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:27.375412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:27.375976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:27.376488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.377310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:27.377859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:27.378358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.393743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:27.513123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:27.520850 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-417dae7b-1b74-4bfc-ae16-9b36dba594e1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1674 microversion: 2.1 time: 0.157744 Aug 30 05:08:27.521448 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3528/6996] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:27 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:27.747148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-461943ad-dac2-4de2-bac4-ef86c25525bb req-ff8c3216-f5d3-41f7-9688-3a319b2ad2f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5d96c3-f186-4712-8158-03ce1b3b3b9c", "name": "network-vif-plugged", "status": "completed", "tag": "5e3f9a56-b2cc-4182-9fb4-542a26a93a1e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:27.757301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-461943ad-dac2-4de2-bac4-ef86c25525bb req-ff8c3216-f5d3-41f7-9688-3a319b2ad2f6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:27.757804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-461943ad-dac2-4de2-bac4-ef86c25525bb req-ff8c3216-f5d3-41f7-9688-3a319b2ad2f6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:27.758263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-461943ad-dac2-4de2-bac4-ef86c25525bb req-ff8c3216-f5d3-41f7-9688-3a319b2ad2f6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:27.770787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-461943ad-dac2-4de2-bac4-ef86c25525bb req-ff8c3216-f5d3-41f7-9688-3a319b2ad2f6 service nova] Creating event network-vif-plugged:5e3f9a56-b2cc-4182-9fb4-542a26a93a1e for instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c on n-h1-854925-5 Aug 30 05:08:27.775926 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-461943ad-dac2-4de2-bac4-ef86c25525bb req-ff8c3216-f5d3-41f7-9688-3a319b2ad2f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033505 Aug 30 05:08:27.776827 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3469/6997] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:08:28.542459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:28.543113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:28.549986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:28.550475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:28.550918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:28.551613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:28.552068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:28.552499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:28.686002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:28.693986 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-961153a9-e10e-4281-b9db-f17573de9ef5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1674 microversion: 2.1 time: 0.156022 Aug 30 05:08:28.694563 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3529/6998] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:28 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:29.719745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:29.720651 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:29.727765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:29.728275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:29.728736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:29.729493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:29.729970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:29.731248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:29.754593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8102282d-67cf-483c-8ab4-b9977fcbf96b req-2019f36a-b423-4f59-9567-656bcf8d5a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c5d96c3-f186-4712-8158-03ce1b3b3b9c", "name": "network-vif-deleted", "tag": "5e3f9a56-b2cc-4182-9fb4-542a26a93a1e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:29.767265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8102282d-67cf-483c-8ab4-b9977fcbf96b req-2019f36a-b423-4f59-9567-656bcf8d5a13 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:29.767752 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8102282d-67cf-483c-8ab4-b9977fcbf96b req-2019f36a-b423-4f59-9567-656bcf8d5a13 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:29.768423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8102282d-67cf-483c-8ab4-b9977fcbf96b req-2019f36a-b423-4f59-9567-656bcf8d5a13 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:29.797303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8102282d-67cf-483c-8ab4-b9977fcbf96b req-2019f36a-b423-4f59-9567-656bcf8d5a13 service nova] Creating event network-vif-deleted:5e3f9a56-b2cc-4182-9fb4-542a26a93a1e for instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c on n-h1-854925-5 Aug 30 05:08:29.804323 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8102282d-67cf-483c-8ab4-b9977fcbf96b req-2019f36a-b423-4f59-9567-656bcf8d5a13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053577 Aug 30 05:08:29.805232 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3530/6999] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:08:29.818549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:29.827193 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-99f63777-1ec4-4e07-a44d-cb4bab00b797 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 200 len: 1607 microversion: 2.1 time: 0.114572 Aug 30 05:08:29.828107 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3470/7000] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:29 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 1607 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:30.853967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:30.854717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:30.861209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:30.861733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:30.862180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:30.862882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:30.863353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:30.863792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:30.877063 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c HTTP/1.1 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1c5d96c3-f186-4712-8158-03ce1b3b3b9c'} Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:08:30.878746 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eefa1280-d276-472f-b0a1-5b6cd9fdaa7a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 404 len: 111 microversion: 2.1 time: 0.032647 Aug 30 05:08:30.886700 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3531/7001] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:30 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:08:30.895007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:30.895697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:30.903745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:30.904267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:30.904730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:30.905491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:30.906004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:30.906455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:30.923929 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c HTTP/1.1 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1c5d96c3-f186-4712-8158-03ce1b3b3b9c'} Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:08:30.925669 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-44935766-c4c5-4fb1-b5e6-18a7ee15ef3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 404 len: 111 microversion: 2.1 time: 0.036607 Aug 30 05:08:30.929437 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3471/7002] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:30 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:08:30.975928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1509878939", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "48111861-387a-4a32-b304-48b570ee81c1"}], "security_groups": [{"name": "tempest-securitygroup--967763685"}], "key_name": "tempest-keypair-202857827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:31.086374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] validate_networks() for [('48111861-387a-4a32-b304-48b570ee81c1', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:08:31.528611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:08:31.529041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:08:31.529557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:08:31.529973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:08:31.530417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:08:31.542106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:31.542601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:31.543048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:31.543823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:31.544329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:31.544762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:31.565040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:08:31.570414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for user 97a814523f7e493e9816a6ebae35f885 and project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:08:31.583665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:08:31.586062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:08:31.636103 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5007ed14-3f68-424b-b73a-7df2fc55d911 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.664076 Aug 30 05:08:31.636944 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3532/7003] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:08:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:08:31.647792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d5b1329d-2af1-4cd2-9b68-14da0ff48ee4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:31.648534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d5b1329d-2af1-4cd2-9b68-14da0ff48ee4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:31.702220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d5b1329d-2af1-4cd2-9b68-14da0ff48ee4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:31.711765 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d5b1329d-2af1-4cd2-9b68-14da0ff48ee4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1238 microversion: 2.1 time: 0.067831 Aug 30 05:08:31.712347 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3472/7004] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:31 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:32.737041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:32.738400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:32.745712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:32.746204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:32.746812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:32.747713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:32.748173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:32.748608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:32.813365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:32.822710 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6a27f81f-169c-408b-a567-0228544c0260 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1308 microversion: 2.1 time: 0.089894 Aug 30 05:08:32.823391 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3533/7005] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:32 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:33.845024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:33.845736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:33.852218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:33.852729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:33.853220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:33.854578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:33.855057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:33.855676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:34.000053 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:34.008099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-65a0844c-8e22-4e0c-abe6-a288080c9043 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1363 microversion: 2.1 time: 0.167360 Aug 30 05:08:34.008683 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3473/7006] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:33 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:34.051686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-68b43671-c20c-417f-9f15-5f8a899238a3 req-941c7d50-f9bd-4dc6-9406-c91b04af46bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80", "tag": "eaae9783-5188-47df-8f78-d902fdc2f9b1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:34.063356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-68b43671-c20c-417f-9f15-5f8a899238a3 req-941c7d50-f9bd-4dc6-9406-c91b04af46bc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:34.063837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-68b43671-c20c-417f-9f15-5f8a899238a3 req-941c7d50-f9bd-4dc6-9406-c91b04af46bc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:34.064283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-68b43671-c20c-417f-9f15-5f8a899238a3 req-941c7d50-f9bd-4dc6-9406-c91b04af46bc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:34.076643 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-68b43671-c20c-417f-9f15-5f8a899238a3 req-941c7d50-f9bd-4dc6-9406-c91b04af46bc service nova] Creating event network-changed:eaae9783-5188-47df-8f78-d902fdc2f9b1 for instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 on n-h1-854925-5 Aug 30 05:08:34.081796 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-68b43671-c20c-417f-9f15-5f8a899238a3 req-941c7d50-f9bd-4dc6-9406-c91b04af46bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034256 Aug 30 05:08:34.082411 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3534/7007] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:08:35.031192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:35.031833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:35.034713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:35.041547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:35.042063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:35.042519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:35.043237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:35.043714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:35.044160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:35.179235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:35.187735 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8defee7e-4658-48a9-8049-e0f0ac3cfeb1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1363 microversion: 2.1 time: 0.160501 Aug 30 05:08:35.188315 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3474/7008] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:35 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:36.211098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:36.211813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:36.213822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:36.220358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:36.220844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:36.221287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:36.222010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:36.222467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:36.222899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:36.351562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:36.360080 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01113ec3-fe8c-4aa8-b879-cf8c2cbc4fbd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1363 microversion: 2.1 time: 0.154195 Aug 30 05:08:36.360656 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3535/7009] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:36 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:37.381738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:37.382375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:37.389411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:37.389916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:37.390374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:37.391084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:37.391557 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:37.392012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:37.523438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:37.532652 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c014062-68fe-410b-9ff6-a118df75c85f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1363 microversion: 2.1 time: 0.154887 Aug 30 05:08:37.533241 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3475/7010] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:37 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:38.554557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:38.555094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:38.562643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:38.563133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:38.563578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:38.564281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:38.564744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:38.565179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:38.694338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:38.702223 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0424dcf7-0e8c-4a68-be89-2badb2744e95 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1363 microversion: 2.1 time: 0.151721 Aug 30 05:08:38.702796 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3536/7011] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:38 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:39.725150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:39.725812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:39.736493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:39.737019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:39.738545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:39.738545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:39.738746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:39.739091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:39.859132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2b5a5693-e3d8-4b23-9f07-08422b9820e4 req-143a77bb-d74e-46ce-a218-85438e683d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80", "name": "network-vif-plugged", "status": "completed", "tag": "eaae9783-5188-47df-8f78-d902fdc2f9b1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:39.874733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2b5a5693-e3d8-4b23-9f07-08422b9820e4 req-143a77bb-d74e-46ce-a218-85438e683d53 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:39.875308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2b5a5693-e3d8-4b23-9f07-08422b9820e4 req-143a77bb-d74e-46ce-a218-85438e683d53 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:39.875974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2b5a5693-e3d8-4b23-9f07-08422b9820e4 req-143a77bb-d74e-46ce-a218-85438e683d53 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:39.888387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:39.892732 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2b5a5693-e3d8-4b23-9f07-08422b9820e4 req-143a77bb-d74e-46ce-a218-85438e683d53 service nova] Creating event network-vif-plugged:eaae9783-5188-47df-8f78-d902fdc2f9b1 for instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 on n-h1-854925-5 Aug 30 05:08:39.896872 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d91c4a78-c6c2-46e6-8899-d72099fb0b97 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1363 microversion: 2.1 time: 0.175881 Aug 30 05:08:39.897732 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3476/7012] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:39 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:39.898656 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2b5a5693-e3d8-4b23-9f07-08422b9820e4 req-143a77bb-d74e-46ce-a218-85438e683d53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044672 Aug 30 05:08:39.899681 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3537/7013] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:08:40.919669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:40.920300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:40.927350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:40.927849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:40.928306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:40.929019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:40.929530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:40.929980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:41.058504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:41.066247 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b28a534d-2ee4-4e54-8416-2242f69c1aa9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1363 microversion: 2.1 time: 0.151021 Aug 30 05:08:41.066826 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3477/7014] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:40 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:42.084801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:42.085679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:42.090358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:42.091142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:42.098559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:42.099045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:42.099485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:42.100179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:42.100638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:42.101071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:42.234468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:08:42.242631 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fad3fba1-c939-4889-a533-ed4649a7a960 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1551 microversion: 2.1 time: 0.159638 Aug 30 05:08:42.243254 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3538/7015] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:08:42 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:08:42.264380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:08:42.264888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:08:42.266785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:08:42.272833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:42.273356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:42.273813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:42.274511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:42.274982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:42.275421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:42.359639 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-93be2bd7-f698-4e2e-b30c-35d3c7d5ca60 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099774 Aug 30 05:08:42.360292 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3478/7016] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 05:08:42 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:08:43.277978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0c97e117-8bf1-4056-b00a-a1ddce404e3a req-72a88521-0f66-4949-8730-d98d6fa87ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80", "tag": "eaae9783-5188-47df-8f78-d902fdc2f9b1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:08:43.288393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c97e117-8bf1-4056-b00a-a1ddce404e3a req-72a88521-0f66-4949-8730-d98d6fa87ed8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:08:43.288966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c97e117-8bf1-4056-b00a-a1ddce404e3a req-72a88521-0f66-4949-8730-d98d6fa87ed8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:08:43.289444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c97e117-8bf1-4056-b00a-a1ddce404e3a req-72a88521-0f66-4949-8730-d98d6fa87ed8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:08:43.300468 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0c97e117-8bf1-4056-b00a-a1ddce404e3a req-72a88521-0f66-4949-8730-d98d6fa87ed8 service nova] Creating event network-changed:eaae9783-5188-47df-8f78-d902fdc2f9b1 for instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 on n-h1-854925-5 Aug 30 05:08:43.305477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0c97e117-8bf1-4056-b00a-a1ddce404e3a req-72a88521-0f66-4949-8730-d98d6fa87ed8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031820 Aug 30 05:08:43.306113 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3539/7017] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:09:55.577576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=9 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:55.578397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:55.582738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b3f21c48-df20-45d4-83fb-020f777f260d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:09:55.590301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f21c48-df20-45d4-83fb-020f777f260d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:55.590810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f21c48-df20-45d4-83fb-020f777f260d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:55.591271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b3f21c48-df20-45d4-83fb-020f777f260d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:55.614343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b3f21c48-df20-45d4-83fb-020f777f260d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Going to try to stop instance {{(pid=122402) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 05:09:55.658096 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b3f21c48-df20-45d4-83fb-020f777f260d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action" status: 202 len: 0 microversion: 2.1 time: 0.082650 Aug 30 05:09:55.658729 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3479/7018] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:09:55 2022] POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:09:55.665944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=9 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:55.666686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=45 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:09:55.672348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:55.673193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:09:55.680800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:55.681292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:55.681763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:55.682469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:55.682933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:55.683364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:55.823543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:09:55.831573 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-66f072a7-78e0-456d-b3d7-9a67a3d45fd9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.168342 Aug 30 05:09:55.832297 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3540/7019] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:09:55 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:09:56.855016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:56.855744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:09:56.861922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:56.862419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:56.862874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:56.863579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:56.864052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:56.864498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:56.995983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:09:57.003836 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a0c478fa-1889-44d1-925d-97110a17884e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.153991 Aug 30 05:09:57.004419 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3480/7020] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:09:56 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:09:58.025531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:58.026144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:09:58.033021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:58.033539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:58.033979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:58.034670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:58.035123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:58.035548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:58.165432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:09:58.173153 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e294aa85-ace2-4e48-a935-dadc550b0b6f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.151577 Aug 30 05:09:58.173757 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3541/7021] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:09:58 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:09:59.202938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:09:59.203499 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:09:59.210383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:59.210890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:59.211356 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:59.212073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:09:59.212552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:09:59.213005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:09:59.341663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:09:59.350476 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45913df9-c460-4558-8ef9-cc938f82f95b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.152109 Aug 30 05:09:59.351070 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3481/7022] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:09:59 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:00.371636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:00.372233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:00.379193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:00.379677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:00.380113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:00.380800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:00.381251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:00.381703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:00.510194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:00.518055 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5df610aa-07d1-4092-9de4-bf0f58c01b24 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.150332 Aug 30 05:10:00.518629 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3542/7023] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:00 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:01.539760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:01.540390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:01.547772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:01.548264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:01.548713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:01.549445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:01.549917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:01.550355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:01.679463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:01.687868 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b1ed592d-dde3-4487-85a0-939214000574 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.152096 Aug 30 05:10:01.688445 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3482/7024] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:01 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:02.708447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:02.709071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:02.715966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:02.716451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:02.717425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:02.718121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:02.718583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:02.719016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:02.850231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:02.858033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2c5016ae-6416-4bf4-9c3b-41eddfec975f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.153485 Aug 30 05:10:02.858606 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3543/7025] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:02 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:03.879072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:03.879707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:03.885894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:03.886391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:03.886846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:03.887549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:03.888022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:03.888470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:04.019330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:04.027100 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dcd5f06d-a33c-4b4f-823a-6d9d194c8bdc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.152181 Aug 30 05:10:04.027680 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3483/7026] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:03 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:05.050614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:05.051153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:05.058032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:05.058516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:05.058952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:05.059645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:05.060102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:05.061184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:05.190035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:05.197827 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3112d1b3-838e-4178-9678-14462e3fbc88 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.153671 Aug 30 05:10:05.198419 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3544/7027] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:05 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:06.219133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:06.220030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:06.227071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.227568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.228024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.228755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.229230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.229735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.357690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:06.365561 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-47ea3454-d4c4-43ea-a289-059c52bb6e1f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1656 microversion: 2.1 time: 0.150523 Aug 30 05:10:06.366142 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3484/7028] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:06 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:06.387164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:06.390080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:06.396764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.397247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.397722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.398417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.398871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.399300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.427419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:06.433640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Old instance type m1.heat2, new instance type m1.heat {{(pid=122403) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:10:06.440586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:10:06.441005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:10:06.441514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:10:06.441923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:10:06.442332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:10:06.505528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b0ee471-2099-4256-bc86-a8f2987978e6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action" status: 202 len: 0 microversion: 2.1 time: 0.122185 Aug 30 05:10:06.506245 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3545/7029] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:10:06 2022] POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:10:06.515189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:06.515823 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:06.522096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.522611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.523079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.523800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:06.524280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:06.524763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:06.664862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:06.674035 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c7d63dba-a934-4c46-9f9c-65cab7787d65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.163439 Aug 30 05:10:06.674625 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3485/7030] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:06 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:07.696107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:07.696660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:07.704157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:07.704649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:07.705092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:07.705817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:07.706275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:07.706707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:07.837648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:07.845781 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab95f49a-75e9-472f-8bc1-e6b1ac087d6c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1679 microversion: 2.1 time: 0.153622 Aug 30 05:10:07.846368 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3546/7031] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:07 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:08.866123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:08.866786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:08.874686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:08.875244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:08.875827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:08.876561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:08.877037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:08.877523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:09.010021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:09.017595 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-98f984cd-e076-4185-adcb-cbef79147db2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1684 microversion: 2.1 time: 0.155612 Aug 30 05:10:09.018206 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3486/7032] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:08 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:10.039204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:10.039824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:10.046686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:10.047171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:10.047612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:10.048303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:10.048761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:10.049184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:10.175385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:10.183193 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46bbc889-fb1c-4d59-863e-2ad575078365 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1684 microversion: 2.1 time: 0.147927 Aug 30 05:10:10.183770 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3547/7033] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:10 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:11.205304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:11.205904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:11.208535 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:10:11.208671 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 (ip 10.222.0.27) !!! Aug 30 05:10:11.221162 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:11.221688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:11.222142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:11.222858 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:11.223325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:11.223762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:11.366228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:11.374907 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f2f97f44-90dc-4be8-83ab-53a6be1e30b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1683 microversion: 2.1 time: 0.174415 Aug 30 05:10:11.375504 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3487/7034] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:11 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:11.720137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-182eb374-7b5c-45b7-8d4a-cbeb5716b19b req-49c55c28-0b79-4ae4-911a-f2721e5e26bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80", "name": "network-vif-unplugged", "status": "completed", "tag": "eaae9783-5188-47df-8f78-d902fdc2f9b1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:11.725611 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:10:11.725762 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:10:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 30 05:10:11.735228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-182eb374-7b5c-45b7-8d4a-cbeb5716b19b req-49c55c28-0b79-4ae4-911a-f2721e5e26bc service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:11.735725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-182eb374-7b5c-45b7-8d4a-cbeb5716b19b req-49c55c28-0b79-4ae4-911a-f2721e5e26bc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:11.736163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-182eb374-7b5c-45b7-8d4a-cbeb5716b19b req-49c55c28-0b79-4ae4-911a-f2721e5e26bc service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:11.747995 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-182eb374-7b5c-45b7-8d4a-cbeb5716b19b req-49c55c28-0b79-4ae4-911a-f2721e5e26bc service nova] Creating event network-vif-unplugged:eaae9783-5188-47df-8f78-d902fdc2f9b1 for instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 on n-h2-854925-5 Aug 30 05:10:11.754148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-182eb374-7b5c-45b7-8d4a-cbeb5716b19b req-49c55c28-0b79-4ae4-911a-f2721e5e26bc service nova] Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:10:11.766137 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-182eb374-7b5c-45b7-8d4a-cbeb5716b19b req-49c55c28-0b79-4ae4-911a-f2721e5e26bc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050527 Aug 30 05:10:11.766769 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3548/7035] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:10:12.396064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:12.396698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:12.403795 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:12.404301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:12.404755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:12.405501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:12.405972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:12.406418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:12.537183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:12.545930 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1d7818f9-9fff-4be9-a59a-9a21a745bec4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1683 microversion: 2.1 time: 0.153748 Aug 30 05:10:12.546529 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3488/7036] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:12 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:13.572593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:13.573300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:13.580077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:13.580564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:13.581009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:13.581743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:13.582199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:13.582629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:13.713127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:13.721168 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aebec873-eb0b-4a47-9c8c-62461c458476 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1681 microversion: 2.1 time: 0.153814 Aug 30 05:10:13.721782 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3549/7037] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:13 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:13.798971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2150b352-8bf0-4cf8-ba57-55b143ecfb3c req-2e93417b-794e-41c4-b7bf-1717eb7d73a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80", "tag": "eaae9783-5188-47df-8f78-d902fdc2f9b1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:13.809432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2150b352-8bf0-4cf8-ba57-55b143ecfb3c req-2e93417b-794e-41c4-b7bf-1717eb7d73a2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:13.809935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2150b352-8bf0-4cf8-ba57-55b143ecfb3c req-2e93417b-794e-41c4-b7bf-1717eb7d73a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:13.810888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2150b352-8bf0-4cf8-ba57-55b143ecfb3c req-2e93417b-794e-41c4-b7bf-1717eb7d73a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:13.822911 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2150b352-8bf0-4cf8-ba57-55b143ecfb3c req-2e93417b-794e-41c4-b7bf-1717eb7d73a2 service nova] Creating event network-changed:eaae9783-5188-47df-8f78-d902fdc2f9b1 for instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 on n-h2-854925-5 Aug 30 05:10:13.829098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-2150b352-8bf0-4cf8-ba57-55b143ecfb3c req-2e93417b-794e-41c4-b7bf-1717eb7d73a2 service nova] Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:10:13.839827 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2150b352-8bf0-4cf8-ba57-55b143ecfb3c req-2e93417b-794e-41c4-b7bf-1717eb7d73a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044629 Aug 30 05:10:13.840432 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3489/7038] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:10:14.742807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:14.743447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:14.750339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:14.750827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:14.751328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:14.752210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:14.752822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:14.753252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:14.963919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:14.972715 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a9565917-5773-4633-a968-b04f4ffd6cd0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1677 microversion: 2.1 time: 0.233799 Aug 30 05:10:14.973623 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3550/7039] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:14 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:14.995017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:14.995758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:15.002131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:15.002634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:15.003085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:15.003793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:15.004255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:15.004718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:15.066099 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-024d41ae-4e83-405c-a15a-9193582d1e26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action" status: 204 len: 0 microversion: 2.1 time: 0.076180 Aug 30 05:10:15.066802 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3490/7040] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:10:14 2022] POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 05:10:15.075015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:15.075642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:15.082775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:15.083516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:15.083966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:15.084755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:15.085151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:15.086021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:15.322954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:15.332152 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1f865692-d430-418f-ada9-c7ccc6f380b4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1677 microversion: 2.1 time: 0.261104 Aug 30 05:10:15.332745 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3551/7041] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:15 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1677 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:16.355732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:16.357789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:16.364145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:16.364689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:16.365375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:16.366102 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:16.366574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:16.367024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:16.510725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:16.518621 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3acdab8c-eba8-4266-a1cf-81b8ba712123 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1656 microversion: 2.1 time: 0.168442 Aug 30 05:10:16.519848 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3491/7042] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:16 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1656 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:16.538682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:16.539296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:16.547168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:16.547658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:16.548094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:16.549074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:16.549559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:16.549987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:16.687841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:16.695684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2bbdc867-e2dc-4fd9-8c66-a3a0fb3bff3b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1656 microversion: 2.1 time: 0.160926 Aug 30 05:10:16.696270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3552/7043] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:16 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1656 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:16.715792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-745180c9-4899-4899-9782-3f8c2341f811 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:16.722639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745180c9-4899-4899-9782-3f8c2341f811 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:16.723133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745180c9-4899-4899-9782-3f8c2341f811 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:16.723587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745180c9-4899-4899-9782-3f8c2341f811 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:16.746200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-745180c9-4899-4899-9782-3f8c2341f811 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Going to try to start instance {{(pid=122402) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 05:10:16.778724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:16.788443 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-745180c9-4899-4899-9782-3f8c2341f811 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action" status: 202 len: 0 microversion: 2.1 time: 0.076508 Aug 30 05:10:16.789058 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3492/7044] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:10:16 2022] POST /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:10:16.797588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:16.798201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:16.805025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:16.805631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:16.806069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:16.806873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:16.807328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:16.807844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:17.020709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:17.028494 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-188b6451-211a-4e1b-b9bd-d7fb32ac4300 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1665 microversion: 2.1 time: 0.234872 Aug 30 05:10:17.029658 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3553/7045] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:16 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1665 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:17.842383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-df56fab9-e58c-48eb-be9a-08602b248e9f req-f7da57d9-1030-4f79-9f78-609ace2dae8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80", "name": "network-vif-plugged", "status": "completed", "tag": "eaae9783-5188-47df-8f78-d902fdc2f9b1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:17.855873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-df56fab9-e58c-48eb-be9a-08602b248e9f req-f7da57d9-1030-4f79-9f78-609ace2dae8d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:17.856384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-df56fab9-e58c-48eb-be9a-08602b248e9f req-f7da57d9-1030-4f79-9f78-609ace2dae8d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:17.856836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-df56fab9-e58c-48eb-be9a-08602b248e9f req-f7da57d9-1030-4f79-9f78-609ace2dae8d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:17.869291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-df56fab9-e58c-48eb-be9a-08602b248e9f req-f7da57d9-1030-4f79-9f78-609ace2dae8d service nova] Creating event network-vif-plugged:eaae9783-5188-47df-8f78-d902fdc2f9b1 for instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 on n-h2-854925-5 Aug 30 05:10:17.875256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-df56fab9-e58c-48eb-be9a-08602b248e9f req-f7da57d9-1030-4f79-9f78-609ace2dae8d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037156 Aug 30 05:10:17.875879 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3493/7046] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:10:18.050490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:18.051030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:18.057973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:18.058461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:18.058902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:18.059600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:18.060059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:18.061086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:18.192154 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:18.200424 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ad866fb5-0b08-4ea1-bab4-ad32f4c2b43a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1665 microversion: 2.1 time: 0.153965 Aug 30 05:10:18.201016 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3554/7047] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:18 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:19.224188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:19.224816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:19.232123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:19.232613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:19.233066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:19.233875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:19.234341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:19.234781 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:19.365438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:19.373249 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6343f2ed-5848-42f4-a19b-c2c75b6011b0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1669 microversion: 2.1 time: 0.153698 Aug 30 05:10:19.373863 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3494/7048] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:19 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:19.393797 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:19.394408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:19.402436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:19.402930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:19.403367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:19.404057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:19.405037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:19.405491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:19.423869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:19.432173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:10:19.508224 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a97c8b85-a7c0-494f-90b9-e6956c0cdbf6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 204 len: 0 microversion: 2.1 time: 0.118042 Aug 30 05:10:19.508808 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3555/7049] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:10:19 2022] DELETE /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:10:19.518174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:19.518801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:19.524753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:19.525247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:19.525739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:19.526437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:19.526903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:19.527342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:19.652883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:19.661298 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bcbcaa2a-e337-4b75-afcd-f5dfe1637e21 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1675 microversion: 2.1 time: 0.147565 Aug 30 05:10:19.661919 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3495/7050] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:19 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:20.683542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:20.684276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:20.691479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:20.691962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:20.692416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:20.693110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:20.693571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:20.694003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:20.828823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:20.836688 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd2f2cbc-28c9-49f2-aa0d-4ec4267cb615 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1675 microversion: 2.1 time: 0.157587 Aug 30 05:10:20.837271 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3556/7051] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:20 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:21.726753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0e6df314-f377-4cc9-87dd-5f0d8b29888e req-940c2ee4-3a44-4e5f-af54-8d75e953f64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80", "name": "network-vif-deleted", "tag": "eaae9783-5188-47df-8f78-d902fdc2f9b1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:21.739217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0e6df314-f377-4cc9-87dd-5f0d8b29888e req-940c2ee4-3a44-4e5f-af54-8d75e953f64c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:21.739732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0e6df314-f377-4cc9-87dd-5f0d8b29888e req-940c2ee4-3a44-4e5f-af54-8d75e953f64c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:21.741873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0e6df314-f377-4cc9-87dd-5f0d8b29888e req-940c2ee4-3a44-4e5f-af54-8d75e953f64c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:21.753502 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0e6df314-f377-4cc9-87dd-5f0d8b29888e req-940c2ee4-3a44-4e5f-af54-8d75e953f64c service nova] Creating event network-vif-deleted:eaae9783-5188-47df-8f78-d902fdc2f9b1 for instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 on n-h2-854925-5 Aug 30 05:10:21.758543 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0e6df314-f377-4cc9-87dd-5f0d8b29888e req-940c2ee4-3a44-4e5f-af54-8d75e953f64c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035907 Aug 30 05:10:21.759297 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3496/7052] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:10:21.860035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:21.860664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:21.867871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:21.868372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:21.869312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:21.870135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:21.870838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:21.871454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:21.906650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:21.907155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:21.907601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:21.908067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lazy-loading 'fault' on Instance uuid 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:10:21.949879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:21.958156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-47e85bed-6d45-4e3b-804c-3ba185c44f00 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 200 len: 1328 microversion: 2.1 time: 0.102522 Aug 30 05:10:21.958740 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3557/7053] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:21 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:22.981535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:22.982247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:22.988868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:22.989385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:22.989855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:22.990531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:22.990995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:22.991452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:23.005258 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 HTTP/1.1 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80'} Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:10:23.006917 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6edd38bf-d089-4181-9988-3ff8295b7608 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 404 len: 111 microversion: 2.1 time: 0.032102 Aug 30 05:10:23.011590 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3497/7054] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:22 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:10:23.024534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:23.025153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:23.032109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:23.032596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:23.033061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:23.033789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:23.034246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:23.034676 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:23.048562 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 HTTP/1.1 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80'} Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:10:23.050263 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-658167b8-af34-402c-b6ef-699fcf8b156e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 404 len: 111 microversion: 2.1 time: 0.031037 Aug 30 05:10:23.054152 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3558/7055] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:23 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:10:23.100417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-930469184", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "48111861-387a-4a32-b304-48b570ee81c1"}], "security_groups": [{"name": "tempest-securitygroup--967763685"}], "key_name": "tempest-keypair-202857827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:23.202482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] validate_networks() for [('48111861-387a-4a32-b304-48b570ee81c1', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:10:23.660407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:10:23.660847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:10:23.661354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:10:23.661819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:10:23.662247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:10:23.671895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:23.672402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:23.672859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:23.673629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:23.674101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:23.674549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:23.694763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:10:23.700277 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for user 97a814523f7e493e9816a6ebae35f885 and project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:10:23.713637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:10:23.715919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:10:23.764245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8cf7920a-e4c3-447b-9e46-ef7f55b2295e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.667166 Aug 30 05:10:23.764921 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3498/7056] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:10:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:10:23.775909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7006fa34-576d-4ac2-b43b-d3be27691371 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:23.776427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7006fa34-576d-4ac2-b43b-d3be27691371 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:23.838075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7006fa34-576d-4ac2-b43b-d3be27691371 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:23.845973 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7006fa34-576d-4ac2-b43b-d3be27691371 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1237 microversion: 2.1 time: 0.074044 Aug 30 05:10:23.846739 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3559/7057] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:23 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:24.867955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:24.868594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:24.877741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:24.878380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:24.878918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:24.879971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:24.880443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:24.881069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:24.950245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:24.958334 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b38d5480-935b-47ca-8c36-572feb1709ac tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1297 microversion: 2.1 time: 0.094441 Aug 30 05:10:24.958917 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3499/7058] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:24 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:25.980619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:25.981795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:25.986075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:25.991948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:25.992445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:25.992919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:25.993649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:25.994101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:25.994911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:26.143402 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:26.152019 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-79cd8f23-8507-4c42-9ad4-c2cbfbdfc57c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.175604 Aug 30 05:10:26.153714 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3560/7059] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:25 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:26.665687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e01d4cca-6b6f-49b5-af19-cfbf6c5b8e07 req-a0cb25c2-cfa5-4c96-ac2a-fba7ff36f153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:26.675073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:26.679861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e01d4cca-6b6f-49b5-af19-cfbf6c5b8e07 req-a0cb25c2-cfa5-4c96-ac2a-fba7ff36f153 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:26.680488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e01d4cca-6b6f-49b5-af19-cfbf6c5b8e07 req-a0cb25c2-cfa5-4c96-ac2a-fba7ff36f153 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:26.681035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e01d4cca-6b6f-49b5-af19-cfbf6c5b8e07 req-a0cb25c2-cfa5-4c96-ac2a-fba7ff36f153 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:26.697970 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e01d4cca-6b6f-49b5-af19-cfbf6c5b8e07 req-a0cb25c2-cfa5-4c96-ac2a-fba7ff36f153 service nova] Creating event network-changed:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h1-854925-5 Aug 30 05:10:26.704081 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e01d4cca-6b6f-49b5-af19-cfbf6c5b8e07 req-a0cb25c2-cfa5-4c96-ac2a-fba7ff36f153 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043181 Aug 30 05:10:26.704799 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3500/7060] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:10:27.173834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:27.174352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:27.181309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:27.181884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:27.182301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:27.183148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:27.183612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:27.184041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:27.315648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:27.323364 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6fbadeb2-c5ee-409d-bb5d-7151f07210a5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.154099 Aug 30 05:10:27.323932 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3561/7061] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:27 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:28.346759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:28.347508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:28.354798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:28.355302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:28.355793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:28.356508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:28.356980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:28.357454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:28.490667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:28.498495 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8bbff2fb-31b2-4aca-9730-040b67c067be tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.157760 Aug 30 05:10:28.499078 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3501/7062] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:28 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:29.520340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:29.520957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:29.527756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:29.528244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:29.528684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:29.529396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:29.529853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:29.530281 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:29.658533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:29.665258 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c1a4133-b296-42d7-8950-79fefeccb915 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.148792 Aug 30 05:10:29.665936 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3562/7063] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:29 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:10:30.687106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:30.687756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:30.695004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:30.695653 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:30.696118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:30.696857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:30.697371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:30.697801 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:30.839145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:30.847205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ebea6011-ec54-4312-929e-6eb51a17b9e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.164567 Aug 30 05:10:30.848046 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3502/7064] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:30 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:31.868228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:31.868843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:31.876399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:31.876900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:31.877320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:31.878029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:31.878483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:31.878908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:32.006270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:32.014021 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-809e671b-e1fc-48b3-afc1-78afe80b5d83 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.149721 Aug 30 05:10:32.014594 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3563/7065] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:31 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:32.512032 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7f83043e-61a9-4a14-b89d-8e9fde7585cd req-e5c2680a-768e-4e37-8647-360d2f9b66b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "name": "network-vif-plugged", "status": "completed", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:32.522895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7f83043e-61a9-4a14-b89d-8e9fde7585cd req-e5c2680a-768e-4e37-8647-360d2f9b66b4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:32.523396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7f83043e-61a9-4a14-b89d-8e9fde7585cd req-e5c2680a-768e-4e37-8647-360d2f9b66b4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:32.523847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7f83043e-61a9-4a14-b89d-8e9fde7585cd req-e5c2680a-768e-4e37-8647-360d2f9b66b4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:32.536395 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7f83043e-61a9-4a14-b89d-8e9fde7585cd req-e5c2680a-768e-4e37-8647-360d2f9b66b4 service nova] Creating event network-vif-plugged:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h1-854925-5 Aug 30 05:10:32.541596 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7f83043e-61a9-4a14-b89d-8e9fde7585cd req-e5c2680a-768e-4e37-8647-360d2f9b66b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Aug 30 05:10:32.542213 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3503/7066] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:10:33.035476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:33.036230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:33.043259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:33.043763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:33.044201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:33.044902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:33.045381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:33.045814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:33.182950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:33.191523 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98975a6e-0226-49a0-9449-8f1bef5b69c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.160115 Aug 30 05:10:33.192115 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3564/7067] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:33 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:34.210826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:34.211685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:34.216453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:34.217184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:34.225189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:34.225712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:34.226173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:34.226876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:34.227349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:34.227796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:34.355459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:34.363291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-92773cfb-10a2-401e-928f-2c57588387e7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1362 microversion: 2.1 time: 0.154521 Aug 30 05:10:34.364371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3504/7068] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:34 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:35.389094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:35.389826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:35.392319 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:10:35.399316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:35.399807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:35.400246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:35.400941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:35.401425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:35.401856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:35.532757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:10:35.540499 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7967b9fc-ee97-4d9d-a2d0-8f83d8b25f5c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1550 microversion: 2.1 time: 0.155470 Aug 30 05:10:35.541082 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3565/7069] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:10:35 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:10:35.561676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:10:35.562780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:10:35.569592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:35.570091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:35.570546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:35.571244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:35.571859 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:35.572327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:35.647962 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ea3d185-8452-4c63-bbc6-1ae2872318e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090127 Aug 30 05:10:35.648590 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3505/7070] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 05:10:35 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:10:36.557559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-11d4e34e-0c66-4d8e-b39b-08d1f4af8433 req-584c1d60-6251-4810-bf58-e47ea6c3a6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:10:36.567783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-11d4e34e-0c66-4d8e-b39b-08d1f4af8433 req-584c1d60-6251-4810-bf58-e47ea6c3a6e2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:10:36.568308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-11d4e34e-0c66-4d8e-b39b-08d1f4af8433 req-584c1d60-6251-4810-bf58-e47ea6c3a6e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:10:36.568747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-11d4e34e-0c66-4d8e-b39b-08d1f4af8433 req-584c1d60-6251-4810-bf58-e47ea6c3a6e2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:10:36.580430 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-11d4e34e-0c66-4d8e-b39b-08d1f4af8433 req-584c1d60-6251-4810-bf58-e47ea6c3a6e2 service nova] Creating event network-changed:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h1-854925-5 Aug 30 05:10:36.585568 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-11d4e34e-0c66-4d8e-b39b-08d1f4af8433 req-584c1d60-6251-4810-bf58-e47ea6c3a6e2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032207 Aug 30 05:10:36.586176 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3566/7071] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:11:48.575454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=11 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:48.576231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=52 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:48.580994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:11:48.583317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:48.591124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:48.591621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:48.592075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:48.592774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:48.593239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:48.593702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:48.622656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:48.628390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Old instance type m1.heat2, new instance type m1.heat {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:11:48.634814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:11:48.635248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:11:48.635730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:11:48.636149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:11:48.636578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:11:48.701111 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-16ed88d8-cc70-4595-8ecf-ebbd45ffd332 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76/action" status: 202 len: 0 microversion: 2.1 time: 0.128068 Aug 30 05:11:48.702028 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3506/7072] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:11:48 2022] POST /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:11:48.709686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=13 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:48.710450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:11:48.715414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:48.716080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:48.724972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:48.725762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:48.726218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:48.727039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:48.727509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:48.727947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:48.945627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:48.953921 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9e6b5e25-0e2b-44aa-8cea-c53b641b6363 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1677 microversion: 2.1 time: 0.247222 Aug 30 05:11:48.954818 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3567/7073] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:48 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1677 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:49.978236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:49.978889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:49.988948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:49.989481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:49.989935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:49.990654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:49.991146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:49.991588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:50.173607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:50.182236 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3ebe2cad-7573-43e5-8690-c5c117a6de7b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1677 microversion: 2.1 time: 0.209541 Aug 30 05:11:50.182835 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3507/7074] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:49 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:51.204305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:51.204814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:51.211755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:51.212238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:51.212675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:51.213381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:51.213833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:51.214265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:51.347313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:51.355973 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-791beacc-f3d0-4955-af0e-4d341235a755 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.155832 Aug 30 05:11:51.356547 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3568/7075] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:51 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:52.376425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:52.377052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:52.384491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:52.384980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:52.385457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:52.386159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:52.386623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:52.387236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:52.514891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:52.523259 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e914d068-c563-4fec-8525-3c3468501ab1 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.150756 Aug 30 05:11:52.523834 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3508/7076] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:52 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:53.544079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:53.544725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:53.553318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:53.553843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:53.554289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:53.554991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:53.555451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:53.555886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:53.686564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:53.694485 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d393e21e-f4da-4f89-8cfc-a20826c25f25 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.154679 Aug 30 05:11:53.695065 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3569/7077] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:53 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:54.715725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:54.716360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:54.723548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:54.724089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:54.724548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:54.725284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:54.725782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:54.726229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:54.859239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:54.867954 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dc34c04a-f891-484c-8494-3b77775187dc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.156248 Aug 30 05:11:54.868538 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3509/7078] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:54 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:55.889136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:55.890046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:55.897713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:55.898203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:55.898663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:55.899362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:55.899813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:55.900239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:56.030612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:56.038660 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26afb3a7-c870-4697-a358-7d8dcfb1c653 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.153473 Aug 30 05:11:56.039231 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3570/7079] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:55 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:57.059812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:57.060442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:57.067299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:57.067799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:57.068257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:57.068961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:57.069463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:57.069910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:57.198978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:57.207201 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9a64bb8b-3fb0-453e-9402-ed2e711bb59f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.151396 Aug 30 05:11:57.207785 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3510/7080] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:57 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:58.229762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:58.230295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:58.237095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:58.237616 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:58.238061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:58.238753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:58.239211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:58.240303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:58.366668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:58.374413 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6094f7c3-fe14-4f41-8524-151cceba9a67 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.148711 Aug 30 05:11:58.375407 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3571/7081] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:58 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:11:59.395652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:11:59.396786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:11:59.403756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:59.404250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:59.404702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:59.405423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:11:59.405891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:11:59.406332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:11:59.542462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:11:59.550812 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9319707-68af-4be3-9817-dddd3d542779 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.159037 Aug 30 05:11:59.551439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3511/7082] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:11:59 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:00.572860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:00.573438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:00.581072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:00.581589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:00.582040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:00.582733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:00.583191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:00.584183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:00.713811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:00.721876 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7678a553-753d-4d80-ac95-05e908d1d1c9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.153040 Aug 30 05:12:00.722456 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3572/7083] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:00 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:01.742862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:01.743490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:01.750373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:01.750866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:01.751346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:01.752041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:01.752504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:01.752942 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:01.879269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:01.887706 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b5558c32-bf51-42ba-b08e-546f5dbc3744 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1682 microversion: 2.1 time: 0.148787 Aug 30 05:12:01.888288 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3512/7084] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:01 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:02.909954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:02.910631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:02.918288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:02.918777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:02.919215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:02.919923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:02.920383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:02.921126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:03.031469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c59bc539-b90d-4ecf-9fe9-15bfe2289da1 req-5979f66b-d934-4860-81d0-1b837da79d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:03.042269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c59bc539-b90d-4ecf-9fe9-15bfe2289da1 req-5979f66b-d934-4860-81d0-1b837da79d78 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:03.042759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c59bc539-b90d-4ecf-9fe9-15bfe2289da1 req-5979f66b-d934-4860-81d0-1b837da79d78 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:03.043208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c59bc539-b90d-4ecf-9fe9-15bfe2289da1 req-5979f66b-d934-4860-81d0-1b837da79d78 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:03.058668 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c59bc539-b90d-4ecf-9fe9-15bfe2289da1 req-5979f66b-d934-4860-81d0-1b837da79d78 service nova] Creating event network-vif-unplugged:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h2-854925-5 Aug 30 05:12:03.065126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-c59bc539-b90d-4ecf-9fe9-15bfe2289da1 req-5979f66b-d934-4860-81d0-1b837da79d78 service nova] Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:12:03.076536 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c59bc539-b90d-4ecf-9fe9-15bfe2289da1 req-5979f66b-d934-4860-81d0-1b837da79d78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048982 Aug 30 05:12:03.077170 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3513/7085] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:12:03.205667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:03.213994 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ddeeb7bd-4707-4028-9bd4-bdd51eb384ea tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1681 microversion: 2.1 time: 0.307950 Aug 30 05:12:03.214575 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3573/7086] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:02 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1681 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:04.239350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:04.240641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:04.246891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:04.247384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:04.247837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:04.248536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:04.249002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:04.249464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:04.408861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:04.417303 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da2a4f9f-53c0-44ff-aede-bc04fcc8e29c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1681 microversion: 2.1 time: 0.183106 Aug 30 05:12:04.417909 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3514/7087] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:04 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:05.091514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c9861021-48a4-4c76-8fe1-34e2b60e353d req-b5ea37d2-2811-4ea7-820b-493803392f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:05.101918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9861021-48a4-4c76-8fe1-34e2b60e353d req-b5ea37d2-2811-4ea7-820b-493803392f24 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:05.102395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9861021-48a4-4c76-8fe1-34e2b60e353d req-b5ea37d2-2811-4ea7-820b-493803392f24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:05.102827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9861021-48a4-4c76-8fe1-34e2b60e353d req-b5ea37d2-2811-4ea7-820b-493803392f24 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:05.114251 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c9861021-48a4-4c76-8fe1-34e2b60e353d req-b5ea37d2-2811-4ea7-820b-493803392f24 service nova] Creating event network-changed:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h2-854925-5 Aug 30 05:12:05.119677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-c9861021-48a4-4c76-8fe1-34e2b60e353d req-b5ea37d2-2811-4ea7-820b-493803392f24 service nova] Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:12:05.130840 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c9861021-48a4-4c76-8fe1-34e2b60e353d req-b5ea37d2-2811-4ea7-820b-493803392f24 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042526 Aug 30 05:12:05.131429 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3574/7088] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:05.439040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:05.439678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:05.447010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:05.447516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:05.447973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:05.448688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:05.449157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:05.449635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:05.581881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:05.591005 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc3e7e1c-d44b-4b99-b694-6157fc78e36a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1679 microversion: 2.1 time: 0.155645 Aug 30 05:12:05.591925 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3515/7089] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:05 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:06.614696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:06.616024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:06.622448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.622938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.623376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.624077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.624527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.624960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.768970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:06.777208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37f9fa80-1512-4173-b81a-42c2ce54a229 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1676 microversion: 2.1 time: 0.167733 Aug 30 05:12:06.777809 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3575/7090] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:06 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:06.797981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:06.798538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:06.805941 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.806446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.806952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.807612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.808085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.808533 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.845766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.846260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.846714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.847455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:06.847925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:06.848379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:06.868799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for project 631d9b92b5974998ac654501c994c0a0. Resources: {'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:06.873987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for user 97a814523f7e493e9816a6ebae35f885 and project 631d9b92b5974998ac654501c994c0a0. Resources: {'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:06.981940 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c04b3255-c2e3-46d9-bd9e-f52ddc64057c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76/action" status: 202 len: 0 microversion: 2.1 time: 0.187685 Aug 30 05:12:06.982563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3516/7091] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:12:06 2022] POST /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:12:06.991233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:06.992119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:07.000841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:07.001539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:07.001983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:07.002794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:07.003286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:07.003895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:07.200348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:07.208387 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c2e0c327-2e03-44d1-93e3-7222265384d6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1675 microversion: 2.1 time: 0.221500 Aug 30 05:12:07.208972 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3576/7092] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:06 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:08.231219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:08.231939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:08.238118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:08.238612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:08.239065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:08.240317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:08.240770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:08.241209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:08.378787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:08.388524 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4602b208-b16a-4a27-b9e8-01ab4d9b49ae tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1675 microversion: 2.1 time: 0.162768 Aug 30 05:12:08.389125 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3517/7093] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:08 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:08.391793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9eb94016-c4af-47f8-8530-384f9a60c38a req-b383d1f0-644f-4ac7-9835-a3ae273cc52c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "name": "network-vif-plugged", "status": "completed", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:08.401386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9eb94016-c4af-47f8-8530-384f9a60c38a req-b383d1f0-644f-4ac7-9835-a3ae273cc52c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:08.402084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9eb94016-c4af-47f8-8530-384f9a60c38a req-b383d1f0-644f-4ac7-9835-a3ae273cc52c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:08.402689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9eb94016-c4af-47f8-8530-384f9a60c38a req-b383d1f0-644f-4ac7-9835-a3ae273cc52c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:08.417558 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9eb94016-c4af-47f8-8530-384f9a60c38a req-b383d1f0-644f-4ac7-9835-a3ae273cc52c service nova] Creating event network-vif-plugged:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h2-854925-5 Aug 30 05:12:08.422854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-9eb94016-c4af-47f8-8530-384f9a60c38a req-b383d1f0-644f-4ac7-9835-a3ae273cc52c service nova] Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:12:08.433792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9eb94016-c4af-47f8-8530-384f9a60c38a req-b383d1f0-644f-4ac7-9835-a3ae273cc52c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109508 Aug 30 05:12:08.434389 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3577/7094] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:12:09.411013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:09.411754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:09.418870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:09.419372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:09.419828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:09.420538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:09.421000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:09.421468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:09.439677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:09.564327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:09.573566 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-20d2b5e5-a3c6-46ba-ba39-cbc7acf1742f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1675 microversion: 2.1 time: 0.166412 Aug 30 05:12:09.574152 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3518/7095] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:09 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:10.129395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-8d641aa3-f70a-462b-b95b-121a8dc8f5d9 req-208013f7-e94f-45e8-a416-163afdc4dfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:10.139646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8d641aa3-f70a-462b-b95b-121a8dc8f5d9 req-208013f7-e94f-45e8-a416-163afdc4dfa1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:10.140137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8d641aa3-f70a-462b-b95b-121a8dc8f5d9 req-208013f7-e94f-45e8-a416-163afdc4dfa1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:10.140565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-8d641aa3-f70a-462b-b95b-121a8dc8f5d9 req-208013f7-e94f-45e8-a416-163afdc4dfa1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:10.152792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-8d641aa3-f70a-462b-b95b-121a8dc8f5d9 req-208013f7-e94f-45e8-a416-163afdc4dfa1 service nova] Creating event network-vif-unplugged:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h1-854925-5 Aug 30 05:12:10.158133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-8d641aa3-f70a-462b-b95b-121a8dc8f5d9 req-208013f7-e94f-45e8-a416-163afdc4dfa1 service nova] Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:12:10.169547 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-8d641aa3-f70a-462b-b95b-121a8dc8f5d9 req-208013f7-e94f-45e8-a416-163afdc4dfa1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104963 Aug 30 05:12:10.170170 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3578/7096] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:10.596656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:10.597312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:10.604849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:10.605475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:10.605998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:10.606718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:10.607191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:10.607634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:10.752622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:10.763504 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ab54ee35-498c-4393-935b-e23644e15277 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1675 microversion: 2.1 time: 0.171201 Aug 30 05:12:10.765185 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3519/7097] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:10 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1675 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:11.788933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:11.789668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:11.796031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:11.796522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:11.796971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:11.797690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:11.798151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:11.798582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:11.930581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:11.938414 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf4543de-9858-4e8a-a8fa-bfb760a42d8c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1675 microversion: 2.1 time: 0.154861 Aug 30 05:12:11.938999 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3579/7098] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:11 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:12.187912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fdb309ed-1cef-44e2-b1cf-09f891dd8984 req-b09ca753-58e1-4961-9217-3fd2bcb826f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:12.199936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fdb309ed-1cef-44e2-b1cf-09f891dd8984 req-b09ca753-58e1-4961-9217-3fd2bcb826f4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:12.200435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fdb309ed-1cef-44e2-b1cf-09f891dd8984 req-b09ca753-58e1-4961-9217-3fd2bcb826f4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:12.200882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fdb309ed-1cef-44e2-b1cf-09f891dd8984 req-b09ca753-58e1-4961-9217-3fd2bcb826f4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:12.212526 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-fdb309ed-1cef-44e2-b1cf-09f891dd8984 req-b09ca753-58e1-4961-9217-3fd2bcb826f4 service nova] Creating event network-changed:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h1-854925-5 Aug 30 05:12:12.217842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-fdb309ed-1cef-44e2-b1cf-09f891dd8984 req-b09ca753-58e1-4961-9217-3fd2bcb826f4 service nova] Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:12:12.229666 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fdb309ed-1cef-44e2-b1cf-09f891dd8984 req-b09ca753-58e1-4961-9217-3fd2bcb826f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045515 Aug 30 05:12:12.230619 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3520/7099] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:12.960838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:12.961479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:12.968470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:12.968990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:12.969465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:12.970420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:12.970881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:12.971310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:13.111512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:13.119373 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0205749-b6a7-4080-b93f-8a197e836a26 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1675 microversion: 2.1 time: 0.163386 Aug 30 05:12:13.119953 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3580/7100] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:12 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:14.141367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.142036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.149176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.149721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.150189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.150920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.151396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.151852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.280958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.289430 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c926c980-781b-4559-82bb-d08179884383 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1668 microversion: 2.1 time: 0.152431 Aug 30 05:12:14.290010 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3521/7101] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:14 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:14.309437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.310057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.316832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.317316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.317785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.318485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.318941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.319372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.450193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.457945 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-049fe269-54ad-49f3-85e2-723c5e9b957b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1668 microversion: 2.1 time: 0.152398 Aug 30 05:12:14.458526 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3581/7102] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:14 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:14.479069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.479702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.488201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.490841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.490841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.490841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.490841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.491226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.619852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.627798 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bb6644e6-8448-4819-8749-95b33fab948e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1668 microversion: 2.1 time: 0.153200 Aug 30 05:12:14.628387 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3522/7103] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:14 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:14.648098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.648532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.655143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.655628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.656066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.656753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.657208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.657663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.683243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:12:14.735076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:14.766183 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4137a230-1d29-41b6-bb39-0a921a01c8f3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 204 len: 0 microversion: 2.1 time: 0.121822 Aug 30 05:12:14.766790 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3582/7104] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:12:14 2022] DELETE /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:12:14.775970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:14.776611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:14.783732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.784515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.785145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.786089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:14.786571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:14.787426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:14.925626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:14.935669 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec73eca6-03b9-43a9-8aa9-57422d333968 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1674 microversion: 2.1 time: 0.164182 Aug 30 05:12:14.936545 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3523/7105] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:14 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:15.958492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:15.959739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:15.966648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.967137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.967574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:15.968263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:15.968714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:15.969138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:16.101448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:16.109297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4d7bb2b-feea-4b3a-a8ae-c0b02f128351 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1674 microversion: 2.1 time: 0.155094 Aug 30 05:12:16.109896 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3583/7106] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:15 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:17.139743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:17.194103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:17.194736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:17.201065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.201600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.202245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.203150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.203626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.204073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.218317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9c289e33-7a32-4757-b8b0-26acf1ce416c req-b8659f73-441e-43ec-a40c-893cbc8e8173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52d3b269-35c7-48dd-92b5-bc6d269aed76", "name": "network-vif-deleted", "tag": "ee6c2324-290b-47af-af5f-8d9cb7e29319"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:17.234257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9c289e33-7a32-4757-b8b0-26acf1ce416c req-b8659f73-441e-43ec-a40c-893cbc8e8173 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:17.234747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9c289e33-7a32-4757-b8b0-26acf1ce416c req-b8659f73-441e-43ec-a40c-893cbc8e8173 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:17.235254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9c289e33-7a32-4757-b8b0-26acf1ce416c req-b8659f73-441e-43ec-a40c-893cbc8e8173 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:17.250868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9c289e33-7a32-4757-b8b0-26acf1ce416c req-b8659f73-441e-43ec-a40c-893cbc8e8173 service nova] Creating event network-vif-deleted:ee6c2324-290b-47af-af5f-8d9cb7e29319 for instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 on n-h1-854925-5 Aug 30 05:12:17.256798 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9c289e33-7a32-4757-b8b0-26acf1ce416c req-b8659f73-441e-43ec-a40c-893cbc8e8173 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042023 Aug 30 05:12:17.261812 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3584/7107] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:17.272507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:17.280888 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e234332e-624f-4570-8540-a9c53ce45cbc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 200 len: 1607 microversion: 2.1 time: 0.146723 Aug 30 05:12:17.281523 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3524/7108] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:17 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 1607 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:18.304390 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:18.305134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:18.311436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.311926 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.312374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.313070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.313569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.314005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.327846 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 HTTP/1.1 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '52d3b269-35c7-48dd-92b5-bc6d269aed76'} Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:12:18.329597 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0ca00b0e-1e09-4884-a2cf-43bcfdf2770e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 404 len: 111 microversion: 2.1 time: 0.031811 Aug 30 05:12:18.333447 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3585/7109] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:18 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:12:18.348747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:18.349430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:18.356403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.356915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.357398 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.358114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.358589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.359041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.372544 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 HTTP/1.1 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '52d3b269-35c7-48dd-92b5-bc6d269aed76'} Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:12:18.374258 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f5fc3638-41a5-4aad-8434-79f07afa2cd2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 404 len: 111 microversion: 2.1 time: 0.031171 Aug 30 05:12:18.378711 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3525/7110] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:18 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:12:18.425924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1235067562", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "48111861-387a-4a32-b304-48b570ee81c1"}], "security_groups": [{"name": "tempest-securitygroup--967763685"}], "key_name": "tempest-keypair-202857827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:18.530174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] validate_networks() for [('48111861-387a-4a32-b304-48b570ee81c1', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:12:18.903445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:12:18.903873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:12:18.904350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:12:18.905273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:12:18.905273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:12:18.907264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:18.915981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.916467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.916904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.917661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:18.918118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:18.918547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:18.936228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:12:18.941548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for user 97a814523f7e493e9816a6ebae35f885 and project 631d9b92b5974998ac654501c994c0a0. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:12:18.954205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:12:18.956551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:12:19.002986 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0cf660b0-dd85-4cd9-9087-8177909de1d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.581203 Aug 30 05:12:19.003633 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3586/7111] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:12:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:12:19.015246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-62c3d351-a192-4101-b95c-f7d98895eca3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:19.015985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-62c3d351-a192-4101-b95c-f7d98895eca3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:19.018951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:19.070843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-62c3d351-a192-4101-b95c-f7d98895eca3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:19.077952 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-62c3d351-a192-4101-b95c-f7d98895eca3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1238 microversion: 2.1 time: 0.066670 Aug 30 05:12:19.078533 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3526/7112] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:19 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:20.099119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:20.099809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:20.106348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.106833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.107268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.107955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:20.108406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:20.108831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:20.206033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:20.214289 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e843a4c-bd8e-4537-a27b-e3a97fd61b59 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1296 microversion: 2.1 time: 0.119570 Aug 30 05:12:20.214864 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3587/7113] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:20 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1296 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:21.236284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:21.236979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:21.245304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.245836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.246294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.247009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.247480 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.247931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.298410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5987b525-09cb-4410-9f11-10c2f9a59abd req-f99a094f-bc58-410c-815d-235d20e0e72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:21.311297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5987b525-09cb-4410-9f11-10c2f9a59abd req-f99a094f-bc58-410c-815d-235d20e0e72d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:21.311708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5987b525-09cb-4410-9f11-10c2f9a59abd req-f99a094f-bc58-410c-815d-235d20e0e72d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:21.312142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5987b525-09cb-4410-9f11-10c2f9a59abd req-f99a094f-bc58-410c-815d-235d20e0e72d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:21.323829 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5987b525-09cb-4410-9f11-10c2f9a59abd req-f99a094f-bc58-410c-815d-235d20e0e72d service nova] Creating event network-changed:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h2-854925-5 Aug 30 05:12:21.328866 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5987b525-09cb-4410-9f11-10c2f9a59abd req-f99a094f-bc58-410c-815d-235d20e0e72d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034047 Aug 30 05:12:21.329668 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3588/7114] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:21.532850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:21.541939 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc1b662f-8398-4564-b155-4a76d6225a61 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1363 microversion: 2.1 time: 0.309535 Aug 30 05:12:21.542547 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3527/7115] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:21 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:12:22.567323 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:22.568025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:22.574984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.575477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.575920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.576621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:22.577080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:22.577543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:22.799776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:22.808445 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7387bad1-066f-4462-a592-f44085efbd89 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1363 microversion: 2.1 time: 0.246325 Aug 30 05:12:22.821564 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3589/7116] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:22 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:23.830175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:23.830811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:23.838487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.838988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.839446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.840234 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:23.840707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:23.841145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:23.976325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:23.984211 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1b2fc951-8a32-48d2-9429-8bc4a3eb1c08 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1363 microversion: 2.1 time: 0.158039 Aug 30 05:12:23.984814 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3528/7117] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:23 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:25.005916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:25.006541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:25.013471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.013956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.014392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.015078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:25.015531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:25.015957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:25.141814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:25.150108 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eb1612e4-c4e5-4e73-a0de-c4be4bb0f420 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1363 microversion: 2.1 time: 0.148182 Aug 30 05:12:25.150682 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3590/7118] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:25 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:26.171280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:26.171918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:26.179537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.180093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.180609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.181347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.181820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.182272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.317877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:26.326310 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0f3992a0-3969-43ad-bd32-6aeafa327eb0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1363 microversion: 2.1 time: 0.158903 Aug 30 05:12:26.326930 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3529/7119] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:26 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:26.521244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c9522175-7a26-41ed-bbfa-b9ca521eb7bc req-2bafd216-762c-41fa-b4de-33f6dee94300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "name": "network-vif-plugged", "status": "completed", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:26.532523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9522175-7a26-41ed-bbfa-b9ca521eb7bc req-2bafd216-762c-41fa-b4de-33f6dee94300 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:26.533016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9522175-7a26-41ed-bbfa-b9ca521eb7bc req-2bafd216-762c-41fa-b4de-33f6dee94300 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:26.533476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c9522175-7a26-41ed-bbfa-b9ca521eb7bc req-2bafd216-762c-41fa-b4de-33f6dee94300 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:26.545594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c9522175-7a26-41ed-bbfa-b9ca521eb7bc req-2bafd216-762c-41fa-b4de-33f6dee94300 service nova] Creating event network-vif-plugged:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h2-854925-5 Aug 30 05:12:26.550963 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c9522175-7a26-41ed-bbfa-b9ca521eb7bc req-2bafd216-762c-41fa-b4de-33f6dee94300 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033377 Aug 30 05:12:26.551594 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3591/7120] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:12:27.348548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:27.349180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:27.356593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.357086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.357562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.358265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:27.358727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:27.359165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:27.487371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:27.495879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3f7351d1-f4b1-4b6c-85b9-551a88d199b8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1363 microversion: 2.1 time: 0.151600 Aug 30 05:12:27.496470 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3530/7121] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:27 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:28.520612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:28.521359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:28.528626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.529116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.529591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.530284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.530742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.531174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.673252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:12:28.682915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-02a9e6b9-fa85-4b65-92bd-2057a0483289 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1550 microversion: 2.1 time: 0.169600 Aug 30 05:12:28.683544 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3592/7122] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:12:28 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1550 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:12:28.704725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:12:28.705415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:12:28.712484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.712989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.713523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.714239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:28.714749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:28.715192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:28.803362 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f0f0e1fb-46c4-4185-90ae-d028691c703e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101994 Aug 30 05:12:28.804005 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3531/7123] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 05:12:28 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:12:30.072639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7c8f1843-75ac-4310-b49d-220eb02e5190 req-696894f2-dd8e-49dd-93e1-25d13cb9ef07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:12:30.077602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:30.078350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:12:30.085637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7c8f1843-75ac-4310-b49d-220eb02e5190 req-696894f2-dd8e-49dd-93e1-25d13cb9ef07 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:12:30.086214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7c8f1843-75ac-4310-b49d-220eb02e5190 req-696894f2-dd8e-49dd-93e1-25d13cb9ef07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:12:30.086717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7c8f1843-75ac-4310-b49d-220eb02e5190 req-696894f2-dd8e-49dd-93e1-25d13cb9ef07 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:12:30.098186 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7c8f1843-75ac-4310-b49d-220eb02e5190 req-696894f2-dd8e-49dd-93e1-25d13cb9ef07 service nova] Creating event network-changed:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h2-854925-5 Aug 30 05:12:30.103211 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7c8f1843-75ac-4310-b49d-220eb02e5190 req-696894f2-dd8e-49dd-93e1-25d13cb9ef07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034973 Aug 30 05:12:30.103821 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3593/7124] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:04.597275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:04.600156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=13 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:04.601372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=66 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:04.606158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:04.606789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:04.614834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:04.615339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:04.615789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:04.617058 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:04.617580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:04.618024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:04.754423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:04.762831 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-469b52ac-1f79-4345-8815-67fe7ab2cd70 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1668 microversion: 2.1 time: 0.166263 Aug 30 05:13:04.763406 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3532/7125] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:04 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1668 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:04.780998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:04.781932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=42 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:04.786238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "418d3ea9-616e-4f31-b85f-987f28937b06"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:04.789316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:04.797180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:04.797705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:04.798149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:04.798846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:04.799303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:04.799732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:05.045815 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d69c604-f1a8-4098-9f13-102f80228c33 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266514 Aug 30 05:13:05.046783 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3594/7126] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 05:13:04 2022] POST /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:15.744505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:15.746902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:15.749700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:15.750374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:15.756240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:15.756738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:15.757192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:15.757920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:15.758386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:15.758824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:15.786793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:15.793565 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Old instance type m1.heat2, new instance type m1.heat {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:13:15.800648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:13:15.801081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:13:15.801600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:13:15.802018 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:13:15.802442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:13:15.865053 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b2d79d7c-99d9-43c1-8ab4-289689fc1a3d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/action" status: 202 len: 0 microversion: 2.1 time: 0.124492 Aug 30 05:13:15.865941 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3533/7127] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:13:15 2022] POST /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:13:15.872213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:15.873662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:15.878025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:15.879167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:15.886828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:15.887230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:15.887683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:15.888380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:15.888856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:15.889291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:16.029844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:16.038673 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0d4107dc-e4ce-4385-bb5d-4bdb9cd02306 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1723 microversion: 2.1 time: 0.168451 Aug 30 05:13:16.039277 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3595/7128] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:15 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:17.060860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:17.061444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:17.071603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:17.072097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:17.072547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:17.073278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:17.073772 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:17.074213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:17.221961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:17.230382 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-280d72cf-edb5-445c-8749-f9e29e292503 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1723 microversion: 2.1 time: 0.174402 Aug 30 05:13:17.231006 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3534/7129] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:17 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:18.252168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:18.252734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:18.260160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:18.260646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:18.261086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:18.261818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:18.262273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:18.262703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:18.395095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:18.403978 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ba3a972a-9ee8-4305-93ab-57fce875b4a4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.155822 Aug 30 05:13:18.404553 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3596/7130] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:18 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:19.425348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:19.426021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:19.432957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:19.433479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:19.434022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:19.434718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:19.435180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:19.435617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:19.563250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:19.571529 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a1f48302-4e26-4fa3-8a29-5f81af20fad9 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.150162 Aug 30 05:13:19.572215 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3535/7131] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:19 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:20.592876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:20.593458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:20.600546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:20.601024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:20.601560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:20.602253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:20.602711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:20.603133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:20.740561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:20.748918 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6fbfcf6-b474-44b4-a8e5-ee18d7ecd8c2 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.160112 Aug 30 05:13:20.749521 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3597/7132] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:20 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:21.770473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:21.771128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:21.778456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:21.778951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:21.779400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:21.780093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:21.780558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:21.780998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:21.909736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:21.919414 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e3de133-1658-47cb-8198-704030fad5f8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.152823 Aug 30 05:13:21.920008 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3536/7133] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:21 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:22.940912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:22.941570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:22.949069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:22.949620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:22.950105 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:22.950801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:22.951261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:22.951696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:23.082142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:23.090945 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26b5b245-bee8-48bf-aa80-55612bce2a2e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.154001 Aug 30 05:13:23.091523 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3598/7134] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:22 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:24.114394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:24.115127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:24.122832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:24.123335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:24.123793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:24.124512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:24.124988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:24.125471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:24.253255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:24.261628 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f7539d53-95bc-466f-ae3f-04f8776633cc tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.151202 Aug 30 05:13:24.262216 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3537/7135] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:24 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:25.283045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:25.283585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:25.290403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:25.290885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:25.291318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:25.292007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:25.292455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:25.292883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:25.420699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:25.429030 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bf3dd402-c465-4d3a-b5b3-e799bbe0f372 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.150000 Aug 30 05:13:25.430185 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3599/7136] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:25 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:26.451467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:26.452098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:26.459176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:26.459675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:26.460134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:26.460836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:26.461306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:26.461775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:26.595161 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:26.604476 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03f3bbf2-424a-43ee-b095-ca04cab15ddb tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.156955 Aug 30 05:13:26.605250 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3538/7137] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:26 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:27.626348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:27.626995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:27.634031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:27.634508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:27.634943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:27.635628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:27.636080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:27.636507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:27.773677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:27.781999 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-44a8509c-7f59-4d1d-b4b3-4e4eb73fabfd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.159583 Aug 30 05:13:27.782571 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3600/7138] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:27 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:28.803282 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:28.803935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:28.810787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.811284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.811734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.812437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:28.812902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:28.813362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:28.946725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:28.955003 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2fe4e5e8-faf5-4300-aa85-f62005faba5a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.155679 Aug 30 05:13:28.955578 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3539/7139] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:28 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:29.976872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:29.977514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:29.984296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:29.984781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:29.985217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:29.985927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:29.986379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:29.986805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:30.116997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:30.125392 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ae0f82c-c119-425f-b60c-ecf29f9cd41a tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.152972 Aug 30 05:13:30.125981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3601/7140] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:29 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:31.150481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:31.151122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:31.158187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.158703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.159163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.159871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:31.160345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:31.160794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:31.297224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:31.305680 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-59bb8da4-1d63-498a-9698-2b84427167ba tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.159717 Aug 30 05:13:31.306275 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3540/7141] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:31 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:32.326656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:32.327172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:32.334346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.334834 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.335266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.336523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:32.336975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:32.337428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:32.464543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:32.473028 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-92fab137-2fab-43c0-9060-b772383b2c44 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.150362 Aug 30 05:13:32.473661 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3602/7142] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:32 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:33.495406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:33.496194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:33.499378 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:13:33.499521 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:13:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 (ip 10.222.0.27) !!! Aug 30 05:13:33.505449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.505952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.506403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.507120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:33.507587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:33.508029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:33.639190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:33.647599 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-55f19aef-b958-4bb5-976c-6dc272bcbf0e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.156701 Aug 30 05:13:33.648687 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3541/7143] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:33 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:34.668971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:34.669622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:34.672802 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:13:34.672947 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:13:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 (ip 10.222.0.27) !!! Aug 30 05:13:34.679716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.680207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.680646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.681349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:34.681818 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:34.682248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:34.820761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:34.829571 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb15db6c-e194-4b47-b384-e412e01d8dc7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.164489 Aug 30 05:13:34.830491 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3603/7144] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:34 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:35.851198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:35.851832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:35.858268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:35.858764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:35.859226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:35.859928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:35.860401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:35.860843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:35.997235 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:36.005761 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7d091b31-4c19-401b-aac8-9fe70f6ede3c tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1728 microversion: 2.1 time: 0.158544 Aug 30 05:13:36.006353 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3542/7145] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:35 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:37.028503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:37.029125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:37.035686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.036174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.036617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.037321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.037798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.038234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.172531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:37.180930 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0801d871-922f-4c18-bb16-bffd9a444ac5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1727 microversion: 2.1 time: 0.156541 Aug 30 05:13:37.181547 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3604/7146] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:37 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:37.251796 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-e98b5586-c671-4101-b937-b20a5f257ffe req-2ed59c53-eaa9-45c7-9dd2-499757cfdad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "name": "network-vif-unplugged", "status": "completed", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:37.268257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e98b5586-c671-4101-b937-b20a5f257ffe req-2ed59c53-eaa9-45c7-9dd2-499757cfdad3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:37.268734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e98b5586-c671-4101-b937-b20a5f257ffe req-2ed59c53-eaa9-45c7-9dd2-499757cfdad3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:37.269178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-e98b5586-c671-4101-b937-b20a5f257ffe req-2ed59c53-eaa9-45c7-9dd2-499757cfdad3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:37.283429 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-e98b5586-c671-4101-b937-b20a5f257ffe req-2ed59c53-eaa9-45c7-9dd2-499757cfdad3 service nova] Creating event network-vif-unplugged:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h1-854925-5 Aug 30 05:13:37.288821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-e98b5586-c671-4101-b937-b20a5f257ffe req-2ed59c53-eaa9-45c7-9dd2-499757cfdad3 service nova] Instance f1d123ee-c112-4b31-9727-5a28e174a057 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:13:37.299986 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-e98b5586-c671-4101-b937-b20a5f257ffe req-2ed59c53-eaa9-45c7-9dd2-499757cfdad3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052621 Aug 30 05:13:37.300602 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3543/7147] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:38.202735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:38.203741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:38.213647 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:38.214487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:38.215200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:38.215960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:38.216424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:38.216859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:38.356714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:38.365245 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9e5f5cc-9fad-459c-bd36-7a9236d08fd8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1727 microversion: 2.1 time: 0.166529 Aug 30 05:13:38.366007 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3605/7148] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:38 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:13:39.337255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-bf7032c6-31b5-466a-b9fd-d2b16446f4bc req-8222d484-0454-4b92-94f3-eff52ec747cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:39.348546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bf7032c6-31b5-466a-b9fd-d2b16446f4bc req-8222d484-0454-4b92-94f3-eff52ec747cb service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.349142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bf7032c6-31b5-466a-b9fd-d2b16446f4bc req-8222d484-0454-4b92-94f3-eff52ec747cb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.349684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-bf7032c6-31b5-466a-b9fd-d2b16446f4bc req-8222d484-0454-4b92-94f3-eff52ec747cb service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.363064 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-bf7032c6-31b5-466a-b9fd-d2b16446f4bc req-8222d484-0454-4b92-94f3-eff52ec747cb service nova] Creating event network-changed:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h1-854925-5 Aug 30 05:13:39.368752 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-bf7032c6-31b5-466a-b9fd-d2b16446f4bc req-8222d484-0454-4b92-94f3-eff52ec747cb service nova] Instance f1d123ee-c112-4b31-9727-5a28e174a057 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:13:39.379843 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-bf7032c6-31b5-466a-b9fd-d2b16446f4bc req-8222d484-0454-4b92-94f3-eff52ec747cb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048540 Aug 30 05:13:39.380781 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3544/7149] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:39.391472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:39.392150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:39.400478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.401261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.401793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.402604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:39.403066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:39.403506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:39.651145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:39.669031 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-43cd7a2f-766b-4c50-a2b9-12d91a492fa5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.285176 Aug 30 05:13:39.679508 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3606/7150] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:39 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:40.702393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:40.703109 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:40.709289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.709811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.710295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.710992 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:40.711458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:40.711897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:40.853959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:40.862452 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82c9cecc-60f4-4081-ba4b-81237dc2b191 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.165165 Aug 30 05:13:40.863113 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3545/7151] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:40 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:41.884943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:41.885937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:41.892914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.893434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.893884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:41.894589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:41.895051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:41.895592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:42.029935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:42.038391 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e3350b64-3115-4874-9e52-f6dbc3758c77 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.157961 Aug 30 05:13:42.038991 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3607/7152] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:41 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:43.060192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:43.061008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:43.068008 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.068510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.069106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:43.070347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:43.070821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:43.071271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:43.202578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:43.213087 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9807f773-e766-440c-9112-d4bb10835498 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.157124 Aug 30 05:13:43.213720 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3546/7153] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:43 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:44.234899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:44.235454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:44.242318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:44.242806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:44.243261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:44.243951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:44.244407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:44.244840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:44.374491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:44.382792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0df60ad1-68d8-4c93-97e9-bc70b9475f94 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.151973 Aug 30 05:13:44.383400 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3608/7154] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:44 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:45.404010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:45.404667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:45.411650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.412145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.412600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.413847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:45.414347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:45.414793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:45.544036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:45.552274 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5be46cb2-01d5-427f-9e83-876e94360096 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.152230 Aug 30 05:13:45.552873 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3547/7155] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:45 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:46.574265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:46.574882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:46.577595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=29 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:46.582878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:46.583364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:46.583799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:46.584491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:46.585051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:46.585553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:46.589626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=85 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:46.713812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:46.723072 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-983b0b79-642f-4690-a252-fc1030552466 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.153280 Aug 30 05:13:46.723703 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3609/7156] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:46 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:47.744945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:47.745595 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:47.748507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=35 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:47.753870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:47.754372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:47.754826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:47.755527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:47.755995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:47.756437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:47.761074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:13:47.891880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:47.900798 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3aeb04ae-8df7-4726-9ae0-568ef83bbffa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.159807 Aug 30 05:13:47.901632 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3548/7157] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:47 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:48.922611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:48.923233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:48.930286 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.930778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.931217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:48.931911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:48.932369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:48.932800 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:49.060801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:49.069060 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7922747-fa97-41b0-afd4-c9a5bb37bb9d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.150622 Aug 30 05:13:49.069676 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3610/7158] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:48 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:50.091374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:50.091958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:50.099147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.099647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.100105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.100814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:50.102735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:50.102735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:50.232870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:50.241155 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd7ca4c7-6e87-47af-8671-bfa8162ca160 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.153804 Aug 30 05:13:50.242393 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3549/7159] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:50 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:51.263929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:51.265170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:51.272348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.272930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.273661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.274463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:51.275022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:51.275749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:51.423836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:51.433960 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29fc703d-cd0b-4c85-9d28-2c1930ad2fe7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1725 microversion: 2.1 time: 0.174189 Aug 30 05:13:51.434558 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3611/7160] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:51 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:52.455477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:52.456105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:52.463106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.463604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.464061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.464768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.465242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.465720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.592577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:52.601203 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e66985a9-8303-40a4-aed4-34d991589baa tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1722 microversion: 2.1 time: 0.149710 Aug 30 05:13:52.601817 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3550/7161] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:52 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:52.622100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:52.622775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:52.629735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.630218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.630661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.631346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.631804 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.632237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.669394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.669881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.670318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.671045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.671499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.671928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.692854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for project 631d9b92b5974998ac654501c994c0a0. Resources: {'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:13:52.698801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Getting quotas for user 97a814523f7e493e9816a6ebae35f885 and project 631d9b92b5974998ac654501c994c0a0. Resources: {'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:13:52.799009 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0e42b37-50ea-49db-ac7a-f290b722a18b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "POST /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/action" status: 202 len: 0 microversion: 2.1 time: 0.180544 Aug 30 05:13:52.799548 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3612/7162] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:13:52 2022] POST /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:13:52.808468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:52.809117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:52.815192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.815695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.816149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.816864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:52.817351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:52.817805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:52.953500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:52.961751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a2f5be44-bfff-467e-b21b-bbbd77bff6ee tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.157769 Aug 30 05:13:52.962335 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3551/7163] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:52 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:53.439011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f5206926-72f7-4d63-8a94-daa52d4adaa2 req-4c93c4c3-f55a-43b1-bf0b-d4bc8482e9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "name": "network-vif-plugged", "status": "completed", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:53.451341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5206926-72f7-4d63-8a94-daa52d4adaa2 req-4c93c4c3-f55a-43b1-bf0b-d4bc8482e9b5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.451963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5206926-72f7-4d63-8a94-daa52d4adaa2 req-4c93c4c3-f55a-43b1-bf0b-d4bc8482e9b5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.452598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f5206926-72f7-4d63-8a94-daa52d4adaa2 req-4c93c4c3-f55a-43b1-bf0b-d4bc8482e9b5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.465928 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f5206926-72f7-4d63-8a94-daa52d4adaa2 req-4c93c4c3-f55a-43b1-bf0b-d4bc8482e9b5 service nova] Creating event network-vif-plugged:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h1-854925-5 Aug 30 05:13:53.473083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-f5206926-72f7-4d63-8a94-daa52d4adaa2 req-4c93c4c3-f55a-43b1-bf0b-d4bc8482e9b5 service nova] Instance f1d123ee-c112-4b31-9727-5a28e174a057 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:13:53.484652 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f5206926-72f7-4d63-8a94-daa52d4adaa2 req-4c93c4c3-f55a-43b1-bf0b-d4bc8482e9b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050403 Aug 30 05:13:53.485342 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3613/7164] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:53.983185 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:53.983845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:53.990835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.991337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.992301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:53.993005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:53.993514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:53.993961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:54.120938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:54.129239 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-02ffc4dd-b14d-4255-a99b-005e46e78a7e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.150200 Aug 30 05:13:54.129852 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3552/7165] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:53 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:55.153445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:55.154277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:55.160492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.160920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.161387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.162074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:55.162532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:55.162974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:55.294574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:55.303119 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5bee12ba-4796-45cb-934a-a28d267098d0 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.155460 Aug 30 05:13:55.303699 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3614/7166] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:55 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:56.324868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:56.325526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:56.332636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.333132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.333603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.334307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:56.334770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:56.335212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:56.467290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:56.476545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9e57573-d537-458e-917b-fddacc514d06 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.155734 Aug 30 05:13:56.477211 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3553/7167] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:56 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:57.498501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:57.499025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:57.507915 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.508410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.509605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.510660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:57.511141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:57.511580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:57.652747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:57.661461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77bc6312-6429-488a-a537-01c69fc62d3f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.167418 Aug 30 05:13:57.662052 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3615/7168] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:57 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:58.293051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-8769d545-adf4-44c7-b324-4267cad8d9f8 req-f0aad7d3-b0ae-4e9f-89ab-e1dd5d437a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "name": "network-vif-unplugged", "status": "completed", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:13:58.303288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8769d545-adf4-44c7-b324-4267cad8d9f8 req-f0aad7d3-b0ae-4e9f-89ab-e1dd5d437a08 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:58.303854 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8769d545-adf4-44c7-b324-4267cad8d9f8 req-f0aad7d3-b0ae-4e9f-89ab-e1dd5d437a08 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:58.305319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-8769d545-adf4-44c7-b324-4267cad8d9f8 req-f0aad7d3-b0ae-4e9f-89ab-e1dd5d437a08 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:58.318197 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-8769d545-adf4-44c7-b324-4267cad8d9f8 req-f0aad7d3-b0ae-4e9f-89ab-e1dd5d437a08 service nova] Creating event network-vif-unplugged:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h2-854925-5 Aug 30 05:13:58.323765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-8769d545-adf4-44c7-b324-4267cad8d9f8 req-f0aad7d3-b0ae-4e9f-89ab-e1dd5d437a08 service nova] Instance f1d123ee-c112-4b31-9727-5a28e174a057 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:13:58.336076 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-8769d545-adf4-44c7-b324-4267cad8d9f8 req-f0aad7d3-b0ae-4e9f-89ab-e1dd5d437a08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115784 Aug 30 05:13:58.336764 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3554/7169] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:13:58.683397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:58.684039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:58.690799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:58.691283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:58.691715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:58.692413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:58.692861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:58.693287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:58.888878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:13:58.897207 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4de50687-ebd2-4bcc-9883-12e147a870d7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.217727 Aug 30 05:13:58.898747 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3616/7170] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:58 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:13:59.921515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:13:59.922341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:13:59.928797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.929390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.929852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:13:59.930568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:13:59.931043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:13:59.931491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.066360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:00.075359 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14d0be72-9777-4485-9c9b-657628015a11 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.159243 Aug 30 05:14:00.075899 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3555/7171] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:13:59 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:00.354643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-9fbfc7e4-aeb2-4f15-afa9-04f4f7500cf2 req-72de00d7-faf8-4a6e-85e8-b975ccb21e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:00.364927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9fbfc7e4-aeb2-4f15-afa9-04f4f7500cf2 req-72de00d7-faf8-4a6e-85e8-b975ccb21e33 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:00.365425 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9fbfc7e4-aeb2-4f15-afa9-04f4f7500cf2 req-72de00d7-faf8-4a6e-85e8-b975ccb21e33 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:00.365855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-9fbfc7e4-aeb2-4f15-afa9-04f4f7500cf2 req-72de00d7-faf8-4a6e-85e8-b975ccb21e33 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:00.378132 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-9fbfc7e4-aeb2-4f15-afa9-04f4f7500cf2 req-72de00d7-faf8-4a6e-85e8-b975ccb21e33 service nova] Creating event network-changed:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h2-854925-5 Aug 30 05:14:00.383472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-9fbfc7e4-aeb2-4f15-afa9-04f4f7500cf2 req-72de00d7-faf8-4a6e-85e8-b975ccb21e33 service nova] Instance f1d123ee-c112-4b31-9727-5a28e174a057 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:14:00.394561 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-9fbfc7e4-aeb2-4f15-afa9-04f4f7500cf2 req-72de00d7-faf8-4a6e-85e8-b975ccb21e33 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044187 Aug 30 05:14:00.395165 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3617/7172] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:01.096868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:01.098168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:01.105238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.105785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.106246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.106960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:01.107431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:01.107878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:01.239172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:01.247804 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6a46abc-3c98-48d2-b124-6784224268b3 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.155236 Aug 30 05:14:01.248390 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3556/7173] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:01 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:02.271475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:02.272293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:02.279011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.279488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.279924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:02.280603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:02.281061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:02.281523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:02.416717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:02.425298 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a3035ba5-199d-4729-8488-941c3c23fbd5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.159232 Aug 30 05:14:02.425925 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3618/7174] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:02 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:03.448431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:03.449092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:03.457656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:03.458170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:03.458634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:03.459365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:03.459839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:03.460890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:03.594351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:03.603345 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0abc597d-c43c-46bd-8c52-0e36b73f7c50 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.160651 Aug 30 05:14:03.603931 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3557/7175] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:03 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:04.625484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:04.626296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:04.628339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:04.635596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:04.636102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:04.636560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:04.637235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:04.638033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:04.638248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:04.770024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:04.778270 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a542a289-e009-48fe-bf58-061e007390e5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.156890 Aug 30 05:14:04.778845 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3619/7176] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:04 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:05.799715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:05.800387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:05.807435 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:05.807943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:05.808404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:05.809112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:05.809618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:05.810072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:05.943528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:05.952001 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-22747521-70ce-439c-b144-ee8b760f9491 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.156248 Aug 30 05:14:05.952585 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3558/7177] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:05 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:06.974748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:06.975389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:06.982182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:06.982667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:06.983108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:06.984085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:06.984475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:06.984909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:07.113042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:07.121551 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b855b81-8bf9-4764-aceb-8e83f579a411 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.151515 Aug 30 05:14:07.122131 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3620/7178] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:06 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:08.143095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:08.143732 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:08.151716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:08.152220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:08.152692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:08.153408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:08.153880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:08.154321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:08.282596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:08.291741 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14fe52d6-13f4-40a2-a70b-586edfd913e8 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.152672 Aug 30 05:14:08.292320 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3559/7179] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:08 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:09.311816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:09.312357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:09.319445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:09.319936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:09.320969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:09.321699 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:09.322162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:09.322599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:09.460050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:09.468980 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f87e4aaf-04b8-4e14-822b-8e05010e4f6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.161173 Aug 30 05:14:09.469589 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3621/7180] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:09 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:10.490646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:10.491281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:10.498697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:10.499190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:10.499643 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:10.500344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:10.500817 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:10.501246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:10.633773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:10.642143 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b870bf3d-b8a9-431e-bc5e-17497f0f8ac4 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1721 microversion: 2.1 time: 0.155541 Aug 30 05:14:10.642734 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3560/7181] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:10 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:11.663213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:11.663868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:11.671571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.672061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.672514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.673214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.673708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.674144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.807694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:11.815917 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-96617872-f238-4959-93e9-81e897add6c6 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1714 microversion: 2.1 time: 0.157100 Aug 30 05:14:11.816495 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3622/7182] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:11 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:11.836357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:11.836985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:11.844387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.844883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.845343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.846324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:11.846785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:11.847222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:11.976677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:11.984972 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6ef02b27-537d-403c-85ee-35ce360472d5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1714 microversion: 2.1 time: 0.152455 Aug 30 05:14:11.985591 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3561/7183] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:11 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:12.005251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:12.005962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:12.012489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.012978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.013456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.014152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.014612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.015047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.030954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:12.148174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:12.157092 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a932406e-d89e-4ab6-93f4-0f76060c9efd tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1714 microversion: 2.1 time: 0.155821 Aug 30 05:14:12.157700 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3623/7184] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:12 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:12.176804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:12.177310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:12.183984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.184476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.184928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.185661 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.186125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.186564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.211946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:14:12.288675 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c5d3fb3-e3e5-49e3-8509-32acc81ed85d tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 204 len: 0 microversion: 2.1 time: 0.115233 Aug 30 05:14:12.289240 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3562/7185] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:12 2022] DELETE /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:14:12.297580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:12.298192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:12.304159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.304619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.305088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.305833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:12.306792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:12.307216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:12.436067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:12.444452 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38beb165-f8fe-45a2-a9e0-0197ac80f20f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1720 microversion: 2.1 time: 0.150910 Aug 30 05:14:12.445031 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3624/7186] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:12 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:13.122456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-5e859c25-e5e9-42b1-8664-25e0659a2ba6 req-2d482638-5594-4fee-a2cc-c6d90ac2ec1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "name": "network-vif-plugged", "status": "completed", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:13.133727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5e859c25-e5e9-42b1-8664-25e0659a2ba6 req-2d482638-5594-4fee-a2cc-c6d90ac2ec1f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.134236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5e859c25-e5e9-42b1-8664-25e0659a2ba6 req-2d482638-5594-4fee-a2cc-c6d90ac2ec1f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.134743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-5e859c25-e5e9-42b1-8664-25e0659a2ba6 req-2d482638-5594-4fee-a2cc-c6d90ac2ec1f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.145275 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-5e859c25-e5e9-42b1-8664-25e0659a2ba6 req-2d482638-5594-4fee-a2cc-c6d90ac2ec1f service nova] Creating event network-vif-plugged:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h2-854925-5 Aug 30 05:14:13.150869 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-5e859c25-e5e9-42b1-8664-25e0659a2ba6 req-2d482638-5594-4fee-a2cc-c6d90ac2ec1f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032073 Aug 30 05:14:13.151502 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3563/7187] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:13.466919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:13.467446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:13.474608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.475085 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.475517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.476197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:13.476651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:13.477071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:13.608908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:13.617144 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2dc34e9a-61dc-4fdb-a745-f80825fc9de5 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1720 microversion: 2.1 time: 0.154793 Aug 30 05:14:13.617894 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3625/7188] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:13 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:14.638825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:14.639563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:14.646790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:14.647286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:14.647746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:14.648460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:14.648931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:14.649399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:14.652605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:14.724484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:14.734018 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bd86c05d-6954-421f-906f-09bd0b7d8eb7 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1653 microversion: 2.1 time: 0.099985 Aug 30 05:14:14.742567 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3564/7189] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:14 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1653 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:14.775700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-26bd24f9-dadc-46c4-a3df-22787b770d94 req-0824d36e-f1c2-43af-9e8f-ef7663dce31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1d123ee-c112-4b31-9727-5a28e174a057", "name": "network-vif-deleted", "tag": "46b09f1f-1aef-4b0e-91ba-6f30daf756fc"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:14.786061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-26bd24f9-dadc-46c4-a3df-22787b770d94 req-0824d36e-f1c2-43af-9e8f-ef7663dce31d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:14.786549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-26bd24f9-dadc-46c4-a3df-22787b770d94 req-0824d36e-f1c2-43af-9e8f-ef7663dce31d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:14.794477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-26bd24f9-dadc-46c4-a3df-22787b770d94 req-0824d36e-f1c2-43af-9e8f-ef7663dce31d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:14.807276 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-26bd24f9-dadc-46c4-a3df-22787b770d94 req-0824d36e-f1c2-43af-9e8f-ef7663dce31d service nova] Creating event network-vif-deleted:46b09f1f-1aef-4b0e-91ba-6f30daf756fc for instance f1d123ee-c112-4b31-9727-5a28e174a057 on n-h2-854925-5 Aug 30 05:14:14.812209 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-26bd24f9-dadc-46c4-a3df-22787b770d94 req-0824d36e-f1c2-43af-9e8f-ef7663dce31d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040934 Aug 30 05:14:14.813132 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3626/7190] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:15.754575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:15.755208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:15.764093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:15.764657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:15.765124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:15.765873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:15.766410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:15.766921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:15.832139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:15.840633 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-447870b2-ae56-45d5-9419-9a72b0118350 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1369 microversion: 2.1 time: 0.090050 Aug 30 05:14:15.841220 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3565/7191] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:15 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:16.863808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:16.864586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:16.866640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:16.872622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:16.873104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:16.873573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:16.874264 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:16.874715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:16.875143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:16.944386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:16.954096 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18549c33-6920-4c68-b498-0cb11bb2208e tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1369 microversion: 2.1 time: 0.095478 Aug 30 05:14:16.954894 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3627/7192] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:16 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:17.975270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:17.975896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:17.978755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:17.984236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.984731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.985183 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:17.986012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:17.986481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:17.986922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:18.056625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:18.065420 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0135f839-5601-4a29-8a47-53d53103567f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1369 microversion: 2.1 time: 0.094011 Aug 30 05:14:18.066105 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3566/7193] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:17 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:19.086648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:19.087159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:19.094083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.094567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.095007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.095954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.096408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.096837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.127311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:19.127793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:19.128237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:19.128684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lazy-loading 'fault' on Instance uuid f1d123ee-c112-4b31-9727-5a28e174a057 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:14:19.168284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97a814523f7e493e9816a6ebae35f885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '631d9b92b5974998ac654501c994c0a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:19.176427 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af0eaad4-c7d3-4745-87c8-d5064e87f51f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 200 len: 1374 microversion: 2.1 time: 0.093773 Aug 30 05:14:19.177001 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3628/7194] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:19 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 1374 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:20.198947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:20.199495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:20.206515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.207010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.207488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.208179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.208640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.209076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.222618 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 HTTP/1.1 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'f1d123ee-c112-4b31-9727-5a28e174a057'} Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:20.224260 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-494da913-4ade-41ab-91dc-ebb7daf5628f tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 404 len: 111 microversion: 2.1 time: 0.031219 Aug 30 05:14:20.230582 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3567/7195] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:20 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:20.286852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:20.289033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:20.296035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.296527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.296972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.297692 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:20.298162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:20.298577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:20.312053 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/os-volume_attachments HTTP/1.1 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': 'f1d123ee-c112-4b31-9727-5a28e174a057'} Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:20.313792 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28994d66-15dd-4b16-b3e6-fdabc5c0dd65 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032483 Aug 30 05:14:20.317878 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3629/7196] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:14:20 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.629969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.630506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.637498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.637991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.638443 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.639140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.639610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.640049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.654407 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 HTTP/1.1 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'f1d123ee-c112-4b31-9727-5a28e174a057'} Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.655995 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b5b1780b-ac10-4050-b756-0e63d025c024 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 404 len: 111 microversion: 2.1 time: 0.031296 Aug 30 05:14:23.660427 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3568/7197] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:23 2022] DELETE /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.666764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.667423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: f1d123ee-c112-4b31-9727-5a28e174a057] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.674662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.675158 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.675678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.676435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.676894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.677349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.693529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 HTTP/1.1 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'f1d123ee-c112-4b31-9727-5a28e174a057'} Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.695138 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance f1d123ee-c112-4b31-9727-5a28e174a057 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4491984a-c45c-425d-8678-c35eeab8c367 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057" status: 404 len: 111 microversion: 2.1 time: 0.034510 Aug 30 05:14:23.700002 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3630/7198] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:23 2022] GET /compute/v2.1/servers/f1d123ee-c112-4b31-9727-5a28e174a057 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:14:23.706346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.706870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.713267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.713885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.714384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.715106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.715574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.716016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.731155 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 HTTP/1.1 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '52d3b269-35c7-48dd-92b5-bc6d269aed76'} Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.732839 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-75400dcc-c3f9-4d8d-b1f1-d326fb37190b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 404 len: 111 microversion: 2.1 time: 0.032067 Aug 30 05:14:23.737512 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3569/7199] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:23 2022] DELETE /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.742888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.743531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 52d3b269-35c7-48dd-92b5-bc6d269aed76] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.750426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.750913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.751349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.752047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.752497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.752918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.767542 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 HTTP/1.1 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '52d3b269-35c7-48dd-92b5-bc6d269aed76'} Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.769081 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 52d3b269-35c7-48dd-92b5-bc6d269aed76 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f01f4e48-4c47-4fda-b639-38a5b55adcda tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76" status: 404 len: 111 microversion: 2.1 time: 0.031423 Aug 30 05:14:23.773582 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3631/7200] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:23 2022] GET /compute/v2.1/servers/52d3b269-35c7-48dd-92b5-bc6d269aed76 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.779009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.779519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.785572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.786071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.786524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.787233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.787700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.788138 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.802327 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 HTTP/1.1 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80'} Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.803904 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.808866 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eb3b90ac-e671-4f48-b38d-c294e8cff770 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 404 len: 111 microversion: 2.1 time: 0.030202 Aug 30 05:14:23.809803 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3570/7201] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:23 2022] DELETE /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.815113 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.815732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.822018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.822683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.823442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.824585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.825491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.825953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.841528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 HTTP/1.1 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80'} Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.843089 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-89d6311c-a183-4c50-887c-1e7f9fbb42da tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80" status: 404 len: 111 microversion: 2.1 time: 0.033252 Aug 30 05:14:23.847412 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3632/7202] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:23 2022] GET /compute/v2.1/servers/0f3c2c2e-9b74-4d7c-a3ef-bc0c2c547f80 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.854359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.854872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.860943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.861418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.861871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.862572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.863035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.863478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.877887 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c HTTP/1.1 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1c5d96c3-f186-4712-8158-03ce1b3b3b9c'} Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.879481 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-91be8c0f-3432-44a4-9539-5fbda33bd747 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 404 len: 111 microversion: 2.1 time: 0.031030 Aug 30 05:14:23.883521 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3571/7203] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:23 2022] DELETE /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.889832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.890485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] [instance: 1c5d96c3-f186-4712-8158-03ce1b3b3b9c] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:23.897258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.902433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.902433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.902433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:23.902433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:23.902433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:23.918610 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] HTTP exception thrown: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Request method failure captured: Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c HTTP/1.1 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZsEhSoAF-jazw5kA0uZ4jrHhheKhtdw_F9F02aTKUmnY0aKjJQX_gTMZGN0HapRxJ20JhRnoZmmIqP49ucf0-qjVcAWn4djU_faPOK-Zcwyo7iCP5m_m4FcAPppgW91abXyW2Ir5GrwQFPr8We2wnRs_z_N-Z_2bpSKrYWd--HTwNg Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_631d9b92b5974998ac654501c994c0a0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/631d9b92b5974998ac654501c994c0a0"}]}] Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 631d9b92b5974998ac654501c994c0a0 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServerActionsTestJSON-564928573 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 97a814523f7e493e9816a6ebae35f885 Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServerActionsTestJSON-564928573-project Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '1c5d96c3-f186-4712-8158-03ce1b3b3b9c'} Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:23.920202 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Returning 404 to user: Instance 1c5d96c3-f186-4712-8158-03ce1b3b3b9c could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-92b87425-1d54-4b4f-aefc-27f839acfa6b tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c" status: 404 len: 111 microversion: 2.1 time: 0.035944 Aug 30 05:14:23.924033 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3633/7204] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:23 2022] GET /compute/v2.1/servers/1c5d96c3-f186-4712-8158-03ce1b3b3b9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:23.930788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6fc01123-2c82-435b-9591-f08c8f9db757 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] Calling method '.version_select at 0x7fe96a1c1280>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:23.957116 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6fc01123-2c82-435b-9591-f08c8f9db757 tempest-ServerActionsTestJSON-564928573 tempest-ServerActionsTestJSON-564928573-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-202857827" status: 202 len: 0 microversion: 2.1 time: 0.030181 Aug 30 05:14:23.958033 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3572/7205] 10.222.0.27 () {58 vars in 1218 bytes} [Tue Aug 30 05:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-202857827 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:14:33.153291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1476719689", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "12aa81fc-eb5d-48b7-95a5-a2fcdd4fa9dd"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:33.213794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] validate_networks() for [('12aa81fc-eb5d-48b7-95a5-a2fcdd4fa9dd', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:14:33.686885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:14:33.687379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:14:33.687923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:14:33.688401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:14:33.688885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:14:33.698373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:33.698950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:33.699527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:33.700338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:33.700867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:33.701542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:33.720569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Getting quotas for project 34ed26c1122c4254bcebf58b37505560. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:14:33.726644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Getting quotas for user 618ee2da496b4e8db337f15d008dbc46 and project 34ed26c1122c4254bcebf58b37505560. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:14:33.746188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:14:33.750509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:14:33.814912 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e0ff5c37-ff51-4b56-9f82-43eba43815db tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792112 Aug 30 05:14:33.815798 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3634/7206] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:14:33.828173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4dbb05bb-c401-462b-9ff8-d0f6143b2ecd tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:33.828818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4dbb05bb-c401-462b-9ff8-d0f6143b2ecd tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:33.869605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=27 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:33.892756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4dbb05bb-c401-462b-9ff8-d0f6143b2ecd tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:33.909219 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4dbb05bb-c401-462b-9ff8-d0f6143b2ecd tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1217 microversion: 2.1 time: 0.086588 Aug 30 05:14:33.921570 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3573/7207] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:33 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1217 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:34.932760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:34.933412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:34.940618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.941520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.942122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:34.943280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:34.943896 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:34.944584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:35.043791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:35.054907 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cabc8732-5921-430d-af31-e9a475a5ae2e tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1277 microversion: 2.1 time: 0.127105 Aug 30 05:14:35.056118 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3635/7208] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:34 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1277 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:36.079402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:36.081104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:36.093075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:36.093931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:36.095400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.097893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:36.098671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:36.099326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.570077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:36.579624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b05ee974-a126-4db3-839c-9558d81ae613 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1317 microversion: 2.1 time: 0.506104 Aug 30 05:14:36.580430 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3574/7209] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:36 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1317 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:36.768202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-df31f8ed-9471-445d-a499-85613cb5bad9 req-d4e2cdda-3e45-436a-bc9a-24ac0ca62e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "683f2ce9-9b5a-47cd-aed9-d9666002f96b", "tag": "18a3d551-7e55-4ada-abf8-f064b2be9743"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:36.782167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-df31f8ed-9471-445d-a499-85613cb5bad9 req-d4e2cdda-3e45-436a-bc9a-24ac0ca62e37 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:36.782648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-df31f8ed-9471-445d-a499-85613cb5bad9 req-d4e2cdda-3e45-436a-bc9a-24ac0ca62e37 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:36.783274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-df31f8ed-9471-445d-a499-85613cb5bad9 req-d4e2cdda-3e45-436a-bc9a-24ac0ca62e37 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:36.797500 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-df31f8ed-9471-445d-a499-85613cb5bad9 req-d4e2cdda-3e45-436a-bc9a-24ac0ca62e37 service nova] Creating event network-changed:18a3d551-7e55-4ada-abf8-f064b2be9743 for instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b on n-h2-854925-5 Aug 30 05:14:36.803244 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-df31f8ed-9471-445d-a499-85613cb5bad9 req-d4e2cdda-3e45-436a-bc9a-24ac0ca62e37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038759 Aug 30 05:14:36.804048 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3636/7210] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:37.601833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:37.602467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:37.609304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:37.609828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:37.610284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:37.611020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:37.611494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:37.611937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:37.743068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:37.751592 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fff57ab0-452b-4ae8-889f-4dc0280284f1 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1317 microversion: 2.1 time: 0.153630 Aug 30 05:14:37.752175 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3575/7211] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:37 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:38.772749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:38.773491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:38.781114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:38.781649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:38.782090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:38.782799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:38.783403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:38.783843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:38.927220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:38.935830 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-38b232d6-7e35-4d24-b765-310eb6a3a72f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1317 microversion: 2.1 time: 0.167492 Aug 30 05:14:38.939256 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3637/7212] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:38 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:39.956794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:39.960190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:39.966211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:39.966719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:39.967174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:39.967905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:39.968371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:39.968815 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:40.113041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:40.120785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c9c5a69-f4ae-4f34-86b5-d9c0b649c67c tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1317 microversion: 2.1 time: 0.168168 Aug 30 05:14:40.121402 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3576/7213] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:39 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:41.142833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:41.143541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:41.150940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:41.151429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:41.151865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:41.152553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:41.153006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:41.153456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:41.205167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b4e7abb9-3162-4899-beb5-180b76b5b58c req-b2a530a8-749b-4717-8a8a-5a063b8e783e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "683f2ce9-9b5a-47cd-aed9-d9666002f96b", "name": "network-vif-plugged", "status": "completed", "tag": "18a3d551-7e55-4ada-abf8-f064b2be9743"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:41.217825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b4e7abb9-3162-4899-beb5-180b76b5b58c req-b2a530a8-749b-4717-8a8a-5a063b8e783e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:41.218691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b4e7abb9-3162-4899-beb5-180b76b5b58c req-b2a530a8-749b-4717-8a8a-5a063b8e783e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:41.219506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b4e7abb9-3162-4899-beb5-180b76b5b58c req-b2a530a8-749b-4717-8a8a-5a063b8e783e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:41.232556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b4e7abb9-3162-4899-beb5-180b76b5b58c req-b2a530a8-749b-4717-8a8a-5a063b8e783e service nova] Creating event network-vif-plugged:18a3d551-7e55-4ada-abf8-f064b2be9743 for instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b on n-h2-854925-5 Aug 30 05:14:41.238119 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b4e7abb9-3162-4899-beb5-180b76b5b58c req-b2a530a8-749b-4717-8a8a-5a063b8e783e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036500 Aug 30 05:14:41.238996 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3577/7214] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:41.307502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:41.315511 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a8f07ee-bbdc-4fa9-a2ef-316e66b31018 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1317 microversion: 2.1 time: 0.176557 Aug 30 05:14:41.316108 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3638/7215] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:41 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:42.336750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:42.338280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:42.345724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:42.346474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:42.346926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:42.347827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:42.348298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:42.348736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:42.484969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:42.492855 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51a8ee7f-2ce5-42b3-813b-38c2f9039138 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1317 microversion: 2.1 time: 0.160609 Aug 30 05:14:42.493450 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3578/7216] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:42 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:43.513254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:43.513910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:43.520757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:43.521235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:43.521704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:43.522389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:43.522838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:43.523261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:43.526557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=64 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:43.654169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:43.662225 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce0e5d46-85db-4da7-8539-92fcd844db1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1505 microversion: 2.1 time: 0.153262 Aug 30 05:14:43.662813 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3639/7217] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:43 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:43.721675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-978235007", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "12aa81fc-eb5d-48b7-95a5-a2fcdd4fa9dd"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:43.778242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] validate_networks() for [('12aa81fc-eb5d-48b7-95a5-a2fcdd4fa9dd', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:14:43.898267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:44.149899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:14:44.150457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:14:44.150959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:14:44.151389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:14:44.151827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:14:44.160790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:44.161284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:44.161774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:44.162541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:44.163002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:44.163440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:44.180816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Getting quotas for project 34ed26c1122c4254bcebf58b37505560. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:14:44.186881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Getting quotas for user 618ee2da496b4e8db337f15d008dbc46 and project 34ed26c1122c4254bcebf58b37505560. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:14:44.199051 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:14:44.201365 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:14:44.247403 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-239ae59b-003f-4ff9-a9cd-1f150ebcda51 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529984 Aug 30 05:14:44.248063 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3579/7218] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:14:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:14:44.258604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5324184a-8907-4579-bc21-afd7e0364b10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:44.259221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5324184a-8907-4579-bc21-afd7e0364b10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:44.261136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:44.262026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:44.319341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5324184a-8907-4579-bc21-afd7e0364b10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:44.327142 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5324184a-8907-4579-bc21-afd7e0364b10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1216 microversion: 2.1 time: 0.072314 Aug 30 05:14:44.327786 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3640/7219] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:44 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:45.349542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:45.351296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:45.359463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:45.360088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:45.360607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:45.361437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:45.362011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:45.363225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:45.429518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:45.439530 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4d24f266-3b11-4d1f-acff-7b4cbffecfe7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1286 microversion: 2.1 time: 0.095550 Aug 30 05:14:45.440113 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3580/7220] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:45 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:46.460055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:46.461291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:46.468780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:46.469269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:46.469733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:46.470433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:46.471175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:46.471572 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:46.566126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a5067755-750a-4cf7-8b38-74244200eb1c req-1f0b5880-8f2c-4100-8b68-a360ec9a1245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0512ef9-b47c-4894-b4cc-782d9ca86a12", "tag": "a2978b37-a06a-4312-8ac9-aabaa59d8ed3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:46.578261 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a5067755-750a-4cf7-8b38-74244200eb1c req-1f0b5880-8f2c-4100-8b68-a360ec9a1245 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:46.579315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a5067755-750a-4cf7-8b38-74244200eb1c req-1f0b5880-8f2c-4100-8b68-a360ec9a1245 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:46.580091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a5067755-750a-4cf7-8b38-74244200eb1c req-1f0b5880-8f2c-4100-8b68-a360ec9a1245 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:46.592912 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a5067755-750a-4cf7-8b38-74244200eb1c req-1f0b5880-8f2c-4100-8b68-a360ec9a1245 service nova] Creating event network-changed:a2978b37-a06a-4312-8ac9-aabaa59d8ed3 for instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 on n-h1-854925-5 Aug 30 05:14:46.598216 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a5067755-750a-4cf7-8b38-74244200eb1c req-1f0b5880-8f2c-4100-8b68-a360ec9a1245 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035701 Aug 30 05:14:46.599343 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3581/7221] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:14:46.627958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:46.636329 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3941248e-d438-4e46-a99b-ccbb58d58c6b tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1316 microversion: 2.1 time: 0.180185 Aug 30 05:14:46.636950 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3641/7222] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:46 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:47.658401 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:47.659175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:47.665528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:47.666742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:47.667195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:47.668087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:47.668552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:47.668997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:47.801909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:47.809545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-570c35c7-098d-4273-8a84-82a0f6a1197f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1316 microversion: 2.1 time: 0.156312 Aug 30 05:14:47.810121 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3582/7223] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:47 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:48.829707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:48.830345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:48.833057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:48.838484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:48.838967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:48.839406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:48.840096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:48.840553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:48.840981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:48.975905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:48.984460 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-27059fed-d551-474f-8358-e7c0120a29d6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1316 microversion: 2.1 time: 0.158658 Aug 30 05:14:48.985041 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3642/7224] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:48 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:50.005268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:50.005919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:50.008780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:50.014669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:50.015164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:50.015615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:50.016312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:50.016778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:50.017215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:50.148635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:50.156409 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d31a0875-f8c2-4698-a80f-e8c7aba843b8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1316 microversion: 2.1 time: 0.155227 Aug 30 05:14:50.157023 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3583/7225] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:49 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:51.177812 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:51.178354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:51.185421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:51.185917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:51.186365 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:51.187062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:51.187522 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:51.187959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:51.314757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:51.323180 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6b62362a-ee32-45b0-9c33-6d1f340ae7a8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1316 microversion: 2.1 time: 0.149619 Aug 30 05:14:51.323760 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3643/7226] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:51 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:51.803002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b82680b9-2454-499a-bca1-3026908042ad req-5445336a-c2b2-42ec-a328-41b7038d0602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0512ef9-b47c-4894-b4cc-782d9ca86a12", "name": "network-vif-plugged", "status": "completed", "tag": "a2978b37-a06a-4312-8ac9-aabaa59d8ed3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:51.815576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b82680b9-2454-499a-bca1-3026908042ad req-5445336a-c2b2-42ec-a328-41b7038d0602 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:51.816119 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b82680b9-2454-499a-bca1-3026908042ad req-5445336a-c2b2-42ec-a328-41b7038d0602 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:51.816964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b82680b9-2454-499a-bca1-3026908042ad req-5445336a-c2b2-42ec-a328-41b7038d0602 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:51.831817 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b82680b9-2454-499a-bca1-3026908042ad req-5445336a-c2b2-42ec-a328-41b7038d0602 service nova] Creating event network-vif-plugged:a2978b37-a06a-4312-8ac9-aabaa59d8ed3 for instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 on n-h1-854925-5 Aug 30 05:14:51.838066 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b82680b9-2454-499a-bca1-3026908042ad req-5445336a-c2b2-42ec-a328-41b7038d0602 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038229 Aug 30 05:14:51.839061 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3584/7227] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:52.343874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:52.344418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:52.351725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:52.352215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:52.352658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:52.353883 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:52.354345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:52.354776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:52.489031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:52.497448 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fa285f87-992a-4a5f-bf53-3d34f632fcc8 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1316 microversion: 2.1 time: 0.157603 Aug 30 05:14:52.498031 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3644/7228] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:52 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:53.519055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:53.519771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:53.527411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.527905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.528354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.529049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.529545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.529987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.658639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:53.667191 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c2299b9-2222-4b09-a80d-98c9ce323a3f tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1504 microversion: 2.1 time: 0.152849 Aug 30 05:14:53.667776 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3585/7229] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:53 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:53.687324 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:53.687825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:53.694646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.695126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.695559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.696238 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.696704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.697109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.722683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:14:53.803148 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-11fc27c7-6609-4055-8a8a-a2320496fb24 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 204 len: 0 microversion: 2.1 time: 0.119415 Aug 30 05:14:53.803722 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3645/7230] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:53 2022] DELETE /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:14:53.811993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:53.812721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:53.819067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.819567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.820020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.821017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:53.821479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:53.822562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:53.957788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:53.967189 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-03a1e038-d178-414d-98f2-5ecdb8dfa2dc tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1510 microversion: 2.1 time: 0.159098 Aug 30 05:14:53.967778 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3586/7231] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:53 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:14:54.988900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:54.989657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:54.991648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:54.998057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:54.998536 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:54.998969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:54.999673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:55.000125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:55.000551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:55.131171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:55.139582 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef60093c-a464-408b-8001-ce43e81e7ee5 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1510 microversion: 2.1 time: 0.154957 Aug 30 05:14:55.140164 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3646/7232] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:54 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:55.818882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-375ef31a-895c-4366-9da3-feb7154053ed req-c7d0dc26-49f0-4944-ac23-4efde0f18acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0512ef9-b47c-4894-b4cc-782d9ca86a12", "name": "network-vif-deleted", "tag": "a2978b37-a06a-4312-8ac9-aabaa59d8ed3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:55.826306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:55.827355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:55.843379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-375ef31a-895c-4366-9da3-feb7154053ed req-c7d0dc26-49f0-4944-ac23-4efde0f18acf service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:55.843888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-375ef31a-895c-4366-9da3-feb7154053ed req-c7d0dc26-49f0-4944-ac23-4efde0f18acf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:55.844352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-375ef31a-895c-4366-9da3-feb7154053ed req-c7d0dc26-49f0-4944-ac23-4efde0f18acf service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:55.858535 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-375ef31a-895c-4366-9da3-feb7154053ed req-c7d0dc26-49f0-4944-ac23-4efde0f18acf service nova] Creating event network-vif-deleted:a2978b37-a06a-4312-8ac9-aabaa59d8ed3 for instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 on n-h1-854925-5 Aug 30 05:14:55.864143 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-375ef31a-895c-4366-9da3-feb7154053ed req-c7d0dc26-49f0-4944-ac23-4efde0f18acf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049156 Aug 30 05:14:55.865011 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3587/7233] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:14:56.160413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:56.161045 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:56.168485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:56.168977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:56.169455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:56.170152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:56.170611 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:56.171042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:56.205250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:56.205771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:56.206307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:56.206761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lazy-loading 'fault' on Instance uuid c0512ef9-b47c-4894-b4cc-782d9ca86a12 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:14:56.249684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:56.257535 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6d0280fc-b041-43d9-8d50-11609773d1f6 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 200 len: 1306 microversion: 2.1 time: 0.101350 Aug 30 05:14:56.258312 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3647/7234] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:56 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:57.279787 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:57.280509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.286888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.287394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.287850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.288562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.289037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.289522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.302792 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] HTTP exception thrown: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Request method failure captured: Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 HTTP/1.1 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZy4MmkfuiJ-FOoXzEbbj3FQHxavbJTiMd302Hr2ub3L9TOrW1SgFnS0aIlU9YakN_iJIOFclyD7tOEzwkIcnqRjIdHKG4A5F3_a_yVYM7sDGp-lgq6XzcAJ9Ufqu0WtlVwGSyKLJ6sIt8ZheqoVoppzmd054VOUcOnJvfOAqoqgkmY Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34ed26c1122c4254bcebf58b37505560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}] Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 618ee2da496b4e8db337f15d008dbc46 Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c0512ef9-b47c-4894-b4cc-782d9ca86a12'} Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:57.304427 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Returning 404 to user: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b8117a39-7950-43d9-8e3e-4e5ea5c4db10 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 404 len: 111 microversion: 2.1 time: 0.031312 Aug 30 05:14:57.309751 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3588/7235] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:57 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:57.315540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:57.316162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.323639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.324127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.324562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.325255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.325735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.326167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.456287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:57.464050 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-612752c9-ef00-46bf-9e31-b7e005d0c641 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1505 microversion: 2.1 time: 0.152380 Aug 30 05:14:57.464626 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3648/7236] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:57 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:57.484084 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66b94e73-b3bf-43ca-9891-096e8e1959ae tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:57.486358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66b94e73-b3bf-43ca-9891-096e8e1959ae tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: e2a7bd26-b9f2-4dcc-a222-318f8d5a731d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.491824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-66b94e73-b3bf-43ca-9891-096e8e1959ae tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] HTTP exception thrown: Instance e2a7bd26-b9f2-4dcc-a222-318f8d5a731d could not be found. Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66b94e73-b3bf-43ca-9891-096e8e1959ae tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Request method failure captured: Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/e2a7bd26-b9f2-4dcc-a222-318f8d5a731d/action HTTP/1.1 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 32 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZy4MmkfuiJ-FOoXzEbbj3FQHxavbJTiMd302Hr2ub3L9TOrW1SgFnS0aIlU9YakN_iJIOFclyD7tOEzwkIcnqRjIdHKG4A5F3_a_yVYM7sDGp-lgq6XzcAJ9Ufqu0WtlVwGSyKLJ6sIt8ZheqoVoppzmd054VOUcOnJvfOAqoqgkmY Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34ed26c1122c4254bcebf58b37505560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}] Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 618ee2da496b4e8db337f15d008dbc46 Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: {"resize": {"flavorRef": "452"}} Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance e2a7bd26-b9f2-4dcc-a222-318f8d5a731d could not be found. Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'e2a7bd26-b9f2-4dcc-a222-318f8d5a731d', 'body': {'resize': {'flavorRef': '452'}}} Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2a7bd26-b9f2-4dcc-a222-318f8d5a731d could not be found. Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:57.493412 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2a7bd26-b9f2-4dcc-a222-318f8d5a731d could not be found. Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2a7bd26-b9f2-4dcc-a222-318f8d5a731d could not be found. Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66b94e73-b3bf-43ca-9891-096e8e1959ae tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Returning 404 to user: Instance e2a7bd26-b9f2-4dcc-a222-318f8d5a731d could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66b94e73-b3bf-43ca-9891-096e8e1959ae tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "POST /compute/v2.1/servers/e2a7bd26-b9f2-4dcc-a222-318f8d5a731d/action" status: 404 len: 111 microversion: 2.1 time: 0.015189 Aug 30 05:14:57.498577 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3589/7237] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:14:57 2022] POST /compute/v2.1/servers/e2a7bd26-b9f2-4dcc-a222-318f8d5a731d/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:14:57.503451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:57.504062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.510583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.511088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.511519 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.512199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.512646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.513069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.640118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:57.647785 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b1f91d3a-5040-4538-b36c-c6266a9c1d05 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1505 microversion: 2.1 time: 0.148090 Aug 30 05:14:57.648351 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3649/7238] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:57 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:57.668506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:57.669131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.676033 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.676527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.676978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.677699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.678165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.678604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.810225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:57.818017 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14011903-3575-40ce-ba53-95abc955b4ea tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1505 microversion: 2.1 time: 0.153874 Aug 30 05:14:57.818588 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3590/7239] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:57 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:57.837756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "dc54f2ad-1a3f-4d72-a503-461b4863576c"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:57.840123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.846350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.846930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.847368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.848057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.848513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.848943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.893212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:57.898764 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] HTTP exception thrown: Flavor dc54f2ad-1a3f-4d72-a503-461b4863576c could not be found. Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Request method failure captured: Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: request: POST /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b/action HTTP/1.1 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 65 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZy4MmkfuiJ-FOoXzEbbj3FQHxavbJTiMd302Hr2ub3L9TOrW1SgFnS0aIlU9YakN_iJIOFclyD7tOEzwkIcnqRjIdHKG4A5F3_a_yVYM7sDGp-lgq6XzcAJ9Ufqu0WtlVwGSyKLJ6sIt8ZheqoVoppzmd054VOUcOnJvfOAqoqgkmY Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34ed26c1122c4254bcebf58b37505560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}] Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 618ee2da496b4e8db337f15d008dbc46 Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: {"resize": {"flavorRef": "dc54f2ad-1a3f-4d72-a503-461b4863576c"}} Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: exception: Flavor dc54f2ad-1a3f-4d72-a503-461b4863576c could not be found. Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '683f2ce9-9b5a-47cd-aed9-d9666002f96b', 'body': {'resize': {'flavorRef': 'dc54f2ad-1a3f-4d72-a503-461b4863576c'}}} Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4198, in resize Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:57.909734 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor dc54f2ad-1a3f-4d72-a503-461b4863576c could not be found. Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor dc54f2ad-1a3f-4d72-a503-461b4863576c could not be found. Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor dc54f2ad-1a3f-4d72-a503-461b4863576c could not be found. Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Returning 400 to user: Flavor dc54f2ad-1a3f-4d72-a503-461b4863576c could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2a0f9868-4663-4a09-a17c-e23cb97749d2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "POST /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b/action" status: 400 len: 107 microversion: 2.1 time: 0.077071 Aug 30 05:14:57.913981 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3650/7240] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:14:57 2022] POST /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b/action => generated 107 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:14:57.920339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:57.920993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:57.927369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.927863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.928312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:57.929015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:57.929520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:57.929960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.057483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.065231 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-663372dc-1816-4936-856a-6daa1ca3c676 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1505 microversion: 2.1 time: 0.149302 Aug 30 05:14:58.065854 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3591/7241] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:57 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:58.086121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.086746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.093409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.093861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.094308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.095006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.095469 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.096152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.226756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.234517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-02f24a18-d288-49ce-99c9-50251401dc27 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1505 microversion: 2.1 time: 0.152230 Aug 30 05:14:58.235090 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3651/7242] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:58 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:58.254825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82dae6c9-7ec9-4fe5-a30f-f201a22e18d7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82dae6c9-7ec9-4fe5-a30f-f201a22e18d7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Request method failure captured: Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: request: POST /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b/action HTTP/1.1 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 29 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZy4MmkfuiJ-FOoXzEbbj3FQHxavbJTiMd302Hr2ub3L9TOrW1SgFnS0aIlU9YakN_iJIOFclyD7tOEzwkIcnqRjIdHKG4A5F3_a_yVYM7sDGp-lgq6XzcAJ9Ufqu0WtlVwGSyKLJ6sIt8ZheqoVoppzmd054VOUcOnJvfOAqoqgkmY Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34ed26c1122c4254bcebf58b37505560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}] Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 618ee2da496b4e8db337f15d008dbc46 Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: {"resize": {"flavorRef": ""}} Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '683f2ce9-9b5a-47cd-aed9-d9666002f96b', 'body': {'resize': {'flavorRef': ''}}} Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise error Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi '' Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.258497 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82dae6c9-7ec9-4fe5-a30f-f201a22e18d7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82dae6c9-7ec9-4fe5-a30f-f201a22e18d7 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "POST /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b/action" status: 400 len: 113 microversion: 2.1 time: 0.009778 Aug 30 05:14:58.263871 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3592/7243] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:14:58 2022] POST /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 05:14:58.268464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.269108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.275089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.275570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.276009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.276695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.277151 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.277617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.407938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.416205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-40417b7c-ca18-45a9-a612-6a26d5ba4a79 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1505 microversion: 2.1 time: 0.150921 Aug 30 05:14:58.416776 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3652/7244] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:58 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:58.441163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.441711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.448990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.449525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.449978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.450706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.451182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.451622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.465217 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] HTTP exception thrown: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Request method failure captured: Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 HTTP/1.1 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZy4MmkfuiJ-FOoXzEbbj3FQHxavbJTiMd302Hr2ub3L9TOrW1SgFnS0aIlU9YakN_iJIOFclyD7tOEzwkIcnqRjIdHKG4A5F3_a_yVYM7sDGp-lgq6XzcAJ9Ufqu0WtlVwGSyKLJ6sIt8ZheqoVoppzmd054VOUcOnJvfOAqoqgkmY Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34ed26c1122c4254bcebf58b37505560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}] Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 618ee2da496b4e8db337f15d008dbc46 Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'c0512ef9-b47c-4894-b4cc-782d9ca86a12'} Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:58.466829 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Returning 404 to user: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-330fc3db-fede-4d47-860f-2dbdd1055a04 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 404 len: 111 microversion: 2.1 time: 0.031936 Aug 30 05:14:58.471348 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3593/7245] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:58 2022] DELETE /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:14:58.477053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.477710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: c0512ef9-b47c-4894-b4cc-782d9ca86a12] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.484397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.484884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.485347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.486036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.486495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.486927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.501249 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] HTTP exception thrown: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Request method failure captured: Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 HTTP/1.1 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZy4MmkfuiJ-FOoXzEbbj3FQHxavbJTiMd302Hr2ub3L9TOrW1SgFnS0aIlU9YakN_iJIOFclyD7tOEzwkIcnqRjIdHKG4A5F3_a_yVYM7sDGp-lgq6XzcAJ9Ufqu0WtlVwGSyKLJ6sIt8ZheqoVoppzmd054VOUcOnJvfOAqoqgkmY Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34ed26c1122c4254bcebf58b37505560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}] Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 618ee2da496b4e8db337f15d008dbc46 Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'c0512ef9-b47c-4894-b4cc-782d9ca86a12'} Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:14:58.502861 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Returning 404 to user: Instance c0512ef9-b47c-4894-b4cc-782d9ca86a12 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21c34b60-9448-468f-8149-148fe89348bf tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12" status: 404 len: 111 microversion: 2.1 time: 0.031080 Aug 30 05:14:58.507450 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3653/7246] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:58 2022] GET /compute/v2.1/servers/c0512ef9-b47c-4894-b4cc-782d9ca86a12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 05:14:58.512733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.513253 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.519300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.519811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.520271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.520978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.521479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.521931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.549292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:14:58.625130 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-86229e04-b3dd-432a-8857-d9cdfc29a0a2 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "DELETE /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 204 len: 0 microversion: 2.1 time: 0.115869 Aug 30 05:14:58.625753 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3594/7247] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:14:58 2022] DELETE /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:14:58.634133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:58.634776 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:58.640687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.641177 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.641685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.642383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:58.642844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:58.643304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:58.773352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:58.781859 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9baa4ae-56f0-4780-a298-2adee7e3862d tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1511 microversion: 2.1 time: 0.151726 Aug 30 05:14:58.782437 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3654/7248] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:58 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:14:59.803538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:14:59.804385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:14:59.811223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:59.811725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:59.812179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:59.812887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:14:59.813389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:14:59.813864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:14:59.832832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:14:59.953826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '618ee2da496b4e8db337f15d008dbc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34ed26c1122c4254bcebf58b37505560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:14:59.961695 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-637f04ef-d150-4fe6-a6e4-825393e66e54 tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 200 len: 1511 microversion: 2.1 time: 0.162413 Aug 30 05:14:59.962926 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3595/7249] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:14:59 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:00.447546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-fb008e46-d08d-45bd-973a-e4ef8b785793 req-71b43cdb-8f8d-4554-8d55-18e5912b7538 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "683f2ce9-9b5a-47cd-aed9-d9666002f96b", "name": "network-vif-deleted", "tag": "18a3d551-7e55-4ada-abf8-f064b2be9743"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:00.458727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fb008e46-d08d-45bd-973a-e4ef8b785793 req-71b43cdb-8f8d-4554-8d55-18e5912b7538 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.459217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fb008e46-d08d-45bd-973a-e4ef8b785793 req-71b43cdb-8f8d-4554-8d55-18e5912b7538 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.459648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-fb008e46-d08d-45bd-973a-e4ef8b785793 req-71b43cdb-8f8d-4554-8d55-18e5912b7538 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.477308 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-fb008e46-d08d-45bd-973a-e4ef8b785793 req-71b43cdb-8f8d-4554-8d55-18e5912b7538 service nova] Creating event network-vif-deleted:18a3d551-7e55-4ada-abf8-f064b2be9743 for instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b on n-h2-854925-5 Aug 30 05:15:00.482846 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-fb008e46-d08d-45bd-973a-e4ef8b785793 req-71b43cdb-8f8d-4554-8d55-18e5912b7538 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039739 Aug 30 05:15:00.483532 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3655/7250] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:00.984015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:00.984641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] [instance: 683f2ce9-9b5a-47cd-aed9-d9666002f96b] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:00.991602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.992100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.992553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:00.993255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:00.994290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:00.994737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:01.008063 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] HTTP exception thrown: Instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b could not be found. Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Request method failure captured: Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b HTTP/1.1 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZy4MmkfuiJ-FOoXzEbbj3FQHxavbJTiMd302Hr2ub3L9TOrW1SgFnS0aIlU9YakN_iJIOFclyD7tOEzwkIcnqRjIdHKG4A5F3_a_yVYM7sDGp-lgq6XzcAJ9Ufqu0WtlVwGSyKLJ6sIt8ZheqoVoppzmd054VOUcOnJvfOAqoqgkmY Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_34ed26c1122c4254bcebf58b37505560", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/34ed26c1122c4254bcebf58b37505560"}]}] Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 34ed26c1122c4254bcebf58b37505560 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-ServersNegativeTestJSON-530142147 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 618ee2da496b4e8db337f15d008dbc46 Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-ServersNegativeTestJSON-530142147-project Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b could not be found. Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '683f2ce9-9b5a-47cd-aed9-d9666002f96b'} Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b could not be found. Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b could not be found. Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:01.010306 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b could not be found. Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] Returning 404 to user: Instance 683f2ce9-9b5a-47cd-aed9-d9666002f96b could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e68bcfe7-17b7-406f-aa6e-9233f88e6c1a tempest-ServersNegativeTestJSON-530142147 tempest-ServersNegativeTestJSON-530142147-project] 10.222.0.27 "GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b" status: 404 len: 111 microversion: 2.1 time: 0.031661 Aug 30 05:15:01.014506 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3596/7251] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:00 2022] GET /compute/v2.1/servers/683f2ce9-9b5a-47cd-aed9-d9666002f96b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:15:31.571450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:31.573592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:31.814695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-98a21fef-bb12-4baf-a8aa-207d9a6f5720 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: .version_select at 0x7fe96a7744c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-555965148", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/297K05drmb37NN2WHXGfzdQZuqkQMTAwQBL/0XmauWhsJ6E3IZacI6EI2+ESdvN75MvB2KdiUtU8DXTDL3Y6KX1y+/CBP/27nxCEHvQYOp1LQZJnfGNJmdJ40SgDeBA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:31.830937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-98a21fef-bb12-4baf-a8aa-207d9a6f5720 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:15:31.836279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-98a21fef-bb12-4baf-a8aa-207d9a6f5720 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for user 4fad8950b1174cf68af2206aee803fb6 and project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:15:31.865709 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-98a21fef-bb12-4baf-a8aa-207d9a6f5720 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.297024 Aug 30 05:15:31.866435 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3656/7252] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:15:31 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:31.927216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1365780621", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-555965148", "networks": [{"uuid": "b987a92a-d6fc-4477-b873-ec0d65073cf5"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:31.943092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:31.943687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:32.002563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] validate_networks() for [('b987a92a-d6fc-4477-b873-ec0d65073cf5', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:15:32.508483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:15:32.509216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:15:32.509783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:15:32.510243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:15:32.510678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:15:32.521579 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:32.522090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:32.522552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:32.523306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:32.523783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:32.524382 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:32.542845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:15:32.548164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for user 4fad8950b1174cf68af2206aee803fb6 and project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:15:32.560982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:15:32.563664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:15:32.612413 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74720250-e359-4528-866c-426ca78e5d53 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689584 Aug 30 05:15:32.613296 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3597/7253] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:15:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:15:32.624420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2bc70571-3627-4c51-854f-89dda483120e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:32.625162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2bc70571-3627-4c51-854f-89dda483120e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:32.682806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2bc70571-3627-4c51-854f-89dda483120e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:32.689961 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2bc70571-3627-4c51-854f-89dda483120e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1262 microversion: 2.1 time: 0.070204 Aug 30 05:15:32.690540 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3657/7254] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:32 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:33.711337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:33.712947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:33.721615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:33.723459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:33.724260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:33.725355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:33.727386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:33.729160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:33.823563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:33.832883 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b38a11b3-b5a2-415b-b1bc-c7d0531a559a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1332 microversion: 2.1 time: 0.126565 Aug 30 05:15:33.833552 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3598/7255] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:33 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:34.860957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:34.861892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:34.870773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:34.871507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:34.871972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:34.873153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:34.875778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:34.876240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.155471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:35.163932 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6513bb4a-8baf-41f3-a189-4d2aa4393b96 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1362 microversion: 2.1 time: 0.313506 Aug 30 05:15:35.164865 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3658/7256] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:34 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:35.240860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-991763e1-a53c-4ea8-9fea-9b64eb4cb25f req-cbd4f154-4d07-4925-af30-73235ab8e2ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b17294f-72e0-4849-a159-fe446a604e04", "tag": "96a4945f-738c-49a3-8207-0fd57f5f72e3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:35.257135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-991763e1-a53c-4ea8-9fea-9b64eb4cb25f req-cbd4f154-4d07-4925-af30-73235ab8e2ee service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:35.258123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-991763e1-a53c-4ea8-9fea-9b64eb4cb25f req-cbd4f154-4d07-4925-af30-73235ab8e2ee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:35.258844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-991763e1-a53c-4ea8-9fea-9b64eb4cb25f req-cbd4f154-4d07-4925-af30-73235ab8e2ee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:35.272271 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-991763e1-a53c-4ea8-9fea-9b64eb4cb25f req-cbd4f154-4d07-4925-af30-73235ab8e2ee service nova] Creating event network-changed:96a4945f-738c-49a3-8207-0fd57f5f72e3 for instance 1b17294f-72e0-4849-a159-fe446a604e04 on n-h2-854925-5 Aug 30 05:15:35.278317 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-991763e1-a53c-4ea8-9fea-9b64eb4cb25f req-cbd4f154-4d07-4925-af30-73235ab8e2ee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041356 Aug 30 05:15:35.279066 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3599/7257] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:36.188446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:36.189061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:36.195738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:36.196216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:36.196654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:36.198004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:36.198457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:36.198881 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:36.337395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:36.345079 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a84c6877-0b80-4c58-852d-0c6630a57e5a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1362 microversion: 2.1 time: 0.160574 Aug 30 05:15:36.345686 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3659/7258] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:36 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:37.366470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:37.367194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:37.375272 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:37.375770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:37.376219 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:37.376924 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:37.377409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:37.377883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:37.852582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:37.861398 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c0d206f-926f-4d1e-9692-8d91a2c1d6c3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1362 microversion: 2.1 time: 0.499087 Aug 30 05:15:37.862084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3600/7259] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:37 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1362 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:38.882029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:38.882644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:38.889447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:38.889928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:38.890368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:38.891050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:38.891501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:38.891925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:39.019624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:39.027470 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-901b7c77-a249-4377-bb9d-d640e7caf848 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1362 microversion: 2.1 time: 0.149372 Aug 30 05:15:39.028086 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3660/7260] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:38 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:39.597872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4df59a56-9486-4cbc-a0fe-1285c6b60b4c req-9ec9b3d7-81f9-4616-8012-4791a6300693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b17294f-72e0-4849-a159-fe446a604e04", "name": "network-vif-plugged", "status": "completed", "tag": "96a4945f-738c-49a3-8207-0fd57f5f72e3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:39.608442 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4df59a56-9486-4cbc-a0fe-1285c6b60b4c req-9ec9b3d7-81f9-4616-8012-4791a6300693 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:39.608948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4df59a56-9486-4cbc-a0fe-1285c6b60b4c req-9ec9b3d7-81f9-4616-8012-4791a6300693 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:39.609439 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4df59a56-9486-4cbc-a0fe-1285c6b60b4c req-9ec9b3d7-81f9-4616-8012-4791a6300693 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:39.620719 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4df59a56-9486-4cbc-a0fe-1285c6b60b4c req-9ec9b3d7-81f9-4616-8012-4791a6300693 service nova] Creating event network-vif-plugged:96a4945f-738c-49a3-8207-0fd57f5f72e3 for instance 1b17294f-72e0-4849-a159-fe446a604e04 on n-h2-854925-5 Aug 30 05:15:39.625723 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4df59a56-9486-4cbc-a0fe-1285c6b60b4c req-9ec9b3d7-81f9-4616-8012-4791a6300693 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032401 Aug 30 05:15:39.626445 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3601/7261] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:40.048109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:40.048877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:40.055824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:40.056822 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:40.057266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:40.057986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:40.058442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:40.058873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:40.184789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:40.192386 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-967cf5e1-6ca6-477b-b309-ab94449e49bf tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1362 microversion: 2.1 time: 0.148176 Aug 30 05:15:40.192956 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3661/7262] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:40 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:41.215049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:41.215683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:41.222190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:41.222677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:41.223129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:41.223824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:41.224285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:41.224724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:41.358269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:41.366227 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-19745670-1607-4481-a53e-2bd16fb120ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1554 microversion: 2.1 time: 0.156323 Aug 30 05:15:41.366820 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3602/7263] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:41 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:41.386384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:41.387004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:41.393980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:41.394465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:41.394905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:41.395599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:41.396053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:41.396479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:41.526391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:15:41.534183 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0fa4a3a-971f-4e96-9c7a-f625243e993e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1554 microversion: 2.1 time: 0.151694 Aug 30 05:15:41.534771 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3662/7264] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:15:41 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:15:43.202895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00c8d760-4a77-42cb-a20d-673cdbcd6300"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:15:43.205241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:43.208071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:43.208750 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:43.215017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:43.215507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:43.215956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:43.216652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:43.217116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:43.217580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:43.457245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-39f17efb-7201-49ed-ac3f-d41f10532dfa tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258123 Aug 30 05:15:43.458089 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3603/7265] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 05:15:43 2022] POST /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:54.336174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:54.336690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:54.339698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:54.340428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:54.341062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=30 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:54.348086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.348577 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.349021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.349743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.350198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.350627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.433478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lazy-loading 'services' on Instance uuid 1b17294f-72e0-4849-a159-fe446a604e04 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:15:54.503981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fafcf8a7-456e-4fd5-8b25-251133c4aea3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments/00c8d760-4a77-42cb-a20d-673cdbcd6300" status: 202 len: 0 microversion: 2.1 time: 0.171721 Aug 30 05:15:54.504667 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3663/7266] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:15:54 2022] DELETE /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments/00c8d760-4a77-42cb-a20d-673cdbcd6300 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:15:54.511496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:54.512561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:15:54.516911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:54.519494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:54.530118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.530647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.531108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.531827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:54.532297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:54.532758 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:54.563929 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ea0d91ad-f25f-4ff5-904a-2b2ae19a5cb1 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054709 Aug 30 05:15:54.564662 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3604/7267] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:15:54 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:55.578275 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:55.580651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:55.587183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:55.588371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:55.588823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:55.589564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:55.590024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:55.590458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:55.621991 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b46d124-f8c9-45c3-97ff-0a618f705e1f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048952 Aug 30 05:15:55.622564 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3664/7268] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:15:55 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:56.634474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:56.636658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:56.643541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:56.644048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:56.644505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:56.645215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:56.645716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:56.646165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:56.677816 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b291bac3-4c51-4bfb-af90-29bfb193e2fc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047389 Aug 30 05:15:56.678395 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3605/7269] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:15:56 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:57.690291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:57.692576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:57.699525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.700015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.700452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.701144 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:57.701617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:57.702044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:57.733871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b696aca-3cbc-4c58-b0af-aaa8e3650bae tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047611 Aug 30 05:15:57.734458 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3665/7270] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:15:57 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:58.746734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:58.748963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:58.756010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:58.756502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:58.756951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:58.757689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:58.758154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:58.758593 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:58.789362 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c32d7ae1-b8a9-4fc2-b3a3-fb3851fc97d6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047064 Aug 30 05:15:58.790005 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3606/7271] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:15:58 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:15:59.801712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:59.804231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:59.811057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:59.811537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:59.811975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:59.812663 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:59.813115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:59.813589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:59.843129 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5b0c6f58-8aac-4930-9017-e52306c3f633 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045485 Aug 30 05:15:59.843689 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3666/7272] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:15:59 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:15:59.854333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:15:59.854828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:15:59.861639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:59.862129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:59.862575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:59.863269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:15:59.863731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:15:59.864168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:15:59.940465 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] HTTP exception thrown: Instance 1b17294f-72e0-4849-a159-fe446a604e04 is not attached to volume 00c8d760-4a77-42cb-a20d-673cdbcd6300 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Request method failure captured: Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments/00c8d760-4a77-42cb-a20d-673cdbcd6300 HTTP/1.1 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZzu6xleEjqAv65le5TrwdUINY1TWbXUZPaqMiEpBc8io0Jxz6qYRVR92BOxa_o4HJTtzpOGz3-dGMXy-yZKC_X_OSk2czHwprXPtKCTe-2-38yeCYQiMfW1ulARuftd9eQa8iseB7J3aM3N7JVAXY5qvLxEYor6LZIbaOGztULwC7g Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae413210f41d49f58a2c78e2e0ed5011", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}] Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4fad8950b1174cf68af2206aee803fb6 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1b17294f-72e0-4849-a159-fe446a604e04 is not attached to volume 00c8d760-4a77-42cb-a20d-673cdbcd6300 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '1b17294f-72e0-4849-a159-fe446a604e04', 'id': '00c8d760-4a77-42cb-a20d-673cdbcd6300'} Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 00c8d760-4a77-42cb-a20d-673cdbcd6300. Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b17294f-72e0-4849-a159-fe446a604e04 is not attached to volume 00c8d760-4a77-42cb-a20d-673cdbcd6300 Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:15:59.949098 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:15:59.953813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:15:59.953813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:15:59.953813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b17294f-72e0-4849-a159-fe446a604e04 is not attached to volume 00c8d760-4a77-42cb-a20d-673cdbcd6300 Aug 30 05:15:59.953813 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:15:59.953813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Returning 404 to user: Instance 1b17294f-72e0-4849-a159-fe446a604e04 is not attached to volume 00c8d760-4a77-42cb-a20d-673cdbcd6300 {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:15:59.953813 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-321b48c7-d540-4cc9-9285-8202c1019340 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments/00c8d760-4a77-42cb-a20d-673cdbcd6300" status: 404 len: 154 microversion: 2.1 time: 0.100306 Aug 30 05:15:59.953813 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3607/7273] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:15:59 2022] DELETE /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04/os-volume_attachments/00c8d760-4a77-42cb-a20d-673cdbcd6300 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:16:03.289125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:03.290075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:03.297001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:03.297554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:03.297997 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:03.298725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:03.299180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:03.299608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:03.327872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:16:03.407036 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a6ff4e0f-f8bc-4e2d-aeef-3dbb48bfe339 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 204 len: 0 microversion: 2.1 time: 0.121449 Aug 30 05:16:03.407842 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3667/7274] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:16:03 2022] DELETE /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:16:03.415811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:03.416448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:03.425402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:03.425850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:03.426332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:03.427142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:03.427636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:03.428103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:03.566236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:03.574497 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1da89138-66e4-4d43-8fd3-f92e828b2969 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1560 microversion: 2.1 time: 0.162463 Aug 30 05:16:03.575039 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3608/7275] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:03 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:04.596652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:04.597384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:04.604304 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:04.604789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:04.605229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:04.605950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:04.606409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:04.606841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:04.753456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:04.762010 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb4f3c29-74d6-41f9-9dfb-f8bcad3165ce tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1560 microversion: 2.1 time: 0.169956 Aug 30 05:16:04.762584 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3668/7276] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:04 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:05.406531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2ab96d6e-2be5-4795-a5a8-6803c0f44305 req-3e7c30b3-037d-49c4-8ed9-0f75f9f79bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b17294f-72e0-4849-a159-fe446a604e04", "name": "network-vif-deleted", "tag": "96a4945f-738c-49a3-8207-0fd57f5f72e3"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:05.418352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2ab96d6e-2be5-4795-a5a8-6803c0f44305 req-3e7c30b3-037d-49c4-8ed9-0f75f9f79bd3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:05.418852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2ab96d6e-2be5-4795-a5a8-6803c0f44305 req-3e7c30b3-037d-49c4-8ed9-0f75f9f79bd3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:05.419305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2ab96d6e-2be5-4795-a5a8-6803c0f44305 req-3e7c30b3-037d-49c4-8ed9-0f75f9f79bd3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:05.431234 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2ab96d6e-2be5-4795-a5a8-6803c0f44305 req-3e7c30b3-037d-49c4-8ed9-0f75f9f79bd3 service nova] Creating event network-vif-deleted:96a4945f-738c-49a3-8207-0fd57f5f72e3 for instance 1b17294f-72e0-4849-a159-fe446a604e04 on n-h2-854925-5 Aug 30 05:16:05.436244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2ab96d6e-2be5-4795-a5a8-6803c0f44305 req-3e7c30b3-037d-49c4-8ed9-0f75f9f79bd3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033748 Aug 30 05:16:05.436864 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3609/7277] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:05.783569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:05.784438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:05.792133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:05.792697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:05.793207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:05.794003 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:05.794649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:05.795166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:05.830660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:05.831350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:05.831862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:05.832339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lazy-loading 'fault' on Instance uuid 1b17294f-72e0-4849-a159-fe446a604e04 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:16:05.878462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:05.887177 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d01676fc-5bbf-41bb-b94e-ac8ae4783262 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 200 len: 1352 microversion: 2.1 time: 0.107954 Aug 30 05:16:05.887937 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3669/7278] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:05 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:06.909745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:06.910462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 1b17294f-72e0-4849-a159-fe446a604e04] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:06.917509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:06.917998 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:06.918446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:06.919146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:06.919608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:06.920047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:06.934546 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] HTTP exception thrown: Instance 1b17294f-72e0-4849-a159-fe446a604e04 could not be found. Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Request method failure captured: Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 HTTP/1.1 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZzu6xleEjqAv65le5TrwdUINY1TWbXUZPaqMiEpBc8io0Jxz6qYRVR92BOxa_o4HJTtzpOGz3-dGMXy-yZKC_X_OSk2czHwprXPtKCTe-2-38yeCYQiMfW1ulARuftd9eQa8iseB7J3aM3N7JVAXY5qvLxEYor6LZIbaOGztULwC7g Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae413210f41d49f58a2c78e2e0ed5011", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}] Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4fad8950b1174cf68af2206aee803fb6 Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1b17294f-72e0-4849-a159-fe446a604e04 could not be found. Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1b17294f-72e0-4849-a159-fe446a604e04'} Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b17294f-72e0-4849-a159-fe446a604e04 could not be found. Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b17294f-72e0-4849-a159-fe446a604e04 could not be found. Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:06.936198 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b17294f-72e0-4849-a159-fe446a604e04 could not be found. Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Returning 404 to user: Instance 1b17294f-72e0-4849-a159-fe446a604e04 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f66d8290-3561-4fd6-9427-8fc8d35cb838 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04" status: 404 len: 111 microversion: 2.1 time: 0.033223 Aug 30 05:16:06.941177 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3610/7279] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:06 2022] GET /compute/v2.1/servers/1b17294f-72e0-4849-a159-fe446a604e04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:16:06.946827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b24e44c0-7ac1-49bd-b9bb-44ee7f48fa64 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '.version_select at 0x7fe96a7435e0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:06.967432 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b24e44c0-7ac1-49bd-b9bb-44ee7f48fa64 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-555965148" status: 202 len: 0 microversion: 2.1 time: 0.024445 Aug 30 05:16:06.968024 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3670/7280] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 05:16:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-555965148 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:16:06.986920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3c103998-9ee7-4ad8-8935-beb784211139 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: .version_select at 0x7fe96ae51040>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1176945140", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFMg2ZbZTHkdHKKgnUsZLDsAugpiHpninTUjZlHu+O87Gq3y0rcMf/bcNG5Dg8ipSNBAFCFz2sc6AyXooXDlEIac9xClpEZdqd4GVAYll/6lmf0ewI3/AcwNHi0xTobow=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:07.003290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3c103998-9ee7-4ad8-8935-beb784211139 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:07.008327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-3c103998-9ee7-4ad8-8935-beb784211139 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for user 4fad8950b1174cf68af2206aee803fb6 and project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:07.032370 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3c103998-9ee7-4ad8-8935-beb784211139 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.049459 Aug 30 05:16:07.032977 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3611/7281] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:16:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:07.082863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-740029041", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1176945140", "networks": [{"uuid": "b987a92a-d6fc-4477-b873-ec0d65073cf5"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:07.137354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] validate_networks() for [('b987a92a-d6fc-4477-b873-ec0d65073cf5', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:16:07.505950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:16:07.506379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:16:07.506855 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:16:07.507292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:16:07.507704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:16:07.516510 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:07.516931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:07.517398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:07.518124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:07.518574 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:07.519000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:07.535256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:07.540473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for user 4fad8950b1174cf68af2206aee803fb6 and project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:07.552984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:16:07.555300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:16:07.602852 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e8d8fde9-a167-40a8-99fe-2d7cc8625742 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.523828 Aug 30 05:16:07.604271 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3671/7282] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:16:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 05:16:07.614690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aa12e55f-e80d-4d3a-842b-48777ffcc649 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:07.615326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aa12e55f-e80d-4d3a-842b-48777ffcc649 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:07.672640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aa12e55f-e80d-4d3a-842b-48777ffcc649 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:07.680785 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aa12e55f-e80d-4d3a-842b-48777ffcc649 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1262 microversion: 2.1 time: 0.070019 Aug 30 05:16:07.681420 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3612/7283] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:07 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1262 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:08.702984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:08.703774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:08.712266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:08.712751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:08.713388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:08.715018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:08.715332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:08.715759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:08.809168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:08.818098 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b07455d-43ef-447b-9c73-60f859c2c8d3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1332 microversion: 2.1 time: 0.119880 Aug 30 05:16:08.818716 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3672/7284] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:08 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:09.839819 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:09.840586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:09.847759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:09.848259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:09.848711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:09.849458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:09.850362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:09.851063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:09.890813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-5dd4ed35-ddf6-4ed7-939a-8cbd36ea8232 req-5eeaed8d-63e3-43cc-92c6-3f2ce2834fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51417235-84c2-4aad-bd0b-b1feb8d0addc", "tag": "a5552a77-7d1a-4f04-a5f9-2d252df86fd1"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:09.906682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5dd4ed35-ddf6-4ed7-939a-8cbd36ea8232 req-5eeaed8d-63e3-43cc-92c6-3f2ce2834fa9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:09.907415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5dd4ed35-ddf6-4ed7-939a-8cbd36ea8232 req-5eeaed8d-63e3-43cc-92c6-3f2ce2834fa9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:09.908005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-5dd4ed35-ddf6-4ed7-939a-8cbd36ea8232 req-5eeaed8d-63e3-43cc-92c6-3f2ce2834fa9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:09.923639 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-5dd4ed35-ddf6-4ed7-939a-8cbd36ea8232 req-5eeaed8d-63e3-43cc-92c6-3f2ce2834fa9 service nova] Creating event network-changed:a5552a77-7d1a-4f04-a5f9-2d252df86fd1 for instance 51417235-84c2-4aad-bd0b-b1feb8d0addc on n-h2-854925-5 Aug 30 05:16:09.928855 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-5dd4ed35-ddf6-4ed7-939a-8cbd36ea8232 req-5eeaed8d-63e3-43cc-92c6-3f2ce2834fa9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041806 Aug 30 05:16:09.929661 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3673/7285] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:16:10.098904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:10.107285 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f15d566a-928c-4e92-b63f-eb23f6f26ccc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1362 microversion: 2.1 time: 0.272212 Aug 30 05:16:10.107861 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3613/7286] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:09 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:11.129570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:11.130277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:11.137035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:11.138695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:11.139293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:11.140027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:11.140501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:11.140934 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:11.353269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:11.361150 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-23d66338-1258-442f-9320-2e66482b7e7b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1362 microversion: 2.1 time: 0.236747 Aug 30 05:16:11.361750 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3674/7287] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:11 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:12.381773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:12.382437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:12.389411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:12.389910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:12.390367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:12.391069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:12.391570 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:12.392016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:12.519129 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:12.527990 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4dee1aaa-3ec4-473b-9616-3558d6a8949f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1362 microversion: 2.1 time: 0.150158 Aug 30 05:16:12.528576 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3614/7288] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:12 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:13.548298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:13.548869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:13.555862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:13.556350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:13.556789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:13.557512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:13.557971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:13.558400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:13.690605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:13.698906 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-661c43f0-0d63-46b4-b195-9ea9050548b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1362 microversion: 2.1 time: 0.154577 Aug 30 05:16:13.699699 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3675/7289] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:13 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:13.824048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f3484820-040c-48a9-9fd8-ca62bd61d011 req-5d14e472-01d0-45a1-92fb-98b29beb1fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51417235-84c2-4aad-bd0b-b1feb8d0addc", "name": "network-vif-plugged", "status": "completed", "tag": "a5552a77-7d1a-4f04-a5f9-2d252df86fd1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:13.836146 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f3484820-040c-48a9-9fd8-ca62bd61d011 req-5d14e472-01d0-45a1-92fb-98b29beb1fb0 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:13.836487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f3484820-040c-48a9-9fd8-ca62bd61d011 req-5d14e472-01d0-45a1-92fb-98b29beb1fb0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:13.837130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f3484820-040c-48a9-9fd8-ca62bd61d011 req-5d14e472-01d0-45a1-92fb-98b29beb1fb0 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:13.849245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f3484820-040c-48a9-9fd8-ca62bd61d011 req-5d14e472-01d0-45a1-92fb-98b29beb1fb0 service nova] Creating event network-vif-plugged:a5552a77-7d1a-4f04-a5f9-2d252df86fd1 for instance 51417235-84c2-4aad-bd0b-b1feb8d0addc on n-h2-854925-5 Aug 30 05:16:13.854291 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f3484820-040c-48a9-9fd8-ca62bd61d011 req-5d14e472-01d0-45a1-92fb-98b29beb1fb0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034017 Aug 30 05:16:13.854902 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3615/7290] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:14.719892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:14.720505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:14.727638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:14.728623 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:14.729056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:14.729767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:14.730216 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:14.730640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:14.867681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:14.875967 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a85163c6-1280-4549-a277-efe004f81de9 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1362 microversion: 2.1 time: 0.159976 Aug 30 05:16:14.876619 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3676/7291] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:14 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:15.897594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:15.898359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:15.905864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:15.906361 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:15.906811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:15.907522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:15.907987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:15.908430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:16.037117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:16.045565 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f67ad984-bade-48f9-9e86-0c3021c0ff31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1555 microversion: 2.1 time: 0.153197 Aug 30 05:16:16.046141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3616/7292] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:15 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:16.065261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:16.065940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:16.072731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:16.073222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:16.073696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:16.074387 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:16.074845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:16.075276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:16.206309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:16.214517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a29fae6d-31a9-4835-96c1-138aa23a0ec3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1555 microversion: 2.1 time: 0.153201 Aug 30 05:16:16.215100 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3677/7293] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:16 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:17.699660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf8af832-d51d-4e3a-9465-a6fd1774122f"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:17.702049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:17.704856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:17.710584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:17.711086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:17.711545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:17.712254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:17.712723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:17.713165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:17.961501 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de556059-b83c-44fc-8cac-d5db18e5f5eb tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266115 Aug 30 05:16:17.965591 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3617/7294] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 05:16:17 2022] POST /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:16:28.664211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:28.665006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:28.667482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:28.668308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:28.669069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:28.669716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:28.676198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.676689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.677129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.677898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.678350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.678779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.763103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lazy-loading 'services' on Instance uuid 51417235-84c2-4aad-bd0b-b1feb8d0addc {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:16:28.833282 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d7a66c5-64f9-49ef-a45b-036ea1fadd27 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments/cf8af832-d51d-4e3a-9465-a6fd1774122f" status: 202 len: 0 microversion: 2.1 time: 0.172927 Aug 30 05:16:28.833905 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3678/7295] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:16:28 2022] DELETE /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments/cf8af832-d51d-4e3a-9465-a6fd1774122f => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:16:28.842190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:28.843449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:28.847995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:28.850458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:28.859615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.860121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.860580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.861297 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:28.861811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:28.862257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:28.900472 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-773e24c9-ebe3-47b1-a726-51e2d338815a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059426 Aug 30 05:16:28.901246 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3618/7296] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:16:28 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:29.913162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:29.916159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:29.923428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:29.923908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:29.924343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:29.925035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:29.925512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:29.925936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:29.957496 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3468ae09-764c-4224-b9bf-dee7fc959a90 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048624 Aug 30 05:16:29.958075 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3679/7297] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:16:29 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:30.969963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:30.972458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:30.980313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:30.980809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:30.981264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:30.982002 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:30.982464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:30.982902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:31.014177 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7c137ae0-51e2-4c79-afe2-78cc01f1bacc tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048169 Aug 30 05:16:31.014745 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3619/7298] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:16:30 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:16:32.026935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:32.029185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:32.036087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:32.036570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:32.037007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:32.037719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:32.038169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:32.038590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:32.068302 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1ad3451f-d4bf-440e-82de-0fc1920d1ed4 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Aug 30 05:16:32.068885 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3680/7299] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:16:32 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:33.081180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:33.083459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:33.091007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:33.091507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:33.091964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:33.092682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:33.093151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:33.093620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:33.124789 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ebf51f21-3bbe-48e5-b8ff-32304e7d1f1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047689 Aug 30 05:16:33.125572 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3620/7300] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:16:33 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:34.137530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:34.139724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:34.146761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.147246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.147686 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.148376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.148829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.149258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.179477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7024a2ca-60d3-4508-8e83-eece6eee9a2a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046477 Aug 30 05:16:34.179966 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3681/7301] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:16:34 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:16:34.190697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:34.191214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:34.197883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.198386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.198851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.199567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:34.200041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:34.200491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:34.277808 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] HTTP exception thrown: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc is not attached to volume cf8af832-d51d-4e3a-9465-a6fd1774122f Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Request method failure captured: Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments/cf8af832-d51d-4e3a-9465-a6fd1774122f HTTP/1.1 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZzu6xleEjqAv65le5TrwdUINY1TWbXUZPaqMiEpBc8io0Jxz6qYRVR92BOxa_o4HJTtzpOGz3-dGMXy-yZKC_X_OSk2czHwprXPtKCTe-2-38yeCYQiMfW1ulARuftd9eQa8iseB7J3aM3N7JVAXY5qvLxEYor6LZIbaOGztULwC7g Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae413210f41d49f58a2c78e2e0ed5011", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}] Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4fad8950b1174cf68af2206aee803fb6 Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc is not attached to volume cf8af832-d51d-4e3a-9465-a6fd1774122f Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '51417235-84c2-4aad-bd0b-b1feb8d0addc', 'id': 'cf8af832-d51d-4e3a-9465-a6fd1774122f'} Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cf8af832-d51d-4e3a-9465-a6fd1774122f. Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc is not attached to volume cf8af832-d51d-4e3a-9465-a6fd1774122f Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:34.279436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:34.284274 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:16:34.284274 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:16:34.284274 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc is not attached to volume cf8af832-d51d-4e3a-9465-a6fd1774122f Aug 30 05:16:34.284274 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:34.284274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Returning 404 to user: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc is not attached to volume cf8af832-d51d-4e3a-9465-a6fd1774122f {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:16:34.284274 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-423b38dc-32cc-4b1a-bea0-66bd3b389b61 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments/cf8af832-d51d-4e3a-9465-a6fd1774122f" status: 404 len: 154 microversion: 2.1 time: 0.094505 Aug 30 05:16:34.284274 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3621/7302] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:16:34 2022] DELETE /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc/os-volume_attachments/cf8af832-d51d-4e3a-9465-a6fd1774122f => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:16:37.624039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:37.624549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:37.631761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:37.632445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:37.632879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:37.633608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:37.634649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:37.635074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:37.664284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:16:37.748088 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7f3d81cd-938a-4b33-807d-f8e79a897042 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 204 len: 0 microversion: 2.1 time: 0.127660 Aug 30 05:16:37.748783 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3682/7303] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:16:37 2022] DELETE /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:16:37.757538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:37.758132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:37.766426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:37.767175 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:37.767744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:37.768462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:37.768983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:37.769457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:37.900700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:37.909072 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee9a87f4-3197-4338-8544-f82858e9411f tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1561 microversion: 2.1 time: 0.155613 Aug 30 05:16:37.909780 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3622/7304] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:37 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:16:38.931702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:38.932466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:38.939833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.940322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.940764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:38.941515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:38.941971 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:38.942403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:39.077086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:39.085032 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76272f2d-17d8-4a2b-900d-60f1cdc21b23 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1561 microversion: 2.1 time: 0.157704 Aug 30 05:16:39.085657 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3683/7305] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:38 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:39.671991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b39a407c-d755-447d-95c0-a543d48b6827 req-4d856806-a91d-4407-9590-643d019e65a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51417235-84c2-4aad-bd0b-b1feb8d0addc", "name": "network-vif-deleted", "tag": "a5552a77-7d1a-4f04-a5f9-2d252df86fd1"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:39.683582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b39a407c-d755-447d-95c0-a543d48b6827 req-4d856806-a91d-4407-9590-643d019e65a5 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:39.684188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b39a407c-d755-447d-95c0-a543d48b6827 req-4d856806-a91d-4407-9590-643d019e65a5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:39.684713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b39a407c-d755-447d-95c0-a543d48b6827 req-4d856806-a91d-4407-9590-643d019e65a5 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:39.699990 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b39a407c-d755-447d-95c0-a543d48b6827 req-4d856806-a91d-4407-9590-643d019e65a5 service nova] Creating event network-vif-deleted:a5552a77-7d1a-4f04-a5f9-2d252df86fd1 for instance 51417235-84c2-4aad-bd0b-b1feb8d0addc on n-h2-854925-5 Aug 30 05:16:39.705461 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b39a407c-d755-447d-95c0-a543d48b6827 req-4d856806-a91d-4407-9590-643d019e65a5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037147 Aug 30 05:16:39.706198 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3623/7306] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:40.106839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:40.107463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:40.114833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:40.115329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:40.115778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:40.116498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:40.116960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:40.117428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:40.152714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:40.152714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:40.153020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:40.153293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lazy-loading 'fault' on Instance uuid 51417235-84c2-4aad-bd0b-b1feb8d0addc {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:16:40.199716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:40.207166 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-500d4330-aacc-4939-9ad1-f2e511222ef6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 200 len: 1352 microversion: 2.1 time: 0.104505 Aug 30 05:16:40.207775 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3684/7307] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:40 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:41.230004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.230673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: 51417235-84c2-4aad-bd0b-b1feb8d0addc] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:41.236911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.237509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.237967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.238675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.239144 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.239591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.252964 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] HTTP exception thrown: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc could not be found. Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Request method failure captured: Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc HTTP/1.1 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZzu6xleEjqAv65le5TrwdUINY1TWbXUZPaqMiEpBc8io0Jxz6qYRVR92BOxa_o4HJTtzpOGz3-dGMXy-yZKC_X_OSk2czHwprXPtKCTe-2-38yeCYQiMfW1ulARuftd9eQa8iseB7J3aM3N7JVAXY5qvLxEYor6LZIbaOGztULwC7g Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae413210f41d49f58a2c78e2e0ed5011", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}] Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4fad8950b1174cf68af2206aee803fb6 Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc could not be found. Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '51417235-84c2-4aad-bd0b-b1feb8d0addc'} Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc could not be found. Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc could not be found. Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:41.254707 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc could not be found. Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Returning 404 to user: Instance 51417235-84c2-4aad-bd0b-b1feb8d0addc could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ef51a8d-3be7-4e4c-80c7-0153c021a02a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc" status: 404 len: 111 microversion: 2.1 time: 0.031475 Aug 30 05:16:41.259886 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3624/7308] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:41 2022] GET /compute/v2.1/servers/51417235-84c2-4aad-bd0b-b1feb8d0addc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:16:41.265295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3fe7b6d9-c2c1-48c2-9d55-21c12965edee tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '.version_select at 0x7fe96a36aaf0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.285935 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3fe7b6d9-c2c1-48c2-9d55-21c12965edee tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1176945140" status: 202 len: 0 microversion: 2.1 time: 0.024365 Aug 30 05:16:41.286513 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3685/7309] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Aug 30 05:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1176945140 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:16:41.307831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6a05ac84-6b18-4c92-ae29-0b1b2339fc31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: .version_select at 0x7fe96a52c940>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-371823708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAqAea9u+6ucjXbLYfXBvzYxAqIuChtBYgAdlni/C3+KS6bLHkteHxY2yUvwUMNcjMyLbufSiIys514uCLDtydE39CzR0AkYLBFuqQmy84Fg+txcH17uH9dTFPPcxwrUPA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:41.324006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6a05ac84-6b18-4c92-ae29-0b1b2339fc31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:41.329195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-6a05ac84-6b18-4c92-ae29-0b1b2339fc31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for user 4fad8950b1174cf68af2206aee803fb6 and project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:41.352798 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6a05ac84-6b18-4c92-ae29-0b1b2339fc31 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048977 Aug 30 05:16:41.353413 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3625/7310] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:16:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:41.402966 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1291158330", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-371823708", "networks": [{"uuid": "b987a92a-d6fc-4477-b873-ec0d65073cf5"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:41.455819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] validate_networks() for [('b987a92a-d6fc-4477-b873-ec0d65073cf5', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:16:41.816681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:16:41.817111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:16:41.817624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:16:41.818041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:16:41.818491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:16:41.827912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.828394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.828831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.829641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:41.830043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:41.830475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:41.847821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:16:41.853223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Getting quotas for user 4fad8950b1174cf68af2206aee803fb6 and project ae413210f41d49f58a2c78e2e0ed5011. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:16:41.865795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:16:41.868123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:16:41.916521 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7e659283-8749-4966-ac2b-b0dd501c917a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517585 Aug 30 05:16:41.917179 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3686/7311] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:16:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:16:41.927830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-04271b0a-7a50-4762-bafd-1c8f505bfe1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:41.928478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-04271b0a-7a50-4762-bafd-1c8f505bfe1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:41.986314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-04271b0a-7a50-4762-bafd-1c8f505bfe1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:41.994283 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-04271b0a-7a50-4762-bafd-1c8f505bfe1e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1262 microversion: 2.1 time: 0.070363 Aug 30 05:16:41.995180 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3626/7312] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:41 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1262 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:43.018332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:43.019311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:43.026723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:43.027413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:43.027923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:43.028946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:43.029567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:43.030193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:43.102747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:43.110964 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-476c6cd6-de1a-4947-8f7a-ede53f7986ec tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1332 microversion: 2.1 time: 0.098428 Aug 30 05:16:43.111561 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3687/7313] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:43 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:44.132634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:44.133273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:44.141696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.142428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.143014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:44.143745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.144289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.144822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:44.277194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:44.285148 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ff4a0a49-dc2f-4f9a-b205-b405281fc239 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1362 microversion: 2.1 time: 0.156751 Aug 30 05:16:44.285768 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3627/7314] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:44 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:44.556261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-28d6e592-e412-415a-9703-63a6dc9dd60e req-5e3cd071-4349-4885-8602-d395063a3233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc39a642-bf55-4e5d-af8a-ce5bf2de331d", "tag": "2a628de9-94ee-443e-a73c-f5dba9015e3a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:44.567816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28d6e592-e412-415a-9703-63a6dc9dd60e req-5e3cd071-4349-4885-8602-d395063a3233 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:44.568289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28d6e592-e412-415a-9703-63a6dc9dd60e req-5e3cd071-4349-4885-8602-d395063a3233 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:44.568815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-28d6e592-e412-415a-9703-63a6dc9dd60e req-5e3cd071-4349-4885-8602-d395063a3233 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:44.581888 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-28d6e592-e412-415a-9703-63a6dc9dd60e req-5e3cd071-4349-4885-8602-d395063a3233 service nova] Creating event network-changed:2a628de9-94ee-443e-a73c-f5dba9015e3a for instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d on n-h1-854925-5 Aug 30 05:16:44.586792 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-28d6e592-e412-415a-9703-63a6dc9dd60e req-5e3cd071-4349-4885-8602-d395063a3233 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034732 Aug 30 05:16:44.587396 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3688/7315] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:45.307079 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:45.307658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:45.314607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:45.315098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:45.315549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:45.316244 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:45.316709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:45.317148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:45.447233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:45.455074 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-42de38ea-b19a-41b7-9836-51f9e4ce5bb2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1362 microversion: 2.1 time: 0.152076 Aug 30 05:16:45.455655 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3628/7316] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:45 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:46.477979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:46.478684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:46.484861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.485374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.485816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.486531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:46.486986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:46.487414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:46.616969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:46.625205 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0c504b16-7f07-4a41-b339-ca7332a52279 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1362 microversion: 2.1 time: 0.152376 Aug 30 05:16:46.625893 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3689/7317] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:46 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:47.646609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:47.647237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:47.654547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:47.655043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:47.655495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:47.656194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:47.656665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:47.657108 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:47.790634 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:47.798358 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-89c58b4f-0336-4288-855c-0169902ce301 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1362 microversion: 2.1 time: 0.155720 Aug 30 05:16:47.798934 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3629/7318] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:47 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:48.818472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:48.819106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:48.826444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:48.827161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:48.827602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:48.828301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:48.835005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:48.835005 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:49.011916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:49.019656 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9a3d73c2-6105-4820-a51c-1f7eed38cbc2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1362 microversion: 2.1 time: 0.205239 Aug 30 05:16:49.020157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3690/7319] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:48 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:50.040064 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:50.040694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:50.047630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:50.048123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:50.048580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:50.049279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:50.049768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:50.050211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:50.225488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:50.233349 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9f76fbf3-6752-47cd-aead-6a281f888ee2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1362 microversion: 2.1 time: 0.197194 Aug 30 05:16:50.233931 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3630/7320] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:50 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:50.373175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-37611b13-0253-4af8-953f-f408e4dbb21f req-2fc4ca48-322f-4a5c-83ba-33658efaa181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc39a642-bf55-4e5d-af8a-ce5bf2de331d", "name": "network-vif-plugged", "status": "completed", "tag": "2a628de9-94ee-443e-a73c-f5dba9015e3a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:50.383472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-37611b13-0253-4af8-953f-f408e4dbb21f req-2fc4ca48-322f-4a5c-83ba-33658efaa181 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:50.384644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-37611b13-0253-4af8-953f-f408e4dbb21f req-2fc4ca48-322f-4a5c-83ba-33658efaa181 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:50.385157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-37611b13-0253-4af8-953f-f408e4dbb21f req-2fc4ca48-322f-4a5c-83ba-33658efaa181 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:50.397508 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-37611b13-0253-4af8-953f-f408e4dbb21f req-2fc4ca48-322f-4a5c-83ba-33658efaa181 service nova] Creating event network-vif-plugged:2a628de9-94ee-443e-a73c-f5dba9015e3a for instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d on n-h1-854925-5 Aug 30 05:16:50.403633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-37611b13-0253-4af8-953f-f408e4dbb21f req-2fc4ca48-322f-4a5c-83ba-33658efaa181 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034305 Aug 30 05:16:50.404240 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3691/7321] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:16:51.254343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:51.254915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:51.262421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:51.262918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:51.263369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:51.264069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:51.264537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:51.264978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:51.405358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:51.413071 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0a6571dd-a3f3-4ba5-9525-fb3e4dde68b3 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1362 microversion: 2.1 time: 0.162673 Aug 30 05:16:51.413704 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3631/7322] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:51 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:52.432465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:52.433253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:52.437694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:52.438395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:52.445381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:52.445887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:52.446954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:52.447634 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:52.448081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:52.448501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:52.576167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:52.584373 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e04c5004-1ce7-42d7-908b-dfa494057834 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1554 microversion: 2.1 time: 0.153704 Aug 30 05:16:52.584958 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3692/7323] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:52 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:52.605798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:16:52.606455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:52.608459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:52.615205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:52.615709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:52.616164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:52.616868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:52.617355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:52.618301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:52.748251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:16:52.756229 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c05bd245-597e-424d-b22c-04a8ac974791 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1554 microversion: 2.1 time: 0.154929 Aug 30 05:16:52.756812 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3632/7324] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:16:52 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:16:54.240968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:16:54.243929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:16:54.250773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:54.251261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:54.251705 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:54.252403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:16:54.252862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:16:54.253294 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:16:54.492667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:16:54.509924 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0723339e-c3b5-4cbd-a156-af9921b6b9f5 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "POST /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272852 Aug 30 05:16:54.510536 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3693/7325] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 05:16:54 2022] POST /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:05.204863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:05.205419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:05.207502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:05.208230 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=70 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:05.214999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:05.215616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:05.216187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:05.216909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:05.217405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:05.217855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:05.298330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lazy-loading 'services' on Instance uuid cc39a642-bf55-4e5d-af8a-ce5bf2de331d {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:17:05.369036 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-82fa5391-a737-460c-be60-93e0704c2b35 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments/9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5" status: 202 len: 0 microversion: 2.1 time: 0.170943 Aug 30 05:17:05.369683 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3633/7326] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:17:05 2022] DELETE /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments/9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:17:05.376358 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:05.377157 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:05.381697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:05.384054 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:05.393698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:05.394187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:05.394680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:05.395376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:05.395821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:05.396246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:05.428903 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-672b8573-7ef2-43e5-8bf0-4a1728776e09 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054403 Aug 30 05:17:05.429399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3694/7327] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:05 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:06.443048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:06.445519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:06.452546 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:06.453061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:06.453551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:06.454273 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:06.454748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:06.455196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:06.486524 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-076f052e-acf4-48d7-96e5-85862e092cbe tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048759 Aug 30 05:17:06.487005 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3634/7328] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:06 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:07.498976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:07.501554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:07.508612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:07.509108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:07.509582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:07.510949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:07.511418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:07.511846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:07.544047 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c602f259-9ec1-4d08-b0d3-4c338564cc6b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049017 Aug 30 05:17:07.544570 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3695/7329] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:07 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:08.555446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:08.557567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:08.564510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:08.565124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:08.565479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:08.566181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:08.566642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:08.567078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:08.597976 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8d2d376e-5941-4c10-84d8-b949f9f3a3c2 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046639 Aug 30 05:17:08.598557 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3635/7330] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:08 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:09.610613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:09.612794 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:09.620161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:09.620644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:09.621075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:09.621806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:09.622258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:09.622682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:09.655421 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e24c1615-c86b-479f-acef-a9f0229a381b tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048772 Aug 30 05:17:09.656165 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3696/7331] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:09 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:17:10.666927 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:10.669139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:10.676096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:10.676594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:10.677049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:10.677797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:10.678268 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:10.678711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:10.708722 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-950148bb-5652-409f-a2f3-11fc466429be tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045818 Aug 30 05:17:10.709287 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3636/7332] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:17:10 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:17:10.719882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:10.720371 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:10.727542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:10.728051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:10.728509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:10.729246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:10.729725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:10.730186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:10.804361 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] HTTP exception thrown: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d is not attached to volume 9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Request method failure captured: Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments/9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 HTTP/1.1 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZzu6xleEjqAv65le5TrwdUINY1TWbXUZPaqMiEpBc8io0Jxz6qYRVR92BOxa_o4HJTtzpOGz3-dGMXy-yZKC_X_OSk2czHwprXPtKCTe-2-38yeCYQiMfW1ulARuftd9eQa8iseB7J3aM3N7JVAXY5qvLxEYor6LZIbaOGztULwC7g Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae413210f41d49f58a2c78e2e0ed5011", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}] Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 4fad8950b1174cf68af2206aee803fb6 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d is not attached to volume 9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': 'cc39a642-bf55-4e5d-af8a-ce5bf2de331d', 'id': '9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5'} Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5. Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d is not attached to volume 9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:10.806364 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:10.811548 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:17:10.811548 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:17:10.811548 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d is not attached to volume 9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 Aug 30 05:17:10.811548 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:17:10.811548 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Returning 404 to user: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d is not attached to volume 9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:17:10.811548 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1ed7f896-a4aa-4565-83d8-12b9b615feda tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments/9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5" status: 404 len: 154 microversion: 2.1 time: 0.092491 Aug 30 05:17:10.811548 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3697/7333] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:17:10 2022] DELETE /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d/os-volume_attachments/9d0dacc0-375a-42f2-83c3-97dd5d4e3bf5 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:17:14.155197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:14.155738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:14.163515 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:14.164029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:14.164489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:14.165236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:14.165724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:14.167000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:14.197038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:17:14.277651 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-18fd269f-f330-4961-95ae-a2461abf4f33 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 204 len: 0 microversion: 2.1 time: 0.126223 Aug 30 05:17:14.278446 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3637/7334] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:17:14 2022] DELETE /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:17:14.286638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:14.287274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:14.297564 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:14.298099 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:14.298754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:14.299753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:14.300461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:14.301187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:14.431655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:14.439529 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-16b70862-aff5-4e6d-b5ca-0d1656b63c60 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1560 microversion: 2.1 time: 0.156867 Aug 30 05:17:14.440104 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3698/7335] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:14 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:15.461524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:15.462240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:15.469887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:15.470384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:15.470837 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:15.471568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:15.472288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:15.472730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:15.599640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:15.607436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ae76a16-3625-49a6-a162-fea07e4856a6 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1560 microversion: 2.1 time: 0.150262 Aug 30 05:17:15.608164 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3638/7336] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:15 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:16.628103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:16.629630 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:16.637091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:16.637705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:16.638233 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:16.639208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:16.639783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:16.640298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:16.717212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-b516810e-5849-4ae3-b94b-ccfcf6e279d4 req-9c410ec8-4214-4674-8a48-03acdd19265d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc39a642-bf55-4e5d-af8a-ce5bf2de331d", "name": "network-vif-deleted", "tag": "2a628de9-94ee-443e-a73c-f5dba9015e3a"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:16.726180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fad8950b1174cf68af2206aee803fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae413210f41d49f58a2c78e2e0ed5011', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:16.735444 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca0edb2c-5d95-4f94-ae6d-82bb0a1b693e tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 200 len: 1347 microversion: 2.1 time: 0.111150 Aug 30 05:17:16.736350 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3639/7337] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:16 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:17:16.737813 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b516810e-5849-4ae3-b94b-ccfcf6e279d4 req-9c410ec8-4214-4674-8a48-03acdd19265d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:16.738511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b516810e-5849-4ae3-b94b-ccfcf6e279d4 req-9c410ec8-4214-4674-8a48-03acdd19265d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:16.738951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-b516810e-5849-4ae3-b94b-ccfcf6e279d4 req-9c410ec8-4214-4674-8a48-03acdd19265d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:16.759705 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-b516810e-5849-4ae3-b94b-ccfcf6e279d4 req-9c410ec8-4214-4674-8a48-03acdd19265d service nova] Creating event network-vif-deleted:2a628de9-94ee-443e-a73c-f5dba9015e3a for instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d on n-h1-854925-5 Aug 30 05:17:16.764776 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-b516810e-5849-4ae3-b94b-ccfcf6e279d4 req-9c410ec8-4214-4674-8a48-03acdd19265d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186129 Aug 30 05:17:16.765481 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3699/7338] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:17.756592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:17.757275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] [instance: cc39a642-bf55-4e5d-af8a-ce5bf2de331d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:17.764256 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:17.764759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:17.765216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:17.765954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:17.766422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:17.766867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:17.780181 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] HTTP exception thrown: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d could not be found. Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Request method failure captured: Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d HTTP/1.1 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZzu6xleEjqAv65le5TrwdUINY1TWbXUZPaqMiEpBc8io0Jxz6qYRVR92BOxa_o4HJTtzpOGz3-dGMXy-yZKC_X_OSk2czHwprXPtKCTe-2-38yeCYQiMfW1ulARuftd9eQa8iseB7J3aM3N7JVAXY5qvLxEYor6LZIbaOGztULwC7g Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ae413210f41d49f58a2c78e2e0ed5011", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ae413210f41d49f58a2c78e2e0ed5011"}]}] Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: ae413210f41d49f58a2c78e2e0ed5011 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1436085958 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 4fad8950b1174cf68af2206aee803fb6 Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestEncryptedCinderVolumes-1436085958-project Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d could not be found. Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'cc39a642-bf55-4e5d-af8a-ce5bf2de331d'} Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d could not be found. Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d could not be found. Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:17:17.781899 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d could not be found. Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Returning 404 to user: Instance cc39a642-bf55-4e5d-af8a-ce5bf2de331d could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0477be4b-a89d-415b-963d-fa1bdfd46b7a tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d" status: 404 len: 111 microversion: 2.1 time: 0.030653 Aug 30 05:17:17.786457 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3640/7339] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:17 2022] GET /compute/v2.1/servers/cc39a642-bf55-4e5d-af8a-ce5bf2de331d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:17:17.794306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d211999b-171e-40c7-aac7-e9b3a0f69414 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] Calling method '.version_select at 0x7fe96914f790>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:17.814799 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d211999b-171e-40c7-aac7-e9b3a0f69414 tempest-TestEncryptedCinderVolumes-1436085958 tempest-TestEncryptedCinderVolumes-1436085958-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-371823708" status: 202 len: 0 microversion: 2.1 time: 0.026144 Aug 30 05:17:17.815397 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3700/7340] 10.222.0.27 () {58 vars in 1275 bytes} [Tue Aug 30 05:17:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-371823708 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:17:44.848665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-69e0bbdc-73c8-4461-bafe-e6f05256096b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'create', calling method: .version_select at 0x7fe969434160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-849891566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqO1tvbRXM18+SCKYX4aM8rzVBLvEOkDdBOWqOABMj97eWyThL0HiaVYUaaPu+FyFo49/FYnX8qCZSW1kuKS8bJbDt3I7VLD9lWCKVTqZaFgsCEVP22i6lVVvCfZR8ISQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:44.854790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:44.855462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:44.870907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-69e0bbdc-73c8-4461-bafe-e6f05256096b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for project d875800223e24b918348d40c958c297f. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:17:44.876047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-69e0bbdc-73c8-4461-bafe-e6f05256096b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for user 241b55926b71439d88188d6fe0806e3d and project d875800223e24b918348d40c958c297f. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:17:44.899458 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-69e0bbdc-73c8-4461-bafe-e6f05256096b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055384 Aug 30 05:17:44.900107 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3641/7341] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:17:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:17:44.950675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=32 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:44.951433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:44.955563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-482481999", "imageRef": "b02e785f-dee5-4dd0-9738-bd5b6a75a05f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-849891566", "networks": [{"uuid": "77db50a7-8930-41a9-9827-e1f0987b56c6"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:45.008830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] validate_networks() for [('77db50a7-8930-41a9-9827-e1f0987b56c6', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:17:45.381065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:17:45.381539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:17:45.382024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:17:45.382438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:17:45.382852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:17:45.391648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:45.392134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:45.392571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:45.393300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:45.393788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:45.394217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:45.411849 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for project d875800223e24b918348d40c958c297f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:17:45.417675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for user 241b55926b71439d88188d6fe0806e3d and project d875800223e24b918348d40c958c297f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:17:45.429853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:17:45.432186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b02e785f-dee5-4dd0-9738-bd5b6a75a05f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:17:45.477211 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5896754e-a803-459e-ba4f-5a372e34ea6d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528477 Aug 30 05:17:45.477941 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3701/7342] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:17:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:17:45.488403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2991146b-25cf-4e48-b8a3-7ccea4a2514e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:45.489041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2991146b-25cf-4e48-b8a3-7ccea4a2514e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:45.546336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2991146b-25cf-4e48-b8a3-7ccea4a2514e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:45.553389 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2991146b-25cf-4e48-b8a3-7ccea4a2514e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1257 microversion: 2.1 time: 0.068766 Aug 30 05:17:45.554333 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3642/7343] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:45 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:46.575907 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:46.576631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:46.583127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.583688 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.584209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.584980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:46.585455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:46.585885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:46.658900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:46.668548 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d12d6059-fbb8-4b93-b149-31f486fec1b7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1315 microversion: 2.1 time: 0.099031 Aug 30 05:17:46.669135 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3702/7344] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:46 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1315 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:47.694054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:47.694814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:47.703479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:47.704236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:47.704689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:47.705433 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:47.705903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:47.706344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:47.848399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:47.857094 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0e0ceaf0-5440-4e26-af26-4394b7cf6aeb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.166976 Aug 30 05:17:47.857933 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3643/7345] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:47 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:48.881274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:48.882032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:48.889708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:48.890156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:48.890724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:48.891492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:48.892020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:48.892708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:49.049843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:49.058462 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5a4caac3-3598-4936-9804-aa2baf718146 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.181445 Aug 30 05:17:49.059053 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3703/7346] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:48 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:50.079665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:50.080359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:50.087391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:50.087893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:50.088347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:50.089061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:50.089779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:50.090232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:50.234097 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:50.241939 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-db23b6d1-6d3a-41a3-87c7-f5d66506318a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.166530 Aug 30 05:17:50.242526 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3644/7347] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:50 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:51.264036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:51.264982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:51.273214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:51.273754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:51.274210 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:51.278910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:51.279615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:51.280068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:51.435825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:51.443836 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-af94da18-f931-4dd1-866a-f0140ed748fa tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.184486 Aug 30 05:17:51.444437 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3704/7348] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:51 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:52.465654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:52.466539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:52.473842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:52.474427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:52.474967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:52.475760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:52.476466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:52.476973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:52.620411 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:52.628471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ac3dc370-dc8c-449d-9872-cf0bbab8199e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.167756 Aug 30 05:17:52.629106 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3645/7349] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:52 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:53.649754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:53.650367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:53.657493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:53.657982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:53.658430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:53.659135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:53.659592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:53.660025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:53.793728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:53.801555 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6afbf304-98ca-4da7-8c0a-966a46cb8ebb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.155791 Aug 30 05:17:53.802139 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3705/7350] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:53 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:17:54.811811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-93f7a141-7d17-4129-9966-8af22d11ef6f req-b6a26a2f-f03a-479e-8902-c18d69019a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1", "tag": "eb5a6711-9109-4a43-a72d-3b6574361ba5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:54.823872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:54.832176 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:54.844455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:54.845232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:54.845874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:54.846011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-93f7a141-7d17-4129-9966-8af22d11ef6f req-b6a26a2f-f03a-479e-8902-c18d69019a62 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:54.846505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-93f7a141-7d17-4129-9966-8af22d11ef6f req-b6a26a2f-f03a-479e-8902-c18d69019a62 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:54.846954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-93f7a141-7d17-4129-9966-8af22d11ef6f req-b6a26a2f-f03a-479e-8902-c18d69019a62 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:54.847243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:54.848122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:54.848715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:54.860801 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-93f7a141-7d17-4129-9966-8af22d11ef6f req-b6a26a2f-f03a-479e-8902-c18d69019a62 service nova] Creating event network-changed:eb5a6711-9109-4a43-a72d-3b6574361ba5 for instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 on n-h2-854925-5 Aug 30 05:17:54.866121 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-93f7a141-7d17-4129-9966-8af22d11ef6f req-b6a26a2f-f03a-479e-8902-c18d69019a62 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058180 Aug 30 05:17:54.866888 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3646/7351] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:17:55.070585 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:55.078981 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b62636b9-bd6c-4de6-a2b0-89f41c473505 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.259764 Aug 30 05:17:55.079559 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3706/7352] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:54 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:56.100537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:56.101258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:56.103395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:56.110384 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.110887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.111340 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.112049 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:56.112547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:56.113036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:56.327720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:56.336515 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-74858808-123a-4648-92e2-b7e34155ba04 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.240297 Aug 30 05:17:56.337950 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3647/7353] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:56 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:57.358091 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:57.358740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:57.360639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:57.361317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:17:57.368840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.369344 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.369781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.370468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:57.370920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:57.371341 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:57.498925 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:57.506594 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bd9296bf-763c-4a1e-8d73-19ebc8c7a10e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.152473 Aug 30 05:17:57.507161 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3707/7354] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:57 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:17:58.474283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-235fff74-720f-4ecf-98b7-ca35393eca78 req-14afcdb3-a0c3-4305-9999-d2beec337bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1", "name": "network-vif-plugged", "status": "completed", "tag": "eb5a6711-9109-4a43-a72d-3b6574361ba5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:17:58.483679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-235fff74-720f-4ecf-98b7-ca35393eca78 req-14afcdb3-a0c3-4305-9999-d2beec337bee service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:58.484163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-235fff74-720f-4ecf-98b7-ca35393eca78 req-14afcdb3-a0c3-4305-9999-d2beec337bee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:58.484604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-235fff74-720f-4ecf-98b7-ca35393eca78 req-14afcdb3-a0c3-4305-9999-d2beec337bee service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:58.495803 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-235fff74-720f-4ecf-98b7-ca35393eca78 req-14afcdb3-a0c3-4305-9999-d2beec337bee service nova] Creating event network-vif-plugged:eb5a6711-9109-4a43-a72d-3b6574361ba5 for instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 on n-h2-854925-5 Aug 30 05:17:58.501132 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-235fff74-720f-4ecf-98b7-ca35393eca78 req-14afcdb3-a0c3-4305-9999-d2beec337bee service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153751 Aug 30 05:17:58.501808 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3648/7355] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:17:58.528446 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:58.529072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:58.535994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:58.536489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:58.536931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:58.537664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:58.538124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:58.538557 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:58.721197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:58.729212 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10c8c967-bbb0-425b-8bcf-9e94b7a4a41a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1357 microversion: 2.1 time: 0.205555 Aug 30 05:17:58.729814 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3708/7356] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:58 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:59.750814 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:59.751541 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:59.758562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:59.759055 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:59.759507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:59.760203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:59.760664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:59.761104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:59.895738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:17:59.903772 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fd4fd103-6a69-408d-bd0d-f234c0b7dd16 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1547 microversion: 2.1 time: 0.157180 Aug 30 05:17:59.904566 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3649/7357] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:59 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:17:59.924026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:17:59.924642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:17:59.932219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:59.932700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:59.933139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:17:59.933895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:17:59.934356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:17:59.934784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.062783 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.070703 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-28ce6606-bfd2-4b8c-baa1-5bdcb60380b4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1547 microversion: 2.1 time: 0.150349 Aug 30 05:18:00.071312 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3709/7358] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:17:59 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:00.090778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:00.095627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.096420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Searching by: {'deleted': False, 'project_id': 'd875800223e24b918348d40c958c297f'} {{(pid=122402) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 05:18:00.102024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.103103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.103564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.104307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.104788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.105229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.128514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.multi_cell_list [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122402) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 05:18:00.159832 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c78e102e-ea89-4605-ac34-2bf249b6a22d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073381 Aug 30 05:18:00.160581 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3650/7359] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 05:18:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:00.173025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:00.173670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:00.179631 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.180115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.180555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.181241 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:00.181732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:00.182160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:00.314490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:00.322171 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-91b818c8-6234-43a6-a556-883c1fb4c2cf tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1547 microversion: 2.1 time: 0.153011 Aug 30 05:18:00.322748 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3710/7360] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:00 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:01.856828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0db7c76c-575f-4c47-ad75-c7417cad9b6b"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:01.859312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:01.866159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.866683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.867135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:01.867828 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:01.868290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:01.868729 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:02.102988 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-51e9ab03-3083-4e32-aecb-c60d223a5adb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250530 Aug 30 05:18:02.103617 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3651/7361] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 05:18:01 2022] POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:15.123317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:15.123930 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:15.126716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:15.127504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=56 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:15.133118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:15.133628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:15.134068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.134755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:15.135204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:15.135628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:15.263381 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:15.271604 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b9af521b-deab-48c4-be26-3fdc3b553789 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1593 microversion: 2.1 time: 0.152117 Aug 30 05:18:15.272177 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3711/7362] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:15 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:17.242919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:17.245408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:17.246305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:18:17.251044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-982969bd-302b-4321-bd69-2721c1b14984 req-df2dcfdc-d2dc-4f61-9e31-dcd74718a68f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1", "tag": "eb5a6711-9109-4a43-a72d-3b6574361ba5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:17.264350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-982969bd-302b-4321-bd69-2721c1b14984 req-df2dcfdc-d2dc-4f61-9e31-dcd74718a68f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:17.264909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-982969bd-302b-4321-bd69-2721c1b14984 req-df2dcfdc-d2dc-4f61-9e31-dcd74718a68f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:17.265598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-982969bd-302b-4321-bd69-2721c1b14984 req-df2dcfdc-d2dc-4f61-9e31-dcd74718a68f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:17.283806 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-982969bd-302b-4321-bd69-2721c1b14984 req-df2dcfdc-d2dc-4f61-9e31-dcd74718a68f service nova] Creating event network-changed:eb5a6711-9109-4a43-a72d-3b6574361ba5 for instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 on n-h2-854925-5 Aug 30 05:18:17.289820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-982969bd-302b-4321-bd69-2721c1b14984 req-df2dcfdc-d2dc-4f61-9e31-dcd74718a68f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048620 Aug 30 05:18:17.291770 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3652/7363] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:18:18.226886 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1926756848"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:18.227434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:18.237524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.238017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.238463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.239170 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.239801 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.240436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.370515 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Adding security group df0e565e-70cc-4612-9313-49e9d9858bde to port eb5a6711-9109-4a43-a72d-3b6574361ba5 Aug 30 05:18:18.687187 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7997ed39-46dd-4c26-9afe-3fff06f0c37b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/action" status: 202 len: 0 microversion: 2.1 time: 0.464455 Aug 30 05:18:18.688086 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3712/7364] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:18:18 2022] POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:18:18.696723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:18:18.697482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:18:18.705077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.705601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.706057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.706769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:18.707242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:18.707686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:18.863479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:18:18.871991 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c72dd620-9308-456f-ac24-dae3dc946d1b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1759 microversion: 2.1 time: 0.179553 Aug 30 05:18:18.872576 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3653/7365] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:18:18 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:18:19.307020 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f9bb6c56-0798-4558-be30-9d495a0df2b6 req-f5aa61d8-0639-4b9d-ac11-6ac5f189fc6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1", "tag": "eb5a6711-9109-4a43-a72d-3b6574361ba5"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:18:19.316513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f9bb6c56-0798-4558-be30-9d495a0df2b6 req-f5aa61d8-0639-4b9d-ac11-6ac5f189fc6f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:18:19.316992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f9bb6c56-0798-4558-be30-9d495a0df2b6 req-f5aa61d8-0639-4b9d-ac11-6ac5f189fc6f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:18:19.317458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f9bb6c56-0798-4558-be30-9d495a0df2b6 req-f5aa61d8-0639-4b9d-ac11-6ac5f189fc6f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:18:19.329276 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f9bb6c56-0798-4558-be30-9d495a0df2b6 req-f5aa61d8-0639-4b9d-ac11-6ac5f189fc6f service nova] Creating event network-changed:eb5a6711-9109-4a43-a72d-3b6574361ba5 for instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 on n-h2-854925-5 Aug 30 05:18:19.334475 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f9bb6c56-0798-4558-be30-9d495a0df2b6 req-f5aa61d8-0639-4b9d-ac11-6ac5f189fc6f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032008 Aug 30 05:18:19.335115 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3713/7366] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:19:56.978776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:56.979531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:56.980995 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:19:56.981140 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:19:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/action (ip 10.222.0.27) !!! Aug 30 05:19:56.988562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:19:56.991171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:57.002698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:57.003257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:57.003713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:57.004428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:57.004902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:57.005392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:57.076708 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-68b18af2-00af-42bc-b9c0-829f8097a9d9 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/action" status: 202 len: 0 microversion: 2.1 time: 0.099240 Aug 30 05:19:57.077364 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3654/7367] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:19:56 2022] POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:19:57.085315 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:19:57.085877 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:57.086515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:19:57.087948 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 05:19:57.088186 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 (ip 10.222.0.27) !!! Aug 30 05:19:57.094432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:57.095285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:57.104315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:57.104807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:57.105258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:57.105963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:57.106515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:57.106947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:57.340535 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:57.349149 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f1b0e7a2-4971-403a-834a-45ad9bbd764e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1761 microversion: 2.1 time: 0.266715 Aug 30 05:19:57.349986 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3714/7368] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:57 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1761 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:19:58.373215 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:19:58.373977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:19:58.380195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:58.380688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:58.381151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:58.381875 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:19:58.382346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:19:58.382788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:19:58.523894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:19:58.532715 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dd739c59-90bb-4005-99bb-58bbcb4285ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1759 microversion: 2.1 time: 0.165479 Aug 30 05:19:58.533294 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3655/7369] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:19:58 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:12.233303 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:12.234137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:12.238902 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1926756848"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:12.239436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:12.248626 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:12.249116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:12.249624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:12.250315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:12.250767 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:12.251193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:12.256217 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38324. Aug 30 05:21:12.378000 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Removing security group df0e565e-70cc-4612-9313-49e9d9858bde from port eb5a6711-9109-4a43-a72d-3b6574361ba5 Aug 30 05:21:12.685043 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c76a9c6e-f005-4427-b524-53ab32628620 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/action" status: 202 len: 0 microversion: 2.1 time: 0.455192 Aug 30 05:21:12.686054 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3715/7370] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:21:12 2022] POST /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:21:12.696602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:12.697975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:12.781302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7043e56c-662c-4fc9-9b4e-99e6a30d8d06 req-11a4e18d-d569-4440-a065-2fe543d97872 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1", "tag": "eb5a6711-9109-4a43-a72d-3b6574361ba5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:12.793740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7043e56c-662c-4fc9-9b4e-99e6a30d8d06 req-11a4e18d-d569-4440-a065-2fe543d97872 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:12.794251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7043e56c-662c-4fc9-9b4e-99e6a30d8d06 req-11a4e18d-d569-4440-a065-2fe543d97872 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:12.794726 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7043e56c-662c-4fc9-9b4e-99e6a30d8d06 req-11a4e18d-d569-4440-a065-2fe543d97872 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:12.806819 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7043e56c-662c-4fc9-9b4e-99e6a30d8d06 req-11a4e18d-d569-4440-a065-2fe543d97872 service nova] Creating event network-changed:eb5a6711-9109-4a43-a72d-3b6574361ba5 for instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 on n-h2-854925-5 Aug 30 05:21:12.812630 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7043e56c-662c-4fc9-9b4e-99e6a30d8d06 req-11a4e18d-d569-4440-a065-2fe543d97872 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122167 Aug 30 05:21:12.813443 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3656/7371] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:14.444543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:14.445434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:14.453180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:14.453996 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:14.454550 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:14.455320 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:14.456066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:14.456539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:14.540203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lazy-loading 'services' on Instance uuid 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:21:14.613995 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [79f96258-f667-45cb-ad1c-b389396cfa9e] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:21:14.829284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0665dc30-2bbb-46c4-8517-3e40773854df req-41f5f6e3-0ebb-479b-b2b5-ced652807648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1", "tag": "eb5a6711-9109-4a43-a72d-3b6574361ba5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:14.842145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0665dc30-2bbb-46c4-8517-3e40773854df req-41f5f6e3-0ebb-479b-b2b5-ced652807648 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:14.842645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0665dc30-2bbb-46c4-8517-3e40773854df req-41f5f6e3-0ebb-479b-b2b5-ced652807648 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:14.843095 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0665dc30-2bbb-46c4-8517-3e40773854df req-41f5f6e3-0ebb-479b-b2b5-ced652807648 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:14.855061 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0665dc30-2bbb-46c4-8517-3e40773854df req-41f5f6e3-0ebb-479b-b2b5-ced652807648 service nova] Creating event network-changed:eb5a6711-9109-4a43-a72d-3b6574361ba5 for instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 on n-h2-854925-5 Aug 30 05:21:14.859957 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0665dc30-2bbb-46c4-8517-3e40773854df req-41f5f6e3-0ebb-479b-b2b5-ced652807648 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034787 Aug 30 05:21:14.860635 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3657/7372] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:21:15.621975 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [79f96258-f667-45cb-ad1c-b389396cfa9e] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38354. Aug 30 05:21:15.625203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3dc6f931-8392-42a9-b7af-9175ef49a855 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments/0db7c76c-575f-4c47-ad75-c7417cad9b6b" status: 202 len: 0 microversion: 2.1 time: 1.185756 Aug 30 05:21:15.625846 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3716/7373] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:21:14 2022] DELETE /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments/0db7c76c-575f-4c47-ad75-c7417cad9b6b => generated 0 bytes in 1187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:21:15.635846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:15.638301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:15.644774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:15.645395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:15.645933 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:15.646652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:15.647128 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:15.647576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:15.678620 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-81c5939e-c990-4dca-aa9d-3b04164085bb tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047078 Aug 30 05:21:15.679209 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3658/7374] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:15 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:16.693147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:16.695583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:16.702598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:16.703106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:16.703530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:16.704227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:16.704682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:16.705110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:16.735158 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c25b119b-8871-4dab-a5b2-73c0172b2cb5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047700 Aug 30 05:21:16.735767 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3717/7375] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:16 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:17.747553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:17.749779 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:17.757106 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:17.757631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:17.758080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:17.758778 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:17.759240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:17.759678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:17.789210 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9590cf0c-680a-4a09-b696-e80f7c829370 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Aug 30 05:21:17.789804 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3659/7376] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:17 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:18.802293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:18.804411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:18.811280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:18.811771 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:18.812215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:18.812906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:18.813384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:18.813815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:18.845679 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c6edcba5-5cd6-4d9a-a918-2fb8334258a5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Aug 30 05:21:18.846273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3718/7377] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:18 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:19.858575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:19.860770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:19.867803 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:19.868304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:19.868759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:19.869503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:19.869975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:19.870419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:19.908306 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8bcb20fb-4d87-4130-b51f-17c1f6e9055f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053722 Aug 30 05:21:19.909193 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3660/7378] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:19 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:20.920678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:20.922866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:20.929766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:20.930278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:20.930714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:20.931397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:20.931846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:20.932271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:20.961860 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4b2d6e5-82c3-4bda-a822-e8dd74984f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045103 Aug 30 05:21:20.962508 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3719/7379] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:21:20 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:21:20.973584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:20.974103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:20.981154 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:20.981694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:20.982159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:20.982860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:20.983329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:20.983773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:21.057740 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] HTTP exception thrown: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 is not attached to volume 0db7c76c-575f-4c47-ad75-c7417cad9b6b Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Request method failure captured: Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: request: DELETE /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments/0db7c76c-575f-4c47-ad75-c7417cad9b6b HTTP/1.1 Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZ1q0Z13tU4XAN0huM1-pSiYWFIzssDa3VnBHmDOS44uLtVgfyxNHyjdbAUt-iNCjBmkxLIBQWUBlCwGNc6S11aptdPjqZ3-X8WNd8IddXCCXU7qWGHjugnz8BRVjdrqRPx4XvK2xvgA6mFuAw4N82XqoSfsWblwzdECJCOX4aNAJYA Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: d875800223e24b918348d40c958c297f Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d875800223e24b918348d40c958c297f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d875800223e24b918348d40c958c297f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}] Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: d875800223e24b918348d40c958c297f Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 241b55926b71439d88188d6fe0806e3d Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 is not attached to volume 0db7c76c-575f-4c47-ad75-c7417cad9b6b Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'server_id': '3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1', 'id': '0db7c76c-575f-4c47-ad75-c7417cad9b6b'} Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0db7c76c-575f-4c47-ad75-c7417cad9b6b. Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 is not attached to volume 0db7c76c-575f-4c47-ad75-c7417cad9b6b Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:21.059400 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:21.063436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:21:21.063436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:21:21.063436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 is not attached to volume 0db7c76c-575f-4c47-ad75-c7417cad9b6b Aug 30 05:21:21.063436 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:21.063436 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Returning 404 to user: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 is not attached to volume 0db7c76c-575f-4c47-ad75-c7417cad9b6b {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:21:21.063436 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ae560d2d-39c7-464f-ba83-517cc160a4a2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments/0db7c76c-575f-4c47-ad75-c7417cad9b6b" status: 404 len: 154 microversion: 2.1 time: 0.092059 Aug 30 05:21:21.063436 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3661/7380] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:21:20 2022] DELETE /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1/os-volume_attachments/0db7c76c-575f-4c47-ad75-c7417cad9b6b => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:21:24.307280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:24.307780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:24.314671 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:24.315163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:24.315672 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:24.316369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:24.316826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:24.317259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:24.341796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:21:24.424648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9d617741-c779-474b-9ad2-16d5fba8abf3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 204 len: 0 microversion: 2.1 time: 0.120778 Aug 30 05:21:24.426180 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3720/7381] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:21:24 2022] DELETE /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:21:24.435098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:24.435746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:24.446785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:24.447463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:24.450025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:24.450025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:24.450387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:24.450839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:24.586679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:24.594632 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-873d2bd2-fffe-4827-a7f9-352253637a6a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1553 microversion: 2.1 time: 0.163854 Aug 30 05:21:24.595212 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3662/7382] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:24 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:25.617735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:25.618435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:25.625252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:25.625766 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:25.626202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:25.626887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:25.627336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:25.627761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:25.762394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:25.770169 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fe10045a-237a-47e3-baa3-9529a05c40d5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1553 microversion: 2.1 time: 0.156738 Aug 30 05:21:25.770745 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3721/7383] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:25 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:26.615488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-33d1acb9-ab9d-4af2-91de-e563219e659e req-4ec17c97-ab04-4f53-add7-b369f8d1ff52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1", "name": "network-vif-deleted", "tag": "eb5a6711-9109-4a43-a72d-3b6574361ba5"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:26.626469 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33d1acb9-ab9d-4af2-91de-e563219e659e req-4ec17c97-ab04-4f53-add7-b369f8d1ff52 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:26.626961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33d1acb9-ab9d-4af2-91de-e563219e659e req-4ec17c97-ab04-4f53-add7-b369f8d1ff52 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:26.627412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-33d1acb9-ab9d-4af2-91de-e563219e659e req-4ec17c97-ab04-4f53-add7-b369f8d1ff52 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:26.640130 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-33d1acb9-ab9d-4af2-91de-e563219e659e req-4ec17c97-ab04-4f53-add7-b369f8d1ff52 service nova] Creating event network-vif-deleted:eb5a6711-9109-4a43-a72d-3b6574361ba5 for instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 on n-h2-854925-5 Aug 30 05:21:26.645744 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-33d1acb9-ab9d-4af2-91de-e563219e659e req-4ec17c97-ab04-4f53-add7-b369f8d1ff52 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034079 Aug 30 05:21:26.646360 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3663/7384] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:21:26.791613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:26.792189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:26.798965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:26.799467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:26.799885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:26.800567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:26.801018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:26.801477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:26.832058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:26.832449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:26.832879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:26.833353 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lazy-loading 'fault' on Instance uuid 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:21:26.875704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:26.883785 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e26c64e4-6bcc-46e5-9e40-8d5563b9827f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 200 len: 1347 microversion: 2.1 time: 0.096113 Aug 30 05:21:26.884602 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3722/7385] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:26 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 1347 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:27.907117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:27.907880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:27.914905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:27.915414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:27.915868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:27.916587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:27.917057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:27.917538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:27.931885 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] HTTP exception thrown: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 could not be found. Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Request method failure captured: Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 HTTP/1.1 Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZ1q0Z13tU4XAN0huM1-pSiYWFIzssDa3VnBHmDOS44uLtVgfyxNHyjdbAUt-iNCjBmkxLIBQWUBlCwGNc6S11aptdPjqZ3-X8WNd8IddXCCXU7qWGHjugnz8BRVjdrqRPx4XvK2xvgA6mFuAw4N82XqoSfsWblwzdECJCOX4aNAJYA Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: d875800223e24b918348d40c958c297f Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d875800223e24b918348d40c958c297f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d875800223e24b918348d40c958c297f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}] Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: d875800223e24b918348d40c958c297f Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 241b55926b71439d88188d6fe0806e3d Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 could not be found. Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1'} Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 could not be found. Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 could not be found. Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:21:27.933657 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 could not be found. Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Returning 404 to user: Instance 3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:21:27.938682 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12884549-40b4-4e1e-a4a2-133cfe3af2d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1" status: 404 len: 111 microversion: 2.1 time: 0.033251 Aug 30 05:21:27.940158 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3664/7386] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:27 2022] GET /compute/v2.1/servers/3ae0b1f9-b2f1-4bdd-bbfa-13b2969875a1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:21:27.945541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-293d0c2d-326a-44cd-8b80-b04e2b466329 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '.version_select at 0x7fe96933fee0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:27.969784 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-293d0c2d-326a-44cd-8b80-b04e2b466329 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-849891566" status: 202 len: 0 microversion: 2.1 time: 0.029576 Aug 30 05:21:27.970464 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3723/7387] 10.222.0.27 () {58 vars in 1269 bytes} [Tue Aug 30 05:21:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-849891566 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:21:36.866402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9903c5b9-a248-40b5-be0e-5fbdc1f24b78 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'create', calling method: .version_select at 0x7fe96bc03e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1660698343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5iNNKPOBU6YArsFzuglH+fV/tN6dMQbPuDdyyL4Ii9OKBwZznF0SsGuWLCJHUriQDhQxryqq6IqWIYTMGqOOv99J51pSNeJtDE454+jTWeJkrktalD1iT83lP8ofmScQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:36.882642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9903c5b9-a248-40b5-be0e-5fbdc1f24b78 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for project d875800223e24b918348d40c958c297f. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:21:36.887910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-9903c5b9-a248-40b5-be0e-5fbdc1f24b78 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for user 241b55926b71439d88188d6fe0806e3d and project d875800223e24b918348d40c958c297f. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:21:36.901648 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9903c5b9-a248-40b5-be0e-5fbdc1f24b78 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [254bee96-1aa4-4fd1-aa64-3e39e9d701b3] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:21:37.911785 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [None req-9903c5b9-a248-40b5-be0e-5fbdc1f24b78 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [254bee96-1aa4-4fd1-aa64-3e39e9d701b3] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 38482. Aug 30 05:21:37.922657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=38 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:37.927347 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9903c5b9-a248-40b5-be0e-5fbdc1f24b78 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.065491 Aug 30 05:21:37.927957 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3665/7388] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:21:36 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:21:37.977900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:37.978925 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:21:37.979073 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:21:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.27) !!! Aug 30 05:21:37.981132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:37.985138 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-882888858", "imageRef": "699f94c5-cfb2-4b7f-b77c-4817b2ac85b0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1660698343", "networks": [{"uuid": "77db50a7-8930-41a9-9827-e1f0987b56c6"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:38.041569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] validate_networks() for [('77db50a7-8930-41a9-9827-e1f0987b56c6', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:21:38.474328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:21:38.475014 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:21:38.475506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:21:38.475898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:21:38.476313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:21:38.485046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:38.485562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:38.486001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:38.486720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:38.487172 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:38.487596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:38.505254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for project d875800223e24b918348d40c958c297f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:21:38.511710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Getting quotas for user 241b55926b71439d88188d6fe0806e3d and project d875800223e24b918348d40c958c297f. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:21:38.526109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:21:38.528360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='699f94c5-cfb2-4b7f-b77c-4817b2ac85b0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:21:38.574492 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d1e2579-5e4f-4733-b948-dd3b5ea89081 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598429 Aug 30 05:21:38.575171 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3724/7389] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:21:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:21:38.587153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8bf407ca-7444-4e8a-8ba7-dec6a09b16f7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:38.587906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8bf407ca-7444-4e8a-8ba7-dec6a09b16f7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:38.641995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8bf407ca-7444-4e8a-8ba7-dec6a09b16f7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:38.649558 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8bf407ca-7444-4e8a-8ba7-dec6a09b16f7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1258 microversion: 2.1 time: 0.066713 Aug 30 05:21:38.650132 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3666/7390] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:38 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:39.671287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ea8ac6cd-a8f8-4bd2-a1b8-b909ef046a8c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:39.671914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ea8ac6cd-a8f8-4bd2-a1b8-b909ef046a8c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:39.739479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ea8ac6cd-a8f8-4bd2-a1b8-b909ef046a8c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:39.747151 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ea8ac6cd-a8f8-4bd2-a1b8-b909ef046a8c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1258 microversion: 2.1 time: 0.080977 Aug 30 05:21:39.749202 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3725/7391] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:39 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:40.770092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba64dee8-06c4-4579-8e2e-8d6ac322342e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:40.770835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba64dee8-06c4-4579-8e2e-8d6ac322342e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:40.832212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ba64dee8-06c4-4579-8e2e-8d6ac322342e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:40.840031 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba64dee8-06c4-4579-8e2e-8d6ac322342e tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1258 microversion: 2.1 time: 0.074231 Aug 30 05:21:40.840603 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3667/7392] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:40 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:41.861213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d0aad03d-5ff3-427d-874a-1b895f9792b5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:41.861860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d0aad03d-5ff3-427d-874a-1b895f9792b5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:41.918470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d0aad03d-5ff3-427d-874a-1b895f9792b5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:41.926431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d0aad03d-5ff3-427d-874a-1b895f9792b5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1258 microversion: 2.1 time: 0.069128 Aug 30 05:21:41.927497 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3726/7393] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:41 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:42.947120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:42.947746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:42.950437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:42.955657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:42.956248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:42.956707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:42.957440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:42.957908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:42.958343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:43.019094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:43.027244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c1248e9e-c835-429e-9721-8311bb8abb0a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1262 microversion: 2.1 time: 0.083959 Aug 30 05:21:43.027842 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3668/7394] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:42 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:44.048129 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:44.048749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:44.059716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.060483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.061165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.062120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:44.062583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:44.063262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:44.134337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:44.142942 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc0ee9e8-b6a7-48e4-bfff-413a62a95934 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1316 microversion: 2.1 time: 0.098768 Aug 30 05:21:44.147778 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3727/7395] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:44 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:45.168188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:45.169635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:45.177158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:45.178040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:45.178713 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:45.179667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:45.180350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:45.181007 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:45.339695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:45.349309 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cbbd4c33-a20c-4ec1-897a-d6a0b55efd91 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.184864 Aug 30 05:21:45.365506 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3669/7396] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:45 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:46.373675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:46.375087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:46.382393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:46.382890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:46.383408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:46.384422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:46.385756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:46.387034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:46.523271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:46.531060 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dc758825-ba6b-42d0-a30c-720a9ac52e39 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.161690 Aug 30 05:21:46.531633 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3728/7397] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:46 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:47.552485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:47.553399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:47.560446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:47.560950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:47.561425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:47.562132 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:47.562594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:47.563082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:47.715257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:47.722973 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3f2c1e87-3c37-4cfd-8e59-f273854823ed tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.174677 Aug 30 05:21:47.723545 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3670/7398] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:47 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:48.744651 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:48.745279 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:48.748007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:48.753521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.754782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.755229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.755945 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:48.756424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:48.756858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:48.982995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:48.992357 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3160277c-8d7b-41fa-9e71-c21702144d1f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.251518 Aug 30 05:21:48.992951 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3729/7399] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:48 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:50.013650 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:50.014284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:50.022067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:50.022725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:50.023188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:50.024197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:50.024673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:50.025229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:50.220430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:50.228600 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d8722ebd-6c6a-4192-85c5-705e2a640805 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.219100 Aug 30 05:21:50.229174 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3671/7400] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:50 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:51.251135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:51.251852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:51.260350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:51.261156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:51.261625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:51.262338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:51.262805 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:51.263235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:51.403305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:51.411684 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e1e92e09-ce8b-4d97-9fed-8b8ad71967e3 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.164797 Aug 30 05:21:51.412273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3730/7401] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:51 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:52.433770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:52.434615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:52.436768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:52.443325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:52.443830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:52.444285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:52.444994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:52.445498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:52.445945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:52.573556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:52.581222 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e7a38549-4883-472f-bd03-dcdd967b3a19 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.152459 Aug 30 05:21:52.581836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3672/7402] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:52 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:53.603220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:53.603833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:53.605828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:21:53.612126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:53.612614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:53.613056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:53.613795 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:53.614250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:53.615316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:53.745283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:53.752932 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2467c4f-25d8-42f6-a626-1db7dd113850 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.153915 Aug 30 05:21:53.753535 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3731/7403] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:53 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:21:54.773783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:54.774414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:54.781479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:54.781980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:54.782438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:54.783142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:54.783617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:54.784060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:54.912487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:54.921204 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3b49fbb9-cd1e-4f74-953b-a03bb279638b tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.151912 Aug 30 05:21:54.921814 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3673/7404] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:54 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:55.942266 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:55.942882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:55.949732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:55.950211 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:55.950645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:55.951329 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:55.951781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:55.952208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:56.080882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:56.089232 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8a3b71c1-145f-4408-81a2-14a1a9e69707 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.151194 Aug 30 05:21:56.089823 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3732/7405] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:55 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:57.111438 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:57.112137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:57.122148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e81df0ce-6882-4c05-8e94-f81a364de20e req-8deace62-19e8-452b-bda7-9390962dc1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b683f76-0b13-4747-b857-9957c7fe5ce2", "tag": "964a470d-267b-4b14-ad17-b13423d740bb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:21:57.127366 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:57.128116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:57.128719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:57.131763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:57.132638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:57.133099 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:57.135110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e81df0ce-6882-4c05-8e94-f81a364de20e req-8deace62-19e8-452b-bda7-9390962dc1c3 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:57.135601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e81df0ce-6882-4c05-8e94-f81a364de20e req-8deace62-19e8-452b-bda7-9390962dc1c3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:57.136232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e81df0ce-6882-4c05-8e94-f81a364de20e req-8deace62-19e8-452b-bda7-9390962dc1c3 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:57.151641 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e81df0ce-6882-4c05-8e94-f81a364de20e req-8deace62-19e8-452b-bda7-9390962dc1c3 service nova] Creating event network-changed:964a470d-267b-4b14-ad17-b13423d740bb for instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 on n-h1-854925-5 Aug 30 05:21:57.157526 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e81df0ce-6882-4c05-8e94-f81a364de20e req-8deace62-19e8-452b-bda7-9390962dc1c3 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040902 Aug 30 05:21:57.158728 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3733/7406] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:21:57.277925 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:57.286219 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f6f3fdf0-ba17-4a85-a434-d6c44f70e029 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.178578 Aug 30 05:21:57.286806 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3674/7407] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:57 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:58.308450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:58.309156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:58.316262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:58.317487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:58.317932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:58.318625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:58.319078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:58.319509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:58.446799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:58.454523 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f6ddc4ea-de46-4b7b-b886-3b6a0a1117ff tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.150494 Aug 30 05:21:58.455096 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3734/7408] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:58 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:21:59.475514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:21:59.476137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:21:59.483061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:59.483553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:59.484001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:59.484701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:21:59.485169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:21:59.485632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:21:59.616620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:21:59.624891 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ecfd8467-7d39-45ab-aeb4-4fcc236b6b9f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.153553 Aug 30 05:21:59.625501 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3675/7409] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:21:59 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:00.645833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:00.646449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:00.653377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:00.653872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:00.654313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:00.655006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:00.655461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:00.655888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:00.790435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:00.798136 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ab5a7009-d0f5-4127-8cb3-3250e77d2f85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.156268 Aug 30 05:22:00.798716 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3735/7410] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:00 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:01.819853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:01.820481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:01.827390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:01.827902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:01.828358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:01.829093 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:01.829590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:01.830060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:01.952715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e160e576-363b-4e82-a91a-f811066bc066 req-04177d42-df66-4b1b-9d92-2e407c5e9c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b683f76-0b13-4747-b857-9957c7fe5ce2", "name": "network-vif-plugged", "status": "completed", "tag": "964a470d-267b-4b14-ad17-b13423d740bb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:01.965789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e160e576-363b-4e82-a91a-f811066bc066 req-04177d42-df66-4b1b-9d92-2e407c5e9c7f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:01.966272 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e160e576-363b-4e82-a91a-f811066bc066 req-04177d42-df66-4b1b-9d92-2e407c5e9c7f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:01.966707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e160e576-363b-4e82-a91a-f811066bc066 req-04177d42-df66-4b1b-9d92-2e407c5e9c7f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:01.973890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:01.984749 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4439c12a-85eb-494c-88f8-2e1356f5f9d7 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.169119 Aug 30 05:22:01.986178 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3676/7411] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:01 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:01.990607 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-e160e576-363b-4e82-a91a-f811066bc066 req-04177d42-df66-4b1b-9d92-2e407c5e9c7f service nova] Creating event network-vif-plugged:964a470d-267b-4b14-ad17-b13423d740bb for instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 on n-h1-854925-5 Aug 30 05:22:01.999712 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e160e576-363b-4e82-a91a-f811066bc066 req-04177d42-df66-4b1b-9d92-2e407c5e9c7f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051013 Aug 30 05:22:02.000990 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3736/7412] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:22:03.009096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:03.009822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:03.016753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:03.017246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:03.017731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:03.018427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:03.018892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:03.019331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:03.145584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:03.153317 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-836bdf03-7c9f-46eb-9624-a10ea8c2570c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1358 microversion: 2.1 time: 0.148725 Aug 30 05:22:03.153928 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3677/7413] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:03 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:04.175660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:04.176287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:04.182582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.183044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.183482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.184171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.184628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.185057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.311558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:04.319834 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f3b2e7d3-0c06-43cf-a8e7-9e6e467e2cc4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1548 microversion: 2.1 time: 0.149508 Aug 30 05:22:04.320425 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3737/7414] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:04 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:04.339945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:04.340576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:04.346682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.347440 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.347983 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.348690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.349500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.350250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.480081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:04.487828 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8476c3a4-93c4-434d-89ca-709ff52af662 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1548 microversion: 2.1 time: 0.152033 Aug 30 05:22:04.488425 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3678/7415] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:04 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:04.508528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:04.513351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:04.514133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Searching by: {'deleted': False, 'project_id': 'd875800223e24b918348d40c958c297f'} {{(pid=122403) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 05:22:04.519584 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.520056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.520488 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.521231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.521702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.522122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.546112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.multi_cell_list [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122403) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 05:22:04.573213 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aee626e6-ef01-45de-9c23-08b168260b80 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.069075 Aug 30 05:22:04.573824 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3738/7416] 10.222.0.27 () {58 vars in 1125 bytes} [Tue Aug 30 05:22:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:04.585028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:04.585686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:04.591648 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.592147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.592601 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.593305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:04.593798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:04.594245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:04.726318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:04.734381 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66bf9859-5bfd-4438-a029-e517f32697d8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1548 microversion: 2.1 time: 0.153212 Aug 30 05:22:04.734959 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3679/7417] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:04 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:06.245142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fa35685-25d9-4625-8dd2-1413ca0f64ed"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:06.247499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:06.254059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:06.254546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:06.254989 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:06.255678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:06.256134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:06.256560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:06.515428 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dfdfbc93-6481-4c1f-a187-ee93fef525c5 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274071 Aug 30 05:22:06.516064 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3739/7418] 10.222.0.27 () {60 vars in 1323 bytes} [Tue Aug 30 05:22:06 2022] POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:22:17.276320 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:17.276943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:17.280047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=23 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:17.280710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=72 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:17.287030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:17.287519 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:17.287964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:17.288660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:17.289121 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:17.289592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:17.420577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:17.428795 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8976f07e-24bd-4bf1-9e7e-3d26d3352a9c tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1594 microversion: 2.1 time: 0.156304 Aug 30 05:22:17.429394 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3680/7419] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:17 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1594 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:19.335208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:19.336189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:19.336868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:22:19.342486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-bb99553a-5e8c-481b-b3d5-e6ad584a02bc req-6c7c41d4-2b06-4cbc-91f9-d2254c1f046e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b683f76-0b13-4747-b857-9957c7fe5ce2", "tag": "964a470d-267b-4b14-ad17-b13423d740bb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:19.354513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb99553a-5e8c-481b-b3d5-e6ad584a02bc req-6c7c41d4-2b06-4cbc-91f9-d2254c1f046e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:19.355049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb99553a-5e8c-481b-b3d5-e6ad584a02bc req-6c7c41d4-2b06-4cbc-91f9-d2254c1f046e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:19.355492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-bb99553a-5e8c-481b-b3d5-e6ad584a02bc req-6c7c41d4-2b06-4cbc-91f9-d2254c1f046e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:19.374440 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-bb99553a-5e8c-481b-b3d5-e6ad584a02bc req-6c7c41d4-2b06-4cbc-91f9-d2254c1f046e service nova] Creating event network-changed:964a470d-267b-4b14-ad17-b13423d740bb for instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 on n-h1-854925-5 Aug 30 05:22:19.379836 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-bb99553a-5e8c-481b-b3d5-e6ad584a02bc req-6c7c41d4-2b06-4cbc-91f9-d2254c1f046e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046901 Aug 30 05:22:19.381211 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3740/7420] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:22:20.477940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1715001638"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:20.478490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:20.485807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:20.486313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:20.486770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:20.487485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:20.487951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:20.488393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:20.623913 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.network.security_group_api [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Adding security group a71d1047-84ce-493f-aae9-e4b5ec22149b to port 964a470d-267b-4b14-ad17-b13423d740bb Aug 30 05:22:20.939724 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3802046-2a2a-40f9-8f35-183f11bfe948 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/action" status: 202 len: 0 microversion: 2.1 time: 0.466107 Aug 30 05:22:20.940366 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3681/7421] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:22:20 2022] POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:22:20.950591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:22:20.951296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:22:20.957521 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:20.958062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:20.958503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:20.959205 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:20.959660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:20.960084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:21.132621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:22:21.141182 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2bbafd1c-667e-434b-9ea0-bbe4971ed50f tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1759 microversion: 2.1 time: 0.195791 Aug 30 05:22:21.141872 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3741/7422] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:22:20 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:22:21.395458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-6798a3ef-29e3-4198-b381-9f373fc08f0e req-2a9a93bc-b9b5-4738-8d73-1b29ecd4c823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b683f76-0b13-4747-b857-9957c7fe5ce2", "tag": "964a470d-267b-4b14-ad17-b13423d740bb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:22:21.405604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6798a3ef-29e3-4198-b381-9f373fc08f0e req-2a9a93bc-b9b5-4738-8d73-1b29ecd4c823 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:22:21.406135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6798a3ef-29e3-4198-b381-9f373fc08f0e req-2a9a93bc-b9b5-4738-8d73-1b29ecd4c823 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:22:21.406581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-6798a3ef-29e3-4198-b381-9f373fc08f0e req-2a9a93bc-b9b5-4738-8d73-1b29ecd4c823 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:22:21.417831 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-6798a3ef-29e3-4198-b381-9f373fc08f0e req-2a9a93bc-b9b5-4738-8d73-1b29ecd4c823 service nova] Creating event network-changed:964a470d-267b-4b14-ad17-b13423d740bb for instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 on n-h1-854925-5 Aug 30 05:22:21.425869 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-6798a3ef-29e3-4198-b381-9f373fc08f0e req-2a9a93bc-b9b5-4738-8d73-1b29ecd4c823 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034025 Aug 30 05:22:21.426688 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3682/7423] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:23:09.278258 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:09.278923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:09.327657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:23:09.330193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:09.336239 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:09.336727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:09.337695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:09.338410 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:09.338862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:09.339288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:09.410772 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-587307e1-e57d-4169-8629-10e394da2d81 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/action" status: 202 len: 0 microversion: 2.1 time: 0.137386 Aug 30 05:23:09.411397 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3742/7424] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:23:09 2022] POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:23:09.422039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:09.422775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:09.425117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:09.425816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:23:09.432856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:09.433400 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:09.433865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:09.434769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:09.435252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:09.435702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:09.582741 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:09.591697 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14e30d6d-862f-4b34-8ca8-bcbffd60ede0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1751 microversion: 2.1 time: 0.174410 Aug 30 05:23:09.592318 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3683/7425] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:09 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:23:10.614819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:10.615526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:10.623349 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:10.623830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:10.624265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:10.624951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:10.625498 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:10.625924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:10.770204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:10.778808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01b96a0a-e73f-4b5f-9cf8-2519577530c4 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.168307 Aug 30 05:23:10.779387 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3743/7426] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:10 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:11.800485 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:11.801134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:11.808061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:11.808554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:11.809006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:11.809812 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:11.810276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:11.810716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:11.954465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:11.963423 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9ccc331f-2b2b-43ba-850a-85228eb27dec tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.166896 Aug 30 05:23:11.964031 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3684/7427] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:11 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:12.984895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:12.985555 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:12.992392 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:12.992967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:12.994171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:12.994866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:12.995328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:12.995762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:13.139208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:13.150077 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e9e2e24e-d4df-4118-b13c-1cfe4e4cd3be tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.168397 Aug 30 05:23:13.150697 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3744/7428] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:12 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:14.171454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:14.172013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:14.178957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:14.179452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:14.179907 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:14.181110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:14.181720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:14.182168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:14.328955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:14.337879 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb039f2c-9f04-4813-8ddf-72c052a3db24 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.170423 Aug 30 05:23:14.338465 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3685/7429] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:14 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:15.359733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:15.360348 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:15.367289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:15.367786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:15.368225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:15.368923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:15.369405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:15.369839 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:15.511894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:15.520140 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bbc113af-af10-4602-b818-2f3a25cf645a tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.164316 Aug 30 05:23:15.520720 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3745/7430] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:15 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:16.542350 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:16.542943 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:16.549910 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:16.550407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:16.550866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:16.551572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:16.552042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:16.552487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:16.691539 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:16.699946 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4400b2bc-b859-496a-98d8-ffd06b3a7c40 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.162201 Aug 30 05:23:16.700537 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3686/7431] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:16 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:17.720524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:17.721140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:17.728343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:17.728828 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:17.729268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:17.729988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:17.730459 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:17.730871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:17.873355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:17.881595 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-05977103-e60c-4990-9eb3-e59f38c251e8 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.165003 Aug 30 05:23:17.882179 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3746/7432] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:17 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:18.904182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:18.904888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:18.907107 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:23:18.907265 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:23:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 (ip 10.222.0.27) !!! Aug 30 05:23:18.914744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:18.915278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:18.915735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:18.916449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:18.916917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:18.917385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:19.062164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:19.070353 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-40dd444b-0c75-4b87-b2a2-bcd76a19dfad tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.170803 Aug 30 05:23:19.070930 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3687/7433] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:18 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:20.092988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:20.093635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:20.101613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:20.102094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:20.103168 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:20.103859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:20.104316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:20.104741 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:20.246077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:20.254522 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b9b4e54-c595-4813-9906-8770cf46ec85 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1756 microversion: 2.1 time: 0.165453 Aug 30 05:23:20.255106 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3747/7434] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:20 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:23:21.276920 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:23:21.277508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:23:21.284684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:21.285182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:21.285669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:21.286370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:23:21.286835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:23:21.287275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:23:21.433224 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:23:21.441580 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2607bd3b-96bb-4867-b8b2-3359277050e0 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1759 microversion: 2.1 time: 0.169285 Aug 30 05:23:21.442157 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3688/7435] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:23:21 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:16.992569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1715001638"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:16.993183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:16.995307 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:16.996037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:17.001608 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:17.002100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:17.002539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:17.003231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:17.003690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:17.004121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:17.130751 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.network.security_group_api [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Removing security group a71d1047-84ce-493f-aae9-e4b5ec22149b from port 964a470d-267b-4b14-ad17-b13423d740bb Aug 30 05:24:17.438010 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ee4b6721-820b-4b29-9c9b-d8e0d8e2e23d tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/action" status: 202 len: 0 microversion: 2.1 time: 0.449739 Aug 30 05:24:17.438660 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3748/7436] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:24:16 2022] POST /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:24:17.447535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b6983bd5-ec21-4ab3-9b06-f2270cbfd5a9 req-5af0e9e9-c742-4de1-ad19-e2c7250f604e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b683f76-0b13-4747-b857-9957c7fe5ce2", "tag": "964a470d-267b-4b14-ad17-b13423d740bb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:17.453614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:17.454638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=36 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:17.460719 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6983bd5-ec21-4ab3-9b06-f2270cbfd5a9 req-5af0e9e9-c742-4de1-ad19-e2c7250f604e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:17.462310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6983bd5-ec21-4ab3-9b06-f2270cbfd5a9 req-5af0e9e9-c742-4de1-ad19-e2c7250f604e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:17.462955 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b6983bd5-ec21-4ab3-9b06-f2270cbfd5a9 req-5af0e9e9-c742-4de1-ad19-e2c7250f604e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:17.476558 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b6983bd5-ec21-4ab3-9b06-f2270cbfd5a9 req-5af0e9e9-c742-4de1-ad19-e2c7250f604e service nova] Creating event network-changed:964a470d-267b-4b14-ad17-b13423d740bb for instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 on n-h1-854925-5 Aug 30 05:24:17.483085 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b6983bd5-ec21-4ab3-9b06-f2270cbfd5a9 req-5af0e9e9-c742-4de1-ad19-e2c7250f604e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039312 Aug 30 05:24:17.484315 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3689/7437] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:18.561215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:18.561815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:18.567975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:18.568534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:18.569067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:18.569856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:18.570388 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:18.570890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:18.665169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lazy-loading 'services' on Instance uuid 7b683f76-0b13-4747-b857-9957c7fe5ce2 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:24:18.740671 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64af9758-a672-400b-af63-2a23bb7f0743 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments/1fa35685-25d9-4625-8dd2-1413ca0f64ed" status: 202 len: 0 microversion: 2.1 time: 0.184981 Aug 30 05:24:18.744385 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3749/7438] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:24:18 2022] DELETE /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments/1fa35685-25d9-4625-8dd2-1413ca0f64ed => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:24:18.751850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:18.754212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:18.760674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:18.761187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:18.761675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:18.762656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:18.763172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:18.763624 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:18.797237 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9357d5dc-861b-4407-840e-a345ec29c293 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051130 Aug 30 05:24:18.797783 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3690/7439] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:24:18 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:19.501618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7072915b-7d2a-45f3-8366-ed14ede73611 req-66a624b1-d183-4ad5-902d-bf2375b3e795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b683f76-0b13-4747-b857-9957c7fe5ce2", "tag": "964a470d-267b-4b14-ad17-b13423d740bb"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:19.516001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7072915b-7d2a-45f3-8366-ed14ede73611 req-66a624b1-d183-4ad5-902d-bf2375b3e795 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:19.516487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7072915b-7d2a-45f3-8366-ed14ede73611 req-66a624b1-d183-4ad5-902d-bf2375b3e795 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:19.516920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7072915b-7d2a-45f3-8366-ed14ede73611 req-66a624b1-d183-4ad5-902d-bf2375b3e795 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:19.527973 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7072915b-7d2a-45f3-8366-ed14ede73611 req-66a624b1-d183-4ad5-902d-bf2375b3e795 service nova] Creating event network-changed:964a470d-267b-4b14-ad17-b13423d740bb for instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 on n-h1-854925-5 Aug 30 05:24:19.533462 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7072915b-7d2a-45f3-8366-ed14ede73611 req-66a624b1-d183-4ad5-902d-bf2375b3e795 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035937 Aug 30 05:24:19.534073 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3750/7440] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:19.810136 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:19.812543 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:19.820930 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:19.821979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:19.822826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:19.824069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:19.825127 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:19.825419 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:19.866540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-31b67ee4-afe4-4a1c-bd68-533fd09e2766 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060490 Aug 30 05:24:19.867148 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3691/7441] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:24:19 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:20.880821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:20.883253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:20.890417 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:20.890922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:20.891356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:20.892061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:20.892511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:20.892935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:20.926170 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da803fa1-73b4-4326-a89a-6edce4760eac tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050718 Aug 30 05:24:20.926767 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3751/7442] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:24:20 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:21.940378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:21.942523 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:21.949525 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:21.950021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:21.950502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:21.951204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:21.951673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:21.952114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:21.982869 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-265fc47c-3154-42a5-8317-d0848abd2228 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Aug 30 05:24:21.983442 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3692/7443] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:24:21 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:24:22.995234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:22.997964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:23.004763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:23.005249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:23.005722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:23.006412 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:23.006871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:23.007292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:23.036868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e775706d-c74b-4eb1-a466-9bada40dd373 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Aug 30 05:24:23.037458 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3752/7444] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:24:22 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:24.049526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:24.051771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:24.059423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:24.060549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:24.061011 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:24.061800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:24.062275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:24.062707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:24.091267 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fb2b4d97-2fc0-4f2c-9270-96b2489dccdd tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045947 Aug 30 05:24:24.091828 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3693/7445] 10.222.0.27 () {58 vars in 1302 bytes} [Tue Aug 30 05:24:24 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 05:24:24.102779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:24.103278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:24.110675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:24.111159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:24.111600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:24.112296 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:24.112748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:24.113194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:24.189601 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] HTTP exception thrown: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 is not attached to volume 1fa35685-25d9-4625-8dd2-1413ca0f64ed Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Request method failure captured: Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: request: DELETE /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments/1fa35685-25d9-4625-8dd2-1413ca0f64ed HTTP/1.1 Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZ1q0Z13tU4XAN0huM1-pSiYWFIzssDa3VnBHmDOS44uLtVgfyxNHyjdbAUt-iNCjBmkxLIBQWUBlCwGNc6S11aptdPjqZ3-X8WNd8IddXCCXU7qWGHjugnz8BRVjdrqRPx4XvK2xvgA6mFuAw4N82XqoSfsWblwzdECJCOX4aNAJYA Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: d875800223e24b918348d40c958c297f Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d875800223e24b918348d40c958c297f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d875800223e24b918348d40c958c297f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}] Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: d875800223e24b918348d40c958c297f Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 241b55926b71439d88188d6fe0806e3d Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 is not attached to volume 1fa35685-25d9-4625-8dd2-1413ca0f64ed Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'server_id': '7b683f76-0b13-4747-b857-9957c7fe5ce2', 'id': '1fa35685-25d9-4625-8dd2-1413ca0f64ed'} Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1fa35685-25d9-4625-8dd2-1413ca0f64ed. Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 is not attached to volume 1fa35685-25d9-4625-8dd2-1413ca0f64ed Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:24:24.191221 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:24:24.195718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:24:24.195718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:24:24.195718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 is not attached to volume 1fa35685-25d9-4625-8dd2-1413ca0f64ed Aug 30 05:24:24.195718 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:24.195718 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Returning 404 to user: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 is not attached to volume 1fa35685-25d9-4625-8dd2-1413ca0f64ed {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:24:24.195718 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-72353f12-86c3-40e3-81e2-eb3fdc094d84 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments/1fa35685-25d9-4625-8dd2-1413ca0f64ed" status: 404 len: 154 microversion: 2.1 time: 0.094337 Aug 30 05:24:24.195718 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3753/7446] 10.222.0.27 () {58 vars in 1416 bytes} [Tue Aug 30 05:24:24 2022] DELETE /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2/os-volume_attachments/1fa35685-25d9-4625-8dd2-1413ca0f64ed => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:24:27.447564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:27.448189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:27.456021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:27.456529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:27.456981 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:27.457749 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:27.458217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:27.458658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:27.485870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:24:27.564075 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2b735634-f794-4b66-aee9-bf9a0949c342 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 204 len: 0 microversion: 2.1 time: 0.120056 Aug 30 05:24:27.568064 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3694/7447] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:24:27 2022] DELETE /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:24:27.573352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:27.573981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:27.581842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:27.582335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:27.582782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:27.583485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:27.583946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:27.584414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:27.716807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:27.724741 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fb6ae588-2a50-4155-8607-8c2a69212496 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1554 microversion: 2.1 time: 0.155452 Aug 30 05:24:27.725318 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3754/7448] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:27 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:24:28.747182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:28.748403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:28.756090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:28.756591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:28.757048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:28.757793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:28.758262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:28.758715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:28.887685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:28.896355 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12f7266f-e6a9-42a6-94ea-c54715af40d1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1554 microversion: 2.1 time: 0.153495 Aug 30 05:24:28.896973 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3695/7449] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:28 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:29.918356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:29.919698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:29.929948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:29.930893 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:29.931409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:29.932372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:29.932892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:29.933693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:30.067762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '241b55926b71439d88188d6fe0806e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd875800223e24b918348d40c958c297f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:30.076123 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-03267547-f7eb-4108-8955-f636026613fc tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 200 len: 1554 microversion: 2.1 time: 0.161119 Aug 30 05:24:30.076719 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3755/7450] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:29 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:30.245990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-188e0038-9bf8-4ea9-a7e9-03c39df9addb req-c2c9080f-9ba3-489e-9403-b042fff5e818 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b683f76-0b13-4747-b857-9957c7fe5ce2", "name": "network-vif-deleted", "tag": "964a470d-267b-4b14-ad17-b13423d740bb"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:30.256372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-188e0038-9bf8-4ea9-a7e9-03c39df9addb req-c2c9080f-9ba3-489e-9403-b042fff5e818 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:30.256870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-188e0038-9bf8-4ea9-a7e9-03c39df9addb req-c2c9080f-9ba3-489e-9403-b042fff5e818 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:30.257313 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-188e0038-9bf8-4ea9-a7e9-03c39df9addb req-c2c9080f-9ba3-489e-9403-b042fff5e818 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:30.269479 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-188e0038-9bf8-4ea9-a7e9-03c39df9addb req-c2c9080f-9ba3-489e-9403-b042fff5e818 service nova] Creating event network-vif-deleted:964a470d-267b-4b14-ad17-b13423d740bb for instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 on n-h1-854925-5 Aug 30 05:24:30.274556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-188e0038-9bf8-4ea9-a7e9-03c39df9addb req-c2c9080f-9ba3-489e-9403-b042fff5e818 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105201 Aug 30 05:24:30.275179 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3696/7451] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:31.098561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:31.099204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] [instance: 7b683f76-0b13-4747-b857-9957c7fe5ce2] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:31.106466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:31.107527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:31.107969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:31.108657 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:31.109112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:31.109576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:31.122804 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] HTTP exception thrown: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 could not be found. Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Request method failure captured: Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 HTTP/1.1 Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDZ1q0Z13tU4XAN0huM1-pSiYWFIzssDa3VnBHmDOS44uLtVgfyxNHyjdbAUt-iNCjBmkxLIBQWUBlCwGNc6S11aptdPjqZ3-X8WNd8IddXCCXU7qWGHjugnz8BRVjdrqRPx4XvK2xvgA6mFuAw4N82XqoSfsWblwzdECJCOX4aNAJYA Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: d875800223e24b918348d40c958c297f Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_d875800223e24b918348d40c958c297f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/d875800223e24b918348d40c958c297f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/d875800223e24b918348d40c958c297f"}]}] Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: d875800223e24b918348d40c958c297f Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1908898016 Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 241b55926b71439d88188d6fe0806e3d Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestMinimumBasicScenario-1908898016-project Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 could not be found. Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '7b683f76-0b13-4747-b857-9957c7fe5ce2'} Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 could not be found. Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 could not be found. Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:24:31.124335 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 could not be found. Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Returning 404 to user: Instance 7b683f76-0b13-4747-b857-9957c7fe5ce2 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2bd601f-0006-4c71-9b1e-6f2e0b1597e2 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2" status: 404 len: 111 microversion: 2.1 time: 0.031110 Aug 30 05:24:31.129448 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3756/7452] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:31 2022] GET /compute/v2.1/servers/7b683f76-0b13-4747-b857-9957c7fe5ce2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:24:31.135482 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e626e8e0-0185-4d70-96ac-95e120d00fa1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] Calling method '.version_select at 0x7fe96a1c1f70>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:31.155850 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e626e8e0-0185-4d70-96ac-95e120d00fa1 tempest-TestMinimumBasicScenario-1908898016 tempest-TestMinimumBasicScenario-1908898016-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1660698343" status: 202 len: 0 microversion: 2.1 time: 0.024614 Aug 30 05:24:31.156436 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3697/7453] 10.222.0.27 () {58 vars in 1272 bytes} [Tue Aug 30 05:24:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1660698343 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:24:40.251235 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8be96630-f334-46ac-b1ed-1d9c77c25fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: .version_select at 0x7fe96905c310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-952358984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD93vOW7ehQwTw5dnGejkAdnmZ4bzroVSXW1ubZKQ3xoQalTUQQAU8pQRHtuj0S74xILipvQf/S9rzwH3ZyrH5Q2/9r0adWFp+p6jDmXLKg+9jAxcmqwkmsSXuu0vibZbA=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:40.267364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8be96630-f334-46ac-b1ed-1d9c77c25fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:24:40.273302 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8be96630-f334-46ac-b1ed-1d9c77c25fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:24:40.298457 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8be96630-f334-46ac-b1ed-1d9c77c25fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.209325 Aug 30 05:24:40.299059 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3757/7454] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:24:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:45.921085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:45.922496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:45.927292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-412630523", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "d79459a8-c76f-4414-82b5-5ef0ffddf815"}], "key_name": "tempest-TestNetworkAdvancedServerOps-952358984", "security_groups": [{"name": "tempest-secgroup-smoke-747132728"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:46.077669 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] validate_networks() for [('d79459a8-c76f-4414-82b5-5ef0ffddf815', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:24:46.571324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:24:46.571764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:24:46.572378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:24:46.572806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:24:46.573269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:24:46.582577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:46.583004 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:46.583465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:46.584217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:46.584694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:46.585140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:46.602966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:24:46.608947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:24:46.621963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:24:46.624863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:24:46.673231 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-da62c8c8-940a-4955-a80a-2e24ec396fcf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.754035 Aug 30 05:24:46.680412 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3698/7455] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:24:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:24:46.683697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:46.689088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d9804220-58fc-4404-b545-a39b402cbbbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:46.689817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d9804220-58fc-4404-b545-a39b402cbbbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:46.759441 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d9804220-58fc-4404-b545-a39b402cbbbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:46.767585 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d9804220-58fc-4404-b545-a39b402cbbbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1265 microversion: 2.1 time: 0.085193 Aug 30 05:24:46.768717 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3758/7456] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:46 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:47.794932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:47.796711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:47.804354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:47.804864 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:47.805317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:47.806345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:47.806822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:47.807288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:47.949679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:47.966619 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-573164fd-6174-4941-8443-f882c23ce680 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1317 microversion: 2.1 time: 0.177393 Aug 30 05:24:47.967884 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3699/7457] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:47 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:48.992532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:48.993788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:49.002454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:49.005117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:49.005861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:49.008591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:49.008591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:49.008591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:49.008591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:49.213376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:49.221357 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b046abe-0276-425a-a0cd-38d02a0b3300 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1390 microversion: 2.1 time: 0.236678 Aug 30 05:24:49.221953 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3759/7458] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:48 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:49.457709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d79e2f2b-e198-432d-b45f-41e2cb38c8bb req-352dd006-45fa-4d42-9210-c53ea5c22e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18a60c2-4186-4adf-b73b-a1732d7a5e3f", "tag": "227d7911-ee13-42bf-a1cb-c6909d689355"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:49.469061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d79e2f2b-e198-432d-b45f-41e2cb38c8bb req-352dd006-45fa-4d42-9210-c53ea5c22e12 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:49.469622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d79e2f2b-e198-432d-b45f-41e2cb38c8bb req-352dd006-45fa-4d42-9210-c53ea5c22e12 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:49.470242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d79e2f2b-e198-432d-b45f-41e2cb38c8bb req-352dd006-45fa-4d42-9210-c53ea5c22e12 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:49.491163 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d79e2f2b-e198-432d-b45f-41e2cb38c8bb req-352dd006-45fa-4d42-9210-c53ea5c22e12 service nova] Creating event network-changed:227d7911-ee13-42bf-a1cb-c6909d689355 for instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f on n-h2-854925-5 Aug 30 05:24:49.496405 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d79e2f2b-e198-432d-b45f-41e2cb38c8bb req-352dd006-45fa-4d42-9210-c53ea5c22e12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042254 Aug 30 05:24:49.497632 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3700/7459] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:50.243078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:50.243697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:50.250865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:50.251355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:50.251796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:50.252491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:50.252949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:50.253397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:50.391146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:50.399617 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c042d98e-b281-4a8b-9071-fdcd840c875e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1390 microversion: 2.1 time: 0.160473 Aug 30 05:24:50.400835 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3760/7460] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:50 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:51.422114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:51.422838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:51.429364 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:51.429862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:51.430314 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:51.431023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:51.431488 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:51.431928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:51.571429 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:51.581208 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee433a35-2926-4935-a575-2b1e347de00b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1390 microversion: 2.1 time: 0.163905 Aug 30 05:24:51.581891 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3701/7461] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:51 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:52.602903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:52.603549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:52.610367 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:52.610852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:52.611288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:52.611977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:52.612430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:52.612857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:52.752167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:52.760203 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8dc08117-5d2b-46c0-95da-8a1848eab139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1390 microversion: 2.1 time: 0.161426 Aug 30 05:24:52.760782 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3761/7462] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:52 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1390 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:24:53.780298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:53.780839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:53.787708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:53.788212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:53.788672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:53.789397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:53.789872 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:53.790322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:53.921063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:53.928787 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-394a5ab9-7533-4bff-b7d6-15179c6b7fd1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1390 microversion: 2.1 time: 0.152546 Aug 30 05:24:53.929381 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3702/7463] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:53 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:54.188665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-93a447f3-c282-4dc9-91a6-1dc6a198b66d req-850018a6-734f-4b86-b50d-a41dda71c759 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18a60c2-4186-4adf-b73b-a1732d7a5e3f", "name": "network-vif-plugged", "status": "completed", "tag": "227d7911-ee13-42bf-a1cb-c6909d689355"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:54.198399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-93a447f3-c282-4dc9-91a6-1dc6a198b66d req-850018a6-734f-4b86-b50d-a41dda71c759 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:54.198882 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-93a447f3-c282-4dc9-91a6-1dc6a198b66d req-850018a6-734f-4b86-b50d-a41dda71c759 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:54.199317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-93a447f3-c282-4dc9-91a6-1dc6a198b66d req-850018a6-734f-4b86-b50d-a41dda71c759 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:54.211023 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-93a447f3-c282-4dc9-91a6-1dc6a198b66d req-850018a6-734f-4b86-b50d-a41dda71c759 service nova] Creating event network-vif-plugged:227d7911-ee13-42bf-a1cb-c6909d689355 for instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f on n-h2-854925-5 Aug 30 05:24:54.216657 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-93a447f3-c282-4dc9-91a6-1dc6a198b66d req-850018a6-734f-4b86-b50d-a41dda71c759 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090305 Aug 30 05:24:54.217253 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3762/7464] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:54.950664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:54.951312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:54.958264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:54.958765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:54.959226 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:54.960306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:54.960786 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:54.961238 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:55.089773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:55.097543 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8409de4c-d250-41cd-b243-146c3ce68cb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1390 microversion: 2.1 time: 0.152129 Aug 30 05:24:55.098136 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3703/7465] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:54 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:56.120603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:56.121308 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:56.128050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:56.128558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:56.128998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:56.129811 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:56.130327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:56.131614 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:56.269424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:56.277677 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b79e3b7f-2599-4878-a9f1-0f3fff2f0faf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1561 microversion: 2.1 time: 0.162117 Aug 30 05:24:56.278402 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3763/7466] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:56 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:56.297668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:56.298303 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:56.305187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:56.305714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:56.306189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:56.306909 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:56.307381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:56.307826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:56.447420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:56.455814 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8cd6e0d8-a540-4108-8436-4db37a87be7b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1561 microversion: 2.1 time: 0.162068 Aug 30 05:24:56.456394 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3704/7467] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:56 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:24:58.026002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:24:58.031673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3606e4cd-cb44-47f5-9001-824a975ba0f0 req-774d08b0-5ee3-4839-9827-8cfbdcf5166b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18a60c2-4186-4adf-b73b-a1732d7a5e3f", "tag": "227d7911-ee13-42bf-a1cb-c6909d689355"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:24:58.036506 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:58.037414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:58.037952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:24:58.040475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:24:58.048761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:58.049460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:58.050152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:58.050948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3606e4cd-cb44-47f5-9001-824a975ba0f0 req-774d08b0-5ee3-4839-9827-8cfbdcf5166b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:58.051357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:24:58.051478 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3606e4cd-cb44-47f5-9001-824a975ba0f0 req-774d08b0-5ee3-4839-9827-8cfbdcf5166b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:58.051882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3606e4cd-cb44-47f5-9001-824a975ba0f0 req-774d08b0-5ee3-4839-9827-8cfbdcf5166b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:58.052009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:24:58.052413 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:24:58.065749 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3606e4cd-cb44-47f5-9001-824a975ba0f0 req-774d08b0-5ee3-4839-9827-8cfbdcf5166b service nova] Creating event network-changed:227d7911-ee13-42bf-a1cb-c6909d689355 for instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f on n-h2-854925-5 Aug 30 05:24:58.071791 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3606e4cd-cb44-47f5-9001-824a975ba0f0 req-774d08b0-5ee3-4839-9827-8cfbdcf5166b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043782 Aug 30 05:24:58.073187 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3705/7468] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:24:58.273368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:24:58.282316 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-20743f74-e1d7-492c-b475-996b9c0286f4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1561 microversion: 2.1 time: 0.260268 Aug 30 05:24:58.283496 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3764/7469] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:24:58 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1561 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:19.537774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:19.540071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:19.542918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:19.543625 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=36 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:19.550344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:19.550842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:19.551288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:19.551989 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:19.552452 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:19.552891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:19.607323 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-91f27f26-0c41-4b15-954a-9b71b90f4a4c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action" status: 200 len: 24567 microversion: 2.1 time: 0.073821 Aug 30 05:25:19.608007 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3706/7470] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:25:19 2022] POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action => generated 24567 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:25:30.590500 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:30.591069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:30.594051 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:25:30.594179 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:25:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action (ip 10.222.0.27) !!! Aug 30 05:25:30.596316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=11 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:30.597031 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=32 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:30.609984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:30.610471 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:30.610908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:30.611598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:30.612048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:30.612499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:30.683989 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-052d1338-a1f4-4d88-b449-d65d77830682 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action" status: 202 len: 0 microversion: 2.1 time: 0.097847 Aug 30 05:25:30.684827 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3765/7471] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:25:30 2022] POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:25:30.694182 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:30.694908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:30.698052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:30.698716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:30.707171 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:30.707677 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:30.708134 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:30.708849 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:30.709321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:30.709792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:30.847529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:30.855834 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7cf9fbe8-f6cb-4c01-9db2-de47382c0969 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1684 microversion: 2.1 time: 0.165911 Aug 30 05:25:30.856416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3707/7472] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:30 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:31.878868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:31.879576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:31.886115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:31.886607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:31.887133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:31.887835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:31.888288 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:31.889232 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:32.038588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:32.046437 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e4cdc96b-06eb-47b8-bd5a-f25780eb6aee tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1664 microversion: 2.1 time: 0.172885 Aug 30 05:25:32.047022 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3766/7473] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:31 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:33.150956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:33.153168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:33.160549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:33.160996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:33.161489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:33.162197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:33.162665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:33.163110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:33.215400 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca2dfa38-f2f3-444d-8d89-e29a13aefaad tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action" status: 200 len: 32643 microversion: 2.1 time: 0.068281 Aug 30 05:25:33.216068 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3708/7474] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:25:33 2022] POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action => generated 32643 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:25:33.227977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:33.228523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:33.236041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:33.236533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:33.236974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:33.237697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:33.238160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:33.238593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:33.320431 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46b68178-f197-414a-ad51-d826fae2a29e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action" status: 202 len: 0 microversion: 2.1 time: 0.096432 Aug 30 05:25:33.321366 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3767/7475] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:25:33 2022] POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:25:33.330307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:33.331038 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:33.338307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:33.338813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:33.339275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:33.340022 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:33.340583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:33.341039 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:33.474317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:33.484029 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c658b9d8-f09b-4531-91dc-16bb93ce882b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1671 microversion: 2.1 time: 0.158198 Aug 30 05:25:33.484626 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3709/7476] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:33 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:25:34.506383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:34.507081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:34.513340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:34.514439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:34.514973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:34.515659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:34.516111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:34.516738 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:34.654906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:34.664208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c9c302b3-f101-4545-a4c6-b5b3ca9eb4d5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1679 microversion: 2.1 time: 0.162933 Aug 30 05:25:34.664780 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3768/7477] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:34 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:34.772492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:34.774725 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:34.781780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:34.782278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:34.782728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:34.783424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:34.783886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:34.784321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:34.835974 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-349baab6-3898-4b3b-8c39-e74727e77349 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action" status: 200 len: 38443 microversion: 2.1 time: 0.067246 Aug 30 05:25:34.836794 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3710/7478] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:25:34 2022] POST /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f/action => generated 38443 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:25:36.156399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:36.162387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-059a7d68-4a23-4a40-90dd-55194b2b789a req-332cef14-9ab6-448f-8000-8ba599d1c49f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d18a60c2-4186-4adf-b73b-a1732d7a5e3f", "tag": "227d7911-ee13-42bf-a1cb-c6909d689355"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:36.162898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:36.170998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:36.170998 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:36.171475 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:36.172183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:36.172649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:36.173080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:36.173972 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-059a7d68-4a23-4a40-90dd-55194b2b789a req-332cef14-9ab6-448f-8000-8ba599d1c49f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:36.174463 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-059a7d68-4a23-4a40-90dd-55194b2b789a req-332cef14-9ab6-448f-8000-8ba599d1c49f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:36.175075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-059a7d68-4a23-4a40-90dd-55194b2b789a req-332cef14-9ab6-448f-8000-8ba599d1c49f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:36.187008 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-059a7d68-4a23-4a40-90dd-55194b2b789a req-332cef14-9ab6-448f-8000-8ba599d1c49f service nova] Creating event network-changed:227d7911-ee13-42bf-a1cb-c6909d689355 for instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f on n-h2-854925-5 Aug 30 05:25:36.198479 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-059a7d68-4a23-4a40-90dd-55194b2b789a req-332cef14-9ab6-448f-8000-8ba599d1c49f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039628 Aug 30 05:25:36.199562 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3711/7479] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:25:36.202456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:25:36.298766 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bef45856-8aa6-4ff9-b5dc-7efb387b26bd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 204 len: 0 microversion: 2.1 time: 0.146659 Aug 30 05:25:36.302782 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3769/7480] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:25:36 2022] DELETE /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:25:36.312658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:36.313414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:36.320323 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:36.320824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:36.321406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:36.322222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:36.322724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:36.323217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:36.490824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:36.499446 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7da2b96-1a79-4ba7-8622-c8da7a4c73c5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1685 microversion: 2.1 time: 0.195216 Aug 30 05:25:36.500050 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3712/7481] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:36 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1685 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:37.526420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:37.527121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:37.534695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:37.535186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:37.535627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:37.536330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:37.536789 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:37.537218 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:37.694123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:37.702694 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-72296c66-efa9-4889-86ae-e69b57abe4bf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1685 microversion: 2.1 time: 0.180606 Aug 30 05:25:37.703287 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3770/7482] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:37 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:38.278160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f089b244-4bd9-4165-a440-b0be1217352a req-82e4b8a6-ee03-4c8c-bc2c-a96f575fceb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d18a60c2-4186-4adf-b73b-a1732d7a5e3f", "name": "network-vif-deleted", "tag": "227d7911-ee13-42bf-a1cb-c6909d689355"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:38.289754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f089b244-4bd9-4165-a440-b0be1217352a req-82e4b8a6-ee03-4c8c-bc2c-a96f575fceb1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:38.290404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f089b244-4bd9-4165-a440-b0be1217352a req-82e4b8a6-ee03-4c8c-bc2c-a96f575fceb1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:38.290883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f089b244-4bd9-4165-a440-b0be1217352a req-82e4b8a6-ee03-4c8c-bc2c-a96f575fceb1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:38.303825 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f089b244-4bd9-4165-a440-b0be1217352a req-82e4b8a6-ee03-4c8c-bc2c-a96f575fceb1 service nova] Creating event network-vif-deleted:227d7911-ee13-42bf-a1cb-c6909d689355 for instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f on n-h2-854925-5 Aug 30 05:25:38.308674 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f089b244-4bd9-4165-a440-b0be1217352a req-82e4b8a6-ee03-4c8c-bc2c-a96f575fceb1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034182 Aug 30 05:25:38.309282 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3713/7483] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:25:38.727964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:38.728724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:38.739573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:38.740254 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:38.741217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:38.741981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:38.742460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:38.743852 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:38.795873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:38.796517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:38.796975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:38.797501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lazy-loading 'fault' on Instance uuid d18a60c2-4186-4adf-b73b-a1732d7a5e3f {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:25:38.840066 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:38.847959 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-988e3d15-01c7-40e5-a690-ac0d73fc6731 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 200 len: 1355 microversion: 2.1 time: 0.124185 Aug 30 05:25:38.848638 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3771/7484] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:38 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 1355 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:39.870712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:39.871432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: d18a60c2-4186-4adf-b73b-a1732d7a5e3f] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:39.877745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:39.878240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:39.878715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:39.879397 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:39.879866 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:39.880371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:39.896424 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] HTTP exception thrown: Instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f could not be found. Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Request method failure captured: Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f HTTP/1.1 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZ8XqLQ2XnoeLjy3gfQj35dox1YH5CBG0bCtLjf05-B1Yo93BI9vDY7yzjeehMPCotYvvaOKI4M1IPZee0eGfYCHUS3YgdukVXskYw9qnuVtaL_TUTTKpS8IYCqhmuj_Jpnpp35NyDw9HzoPbnHxREMCcpVWa6OG2_sQOOmlx07o8eg Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49b721c6a545492eac1cee9db1e66f8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}] Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 5e62a83482494bfda64a3cd4d5a017c8 Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f could not be found. Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'd18a60c2-4186-4adf-b73b-a1732d7a5e3f'} Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f could not be found. Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f could not be found. Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:25:39.898204 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f could not be found. Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Returning 404 to user: Instance d18a60c2-4186-4adf-b73b-a1732d7a5e3f could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-73775616-857a-4498-ae5f-e408b14a3d46 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f" status: 404 len: 111 microversion: 2.1 time: 0.034099 Aug 30 05:25:39.903105 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3714/7485] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:39 2022] GET /compute/v2.1/servers/d18a60c2-4186-4adf-b73b-a1732d7a5e3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:25:42.871229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-656c4e00-26c0-44f9-bbbd-f954166e4ff1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '.version_select at 0x7fe969585b80>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:42.893871 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-656c4e00-26c0-44f9-bbbd-f954166e4ff1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-952358984" status: 202 len: 0 microversion: 2.1 time: 0.026519 Aug 30 05:25:42.894877 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3772/7486] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Aug 30 05:25:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-952358984 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:25:42.920180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b882ed94-3241-47a3-8e86-1daec2d970f8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: .version_select at 0x7fe96994bc10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-17181713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf0yp2WovPYT69YOcOh4r2GL4HlJlCM2dObKjb1eE1O/6aVW5sbE9/+bSgmlKagrafglaqMAflZd0P+i3PZc/YVSRga1lJwDY5zRJj270FH3danbZH6EtrJ5m0D6hOmtg=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:42.936737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b882ed94-3241-47a3-8e86-1daec2d970f8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:25:42.942714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b882ed94-3241-47a3-8e86-1daec2d970f8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:25:42.966136 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b882ed94-3241-47a3-8e86-1daec2d970f8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.050764 Aug 30 05:25:42.967340 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3715/7487] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:25:42 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:25:48.662012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-683940781", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "903f739c-5e0d-40b1-bf20-33a03d967818"}], "key_name": "tempest-TestNetworkAdvancedServerOps-17181713", "security_groups": [{"name": "tempest-secgroup-smoke-578686290"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:48.813444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] validate_networks() for [('903f739c-5e0d-40b1-bf20-33a03d967818', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:25:48.845094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:49.282973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:25:49.283551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:25:49.284047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:25:49.284464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:25:49.284884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:25:49.295571 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:49.296058 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:49.296495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:49.297224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:49.298182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:49.298622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:49.318447 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:25:49.324565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:25:49.338338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:25:49.340764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:25:49.407637 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7b157e3-974b-4329-bcdd-72e8ef783be3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751573 Aug 30 05:25:49.416719 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3773/7488] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:25:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:25:49.421616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-95905eed-ebd7-416c-84e3-8a251d2eac2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:49.422309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-95905eed-ebd7-416c-84e3-8a251d2eac2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:49.478065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-95905eed-ebd7-416c-84e3-8a251d2eac2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:49.486471 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-95905eed-ebd7-416c-84e3-8a251d2eac2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1264 microversion: 2.1 time: 0.070581 Aug 30 05:25:49.487063 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3716/7489] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:49 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1264 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:25:50.510703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-14377d1f-7002-4c31-b5cd-132dceb6983c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:50.511426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-14377d1f-7002-4c31-b5cd-132dceb6983c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:50.591596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-14377d1f-7002-4c31-b5cd-132dceb6983c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:50.599220 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-14377d1f-7002-4c31-b5cd-132dceb6983c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1264 microversion: 2.1 time: 0.095080 Aug 30 05:25:50.611242 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3774/7490] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:50 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1264 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:51.631607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf47a07f-fec4-4be8-b087-d2bb264f0a36 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:51.632243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cf47a07f-fec4-4be8-b087-d2bb264f0a36 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:51.634271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=32 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:51.690345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cf47a07f-fec4-4be8-b087-d2bb264f0a36 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:51.697337 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf47a07f-fec4-4be8-b087-d2bb264f0a36 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1264 microversion: 2.1 time: 0.069514 Aug 30 05:25:51.697919 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3717/7491] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:51 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1264 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:52.719130 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a8827e6f-de60-4a41-942e-db1c96c6ee4f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:52.719853 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a8827e6f-de60-4a41-942e-db1c96c6ee4f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:52.776781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a8827e6f-de60-4a41-942e-db1c96c6ee4f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:52.790020 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a8827e6f-de60-4a41-942e-db1c96c6ee4f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1264 microversion: 2.1 time: 0.074878 Aug 30 05:25:52.790966 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3775/7492] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:52 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1264 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:53.815850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:53.816417 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:53.823449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:53.823944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:53.824394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:53.825092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:53.825609 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:53.826054 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:53.886739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:53.894598 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6e3582fd-39e7-4474-acfe-bf6a75b263c9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1268 microversion: 2.1 time: 0.082782 Aug 30 05:25:53.895177 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3718/7493] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:53 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1268 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:54.916111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:54.916732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:54.923908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:54.924380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:54.924842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:54.925552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:54.926010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:54.926609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:54.989879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:54.998480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2b9ac858-b134-4643-8759-5eebd2c3b176 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1322 microversion: 2.1 time: 0.086381 Aug 30 05:25:54.999183 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3776/7494] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:54 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1322 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:56.020391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:56.020931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:56.027838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:56.028345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:56.029487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:56.030241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:56.030715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:56.031166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:56.277956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3939598e-83e6-439a-9012-aae57facad57 req-96d9dc71-349f-4c69-aa30-23abfa6c4433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f9502b-9c20-4ab2-a1e3-9d58b3d08602", "tag": "978c0c30-905c-4a6a-a639-4652453abcef"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:25:56.291747 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3939598e-83e6-439a-9012-aae57facad57 req-96d9dc71-349f-4c69-aa30-23abfa6c4433 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:56.292593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3939598e-83e6-439a-9012-aae57facad57 req-96d9dc71-349f-4c69-aa30-23abfa6c4433 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:56.293123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3939598e-83e6-439a-9012-aae57facad57 req-96d9dc71-349f-4c69-aa30-23abfa6c4433 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:56.305478 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3939598e-83e6-439a-9012-aae57facad57 req-96d9dc71-349f-4c69-aa30-23abfa6c4433 service nova] Creating event network-changed:978c0c30-905c-4a6a-a639-4652453abcef for instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 on n-h1-854925-5 Aug 30 05:25:56.323617 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3939598e-83e6-439a-9012-aae57facad57 req-96d9dc71-349f-4c69-aa30-23abfa6c4433 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049592 Aug 30 05:25:56.324400 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3777/7495] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:25:56.515170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:56.523399 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b06d2722-4987-4855-9079-ed84c82baa41 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1389 microversion: 2.1 time: 0.507061 Aug 30 05:25:56.524239 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3719/7496] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:56 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1389 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:57.544556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:57.545262 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:57.552250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:57.552730 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:57.553169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:57.553890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:57.554347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:57.554772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:57.688727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:57.696359 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-86b3fc3f-9999-403b-a5d6-2e4305ed92c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1389 microversion: 2.1 time: 0.156034 Aug 30 05:25:57.696931 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3778/7497] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:57 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:58.718527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:58.719159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:58.726503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:58.727000 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:58.727707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:58.728409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:58.728876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:58.729315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:58.869537 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:25:58.877611 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9f96bcf3-b51a-4f5b-8a9d-9433e230dad1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1389 microversion: 2.1 time: 0.163429 Aug 30 05:25:58.878173 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3720/7498] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:58 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1389 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:25:59.898854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:25:59.899477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:25:59.902494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:25:59.909354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:59.909854 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:59.910310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:25:59.911010 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:25:59.911461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:25:59.911888 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:00.045910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:00.053651 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8cc51a52-f38b-406d-b33f-b99d9f7479e8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1389 microversion: 2.1 time: 0.158748 Aug 30 05:26:00.054224 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3779/7499] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:25:59 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1389 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:01.074341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:01.074978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:01.078218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:01.083710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:01.084223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:01.084685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:01.085431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:01.085906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:01.086353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:01.141713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f063a278-d6d4-479a-96b1-8d4bcad7a3e2 req-471cf9d0-1b57-4942-9ab1-25df7fa7870e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f9502b-9c20-4ab2-a1e3-9d58b3d08602", "name": "network-vif-plugged", "status": "completed", "tag": "978c0c30-905c-4a6a-a639-4652453abcef"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:26:01.151184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:01.164674 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f063a278-d6d4-479a-96b1-8d4bcad7a3e2 req-471cf9d0-1b57-4942-9ab1-25df7fa7870e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:01.165102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f063a278-d6d4-479a-96b1-8d4bcad7a3e2 req-471cf9d0-1b57-4942-9ab1-25df7fa7870e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:01.165565 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f063a278-d6d4-479a-96b1-8d4bcad7a3e2 req-471cf9d0-1b57-4942-9ab1-25df7fa7870e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:01.178573 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f063a278-d6d4-479a-96b1-8d4bcad7a3e2 req-471cf9d0-1b57-4942-9ab1-25df7fa7870e service nova] Creating event network-vif-plugged:978c0c30-905c-4a6a-a639-4652453abcef for instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 on n-h1-854925-5 Aug 30 05:26:01.187893 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f063a278-d6d4-479a-96b1-8d4bcad7a3e2 req-471cf9d0-1b57-4942-9ab1-25df7fa7870e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049950 Aug 30 05:26:01.188107 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3780/7500] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:26:01.234660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:01.243355 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adec48eb-c581-4057-b0bc-ff93bee26e76 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1389 microversion: 2.1 time: 0.172965 Aug 30 05:26:01.243937 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3721/7501] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:01 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1389 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:02.265980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:02.266598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:02.274284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:02.274768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:02.275200 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:02.275880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:02.276327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:02.276750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:02.409982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:02.417650 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fc8122a4-e441-4762-a607-2cbc870d2483 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1389 microversion: 2.1 time: 0.157237 Aug 30 05:26:02.418222 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3781/7502] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:02 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:03.438867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:03.439529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:03.441462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=8 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:03.447576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:03.448078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:03.448532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:03.449241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:03.449735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:03.450181 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:03.580501 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:03.588313 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b7a06484-5274-405a-a86f-6213d48e8672 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1561 microversion: 2.1 time: 0.153958 Aug 30 05:26:03.588907 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3722/7503] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:03 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:03.609589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:03.610208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:03.612195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=10 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:03.618207 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:03.618694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:03.619136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:03.619823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:03.620280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:03.620707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:03.756637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:03.764603 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7b3fd097-1110-45ed-8581-f3888f41ba4b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1561 microversion: 2.1 time: 0.159591 Aug 30 05:26:03.765229 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3782/7504] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:03 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:05.335747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:26:05.336374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:05.338295 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c981f158-c88a-4e26-8a08-dbac900f9936 req-efa22b14-eb06-4bea-bdba-ba3a1429c259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f9502b-9c20-4ab2-a1e3-9d58b3d08602", "tag": "978c0c30-905c-4a6a-a639-4652453abcef"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:26:05.343810 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:05.344629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:05.345086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:05.346213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:05.346884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:05.347327 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:05.348913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c981f158-c88a-4e26-8a08-dbac900f9936 req-efa22b14-eb06-4bea-bdba-ba3a1429c259 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:05.349620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c981f158-c88a-4e26-8a08-dbac900f9936 req-efa22b14-eb06-4bea-bdba-ba3a1429c259 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:05.350228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c981f158-c88a-4e26-8a08-dbac900f9936 req-efa22b14-eb06-4bea-bdba-ba3a1429c259 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:05.362530 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c981f158-c88a-4e26-8a08-dbac900f9936 req-efa22b14-eb06-4bea-bdba-ba3a1429c259 service nova] Creating event network-changed:978c0c30-905c-4a6a-a639-4652453abcef for instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 on n-h1-854925-5 Aug 30 05:26:05.367724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c981f158-c88a-4e26-8a08-dbac900f9936 req-efa22b14-eb06-4bea-bdba-ba3a1429c259 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033076 Aug 30 05:26:05.368717 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3783/7505] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:26:05.489893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:26:05.498360 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4391ddad-4526-4758-b520-18c3690ab018 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1561 microversion: 2.1 time: 0.166611 Aug 30 05:26:05.499026 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3723/7506] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:26:05 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:26:38.781700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:26:38.783949 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:26:38.786109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=7 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:38.786756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=38 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:26:38.793606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:38.794682 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:38.795124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:38.795827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:26:38.796274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:26:38.796698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:26:38.879630 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9bccdcd4-055b-4997-8e52-01b278a3a8dd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602/action" status: 200 len: 24568 microversion: 2.1 time: 0.102838 Aug 30 05:26:38.880632 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3784/7507] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:26:38 2022] POST /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602/action => generated 24568 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:27:09.296352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=5 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:09.297044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=36 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:09.302580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:27:09.304960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:09.311804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:09.312304 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:09.312761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:09.313507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:09.313980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:09.314430 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:09.386745 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e80c31a0-3630-49c5-881e-1d17599246f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602/action" status: 202 len: 0 microversion: 2.1 time: 0.092128 Aug 30 05:27:09.387629 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3724/7508] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:27:09 2022] POST /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:27:09.398420 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:09.399124 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:09.401710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:09.402375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:09.408970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:09.409506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:09.409943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:09.410638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:09.411086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:09.411514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:09.605867 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:09.613899 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-309c0610-9edf-48fc-8e6b-384bf2a473a5 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1672 microversion: 2.1 time: 0.219831 Aug 30 05:27:09.614472 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3785/7509] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:09 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1672 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:10.636123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:10.636852 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:10.644887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:10.645410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:10.645868 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:10.646581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:10.647052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:10.647498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:10.827431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:10.835399 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-13397a0b-1249-4b90-b7a0-d6c4a21e7be7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.203808 Aug 30 05:27:10.835982 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3725/7510] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:10 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:11.858526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:11.859231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:11.867695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:11.868185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:11.868620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:11.869310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:11.869782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:11.870208 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:11.999453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:12.007209 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce3c01dd-bbf5-4e49-8026-501448241993 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.153238 Aug 30 05:27:12.007776 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3786/7511] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:11 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:13.028246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:13.028880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:13.035813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:13.036312 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:13.036769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:13.037502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:13.037975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:13.038420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:13.170961 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:13.178692 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-577b72b6-c076-4f1f-b920-73e0375448c7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.154436 Aug 30 05:27:13.179266 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3726/7512] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:13 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:14.200466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:14.200985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:14.208273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:14.208759 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:14.209202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:14.209913 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:14.210368 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:14.210799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:14.340030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:14.347944 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-26eb59ac-4604-4cde-b9b0-583dc022419b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.151504 Aug 30 05:27:14.348662 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3787/7513] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:14 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:15.370096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:15.370728 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:15.377723 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:15.378223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:15.378680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:15.379380 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:15.379847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:15.380289 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:15.515199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:15.522918 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c9593a0-7c1b-4fab-bd5a-52ff03021134 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.156806 Aug 30 05:27:15.523496 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3727/7514] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:15 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:16.543943 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:16.544559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:16.551309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:16.551787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:16.552245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:16.552931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:16.553409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:16.553833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:16.683476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:16.691954 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7df94dc5-3b8c-4bff-b74c-c31697486eaa tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.151871 Aug 30 05:27:16.692527 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3788/7515] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:16 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:27:17.713178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:17.713839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:17.721172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:17.721699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:17.722155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:17.722857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:17.723329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:17.723774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:17.854014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:17.862319 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-05f0e01a-64bd-4f7a-9dad-90d13e056eed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.153125 Aug 30 05:27:17.862908 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3728/7516] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:17 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:18.885108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:18.885746 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:18.892673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:18.893152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:18.893609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:18.894297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:18.894736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:18.895160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:19.034642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:19.042389 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-dc27e78a-9a92-4ca7-8305-27ad49a27bf1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.161187 Aug 30 05:27:19.042958 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3789/7517] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:18 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:20.064980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:20.065638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:20.072596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:20.073098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:20.073710 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:20.074425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:20.074897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:20.075344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:20.215184 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:20.223428 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-807ac2af-4ce1-495f-a7fe-085cf209f3d1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1677 microversion: 2.1 time: 0.162342 Aug 30 05:27:20.224011 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3729/7518] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:20 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:21.245559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:27:21.246174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:21.254015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:21.254496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:21.254933 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:21.255615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:21.256068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:21.256499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:21.396590 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:27:21.404833 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e30da637-636b-45ba-861e-39f9bcfba0cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1680 microversion: 2.1 time: 0.163991 Aug 30 05:27:21.405425 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3790/7519] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:27:21 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:27:53.626820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:27:53.629147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:27:53.631636 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:53.632307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:27:53.637980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:53.638481 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:53.638956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:53.639642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:27:53.640782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:27:53.641229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:27:53.712603 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8b3e2b24-6e26-422d-b8e7-619e7acc2588 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602/action" status: 200 len: 69088 microversion: 2.1 time: 0.090175 Aug 30 05:27:53.713256 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3730/7520] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:27:53 2022] POST /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602/action => generated 69088 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:28:10.923509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:10.924047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:10.926406 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=12 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:10.927181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=36 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:10.928057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:10.928973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:10.934856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:10.935462 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:10.936159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:10.937089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:10.937675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:10.938174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:10.967074 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:28:11.050627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9bf3da37-985d-4493-b0c4-cb8f35f7e26a req-f65ef5e7-edcf-45ea-8057-c2c7adc47088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54f9502b-9c20-4ab2-a1e3-9d58b3d08602", "tag": "978c0c30-905c-4a6a-a639-4652453abcef"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:11.058489 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ee4a4314-9593-414c-8fe3-ceb466409177 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 204 len: 0 microversion: 2.1 time: 0.138298 Aug 30 05:28:11.062564 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3791/7521] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:28:10 2022] DELETE /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:28:11.064738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9bf3da37-985d-4493-b0c4-cb8f35f7e26a req-f65ef5e7-edcf-45ea-8057-c2c7adc47088 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:11.065307 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9bf3da37-985d-4493-b0c4-cb8f35f7e26a req-f65ef5e7-edcf-45ea-8057-c2c7adc47088 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:11.065783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9bf3da37-985d-4493-b0c4-cb8f35f7e26a req-f65ef5e7-edcf-45ea-8057-c2c7adc47088 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:11.073825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:11.074638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:11.078653 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9bf3da37-985d-4493-b0c4-cb8f35f7e26a req-f65ef5e7-edcf-45ea-8057-c2c7adc47088 service nova] Creating event network-changed:978c0c30-905c-4a6a-a639-4652453abcef for instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 on n-h1-854925-5 Aug 30 05:28:11.081438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:11.082037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:11.082553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:11.083372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:11.084029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:11.084159 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9bf3da37-985d-4493-b0c4-cb8f35f7e26a req-f65ef5e7-edcf-45ea-8057-c2c7adc47088 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162457 Aug 30 05:28:11.085206 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:11.087694 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3731/7522] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:28:11.227987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:11.236152 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cb42e935-91f8-4281-b21d-de26dfad7697 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1686 microversion: 2.1 time: 0.171700 Aug 30 05:28:11.236733 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3792/7523] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:11 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1686 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:12.337738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:12.338412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:12.346023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:12.346620 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:12.347083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:12.347792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:12.348265 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:12.348716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:12.484844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:12.493033 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-11aea65e-4599-4449-a106-1b812e3e867a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1686 microversion: 2.1 time: 0.159668 Aug 30 05:28:12.493653 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3732/7524] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:12 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:13.526444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:13.530019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:13.537959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:13.538995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:13.539784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:13.540605 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:13.541287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:13.541995 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:13.575844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-d9b2c592-9f04-4c64-8e57-2d4d834b78f4 req-bfebe646-cb1f-4731-8432-08fef79a9732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54f9502b-9c20-4ab2-a1e3-9d58b3d08602", "name": "network-vif-deleted", "tag": "978c0c30-905c-4a6a-a639-4652453abcef"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:13.586905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9b2c592-9f04-4c64-8e57-2d4d834b78f4 req-bfebe646-cb1f-4731-8432-08fef79a9732 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:13.587396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9b2c592-9f04-4c64-8e57-2d4d834b78f4 req-bfebe646-cb1f-4731-8432-08fef79a9732 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:13.587838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-d9b2c592-9f04-4c64-8e57-2d4d834b78f4 req-bfebe646-cb1f-4731-8432-08fef79a9732 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:13.600253 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-d9b2c592-9f04-4c64-8e57-2d4d834b78f4 req-bfebe646-cb1f-4731-8432-08fef79a9732 service nova] Creating event network-vif-deleted:978c0c30-905c-4a6a-a639-4652453abcef for instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 on n-h1-854925-5 Aug 30 05:28:13.606016 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-d9b2c592-9f04-4c64-8e57-2d4d834b78f4 req-bfebe646-cb1f-4731-8432-08fef79a9732 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Aug 30 05:28:13.606971 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3733/7525] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:28:13.618214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:13.626043 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ef672223-c29d-46fb-bcf9-ffcdb2a2e1c6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 200 len: 1500 microversion: 2.1 time: 0.112647 Aug 30 05:28:13.626624 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3793/7526] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:13 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 1500 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:14.649739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:14.650394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 54f9502b-9c20-4ab2-a1e3-9d58b3d08602] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:14.657056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:14.657583 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:14.658048 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:14.658834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:14.659309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:14.659761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:14.673591 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] HTTP exception thrown: Instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 could not be found. Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Request method failure captured: Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 HTTP/1.1 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZ8XqLQ2XnoeLjy3gfQj35dox1YH5CBG0bCtLjf05-B1Yo93BI9vDY7yzjeehMPCotYvvaOKI4M1IPZee0eGfYCHUS3YgdukVXskYw9qnuVtaL_TUTTKpS8IYCqhmuj_Jpnpp35NyDw9HzoPbnHxREMCcpVWa6OG2_sQOOmlx07o8eg Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49b721c6a545492eac1cee9db1e66f8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}] Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 5e62a83482494bfda64a3cd4d5a017c8 Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 could not be found. Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '54f9502b-9c20-4ab2-a1e3-9d58b3d08602'} Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 could not be found. Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 could not be found. Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:28:14.675407 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 could not be found. Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Returning 404 to user: Instance 54f9502b-9c20-4ab2-a1e3-9d58b3d08602 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ba51b702-7aa5-4936-bf99-f69d6b7d8790 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602" status: 404 len: 111 microversion: 2.1 time: 0.032823 Aug 30 05:28:14.680245 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3734/7527] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:14 2022] GET /compute/v2.1/servers/54f9502b-9c20-4ab2-a1e3-9d58b3d08602 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:28:17.956136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21f097d6-9428-44d7-b7a6-ce6c20e67202 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '.version_select at 0x7fe96bb199d0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:17.962209 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [None req-21f097d6-9428-44d7-b7a6-ce6c20e67202 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [8dd2a198-3d7d-4bab-ac63-d9702e11791a] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:28:18.969496 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [None req-21f097d6-9428-44d7-b7a6-ce6c20e67202 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [8dd2a198-3d7d-4bab-ac63-d9702e11791a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 39312. Aug 30 05:28:18.991057 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21f097d6-9428-44d7-b7a6-ce6c20e67202 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-17181713" status: 202 len: 0 microversion: 2.1 time: 1.039698 Aug 30 05:28:18.991667 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3794/7528] 10.222.0.27 () {58 vars in 1278 bytes} [Tue Aug 30 05:28:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-17181713 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 05:28:19.019699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b237e974-3a77-4b46-95d3-2ff6b35fc90a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: .version_select at 0x7fe968eb5670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-734036827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoTJGoeZwDla7ISRQyjLwYLope0QiVuigLtiM9Ser2uU7N+pI5dpiVutIl3YkoCii2ijdkgFeChwtSSD8N50UfetixSYi7CnUdhn9yH7CQyoaPVYHp/I3i7ARyvPGFSWw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:19.036987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b237e974-3a77-4b46-95d3-2ff6b35fc90a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:28:19.042176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-b237e974-3a77-4b46-95d3-2ff6b35fc90a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:28:19.065395 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b237e974-3a77-4b46-95d3-2ff6b35fc90a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.049690 Aug 30 05:28:19.065997 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3735/7529] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:28:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:28:24.525120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:24.529255 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-663547392", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "5401cb60-bc6c-4875-8951-cf9cd6b167fc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-734036827", "security_groups": [{"name": "tempest-secgroup-smoke-2139722349"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:24.647384 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] validate_networks() for [('5401cb60-bc6c-4875-8951-cf9cd6b167fc', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:28:25.105723 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:28:25.106147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:28:25.106620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:28:25.107059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:28:25.107478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:28:25.117095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:25.117612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:25.118064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:25.118803 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:25.119267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:25.119702 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:25.138415 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:28:25.143744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:28:25.156908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:28:25.159277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:28:25.206436 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-269793e6-4425-45d2-abe5-5dfbe2966fbb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683408 Aug 30 05:28:25.207300 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3795/7530] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:28:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:28:25.215975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:25.220572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bb490164-5f9b-47f2-b338-7909d66fecb9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:25.221213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bb490164-5f9b-47f2-b338-7909d66fecb9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:25.282888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bb490164-5f9b-47f2-b338-7909d66fecb9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:25.291540 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bb490164-5f9b-47f2-b338-7909d66fecb9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1265 microversion: 2.1 time: 0.077265 Aug 30 05:28:25.292371 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3736/7531] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:25 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1265 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:28:26.313635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:26.314862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:26.329722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:26.330463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:26.333755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:26.336134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:26.336618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:26.337059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:26.433004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:26.442249 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c3b69b5b-14c0-45a3-84f1-0bd1173d5139 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1335 microversion: 2.1 time: 0.134013 Aug 30 05:28:26.444029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3796/7532] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:26 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1335 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:27.464262 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:27.464870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:27.477737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:27.478243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:27.478699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:27.479686 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:27.480349 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:27.480804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:27.618516 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:27.626904 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c4e77cd-dada-4d38-9a04-86a3c3216fba tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1391 microversion: 2.1 time: 0.166565 Aug 30 05:28:27.627691 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3737/7533] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:27 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:27.724165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-2f2463c1-4439-4232-b5ea-0fb9436ab02e req-8307b148-78b5-4486-bae1-326ffc18976b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:27.736126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2f2463c1-4439-4232-b5ea-0fb9436ab02e req-8307b148-78b5-4486-bae1-326ffc18976b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:27.736782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2f2463c1-4439-4232-b5ea-0fb9436ab02e req-8307b148-78b5-4486-bae1-326ffc18976b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:27.737237 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-2f2463c1-4439-4232-b5ea-0fb9436ab02e req-8307b148-78b5-4486-bae1-326ffc18976b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:27.750090 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-2f2463c1-4439-4232-b5ea-0fb9436ab02e req-8307b148-78b5-4486-bae1-326ffc18976b service nova] Creating event network-changed:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h2-854925-5 Aug 30 05:28:27.755585 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-2f2463c1-4439-4232-b5ea-0fb9436ab02e req-8307b148-78b5-4486-bae1-326ffc18976b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035008 Aug 30 05:28:27.756263 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3797/7534] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:28:28.648827 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:28.649402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:28.656757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:28.657252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:28.657731 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:28.658432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:28.658951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:28.659390 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:28.788507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:28.797441 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2d84cd20-f39f-4773-990c-ad57a8e45ff8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1391 microversion: 2.1 time: 0.151954 Aug 30 05:28:28.798035 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3738/7535] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:28 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:29.819974 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:29.820713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:29.827027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:29.827512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:29.827953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:29.828644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:29.829104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:29.829568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:29.963630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:29.971522 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d10cb9c4-5a16-4c41-8c89-74b3c46515e9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1391 microversion: 2.1 time: 0.156665 Aug 30 05:28:29.972098 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3798/7536] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:29 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:30.993074 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:30.993738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:31.001258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:31.001791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:31.002259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:31.002971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:31.003451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:31.003905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:31.139804 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:31.148387 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a1a11f14-8a3a-4e5b-a9ed-37b7743fd983 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1391 microversion: 2.1 time: 0.159265 Aug 30 05:28:31.148974 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3739/7537] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:30 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:32.168433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:32.168979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:32.176060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:32.176386 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:32.176821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:32.177533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:32.177985 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:32.178411 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:32.311072 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:32.319297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3e07aa1f-6128-443b-9cdf-cfeac6e4eaa4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1391 microversion: 2.1 time: 0.155004 Aug 30 05:28:32.319877 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3799/7538] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:32 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:33.239873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-45d267e5-51d8-4729-9f82-b46403bde310 req-6bc62c24-4878-4b4d-8fb1-980b2fca768d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "name": "network-vif-plugged", "status": "completed", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:33.251271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-45d267e5-51d8-4729-9f82-b46403bde310 req-6bc62c24-4878-4b4d-8fb1-980b2fca768d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:33.251899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-45d267e5-51d8-4729-9f82-b46403bde310 req-6bc62c24-4878-4b4d-8fb1-980b2fca768d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:33.252345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-45d267e5-51d8-4729-9f82-b46403bde310 req-6bc62c24-4878-4b4d-8fb1-980b2fca768d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:33.263856 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-45d267e5-51d8-4729-9f82-b46403bde310 req-6bc62c24-4878-4b4d-8fb1-980b2fca768d service nova] Creating event network-vif-plugged:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h2-854925-5 Aug 30 05:28:33.269118 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-45d267e5-51d8-4729-9f82-b46403bde310 req-6bc62c24-4878-4b4d-8fb1-980b2fca768d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033163 Aug 30 05:28:33.269989 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3740/7539] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:28:33.340166 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:33.340891 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:33.348401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:33.348884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:33.349343 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:33.350036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:33.350530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:33.350960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:33.482908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:33.490633 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-09fa4cb1-b1c2-4abd-845b-2be19c7e76e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1391 microversion: 2.1 time: 0.154402 Aug 30 05:28:33.491210 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3800/7540] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:33 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:34.512668 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:34.513418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:34.519645 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:34.520148 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:34.520603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:34.521316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:34.521816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:34.522342 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:34.660605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:34.668413 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-acbd1317-46f1-462c-941d-6edf716a94f9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1562 microversion: 2.1 time: 0.161081 Aug 30 05:28:34.668998 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3741/7541] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:34 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:34.689350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:34.690050 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:34.696941 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:34.697474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:34.697912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:34.698629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:34.699363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:34.699509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:34.832848 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:34.840698 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-25bcf43f-a41a-4a98-b375-1019d9d29249 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1562 microversion: 2.1 time: 0.155315 Aug 30 05:28:34.841281 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3801/7542] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:34 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:36.419023 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:28:36.419654 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:36.420479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-3d4672a6-2437-4f0e-a8a7-ba8c6c532b02 req-d6b9906d-2056-4595-9dd7-5bcc62e60b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:36.423325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:36.427932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:36.428976 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:36.432468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:36.432967 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:36.433603 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:36.434372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:36.434845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:36.434955 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3d4672a6-2437-4f0e-a8a7-ba8c6c532b02 req-d6b9906d-2056-4595-9dd7-5bcc62e60b0b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:36.435285 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:36.435398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3d4672a6-2437-4f0e-a8a7-ba8c6c532b02 req-d6b9906d-2056-4595-9dd7-5bcc62e60b0b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:36.435782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-3d4672a6-2437-4f0e-a8a7-ba8c6c532b02 req-d6b9906d-2056-4595-9dd7-5bcc62e60b0b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:36.448147 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-3d4672a6-2437-4f0e-a8a7-ba8c6c532b02 req-d6b9906d-2056-4595-9dd7-5bcc62e60b0b service nova] Creating event network-changed:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h2-854925-5 Aug 30 05:28:36.453145 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-3d4672a6-2437-4f0e-a8a7-ba8c6c532b02 req-d6b9906d-2056-4595-9dd7-5bcc62e60b0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036680 Aug 30 05:28:36.454053 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3802/7543] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:28:36.583718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:28:36.592924 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd17d109-3158-4375-b3c6-af718508fc97 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1562 microversion: 2.1 time: 0.178530 Aug 30 05:28:36.594469 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3742/7544] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:28:36 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1562 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:28:59.861629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:59.862466 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=36 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:28:59.867219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:28:59.869473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:28:59.880580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:59.881067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:59.881542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:59.882244 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:28:59.882704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:28:59.883135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:28:59.938526 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2ee4c6fb-7230-41d7-b9b5-babf3a01395d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action" status: 200 len: 24572 microversion: 2.1 time: 0.078597 Aug 30 05:28:59.939241 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3803/7545] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:28:59 2022] POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action => generated 24572 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:29:06.353096 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:29:06.355665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:06.358029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:06.358871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=32 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:06.365512 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:06.366101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:06.366560 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:06.367276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:06.367744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:06.368188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:06.408167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:06.415278 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Old instance type m1.heat2, new instance type m1.heat {{(pid=122402) resize /opt/stack/nova/nova/compute/api.py:4218}} Aug 30 05:29:06.421857 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:29:06.422330 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:29:06.422822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:29:06.423249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:29:06.423675 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:29:06.489874 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-53a99add-f4f9-42b6-9ee2-b01a44119016 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action" status: 202 len: 0 microversion: 2.1 time: 0.140713 Aug 30 05:29:06.490424 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3743/7546] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:29:06 2022] POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:29:06.499400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:06.500100 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:06.507137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:06.507625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:06.508060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:06.508750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:06.509204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:06.509659 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:06.655088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:06.663647 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1b28bd45-995d-43c3-a7ed-0a549b77983e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1689 microversion: 2.1 time: 0.168751 Aug 30 05:29:06.664226 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3804/7547] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:06 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:07.685275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:07.685932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:07.692103 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:07.692649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:07.693179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:07.694044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:07.694588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:07.695081 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:07.828911 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:07.837223 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dae3674c-fb37-410e-848d-ba02c3343992 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1689 microversion: 2.1 time: 0.157028 Aug 30 05:29:07.837836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3744/7548] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:07 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:08.858857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:08.859478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:08.866468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:08.866977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:08.867409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:08.868110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:08.868591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:08.869011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:08.998515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:09.006840 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b2210c11-479b-4813-8444-e3bb08a18a33 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.151968 Aug 30 05:29:09.007409 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3805/7549] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:08 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:10.029951 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:10.030530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:10.037836 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:10.038332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:10.038782 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:10.039475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:10.039939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:10.040379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:10.173958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:10.181743 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-785200cb-09e9-498f-85fc-5fbe8dc36c5c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.155791 Aug 30 05:29:10.182693 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3745/7550] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:10 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:11.203527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:11.204089 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:11.211110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:11.211598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:11.212039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:11.212731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:11.213193 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:11.213658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:11.342161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:11.350370 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d6c25cf6-6971-46b7-8005-b88b5f147470 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.150864 Aug 30 05:29:11.350945 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3806/7551] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:11 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:12.372133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:12.372759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:12.379900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:12.380391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:12.380841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:12.381564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:12.382034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:12.382472 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:12.515286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:12.523896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-14163c6f-ea9d-4e16-8ee7-29e55fedd6cc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.155645 Aug 30 05:29:12.524475 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3746/7552] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:12 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:13.545336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:13.545961 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:13.553656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:13.554145 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:13.554582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:13.555276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:13.555727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:13.556153 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:13.701652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:13.709477 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cd9301fe-e8a8-4c7c-a371-ca53fc1cbf22 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.168035 Aug 30 05:29:13.710159 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3807/7553] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:13 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:14.731666 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:14.732192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:14.739876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:14.740370 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:14.740820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:14.741551 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:14.742019 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:14.742459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:14.881505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:14.889605 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-dc6655d5-b1d2-433a-8d29-5c6f115e5e6a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.162108 Aug 30 05:29:14.890194 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3747/7554] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:14 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:15.911395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:15.912006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:15.918830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:15.919306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:15.919744 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:15.920429 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:15.920909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:15.921351 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:16.054517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:16.062186 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8b71f10f-e20a-44f0-b881-df07a4389e04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.155179 Aug 30 05:29:16.062760 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3808/7555] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:15 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:17.083140 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:17.083798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:17.090821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:17.091318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:17.091774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:17.092705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:17.092973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:17.093459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:17.223496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:17.231479 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2efd70f2-e352-49fe-8f66-db709da74eb1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.152265 Aug 30 05:29:17.232058 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3748/7556] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:17 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:29:18.254162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:18.254775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:18.261711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:18.262192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:18.262627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:18.263312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:18.263765 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:18.264194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:18.400558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:18.408506 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c603d9e5-3a16-4a1e-9ddc-64a7b7d6baa9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.158785 Aug 30 05:29:18.409101 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3809/7557] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:18 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:19.429848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:19.430471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:19.437315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:19.437841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:19.438287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:19.438984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:19.439447 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:19.439885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:19.572611 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:19.580349 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a97648e0-930c-4bfe-80ba-79ff690f288f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.154412 Aug 30 05:29:19.580939 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3749/7558] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:19 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:20.602360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:20.602992 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:20.610670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:20.611149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:20.611582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:20.612265 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:20.612713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:20.613133 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:20.746583 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:20.754447 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d5d75f24-2a8c-426a-bdd4-88a82b694b75 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1694 microversion: 2.1 time: 0.156007 Aug 30 05:29:20.755222 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3810/7559] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:20 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:21.318257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-ab57515f-11e1-40eb-a37a-658962a00aca req-ecb8e5fb-ac32-480a-be07-7c316a32e784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "name": "network-vif-unplugged", "status": "completed", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:29:21.328824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ab57515f-11e1-40eb-a37a-658962a00aca req-ecb8e5fb-ac32-480a-be07-7c316a32e784 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:21.329353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ab57515f-11e1-40eb-a37a-658962a00aca req-ecb8e5fb-ac32-480a-be07-7c316a32e784 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:21.329792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-ab57515f-11e1-40eb-a37a-658962a00aca req-ecb8e5fb-ac32-480a-be07-7c316a32e784 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:21.343329 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-ab57515f-11e1-40eb-a37a-658962a00aca req-ecb8e5fb-ac32-480a-be07-7c316a32e784 service nova] Creating event network-vif-unplugged:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h1-854925-5 Aug 30 05:29:21.350842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [req-ab57515f-11e1-40eb-a37a-658962a00aca req-ecb8e5fb-ac32-480a-be07-7c316a32e784 service nova] Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122402) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:29:21.364014 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-ab57515f-11e1-40eb-a37a-658962a00aca req-ecb8e5fb-ac32-480a-be07-7c316a32e784 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050344 Aug 30 05:29:21.364635 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3750/7560] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:29:21.775755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:21.776363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:21.783573 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:21.784059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:21.785013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:21.785754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:21.786213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:21.786646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:21.923118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:21.931589 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10054b0e-43d3-4135-b30c-2ca7ae61a1de tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1693 microversion: 2.1 time: 0.159789 Aug 30 05:29:21.932169 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3811/7561] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:21 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:22.954591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:22.955332 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:22.961567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:22.962067 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:22.962556 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:22.963260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:22.963734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:22.964177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:23.095410 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:23.103073 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc7a4722-5b1a-460e-9510-0899661d32ea tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1691 microversion: 2.1 time: 0.153650 Aug 30 05:29:23.103650 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3751/7562] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:22 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:23.405897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-ff4561f3-f39b-4af1-b3a3-321397f4cb09 req-9d75bcbb-d4f0-4f8b-ab32-0c1e142840fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:29:23.415927 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ff4561f3-f39b-4af1-b3a3-321397f4cb09 req-9d75bcbb-d4f0-4f8b-ab32-0c1e142840fd service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:23.416404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ff4561f3-f39b-4af1-b3a3-321397f4cb09 req-9d75bcbb-d4f0-4f8b-ab32-0c1e142840fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:23.416836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-ff4561f3-f39b-4af1-b3a3-321397f4cb09 req-9d75bcbb-d4f0-4f8b-ab32-0c1e142840fd service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:23.428418 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-ff4561f3-f39b-4af1-b3a3-321397f4cb09 req-9d75bcbb-d4f0-4f8b-ab32-0c1e142840fd service nova] Creating event network-changed:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h1-854925-5 Aug 30 05:29:23.433796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [req-ff4561f3-f39b-4af1-b3a3-321397f4cb09 req-9d75bcbb-d4f0-4f8b-ab32-0c1e142840fd service nova] Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-854925-5', 'n-h2-854925-5'} {{(pid=122403) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5936}} Aug 30 05:29:23.446290 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-ff4561f3-f39b-4af1-b3a3-321397f4cb09 req-9d75bcbb-d4f0-4f8b-ab32-0c1e142840fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043986 Aug 30 05:29:23.446869 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3812/7563] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:29:24.125180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:24.125842 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:24.132724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:24.133223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:24.133714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:24.134423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:24.134893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:24.135338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:24.269116 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:24.276820 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-099c3d67-71b4-48eb-8875-642fc9bb29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1691 microversion: 2.1 time: 0.155554 Aug 30 05:29:24.277439 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3752/7564] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:24 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:25.300127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:25.300829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:25.307018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:25.307497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:25.307931 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:25.308615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:25.309068 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:25.309520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:25.442282 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:25.450496 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aa2fc37e-3d54-4982-81a1-4795a56ad03a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1691 microversion: 2.1 time: 0.155769 Aug 30 05:29:25.451071 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3813/7565] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:25 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:26.472584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:26.473213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:26.480387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.480880 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.481343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:26.482044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.482508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.482947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:26.615751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:26.623509 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0bd1b413-784f-48c5-b2d5-e6603c4b29ed tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1688 microversion: 2.1 time: 0.155431 Aug 30 05:29:26.624094 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3753/7566] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:26 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:26.645125 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:29:26.645717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:26.652467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.652953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.653418 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:26.654115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.654569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.655000 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:26.713683 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b4b0c840-dd97-4a90-9e74-00af15d65a04 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action" status: 204 len: 0 microversion: 2.1 time: 0.072763 Aug 30 05:29:26.714635 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3814/7567] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:29:26 2022] POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:29:26.723389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:26.724126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:26.730563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.731087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.731534 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:26.732229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.732698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.733137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:26.874832 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:26.882658 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f1164f32-81b0-4bd4-92f8-54566a254dbe tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1688 microversion: 2.1 time: 0.163793 Aug 30 05:29:26.883244 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3754/7568] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:26 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:26.904008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:26.904856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:26.912043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.912601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.913143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:26.913937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:26.914460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:26.914912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:27.052174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:27.059952 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0b984798-9b36-4d08-9c2c-00b49fda0c05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1688 microversion: 2.1 time: 0.160436 Aug 30 05:29:27.060527 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3815/7569] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:26 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:28.082513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:29:28.083155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:28.090279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:28.090847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:28.091367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:28.092139 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:28.092691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:28.093197 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:28.226908 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:29:28.235010 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9bbdfe25-60e8-4de8-b958-4e326ee567c4 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1680 microversion: 2.1 time: 0.157101 Aug 30 05:29:28.235590 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3755/7570] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:29:28 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:29:30.227492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-98b86299-aa79-4747-8013-711217f1fe50 req-abc7dec4-f57e-4ffd-9ffe-bf67c96211a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "name": "network-vif-plugged", "status": "completed", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:29:30.233899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=27 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:30.241748 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98b86299-aa79-4747-8013-711217f1fe50 req-abc7dec4-f57e-4ffd-9ffe-bf67c96211a2 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:30.242236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98b86299-aa79-4747-8013-711217f1fe50 req-abc7dec4-f57e-4ffd-9ffe-bf67c96211a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:30.242704 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-98b86299-aa79-4747-8013-711217f1fe50 req-abc7dec4-f57e-4ffd-9ffe-bf67c96211a2 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:30.246799 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:30.255027 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-98b86299-aa79-4747-8013-711217f1fe50 req-abc7dec4-f57e-4ffd-9ffe-bf67c96211a2 service nova] Creating event network-vif-plugged:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h1-854925-5 Aug 30 05:29:30.260156 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-98b86299-aa79-4747-8013-711217f1fe50 req-abc7dec4-f57e-4ffd-9ffe-bf67c96211a2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036345 Aug 30 05:29:30.260955 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3816/7571] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:29:58.451874 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=30 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:58.452637 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:29:58.500771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:29:58.503077 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:29:58.509649 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:58.510149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:58.510607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:58.511309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:29:58.511780 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:29:58.512269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:29:58.584663 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4c6f0c2d-d291-4df6-82dd-406fc8fe655d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action" status: 200 len: 24576 microversion: 2.1 time: 0.137725 Aug 30 05:29:58.585296 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3756/7572] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:29:58 2022] POST /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135/action => generated 24576 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:30:15.847397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:15.848028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:15.852768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:15.853974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:15.854431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:15.860964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:15.861775 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:15.862242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:15.862947 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:15.863397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:15.863826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:15.892056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:30:15.916031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-578e08cf-f626-4a98-89eb-e9dd8d200620 req-75f8803f-cbf2-4d39-94c5-cf710ffe0e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:30:15.927950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-578e08cf-f626-4a98-89eb-e9dd8d200620 req-75f8803f-cbf2-4d39-94c5-cf710ffe0e7b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:15.928454 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-578e08cf-f626-4a98-89eb-e9dd8d200620 req-75f8803f-cbf2-4d39-94c5-cf710ffe0e7b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:15.929110 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-578e08cf-f626-4a98-89eb-e9dd8d200620 req-75f8803f-cbf2-4d39-94c5-cf710ffe0e7b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:15.940546 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-578e08cf-f626-4a98-89eb-e9dd8d200620 req-75f8803f-cbf2-4d39-94c5-cf710ffe0e7b service nova] Creating event network-changed:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h1-854925-5 Aug 30 05:30:15.946817 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-578e08cf-f626-4a98-89eb-e9dd8d200620 req-75f8803f-cbf2-4d39-94c5-cf710ffe0e7b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100438 Aug 30 05:30:15.947654 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3757/7573] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:30:15.982669 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ebf5b3a8-fa0f-4cff-8b6e-070d880d824f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 204 len: 0 microversion: 2.1 time: 0.139295 Aug 30 05:30:15.986572 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3817/7574] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:30:15 2022] DELETE /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:30:15.993201 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:15.994194 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:16.010993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:16.011514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:16.011975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:16.012701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:16.013371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:16.013684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:16.149629 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:16.157771 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-7e32e515-d4db-41a4-80ab-ac9f3e7aa2fb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1686 microversion: 2.1 time: 0.169462 Aug 30 05:30:16.158366 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3758/7575] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:15 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:17.180745 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:17.181499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:17.188360 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:17.188850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:17.189293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:17.190025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:17.190487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:17.190919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:17.321454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:17.329269 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-46287ae9-cfea-44b2-a497-b69b4de1272a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1686 microversion: 2.1 time: 0.152875 Aug 30 05:30:17.329875 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3818/7576] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:17 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:18.004507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-7e385713-5da9-40cf-871c-3a81761c6ab8 req-4cd3c556-71bd-4b62-90c6-b62e7d533ec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a1e658a-5e92-41cb-b84e-9a5d74f0c135", "name": "network-vif-deleted", "tag": "5421f806-7b31-484c-96fc-7f619c7445aa"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:30:18.016797 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e385713-5da9-40cf-871c-3a81761c6ab8 req-4cd3c556-71bd-4b62-90c6-b62e7d533ec7 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:18.017202 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e385713-5da9-40cf-871c-3a81761c6ab8 req-4cd3c556-71bd-4b62-90c6-b62e7d533ec7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:18.018208 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-7e385713-5da9-40cf-871c-3a81761c6ab8 req-4cd3c556-71bd-4b62-90c6-b62e7d533ec7 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:18.030328 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-7e385713-5da9-40cf-871c-3a81761c6ab8 req-4cd3c556-71bd-4b62-90c6-b62e7d533ec7 service nova] Creating event network-vif-deleted:5421f806-7b31-484c-96fc-7f619c7445aa for instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 on n-h1-854925-5 Aug 30 05:30:18.036624 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-7e385713-5da9-40cf-871c-3a81761c6ab8 req-4cd3c556-71bd-4b62-90c6-b62e7d533ec7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035962 Aug 30 05:30:18.037228 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3759/7577] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:30:18.351878 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:18.352478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:18.359758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:18.360253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:18.360693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:18.361476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:18.361932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:18.362359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:18.396588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:18.397543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:18.397991 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:18.398452 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lazy-loading 'fault' on Instance uuid 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:30:18.442372 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:18.450223 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d360bc2b-ace2-4df5-9566-41f117ede3ce tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 200 len: 1355 microversion: 2.1 time: 0.102926 Aug 30 05:30:18.450797 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3819/7578] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:18 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 1355 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:19.472385 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:19.473631 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 1a1e658a-5e92-41cb-b84e-9a5d74f0c135] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:19.480897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:19.481418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:19.481871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:19.482574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:19.483037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:19.483475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:19.497209 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] HTTP exception thrown: Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 could not be found. Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Request method failure captured: Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 HTTP/1.1 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZ8XqLQ2XnoeLjy3gfQj35dox1YH5CBG0bCtLjf05-B1Yo93BI9vDY7yzjeehMPCotYvvaOKI4M1IPZee0eGfYCHUS3YgdukVXskYw9qnuVtaL_TUTTKpS8IYCqhmuj_Jpnpp35NyDw9HzoPbnHxREMCcpVWa6OG2_sQOOmlx07o8eg Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49b721c6a545492eac1cee9db1e66f8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}] Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 5e62a83482494bfda64a3cd4d5a017c8 Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 could not be found. Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '1a1e658a-5e92-41cb-b84e-9a5d74f0c135'} Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 could not be found. Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 could not be found. Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:30:19.498861 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 could not be found. Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Returning 404 to user: Instance 1a1e658a-5e92-41cb-b84e-9a5d74f0c135 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a3a71ab0-faab-4fe1-9527-5b0cdc018210 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135" status: 404 len: 111 microversion: 2.1 time: 0.032154 Aug 30 05:30:19.503784 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3760/7579] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:19 2022] GET /compute/v2.1/servers/1a1e658a-5e92-41cb-b84e-9a5d74f0c135 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:30:23.097513 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1645ea51-da08-4c48-982c-23a4859f287e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '.version_select at 0x7fe9690fbf70>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:23.118834 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1645ea51-da08-4c48-982c-23a4859f287e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-734036827" status: 202 len: 0 microversion: 2.1 time: 0.026788 Aug 30 05:30:23.119698 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3820/7580] 10.222.0.27 () {58 vars in 1281 bytes} [Tue Aug 30 05:30:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-734036827 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:30:23.143617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-183da057-8f49-4357-b67c-6904c6a67180 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: .version_select at 0x7fe96927fe50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1306591369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYBoLu0V8KfQE2zbJYbrl73spONCqfa720pfPmjYKDFdP0o5B56cYE8VJCOKWw4kSTh/fK5fpfDCSV+aJHmuHaL3lOwm8XLcVSB79k4j8z4VeOr9Qd7YgTPOfhU0Ab2KA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:30:23.161298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-183da057-8f49-4357-b67c-6904c6a67180 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:30:23.166505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-183da057-8f49-4357-b67c-6904c6a67180 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:30:23.190522 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-183da057-8f49-4357-b67c-6904c6a67180 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050873 Aug 30 05:30:23.191141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3761/7581] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:30:23 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:30:28.573717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-868195545", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "214a862d-aa01-4b0d-8a37-7cfc4c9b6cd0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1306591369", "security_groups": [{"name": "tempest-secgroup-smoke-284906302"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:30:28.600352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:28.717395 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] validate_networks() for [('214a862d-aa01-4b0d-8a37-7cfc4c9b6cd0', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:30:29.200953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:30:29.201988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:30:29.203084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:30:29.203661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:30:29.204252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:30:29.217428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:29.218174 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:29.219056 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:29.220027 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:29.220734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:29.221394 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:29.245499 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:30:29.253501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:30:29.276140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:30:29.279016 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:30:29.340835 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e5e17bbd-6d24-42e7-8e8b-76243d4d476f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.772825 Aug 30 05:30:29.342182 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3821/7582] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:30:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:30:29.353886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bfd49060-83b3-4e8a-81f8-0bec3ad17fc1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:29.355153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bfd49060-83b3-4e8a-81f8-0bec3ad17fc1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:29.422309 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bfd49060-83b3-4e8a-81f8-0bec3ad17fc1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:29.432374 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bfd49060-83b3-4e8a-81f8-0bec3ad17fc1 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1266 microversion: 2.1 time: 0.083562 Aug 30 05:30:29.445852 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3762/7583] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:29 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:30.455453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:30.456182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:30.478836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:30.479338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:30.480015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:30.481155 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:30.482141 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:30.482589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:30.565116 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:30.575184 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c4a8750b-44e2-4a9c-a782-ae354b98c03c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1326 microversion: 2.1 time: 0.124078 Aug 30 05:30:30.581244 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3822/7584] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:30 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:31.600945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:31.608347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:31.611960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:31.618237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:31.618774 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:31.619237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:31.619952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:31.620434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:31.620882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:31.763876 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:31.772415 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-235f35b4-e0b7-4150-88b1-5f2d21baf60c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1391 microversion: 2.1 time: 0.176539 Aug 30 05:30:31.772998 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3763/7585] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:31 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1391 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:32.036821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-7b91a00b-1e32-464b-995a-2e84b5b23865 req-eabb787d-7220-4757-868f-bb08299da9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f929175f-b2ec-448e-aa33-670a79baaa20", "tag": "95605deb-e5fb-4324-b304-737ac559eed7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:30:32.047594 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7b91a00b-1e32-464b-995a-2e84b5b23865 req-eabb787d-7220-4757-868f-bb08299da9d1 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:32.048075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7b91a00b-1e32-464b-995a-2e84b5b23865 req-eabb787d-7220-4757-868f-bb08299da9d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:32.048712 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-7b91a00b-1e32-464b-995a-2e84b5b23865 req-eabb787d-7220-4757-868f-bb08299da9d1 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:32.063373 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-7b91a00b-1e32-464b-995a-2e84b5b23865 req-eabb787d-7220-4757-868f-bb08299da9d1 service nova] Creating event network-changed:95605deb-e5fb-4324-b304-737ac559eed7 for instance f929175f-b2ec-448e-aa33-670a79baaa20 on n-h2-854925-5 Aug 30 05:30:32.068989 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-7b91a00b-1e32-464b-995a-2e84b5b23865 req-eabb787d-7220-4757-868f-bb08299da9d1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036623 Aug 30 05:30:32.069793 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3823/7586] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:30:32.792792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:32.793455 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:32.800322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:32.801680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:32.802147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:32.802851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:32.803325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:32.803770 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:32.933367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:32.941210 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a071028c-94dd-44e6-bda5-6100e709d0cf tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1391 microversion: 2.1 time: 0.152355 Aug 30 05:30:32.941817 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3764/7587] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:32 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:33.963256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:33.963990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:33.970786 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:33.971309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:33.972336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:33.973968 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:33.974636 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:33.975076 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:34.112196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:34.120049 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-219e183a-1d3f-452d-981b-36ea156a0bcc tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1391 microversion: 2.1 time: 0.161859 Aug 30 05:30:34.120644 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3824/7588] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:33 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:35.140383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:35.141015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:35.147250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:35.147748 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:35.148203 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:35.148900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:35.149391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:35.149841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:35.281977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:35.290163 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-aaa1e243-2b20-4c81-a69f-6f4381f3f98c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1391 microversion: 2.1 time: 0.153869 Aug 30 05:30:35.290744 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3765/7589] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:35 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:36.311782 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:36.312379 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:36.318911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:36.319398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:36.319836 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:36.320527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:36.320979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:36.321445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:36.450201 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:36.458430 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-64aeed14-9046-411f-9edd-7ea1914d0b67 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1391 microversion: 2.1 time: 0.150844 Aug 30 05:30:36.459043 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3825/7590] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:36 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:37.479198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:37.480029 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:37.487218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:37.487715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:37.488174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:37.489112 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:37.489690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:37.490319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:37.630547 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:37.640500 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d867b4df-2805-4e11-91a6-45cdbac52a1a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1391 microversion: 2.1 time: 0.165217 Aug 30 05:30:37.641239 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3766/7591] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:37 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:37.693126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-672f916c-5dd2-4d78-ba17-3f7a09874fc0 req-4eb6b196-fe78-451c-bf19-0a0943899a37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f929175f-b2ec-448e-aa33-670a79baaa20", "name": "network-vif-plugged", "status": "completed", "tag": "95605deb-e5fb-4324-b304-737ac559eed7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:30:37.703081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-672f916c-5dd2-4d78-ba17-3f7a09874fc0 req-4eb6b196-fe78-451c-bf19-0a0943899a37 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:37.703580 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-672f916c-5dd2-4d78-ba17-3f7a09874fc0 req-4eb6b196-fe78-451c-bf19-0a0943899a37 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:37.704013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-672f916c-5dd2-4d78-ba17-3f7a09874fc0 req-4eb6b196-fe78-451c-bf19-0a0943899a37 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:37.714803 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-672f916c-5dd2-4d78-ba17-3f7a09874fc0 req-4eb6b196-fe78-451c-bf19-0a0943899a37 service nova] Creating event network-vif-plugged:95605deb-e5fb-4324-b304-737ac559eed7 for instance f929175f-b2ec-448e-aa33-670a79baaa20 on n-h2-854925-5 Aug 30 05:30:37.719648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-672f916c-5dd2-4d78-ba17-3f7a09874fc0 req-4eb6b196-fe78-451c-bf19-0a0943899a37 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092117 Aug 30 05:30:37.720309 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3826/7592] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:30:38.662473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:38.663142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:38.670151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:38.670656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:38.671118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:38.671831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:38.672310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:38.672768 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:38.804659 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:38.813461 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c459b7d8-4dbf-4292-9fd5-8ecb64df1186 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1391 microversion: 2.1 time: 0.154390 Aug 30 05:30:38.814092 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3767/7593] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:38 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:39.832808 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:39.833607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:39.837678 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:39.838422 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:39.845731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:39.846291 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:39.846666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:39.847562 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:39.848025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:39.848964 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:39.991897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:40.002449 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6578dcaf-4cb1-4db4-be75-ea2855644332 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1564 microversion: 2.1 time: 0.171401 Aug 30 05:30:40.003041 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3827/7594] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:39 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1564 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:40.022929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:40.023567 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:40.025505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:30:40.032100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:40.032594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:40.033047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:40.033769 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:40.034242 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:40.034680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:40.164538 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:40.172391 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc17e020-3b64-4e4a-b810-398a74ea1641 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1564 microversion: 2.1 time: 0.153801 Aug 30 05:30:40.172980 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3768/7595] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:40 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:30:41.751422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-61b4fb49-5b10-44c9-b567-3a9a2417ba75 req-2c60fcc7-f6f1-4df4-b316-1c9e13f44a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f929175f-b2ec-448e-aa33-670a79baaa20", "tag": "95605deb-e5fb-4324-b304-737ac559eed7"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:30:41.753277 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:30:41.753935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:30:41.761814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:41.762316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:41.762760 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:41.763465 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:41.763807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-61b4fb49-5b10-44c9-b567-3a9a2417ba75 req-2c60fcc7-f6f1-4df4-b316-1c9e13f44a43 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:30:41.763937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:41.764299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-61b4fb49-5b10-44c9-b567-3a9a2417ba75 req-2c60fcc7-f6f1-4df4-b316-1c9e13f44a43 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:30:41.764408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:41.764743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-61b4fb49-5b10-44c9-b567-3a9a2417ba75 req-2c60fcc7-f6f1-4df4-b316-1c9e13f44a43 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:30:41.776315 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-61b4fb49-5b10-44c9-b567-3a9a2417ba75 req-2c60fcc7-f6f1-4df4-b316-1c9e13f44a43 service nova] Creating event network-changed:95605deb-e5fb-4324-b304-737ac559eed7 for instance f929175f-b2ec-448e-aa33-670a79baaa20 on n-h2-854925-5 Aug 30 05:30:41.781730 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-61b4fb49-5b10-44c9-b567-3a9a2417ba75 req-2c60fcc7-f6f1-4df4-b316-1c9e13f44a43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035502 Aug 30 05:30:41.782681 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3769/7596] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:30:41.918540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:30:41.928313 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b9977ce-2451-40d0-a154-18c9b4c7379f tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1564 microversion: 2.1 time: 0.183967 Aug 30 05:30:41.929368 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3828/7597] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:30:41 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1564 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:03.170066 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:03.170747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=38 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:03.175193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:31:03.177507 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:03.185576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:03.186092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:03.186540 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:03.187237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:03.187699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:03.188135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:03.243753 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c012a213-e05c-40b9-bf72-77fdb59bf818 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action" status: 200 len: 24569 microversion: 2.1 time: 0.076238 Aug 30 05:31:03.244404 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3770/7598] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:31:03 2022] POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action => generated 24569 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:31:14.212838 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0e209c6b-0a49-48f0-b754-e76d66282e64 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:31:14.215004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:14.215698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=36 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:14.221707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e209c6b-0a49-48f0-b754-e76d66282e64 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:14.222703 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e209c6b-0a49-48f0-b754-e76d66282e64 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:14.223163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0e209c6b-0a49-48f0-b754-e76d66282e64 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:14.247689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0e209c6b-0a49-48f0-b754-e76d66282e64 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Going to try to stop instance {{(pid=122403) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 05:31:14.287621 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0e209c6b-0a49-48f0-b754-e76d66282e64 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action" status: 202 len: 0 microversion: 2.1 time: 0.078975 Aug 30 05:31:14.288273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3829/7599] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:31:14 2022] POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:31:14.297903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:14.298628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:14.301759 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:14.302505 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:14.313174 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:14.313718 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:14.314169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:14.314892 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:14.315360 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:14.315805 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:14.451906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:14.459836 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-66cbd961-6d32-4023-9cdb-53fe94da1c8c tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.166930 Aug 30 05:31:14.460411 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3771/7600] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:14 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:15.483932 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:15.484666 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:15.491568 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:15.492052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:15.492492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:15.493181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:15.493667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:15.494098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:15.631638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:15.639810 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01974740-a01b-4b3a-886e-62fd607f19df tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.161270 Aug 30 05:31:15.640387 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3830/7601] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:15 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:16.660913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:16.661564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:16.668333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:16.668824 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:16.669271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:16.669988 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:16.670465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:16.670895 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:16.804050 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:16.811728 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c764dc09-c41e-47da-a82e-2d15c249ba1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.154800 Aug 30 05:31:16.812328 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3772/7602] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:16 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:17.834029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:17.834643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:17.841427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:17.841912 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:17.842347 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:17.843030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:17.843481 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:17.843906 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:17.975426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:17.983524 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7694e699-8903-4e04-b9cd-1f46f8cbdbb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.153993 Aug 30 05:31:17.984102 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3831/7603] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:17 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:19.005580 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:19.006211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:19.012978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:19.013509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:19.013970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:19.014692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:19.015157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:19.015623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:19.146919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:19.154670 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c7c08db2-0470-4d6e-8e9d-b29eb7338556 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.153878 Aug 30 05:31:19.155250 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3773/7604] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:18 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:20.176407 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:20.176952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:20.183950 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:20.184440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:20.184876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:20.185587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:20.186040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:20.186467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:20.322075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:20.329737 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1c9328cb-d57c-4909-b5cb-9ed4cff58882 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.157892 Aug 30 05:31:20.330311 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3832/7605] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:20 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:21.351806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:21.352333 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:21.359664 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:21.360172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:21.360622 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:21.361355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:21.361813 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:21.362257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:21.494040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:21.501837 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b97f3bd5-9b54-4b48-9146-f1f0da2c1167 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.154694 Aug 30 05:31:21.502423 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3774/7606] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:21 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:22.524203 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:22.524831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:22.531751 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:22.532233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:22.532669 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:22.533369 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:22.533824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:22.534248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:22.661538 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:22.669197 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2f8a66a4-d42f-4b95-9e48-2a95c516da1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.149645 Aug 30 05:31:22.669796 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3833/7607] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:22 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:23.690489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:23.691118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:23.698123 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:23.698618 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:23.699068 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:23.699764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:23.700236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:23.700733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:23.833296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:23.841033 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3b424774-1b7c-478d-a029-5a6a33444a95 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.154453 Aug 30 05:31:23.841624 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3775/7608] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:23 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:24.863569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:24.864195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:24.871312 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:24.871807 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:24.872252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:24.872944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:24.873445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:24.873879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:25.003180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:25.011700 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-10d75390-c4c0-4814-9fe0-996becd47a40 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.152032 Aug 30 05:31:25.012273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3834/7609] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:24 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:26.033003 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:26.033657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:26.041214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:26.041742 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:26.042198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:26.042902 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:26.043374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:26.043821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:26.172352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:26.180111 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-55677a57-c00e-4132-936a-156f0c2fb900 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.151042 Aug 30 05:31:26.180694 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3776/7610] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:26 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:27.201627 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:27.202189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:27.208977 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:27.209495 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:27.209938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:27.210625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:27.211084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:27.211512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:27.345028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:27.354658 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94cef95f-522b-4af6-b2fe-014dc010836a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.156218 Aug 30 05:31:27.355022 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3835/7611] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:27 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:28.374753 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:28.375381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:28.382757 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:28.383252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:28.383707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:28.384407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:28.384870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:28.385310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:28.513702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:28.521498 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-58ca2b88-8fc6-41be-afc8-d6e8acb6d750 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.150643 Aug 30 05:31:28.522071 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3777/7612] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:28 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:29.543431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:29.544301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:29.552251 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:29.552773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:29.553221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:29.553980 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:29.554438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:29.554869 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:29.693660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:29.701473 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-752b837b-d716-449a-a82e-fcf405230cca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1693 microversion: 2.1 time: 0.162103 Aug 30 05:31:29.702062 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3836/7613] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:29 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:30.723952 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:30.724589 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:30.732169 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:30.732674 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:30.733137 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:30.733918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:30.734466 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:30.734917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:30.870005 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:30.878129 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5d65f2cf-333a-4343-bb27-5d8e4bfd3658 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1670 microversion: 2.1 time: 0.158595 Aug 30 05:31:30.878959 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3778/7614] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:30 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1670 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:31.975053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:31:31.977364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:31.984487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:31.984978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:31.985458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:31.986152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:31.986612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:31.987047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:32.037698 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bc4fc685-e167-40e3-a813-88c60fa7d267 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action" status: 200 len: 38388 microversion: 2.1 time: 0.066510 Aug 30 05:31:32.038352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3837/7615] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:31:31 2022] POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action => generated 38388 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:31:32.050368 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8818fa5-50f8-4f5a-9808-dfd1cf0ec9f6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:31:32.057783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8818fa5-50f8-4f5a-9808-dfd1cf0ec9f6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:32.058308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8818fa5-50f8-4f5a-9808-dfd1cf0ec9f6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:32.058767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8818fa5-50f8-4f5a-9808-dfd1cf0ec9f6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:32.081062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a8818fa5-50f8-4f5a-9808-dfd1cf0ec9f6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Going to try to start instance {{(pid=122402) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 05:31:32.123673 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8818fa5-50f8-4f5a-9808-dfd1cf0ec9f6 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action" status: 202 len: 0 microversion: 2.1 time: 0.077038 Aug 30 05:31:32.124273 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3779/7616] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:31:32 2022] POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:31:32.133683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:32.134436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:32.142638 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:32.143143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:32.143618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:32.144393 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:32.144858 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:32.145289 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:32.282220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:32.290651 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c3c1deb8-6d55-40c8-9f95-5f20e127bba9 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1679 microversion: 2.1 time: 0.161392 Aug 30 05:31:32.291426 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3838/7617] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:32 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:33.312736 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:31:33.313388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:33.320392 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:33.320889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:33.321353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:33.322060 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:33.322528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:33.322968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:33.453561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:31:33.461909 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8199283d-4e72-4d51-b1ce-43991e8cd563 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1683 microversion: 2.1 time: 0.153577 Aug 30 05:31:33.462486 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3780/7618] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:31:33 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:31:57.655543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:31:57.657826 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:31:57.660476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=20 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:57.661143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:31:57.666917 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:57.667408 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:57.667851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:57.668546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:31:57.669004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:31:57.669467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:31:57.726239 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7d9fc4e4-1dac-456a-96be-3c81994917f0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action" status: 200 len: 62941 microversion: 2.1 time: 0.074648 Aug 30 05:31:57.726886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3839/7619] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:31:57 2022] POST /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20/action => generated 62941 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:32:05.298638 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:05.299200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:05.301409 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=20 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:05.302086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:05.308373 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:05.308887 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:05.309013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-aaaaf707-beca-4bb2-9879-464dc220ae96 req-78183997-abce-4d3f-8caf-2de00f4bb426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f929175f-b2ec-448e-aa33-670a79baaa20", "tag": "95605deb-e5fb-4324-b304-737ac559eed7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:32:05.309586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:05.310236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:05.310711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:05.311288 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:05.320847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-aaaaf707-beca-4bb2-9879-464dc220ae96 req-78183997-abce-4d3f-8caf-2de00f4bb426 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:05.321630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-aaaaf707-beca-4bb2-9879-464dc220ae96 req-78183997-abce-4d3f-8caf-2de00f4bb426 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:05.322070 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-aaaaf707-beca-4bb2-9879-464dc220ae96 req-78183997-abce-4d3f-8caf-2de00f4bb426 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:05.336640 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-aaaaf707-beca-4bb2-9879-464dc220ae96 req-78183997-abce-4d3f-8caf-2de00f4bb426 service nova] Creating event network-changed:95605deb-e5fb-4324-b304-737ac559eed7 for instance f929175f-b2ec-448e-aa33-670a79baaa20 on n-h2-854925-5 Aug 30 05:32:05.342581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:32:05.343092 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-aaaaf707-beca-4bb2-9879-464dc220ae96 req-78183997-abce-4d3f-8caf-2de00f4bb426 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038054 Aug 30 05:32:05.343788 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3840/7620] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:32:05.431399 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d4ae210d-cb1b-4585-bb67-b90373288927 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 204 len: 0 microversion: 2.1 time: 0.136736 Aug 30 05:32:05.432188 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3781/7621] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:32:05 2022] DELETE /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:32:05.440743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:05.441846 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:05.449069 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:05.449910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:05.450595 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:05.451707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:05.452378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:05.453041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:05.598697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:05.606824 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-29004a5e-60ff-4d62-90d2-75641b669212 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1689 microversion: 2.1 time: 0.170221 Aug 30 05:32:05.607399 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3841/7622] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:05 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:06.628698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:06.629457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:06.636584 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:06.637086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:06.637574 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:06.638286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:06.638755 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:06.639200 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:06.783205 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:06.791819 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-477153ba-d021-4295-84c1-be4c3809aeeb tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 200 len: 1689 microversion: 2.1 time: 0.167373 Aug 30 05:32:06.792625 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3782/7623] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:06 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:07.351330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-d390dd7a-0554-439c-8318-9f692864b67b req-7bda92c8-90c4-4c0d-8dc0-45314c2c9d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f929175f-b2ec-448e-aa33-670a79baaa20", "name": "network-vif-deleted", "tag": "95605deb-e5fb-4324-b304-737ac559eed7"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:32:07.365163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d390dd7a-0554-439c-8318-9f692864b67b req-7bda92c8-90c4-4c0d-8dc0-45314c2c9d9b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:07.366179 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d390dd7a-0554-439c-8318-9f692864b67b req-7bda92c8-90c4-4c0d-8dc0-45314c2c9d9b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:07.366687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-d390dd7a-0554-439c-8318-9f692864b67b req-7bda92c8-90c4-4c0d-8dc0-45314c2c9d9b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:07.378347 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-d390dd7a-0554-439c-8318-9f692864b67b req-7bda92c8-90c4-4c0d-8dc0-45314c2c9d9b service nova] Creating event network-vif-deleted:95605deb-e5fb-4324-b304-737ac559eed7 for instance f929175f-b2ec-448e-aa33-670a79baaa20 on n-h2-854925-5 Aug 30 05:32:07.384089 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-d390dd7a-0554-439c-8318-9f692864b67b req-7bda92c8-90c4-4c0d-8dc0-45314c2c9d9b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036691 Aug 30 05:32:07.385009 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3842/7624] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:32:07.813839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:07.814473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: f929175f-b2ec-448e-aa33-670a79baaa20] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:07.821853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:07.822357 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:07.822838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:07.823621 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:07.824089 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:07.824530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:07.839027 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] HTTP exception thrown: Instance f929175f-b2ec-448e-aa33-670a79baaa20 could not be found. Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Request method failure captured: Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 HTTP/1.1 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZ8XqLQ2XnoeLjy3gfQj35dox1YH5CBG0bCtLjf05-B1Yo93BI9vDY7yzjeehMPCotYvvaOKI4M1IPZee0eGfYCHUS3YgdukVXskYw9qnuVtaL_TUTTKpS8IYCqhmuj_Jpnpp35NyDw9HzoPbnHxREMCcpVWa6OG2_sQOOmlx07o8eg Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49b721c6a545492eac1cee9db1e66f8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}] Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 5e62a83482494bfda64a3cd4d5a017c8 Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance f929175f-b2ec-448e-aa33-670a79baaa20 could not be found. Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': 'f929175f-b2ec-448e-aa33-670a79baaa20'} Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f929175f-b2ec-448e-aa33-670a79baaa20 could not be found. Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f929175f-b2ec-448e-aa33-670a79baaa20 could not be found. Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:32:07.840743 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f929175f-b2ec-448e-aa33-670a79baaa20 could not be found. Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Returning 404 to user: Instance f929175f-b2ec-448e-aa33-670a79baaa20 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1ed9f5b0-a025-41d5-9df0-6a63c5707241 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20" status: 404 len: 111 microversion: 2.1 time: 0.032365 Aug 30 05:32:07.846689 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3783/7625] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:07 2022] GET /compute/v2.1/servers/f929175f-b2ec-448e-aa33-670a79baaa20 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:32:11.164053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d938701-4fa8-4581-ac50-26ec764d8127 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '.version_select at 0x7fe968fd8a60>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:11.187480 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d938701-4fa8-4581-ac50-26ec764d8127 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1306591369" status: 202 len: 0 microversion: 2.1 time: 0.028614 Aug 30 05:32:11.191977 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3843/7626] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Aug 30 05:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1306591369 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:32:11.225280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-39b269bc-8998-49d3-857d-2242cdc53578 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: .version_select at 0x7fe96a1c1c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1274708121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH960RThPnYIgnfmsd4UZp8AA9V4M5xjB6GvAjRKDso+jLlTop+tH6rQkxuptAKzkY9eNkkr56bC9qx2VssJ4H8cJNOS1Mrg0tTUeo8IcwP9zRnbthJLabqzIFn3Wk4thw=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:32:11.242414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-39b269bc-8998-49d3-857d-2242cdc53578 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:32:11.247494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-39b269bc-8998-49d3-857d-2242cdc53578 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:32:11.272312 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-39b269bc-8998-49d3-857d-2242cdc53578 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050968 Aug 30 05:32:11.272918 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3784/7627] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:32:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:32:16.757350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-265781696", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "networks": [{"uuid": "250d4968-2d4e-466d-8ff9-b9a2c22316a2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1274708121", "security_groups": [{"name": "tempest-secgroup-smoke-1665102185"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:32:17.031189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] validate_networks() for [('250d4968-2d4e-466d-8ff9-b9a2c22316a2', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:32:17.371569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=14 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:17.412948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:32:17.413385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:32:17.413880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:32:17.414287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:32:17.414696 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:32:17.423679 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:17.424156 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:17.424588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:17.425310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:17.425787 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:17.426209 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:17.446442 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:32:17.451630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Getting quotas for user 5e62a83482494bfda64a3cd4d5a017c8 and project 49b721c6a545492eac1cee9db1e66f8a. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:32:17.464530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:32:17.467046 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:32:17.514468 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3577f1ee-b79a-4db4-b1f5-cfa466ad4cae tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.761741 Aug 30 05:32:17.515402 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3844/7628] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:32:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:32:17.528281 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-05c33b83-ad23-4267-ac44-80a5706fa142 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:17.529528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-05c33b83-ad23-4267-ac44-80a5706fa142 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:17.641577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-05c33b83-ad23-4267-ac44-80a5706fa142 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:17.649252 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-05c33b83-ad23-4267-ac44-80a5706fa142 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1266 microversion: 2.1 time: 0.125963 Aug 30 05:32:17.662264 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3785/7629] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:17 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:18.671336 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:18.672664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:18.694491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:18.695374 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:18.696043 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:18.697017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:18.697733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:18.698609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:18.809837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:18.819951 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a836e1cf-9466-4ca3-82b7-384ed58e9372 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1326 microversion: 2.1 time: 0.152467 Aug 30 05:32:18.828607 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3845/7630] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:18 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1326 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:19.843251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:19.843721 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:19.847322 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:19.854487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:19.855087 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:19.855606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:19.856388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:19.856959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:19.857528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:20.064025 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:20.072545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eebb9b08-1537-4a0c-9ca2-944865ebccca tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.234069 Aug 30 05:32:20.073268 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3786/7631] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:19 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:20.286942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-493315bf-c9d7-48a3-8f41-1e2bd90d1543 req-f6fe4f35-57e2-49fd-ae28-55f9833200d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb", "tag": "e5c79f84-a9ca-436c-9351-cb9503b75d72"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:32:20.298507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-493315bf-c9d7-48a3-8f41-1e2bd90d1543 req-f6fe4f35-57e2-49fd-ae28-55f9833200d9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:20.299078 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-493315bf-c9d7-48a3-8f41-1e2bd90d1543 req-f6fe4f35-57e2-49fd-ae28-55f9833200d9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:20.299861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-493315bf-c9d7-48a3-8f41-1e2bd90d1543 req-f6fe4f35-57e2-49fd-ae28-55f9833200d9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:20.312434 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-493315bf-c9d7-48a3-8f41-1e2bd90d1543 req-f6fe4f35-57e2-49fd-ae28-55f9833200d9 service nova] Creating event network-changed:e5c79f84-a9ca-436c-9351-cb9503b75d72 for instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb on n-h1-854925-5 Aug 30 05:32:20.318197 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-493315bf-c9d7-48a3-8f41-1e2bd90d1543 req-f6fe4f35-57e2-49fd-ae28-55f9833200d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034468 Aug 30 05:32:20.318831 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3846/7632] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:32:21.094496 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:21.095078 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:21.102598 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:21.103100 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:21.103811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:21.104524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:21.104996 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:21.105473 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:21.238581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:21.246397 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2adc616b-0f8c-4317-aedb-d96b576f2e2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.155957 Aug 30 05:32:21.246980 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3787/7633] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:21 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:22.268905 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:22.269542 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:22.276439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:22.276918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:22.277378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:22.278060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:22.278511 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:22.278938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:22.406973 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:22.414597 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-32fcb2a4-cf11-443c-b6bc-d1f51f714940 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.150875 Aug 30 05:32:22.415166 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3847/7634] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:22 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:32:23.435760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:23.436293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:23.443743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:23.444236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:23.444685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:23.445415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:23.445882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:23.446324 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:23.590489 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:23.598169 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-12277fba-f97e-4755-9f93-f298522adf1d tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.166411 Aug 30 05:32:23.599259 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3788/7635] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:23 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:24.619983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:24.620624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:24.627576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:24.628062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:24.628503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:24.629199 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:24.630376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:24.630837 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:24.765022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:24.773083 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-138019ba-eed3-43c1-b6d1-2a898154ba7a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.156948 Aug 30 05:32:24.773625 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3848/7636] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:24 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:25.793699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:25.794352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:25.801260 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:25.801793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:25.802245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:25.802950 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:25.803427 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:25.803871 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:25.936657 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:25.944845 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-88eaaff9-49ac-4efe-8cae-1328aea4d5e2 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.155078 Aug 30 05:32:25.945449 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3789/7637] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:25 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:26.966134 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:26.966753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:26.974247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:26.974727 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:26.975167 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:26.975856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:26.976310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:26.976737 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:27.123756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:27.131964 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ffcaab43-1125-4ea0-a8f4-2a6cfcadde2e tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.169762 Aug 30 05:32:27.132550 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3849/7638] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:26 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:27.176493 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-623b48a9-a993-450f-a7b8-11d0604fa950 req-52b45e31-baa5-4c9b-a8c6-4d6b30533e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb", "name": "network-vif-plugged", "status": "completed", "tag": "e5c79f84-a9ca-436c-9351-cb9503b75d72"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:32:27.188495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-623b48a9-a993-450f-a7b8-11d0604fa950 req-52b45e31-baa5-4c9b-a8c6-4d6b30533e28 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:27.189016 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-623b48a9-a993-450f-a7b8-11d0604fa950 req-52b45e31-baa5-4c9b-a8c6-4d6b30533e28 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:27.189486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-623b48a9-a993-450f-a7b8-11d0604fa950 req-52b45e31-baa5-4c9b-a8c6-4d6b30533e28 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:27.201410 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-623b48a9-a993-450f-a7b8-11d0604fa950 req-52b45e31-baa5-4c9b-a8c6-4d6b30533e28 service nova] Creating event network-vif-plugged:e5c79f84-a9ca-436c-9351-cb9503b75d72 for instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb on n-h1-854925-5 Aug 30 05:32:27.206763 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-623b48a9-a993-450f-a7b8-11d0604fa950 req-52b45e31-baa5-4c9b-a8c6-4d6b30533e28 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034078 Aug 30 05:32:27.207366 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3790/7639] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:32:28.154165 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:28.154697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:28.156675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:28.157355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:28.159030 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:28.165830 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:28.166313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:28.166749 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:28.167435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:28.167887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:28.168309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:28.298126 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:28.306436 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-fe1d8e5b-2785-46b9-956c-00af169cb1be tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1392 microversion: 2.1 time: 0.156218 Aug 30 05:32:28.307015 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3850/7640] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:28 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:29.324956 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:32:29.330966 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:29.331684 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:29.338639 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:29.339130 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:29.339582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:29.340276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:29.340740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:29.341177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:29.474644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:29.482552 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2c4a5380-6fc2-4105-92ae-e785f0344329 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1564 microversion: 2.1 time: 0.159142 Aug 30 05:32:29.483135 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3791/7641] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:29 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:29.502520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:29.503147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:29.510579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:29.511064 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:29.511504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:29.512190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:29.512646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:29.513075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:29.646036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:29.657104 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5403388f-43d3-493c-bc92-a8571a9f5de0 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1564 microversion: 2.1 time: 0.158084 Aug 30 05:32:29.658225 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3851/7642] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:29 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:32:31.242807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:32:31.243468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:32:31.250220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0f03b88b-ac58-49ae-8ddd-b892440a822d req-11e7b323-935f-4963-b480-187cec2a17a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb", "tag": "e5c79f84-a9ca-436c-9351-cb9503b75d72"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:32:31.261044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f03b88b-ac58-49ae-8ddd-b892440a822d req-11e7b323-935f-4963-b480-187cec2a17a6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:31.261684 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f03b88b-ac58-49ae-8ddd-b892440a822d req-11e7b323-935f-4963-b480-187cec2a17a6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:31.262118 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0f03b88b-ac58-49ae-8ddd-b892440a822d req-11e7b323-935f-4963-b480-187cec2a17a6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:31.262483 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:31.262990 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:31.263451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:31.264298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:32:31.264969 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:32:31.265456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:32:31.273750 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0f03b88b-ac58-49ae-8ddd-b892440a822d req-11e7b323-935f-4963-b480-187cec2a17a6 service nova] Creating event network-changed:e5c79f84-a9ca-436c-9351-cb9503b75d72 for instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb on n-h1-854925-5 Aug 30 05:32:31.278808 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0f03b88b-ac58-49ae-8ddd-b892440a822d req-11e7b323-935f-4963-b480-187cec2a17a6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032206 Aug 30 05:32:31.279421 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3852/7643] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:32:31.496179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:32:31.504604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a202586f-1701-4efe-aaeb-1e175eb3a3cd tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1564 microversion: 2.1 time: 0.266498 Aug 30 05:32:31.517836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3792/7644] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:32:31 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1564 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:04.784146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=5 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:04.784892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=42 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:04.789026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:33:04.791879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:04.798788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:04.799273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:04.799714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:04.800405 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:04.800860 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:04.801285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:04.870825 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f7b7d456-c9e2-4a02-a53c-dcb4b45cafb3 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action" status: 200 len: 24554 microversion: 2.1 time: 0.088590 Aug 30 05:33:04.871490 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3853/7645] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:33:04 2022] POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action => generated 24554 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:33:35.278024 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:35.278720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=38 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:35.280099 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:33:35.280246 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:33:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action (ip 10.222.0.27) !!! Aug 30 05:33:35.284613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:33:35.285160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:35.297921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:35.298413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:35.298860 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:35.299552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:35.300014 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:35.300448 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:35.326291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lazy-loading 'flavor' on Instance uuid 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:33:35.396256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b36494ed-7bfb-44e1-b8cd-35d3531754d8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action" status: 202 len: 0 microversion: 2.1 time: 0.120579 Aug 30 05:33:35.396954 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3793/7646] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:33:35 2022] POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:33:35.406383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:35.407090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:35.409620 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:35.410497 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=4 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:33:35.417111 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:35.417629 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:35.418075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:35.418768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:35.419221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:35.419646 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:35.550135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:35.558400 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-693185ba-d314-4b4d-b8af-7637f0ad1030 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1691 microversion: 2.1 time: 0.157002 Aug 30 05:33:35.558961 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3854/7647] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:35 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:36.580572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:36.581283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:36.588937 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:36.589509 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:36.590504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:36.591218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:36.591694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:36.592145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:36.735536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:36.745511 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-abf09a07-5e05-4c8d-9b2f-b96049ff4e2a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1691 microversion: 2.1 time: 0.169103 Aug 30 05:33:36.746198 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3794/7648] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:36 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:37.769578 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:37.770188 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:37.776546 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:37.777021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:37.777482 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:37.778187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:37.778637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:37.779059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:37.922698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:37.930375 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5d10656e-3a41-49f3-a2ed-1e0a603331f7 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1674 microversion: 2.1 time: 0.164923 Aug 30 05:33:37.930934 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3855/7649] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:37 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:39.020794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:33:39.023040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:39.029931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:39.030432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:39.030886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:39.031594 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:39.032061 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:39.032504 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:39.096597 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cd749e6d-12a7-4414-9e67-0811b17aa801 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action" status: 200 len: 37032 microversion: 2.1 time: 0.079508 Aug 30 05:33:39.097599 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3795/7650] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:33:39 2022] POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action => generated 37032 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 05:33:39.110060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:33:39.110603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:39.117835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:39.118330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:39.118774 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:39.119483 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:39.119942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:39.120373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:39.188890 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d149cd4-f045-49bd-a0bb-48b24488a60b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action" status: 202 len: 0 microversion: 2.1 time: 0.083230 Aug 30 05:33:39.192793 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3856/7651] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:33:39 2022] POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:33:39.198699 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:39.199424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:39.206954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:39.207457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:39.207973 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:39.208705 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:39.209212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:39.209697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:39.433936 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:39.444137 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4cbb389f-b378-4279-9aa9-6101e6da7d0a tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1680 microversion: 2.1 time: 0.249688 Aug 30 05:33:39.450474 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3796/7652] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:39 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1680 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:40.466781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:40.467487 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:40.473791 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:40.474280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:40.474722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:40.475428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:40.476023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:40.476322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:40.609527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:40.619546 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4b837705-5e2e-4c88-bc03-c5dba80b6693 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1680 microversion: 2.1 time: 0.158482 Aug 30 05:33:40.620139 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3857/7653] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:40 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:41.641241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:41.641935 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:41.648766 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:41.649257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:41.649767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:41.650465 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:41.650938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:41.651378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:41.783905 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:41.791937 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-78ab6463-e93d-48db-a5bc-4f37a6910e14 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1683 microversion: 2.1 time: 0.155317 Aug 30 05:33:41.792525 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3797/7654] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:41 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:41.893247 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:33:41.895416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:41.902310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:41.902840 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:41.903378 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:41.904079 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:41.904531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:41.904958 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:41.985178 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-809fab23-ed94-4a10-843e-821cf0174a77 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action" status: 200 len: 37032 microversion: 2.1 time: 0.095794 Aug 30 05:33:41.985886 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3858/7655] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:33:41 2022] POST /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb/action => generated 37032 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 05:33:43.007853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:43.009264 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:43.009972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c0a46315-fbf2-4516-b9cc-a825237e2306 req-552d4cf2-8a91-4f31-a9a2-c8aaf5d2686e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb", "tag": "e5c79f84-a9ca-436c-9351-cb9503b75d72"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:33:43.017425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:43.018372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:43.019027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:43.019884 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:43.020514 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:43.020964 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:43.022084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c0a46315-fbf2-4516-b9cc-a825237e2306 req-552d4cf2-8a91-4f31-a9a2-c8aaf5d2686e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:43.022640 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c0a46315-fbf2-4516-b9cc-a825237e2306 req-552d4cf2-8a91-4f31-a9a2-c8aaf5d2686e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:43.023143 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c0a46315-fbf2-4516-b9cc-a825237e2306 req-552d4cf2-8a91-4f31-a9a2-c8aaf5d2686e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:43.049592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:33:43.147393 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-34eb6713-6b0a-4d61-8a1c-472af20d1e05 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 204 len: 0 microversion: 2.1 time: 0.143155 Aug 30 05:33:43.152444 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3798/7656] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:33:43 2022] DELETE /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:33:43.160237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:43.160999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:43.169518 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:43.170031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:43.170486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:43.171213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:43.171683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:43.172176 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:43.299410 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c0a46315-fbf2-4516-b9cc-a825237e2306 req-552d4cf2-8a91-4f31-a9a2-c8aaf5d2686e service nova] Creating event network-changed:e5c79f84-a9ca-436c-9351-cb9503b75d72 for instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb on n-h1-854925-5 Aug 30 05:33:43.304300 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c0a46315-fbf2-4516-b9cc-a825237e2306 req-552d4cf2-8a91-4f31-a9a2-c8aaf5d2686e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299027 Aug 30 05:33:43.305157 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3859/7657] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:33:43.325120 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:43.333271 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ec22d880-9e9a-43e6-a145-03f169bef4ef tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1689 microversion: 2.1 time: 0.178721 Aug 30 05:33:43.334110 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3799/7658] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:43 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:44.358450 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:44.359149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:44.365820 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:44.366297 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:44.366733 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:44.367414 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:44.367866 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:44.368293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:44.495788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:44.504187 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-feb77660-682c-4695-87cb-618caeef5ee8 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1689 microversion: 2.1 time: 0.151824 Aug 30 05:33:44.504761 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3860/7659] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:44 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:45.451413 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a8526435-8df5-492f-a50d-ceeade4edd9a req-a091215a-7901-465b-9432-63ddbc316e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb", "name": "network-vif-deleted", "tag": "e5c79f84-a9ca-436c-9351-cb9503b75d72"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:33:45.462421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a8526435-8df5-492f-a50d-ceeade4edd9a req-a091215a-7901-465b-9432-63ddbc316e8b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:45.462939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a8526435-8df5-492f-a50d-ceeade4edd9a req-a091215a-7901-465b-9432-63ddbc316e8b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:45.463451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a8526435-8df5-492f-a50d-ceeade4edd9a req-a091215a-7901-465b-9432-63ddbc316e8b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:45.475701 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a8526435-8df5-492f-a50d-ceeade4edd9a req-a091215a-7901-465b-9432-63ddbc316e8b service nova] Creating event network-vif-deleted:e5c79f84-a9ca-436c-9351-cb9503b75d72 for instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb on n-h1-854925-5 Aug 30 05:33:45.482456 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a8526435-8df5-492f-a50d-ceeade4edd9a req-a091215a-7901-465b-9432-63ddbc316e8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034712 Aug 30 05:33:45.483108 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3800/7660] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:33:45.526399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:45.528136 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:45.537063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:45.537880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:45.538439 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:45.540033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:45.540589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:45.541110 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:45.574430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:45.574935 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:45.575530 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:45.577018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lazy-loading 'fault' on Instance uuid 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:33:45.619710 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e62a83482494bfda64a3cd4d5a017c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49b721c6a545492eac1cee9db1e66f8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:33:45.627534 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18cf85aa-5ca0-47b3-bfbd-b689843d3e80 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 200 len: 1356 microversion: 2.1 time: 0.105276 Aug 30 05:33:45.628098 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3861/7661] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:45 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:33:46.649590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:46.650308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] [instance: 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:33:46.657319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:46.658290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:46.659094 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:46.660229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:33:46.660744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:33:46.661199 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:33:46.676355 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] HTTP exception thrown: Instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb could not be found. Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Request method failure captured: Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb HTTP/1.1 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDZ8XqLQ2XnoeLjy3gfQj35dox1YH5CBG0bCtLjf05-B1Yo93BI9vDY7yzjeehMPCotYvvaOKI4M1IPZee0eGfYCHUS3YgdukVXskYw9qnuVtaL_TUTTKpS8IYCqhmuj_Jpnpp35NyDw9HzoPbnHxREMCcpVWa6OG2_sQOOmlx07o8eg Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_49b721c6a545492eac1cee9db1e66f8a", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/49b721c6a545492eac1cee9db1e66f8a"}]}] Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 49b721c6a545492eac1cee9db1e66f8a Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009606617 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 5e62a83482494bfda64a3cd4d5a017c8 Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009606617-project Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb could not be found. Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb'} Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb could not be found. Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb could not be found. Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:33:46.678072 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb could not be found. Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Returning 404 to user: Instance 9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-068bac22-7d3f-45cb-a3e7-8a5a77baf07b tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb" status: 404 len: 111 microversion: 2.1 time: 0.035088 Aug 30 05:33:46.683189 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3801/7662] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:33:46 2022] GET /compute/v2.1/servers/9e5a2ba2-15f1-4342-9fcd-bd58d9b2a1fb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:33:50.022610 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f2d22cd3-51ab-4997-90d4-d5b1242cd070 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] Calling method '.version_select at 0x7fe968f9a820>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:33:50.047461 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f2d22cd3-51ab-4997-90d4-d5b1242cd070 tempest-TestNetworkAdvancedServerOps-1009606617 tempest-TestNetworkAdvancedServerOps-1009606617-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1274708121" status: 202 len: 0 microversion: 2.1 time: 0.029449 Aug 30 05:33:50.048060 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3862/7663] 10.222.0.27 () {58 vars in 1284 bytes} [Tue Aug 30 05:33:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1274708121 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:34:01.174708 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:34:01.176408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:34:01.422195 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c19f35e-a447-4c33-bcc5-ae5810b4ea8b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'create', calling method: .version_select at 0x7fe96857d8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-503131128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI0OuWz/9k2wsljcPSvObNz9MArd1g0X8MS1D9Od5MfnqKTavFPy/vI5qdxiPkwevzKJWqSR2rKtSNyO6fVlQ9MKMc8MrOJ3w+7VS7685ZA/83mhLNl5TKEtW4SjTQksXQ=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:34:01.438939 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-0c19f35e-a447-4c33-bcc5-ae5810b4ea8b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for project e4736613a59b4dee92992b02a81e7245. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:34:01.445464 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-0c19f35e-a447-4c33-bcc5-ae5810b4ea8b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for user 2ef9a4cf4217488cbf7ffe96d4e350db and project e4736613a59b4dee92992b02a81e7245. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:34:01.475318 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c19f35e-a447-4c33-bcc5-ae5810b4ea8b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.307006 Aug 30 05:34:01.475938 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3802/7664] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:34:01 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:34:02.428327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:34:02.429087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:34:02.434781 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-863173485", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-503131128", "security_groups": [{"name": "tempest-secgroup-smoke-896155143"}], "networks": [{"uuid": "3a40fccb-470f-44a1-b7fe-d31c3a3126d2"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:34:02.541115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] validate_networks() for [('3a40fccb-470f-44a1-b7fe-d31c3a3126d2', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:34:03.066843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:34:03.067361 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:34:03.067929 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:34:03.068350 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:34:03.068772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:34:03.078334 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:03.078825 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:03.079267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:03.080006 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:03.080470 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:03.080901 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:03.102178 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for project e4736613a59b4dee92992b02a81e7245. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:34:03.113185 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for user 2ef9a4cf4217488cbf7ffe96d4e350db and project e4736613a59b4dee92992b02a81e7245. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:34:03.127354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:34:03.129716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:34:03.178509 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ddb39fbe-197b-4d84-88fd-14083c4ec3c0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751690 Aug 30 05:34:03.185574 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3863/7665] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:34:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:34:03.192220 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-64f335c8-c984-4bbb-a079-987f9d4e5017 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:03.193408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-64f335c8-c984-4bbb-a079-987f9d4e5017 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:03.265807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-64f335c8-c984-4bbb-a079-987f9d4e5017 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:03.273049 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-64f335c8-c984-4bbb-a079-987f9d4e5017 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1245 microversion: 2.1 time: 0.086041 Aug 30 05:34:03.274246 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3803/7666] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:03 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:04.295899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:04.297300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:04.307053 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:04.307938 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:04.308618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:04.310403 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:04.311081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:04.311698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:04.404622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:04.413678 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eab77c27-b72c-443d-96e4-204ae4b6ce54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1303 microversion: 2.1 time: 0.123731 Aug 30 05:34:04.414352 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3864/7667] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:04 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:05.434587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:05.435274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:05.446249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:05.446760 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:05.447216 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:05.447940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:05.448590 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:05.449041 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:05.652028 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:05.667570 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e19c26ee-bc79-447a-9420-e841abc919d6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1370 microversion: 2.1 time: 0.236952 Aug 30 05:34:05.668476 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3804/7668] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:05 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:05.801240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c7b806da-cfaa-4ee4-a813-25f73a2f7299 req-72992a39-0272-4253-946c-7b36e4c77a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:34:05.812904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c7b806da-cfaa-4ee4-a813-25f73a2f7299 req-72992a39-0272-4253-946c-7b36e4c77a2a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:05.813423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c7b806da-cfaa-4ee4-a813-25f73a2f7299 req-72992a39-0272-4253-946c-7b36e4c77a2a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:05.814146 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c7b806da-cfaa-4ee4-a813-25f73a2f7299 req-72992a39-0272-4253-946c-7b36e4c77a2a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:05.826607 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c7b806da-cfaa-4ee4-a813-25f73a2f7299 req-72992a39-0272-4253-946c-7b36e4c77a2a service nova] Creating event network-changed:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h2-854925-5 Aug 30 05:34:05.831927 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c7b806da-cfaa-4ee4-a813-25f73a2f7299 req-72992a39-0272-4253-946c-7b36e4c77a2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106935 Aug 30 05:34:05.832822 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3865/7669] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:34:06.688296 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:06.688889 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:06.696339 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:06.696844 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:06.697300 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:06.698045 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:06.698521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:06.698995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:06.838839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:06.847222 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-10eb9103-7ff6-4fb9-9e74-cbfee685a6b5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1370 microversion: 2.1 time: 0.163005 Aug 30 05:34:06.847797 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3805/7670] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:06 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:07.869588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:07.870400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:07.877340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:07.877821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:07.878263 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:07.878957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:07.879416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:07.879875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:08.016060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:08.024150 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-552bed69-97dd-4e3c-8ba1-a01180dc7b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1370 microversion: 2.1 time: 0.159748 Aug 30 05:34:08.024736 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3866/7671] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:07 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:09.045720 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:09.046355 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:09.055641 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:09.056394 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:09.057167 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:09.057596 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:09.058076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:09.058529 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:09.188530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:09.196337 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9d54e1f7-c192-4a9c-8548-e6eb5b02ced3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1370 microversion: 2.1 time: 0.155102 Aug 30 05:34:09.196917 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3806/7672] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:09 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:10.216982 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:10.217643 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:10.224576 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:10.225063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:10.225553 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:10.226257 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:10.226711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:10.227140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:10.359772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:10.367690 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3bb674d2-cdd6-4057-afbe-44a6615086b2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1370 microversion: 2.1 time: 0.154660 Aug 30 05:34:10.368270 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3867/7673] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:10 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:10.554271 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-af6af421-1a03-4dd2-87f3-0257a03ff7f9 req-07301fd9-a4c1-43e5-a6a5-8b95c3c4b963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "name": "network-vif-plugged", "status": "completed", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:34:10.565771 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af6af421-1a03-4dd2-87f3-0257a03ff7f9 req-07301fd9-a4c1-43e5-a6a5-8b95c3c4b963 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:10.566334 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af6af421-1a03-4dd2-87f3-0257a03ff7f9 req-07301fd9-a4c1-43e5-a6a5-8b95c3c4b963 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:10.566792 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-af6af421-1a03-4dd2-87f3-0257a03ff7f9 req-07301fd9-a4c1-43e5-a6a5-8b95c3c4b963 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:10.580508 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-af6af421-1a03-4dd2-87f3-0257a03ff7f9 req-07301fd9-a4c1-43e5-a6a5-8b95c3c4b963 service nova] Creating event network-vif-plugged:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h2-854925-5 Aug 30 05:34:10.585656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-af6af421-1a03-4dd2-87f3-0257a03ff7f9 req-07301fd9-a4c1-43e5-a6a5-8b95c3c4b963 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035116 Aug 30 05:34:10.586269 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3807/7674] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:34:11.388219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:11.388841 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:11.395707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:11.396196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:11.396639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:11.397364 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:11.397816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:11.398248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:11.531316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:11.539121 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-11c12bc2-32db-4749-ac44-2a3fe0680a6c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1370 microversion: 2.1 time: 0.154964 Aug 30 05:34:11.539700 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3868/7675] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:11 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:12.562062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:12.562785 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:12.568976 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:12.569536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:12.569994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:12.570700 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:12.571177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:12.571632 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:12.706444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:12.714286 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9eef1fae-7ac8-46c3-b4b7-a7e48cae5d85 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1555 microversion: 2.1 time: 0.157965 Aug 30 05:34:12.714867 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3808/7676] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:12 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:12.735280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:34:12.735859 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:34:12.742658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:12.743150 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:12.743593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:12.744293 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:12.744756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:12.745190 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:12.875868 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:34:12.883956 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-76d505b2-e7f0-461c-a5bd-418b18c99332 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1555 microversion: 2.1 time: 0.153234 Aug 30 05:34:12.884524 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3869/7677] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:34:12 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:34:14.508236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-4473adad-d1cf-4821-be1f-4cb7e3c70d22 req-8c32f9c7-d3c2-476f-9e37-b43c78a44a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:34:14.513151 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:34:14.519894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4473adad-d1cf-4821-be1f-4cb7e3c70d22 req-8c32f9c7-d3c2-476f-9e37-b43c78a44a43 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:34:14.520399 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4473adad-d1cf-4821-be1f-4cb7e3c70d22 req-8c32f9c7-d3c2-476f-9e37-b43c78a44a43 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:34:14.520853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-4473adad-d1cf-4821-be1f-4cb7e3c70d22 req-8c32f9c7-d3c2-476f-9e37-b43c78a44a43 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:34:14.532318 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-4473adad-d1cf-4821-be1f-4cb7e3c70d22 req-8c32f9c7-d3c2-476f-9e37-b43c78a44a43 service nova] Creating event network-changed:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h2-854925-5 Aug 30 05:34:14.537425 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-4473adad-d1cf-4821-be1f-4cb7e3c70d22 req-8c32f9c7-d3c2-476f-9e37-b43c78a44a43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032854 Aug 30 05:34:14.538292 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3809/7678] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:36:09.772741 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6bf038f-e45d-4293-8cc8-126372c20574] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 05:36:09.773321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:09.773879 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:09.774693 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:09.775540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=34 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:09.777186 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Aug 30 05:36:09.788104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:36:09.788650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:09.797753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:09.798330 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:09.798769 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:09.799512 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:09.799962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:09.800391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:09.823948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lazy-loading 'flavor' on Instance uuid 74337c73-0d32-4285-bf47-e1e58615ee00 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:36:10.000915 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-df816f3a-07ef-4efa-80ed-acf5d9ca360f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00/action" status: 202 len: 0 microversion: 2.1 time: 0.230247 Aug 30 05:36:10.001542 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3870/7679] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:36:09 2022] POST /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:36:10.008612 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:36:10.009655 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:36:10.010412 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:10.011426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=28 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:10.019145 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:10.019963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:10.028232 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:10.034665 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:10.035142 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:10.035898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:10.036376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:10.036829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:10.168461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:10.176896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d75eebe9-707e-4d7b-a3c1-89090066ff6f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.170235 Aug 30 05:36:10.177495 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3810/7680] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:10 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:11.202438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:11.203094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:11.211428 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6bf038f-e45d-4293-8cc8-126372c20574] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40148. Aug 30 05:36:11.216409 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:11.216887 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:11.217340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:11.218036 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:11.218489 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:11.218916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:11.346632 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:11.354751 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1386e367-c861-49e0-a24e-0f9d2a9294e7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.160199 Aug 30 05:36:11.355328 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3871/7681] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:11 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:12.375843 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:12.376476 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:12.385790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:12.386283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:12.386746 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:12.387451 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:12.387921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:12.388371 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:12.395521 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40154. Aug 30 05:36:12.406033 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40152. Aug 30 05:36:12.527604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:12.535423 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ac10ebe-4f4f-43f7-a82a-cbc57d08de3f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.163548 Aug 30 05:36:12.535990 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3811/7682] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:12 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:13.557599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:13.558223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:13.566149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:13.566779 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:13.567227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:13.567937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:13.568399 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:13.568831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:13.700796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:13.708595 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7fc78b6d-c37a-470b-b4f8-df31d0afcd4d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.155034 Aug 30 05:36:13.709176 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3872/7683] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:13 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:14.729979 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:14.730542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:14.738101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:14.738604 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:14.739063 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:14.739773 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:14.740243 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:14.740691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:14.874386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:14.882248 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-26a4ec1a-2db4-4c5e-ace3-4ecc3bd30073 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.156605 Aug 30 05:36:14.882836 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3812/7684] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:14 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:15.904665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:15.905382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:15.912391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:15.912875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:15.913316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:15.914033 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:15.914490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:15.914919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:16.044287 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:16.052005 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0263c3a6-06f4-438b-af53-637ff3b913aa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.151270 Aug 30 05:36:16.052581 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3873/7685] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:15 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:17.074173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:17.074807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:17.081697 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:17.082198 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:17.082682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:17.083383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:17.083851 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:17.084295 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:17.219681 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:17.227721 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28c2b213-ac77-4da2-bffe-2b135d7fd356 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.157469 Aug 30 05:36:17.228304 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3813/7686] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:17 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:18.252641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:18.253175 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:18.259972 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:18.260454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:18.260885 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:18.261593 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:18.262047 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:18.262472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:18.390725 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:18.398532 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-82781268-4a8d-4fe7-82dc-a5df240bfab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.150409 Aug 30 05:36:18.399116 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3874/7687] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:18 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:36:19.420012 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:19.420640 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:19.428117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:19.428606 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:19.429057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:19.429775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:19.430240 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:19.430678 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:19.561542 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:19.569880 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-880fa1ad-f6a1-4a79-b667-9dfb3779f03d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.153747 Aug 30 05:36:19.570461 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3814/7688] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:19 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:20.590517 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:20.591063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:20.598713 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:20.599230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:20.599667 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:20.600354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:20.600806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:20.601234 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:20.734437 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:20.742374 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-32b3a7fb-4d0f-4291-b4a1-8d93dfc447a3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1701 microversion: 2.1 time: 0.155868 Aug 30 05:36:20.742949 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3875/7689] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:20 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:21.764101 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:21.764730 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:21.772231 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:21.772734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:21.773190 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:21.773921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:21.774388 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:21.774830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:21.904727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:21.912942 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-28669adf-4142-4fc1-bd94-cf83611bdb47 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1701 microversion: 2.1 time: 0.152662 Aug 30 05:36:21.913559 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3815/7690] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:21 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:22.935827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:22.937476 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:22.945248 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:22.946142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:22.946653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:22.947756 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:22.948454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:22.949122 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:23.129028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:23.139106 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-41f7f54d-4c99-4b41-8dae-11198a81bcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.209433 Aug 30 05:36:23.154156 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3876/7691] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:22 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:24.163991 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:24.165425 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:24.172301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:24.173083 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:24.173586 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:24.174287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:24.174762 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:24.175252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:24.324301 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:24.336385 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6d4ac363-6840-4b90-809b-600ec7690080 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.177359 Aug 30 05:36:24.337141 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3816/7692] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:24 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:25.196758 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-0c95a844-8328-46cd-b6ac-57e477fbb344 req-1ffee1b3-f2a0-47f7-a32e-5b527eb2fc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "name": "network-vif-plugged", "status": "completed", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:36:25.208508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c95a844-8328-46cd-b6ac-57e477fbb344 req-1ffee1b3-f2a0-47f7-a32e-5b527eb2fc2a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:25.209007 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c95a844-8328-46cd-b6ac-57e477fbb344 req-1ffee1b3-f2a0-47f7-a32e-5b527eb2fc2a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:25.209479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-0c95a844-8328-46cd-b6ac-57e477fbb344 req-1ffee1b3-f2a0-47f7-a32e-5b527eb2fc2a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:25.222253 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-0c95a844-8328-46cd-b6ac-57e477fbb344 req-1ffee1b3-f2a0-47f7-a32e-5b527eb2fc2a service nova] Creating event network-vif-plugged:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h2-854925-5 Aug 30 05:36:25.228086 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-0c95a844-8328-46cd-b6ac-57e477fbb344 req-1ffee1b3-f2a0-47f7-a32e-5b527eb2fc2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129829 Aug 30 05:36:25.228978 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3877/7693] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:36:25.358938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:25.359915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:25.367806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:25.368326 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:25.368788 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:25.369568 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:25.370044 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:25.370492 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:25.519445 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:25.527959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0bf80797-1b20-422f-9186-b6fb435e5c1e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.173216 Aug 30 05:36:25.529283 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3817/7694] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:25 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:36:26.553106 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:26.554954 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:26.562994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:26.564554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:26.565040 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:26.565850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:26.566316 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:26.566753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:26.712617 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:26.721724 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3b0aa227-e1de-4835-a883-53fa4b8cf744 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.173499 Aug 30 05:36:26.722311 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3878/7695] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:26 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:27.743761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:27.745158 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:27.753536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:27.754057 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:27.754526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:27.755258 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:27.755739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:27.756191 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:27.930222 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:27.940474 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d40c6e8a-cbdf-4520-aa38-8d18c94d45d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.200667 Aug 30 05:36:27.941220 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3818/7696] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:27 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:28.961884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:28.963114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:28.970937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:28.971376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:28.971814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:28.972523 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:28.972970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:28.973430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:29.123814 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:29.132053 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da4c07f2-b8cc-43c2-ac4e-53760219e71c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.174075 Aug 30 05:36:29.132687 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3879/7697] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:28 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:30.153900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:30.154608 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:30.162192 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:30.163118 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:30.163581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:30.164318 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:30.164793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:30.165652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:30.316722 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:30.327275 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8197de7d-c8c0-4b6b-a121-787049885ab9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.177519 Aug 30 05:36:30.328239 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3819/7698] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:30 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:31.351598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:31.352215 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:31.359656 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:31.360142 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:31.360575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:31.361285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:31.361763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:31.362189 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:31.518217 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:31.526513 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-92f15be6-90f5-4a25-8c4d-2ca5ac70fef9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1696 microversion: 2.1 time: 0.178663 Aug 30 05:36:31.527585 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3880/7699] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:31 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:32.549647 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:32.550283 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:32.557299 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:32.557830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:32.558290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:32.558999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:32.559479 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:32.559928 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:32.693663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:32.701559 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-70057316-4187-452c-8365-028ae37bbd09 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1678 microversion: 2.1 time: 0.156575 Aug 30 05:36:32.702085 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3820/7700] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:32 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:33.723724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:33.724342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:33.731559 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:33.732039 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:33.732479 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:33.733163 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:33.733650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:33.734083 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:33.869423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:33.877868 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-66eff9f3-f94e-41d0-a428-6747176f9ef2 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1678 microversion: 2.1 time: 0.158712 Aug 30 05:36:33.878633 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3881/7701] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:33 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:34.909284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:34.909982 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:34.916672 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:34.917173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:34.917660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:34.918386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:34.918850 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:34.919298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:35.051978 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:35.060489 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ca597bae-b5a8-4496-ae56-0316b08a8c8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1621 microversion: 2.1 time: 0.166016 Aug 30 05:36:35.060809 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-e6d1355e-0738-4f50-ae27-821fc04b954e req-dd19521b-422c-4ce5-bbf7-7fb716bf047a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "name": "network-vif-unplugged", "status": "completed", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:36:35.073137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6d1355e-0738-4f50-ae27-821fc04b954e req-dd19521b-422c-4ce5-bbf7-7fb716bf047a service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:35.073137 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6d1355e-0738-4f50-ae27-821fc04b954e req-dd19521b-422c-4ce5-bbf7-7fb716bf047a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:35.073416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-e6d1355e-0738-4f50-ae27-821fc04b954e req-dd19521b-422c-4ce5-bbf7-7fb716bf047a service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:35.077619 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3821/7702] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:34 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1621 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:35.082662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:36:35.083284 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:35.086230 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.compute.server_external_events [req-e6d1355e-0738-4f50-ae27-821fc04b954e req-dd19521b-422c-4ce5-bbf7-7fb716bf047a service nova] Unable to find a host for instance 74337c73-0d32-4285-bf47-e1e58615ee00. Dropping event network-vif-unplugged {{(pid=122403) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 05:36:35.086849 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-e6d1355e-0738-4f50-ae27-821fc04b954e req-dd19521b-422c-4ce5-bbf7-7fb716bf047a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029901 Aug 30 05:36:35.087733 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3882/7703] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 05:36:35.089247 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:35.089882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:35.090336 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:35.091036 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:35.091498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:35.091934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:35.177408 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122402) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 05:36:35.243768 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0f39744a-883c-4400-abd3-cd70128847ba tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00/action" status: 202 len: 0 microversion: 2.1 time: 0.164932 Aug 30 05:36:35.244678 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3822/7704] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:36:35 2022] POST /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:36:35.252569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:35.253191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:35.259306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:35.259785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:35.260223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:35.260922 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:35.261400 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:35.261833 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:35.395391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:35.403501 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-45e1fb31-0c84-4151-aff7-8508ab5810ff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1629 microversion: 2.1 time: 0.154739 Aug 30 05:36:35.404075 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3883/7705] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:35 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1629 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:36.425115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:36.425870 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:36.431743 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:36.432236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:36.432685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:36.433405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:36.433877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:36.434316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:36.571462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:36.579434 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0c903eb9-906d-433d-a26d-4287c37b1c98 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.159071 Aug 30 05:36:36.580128 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3823/7706] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:36 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:37.604569 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:37.605625 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:37.613516 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:37.614301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:37.614508 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:37.616280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:37.616755 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:37.617197 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:37.733536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cbe80980-cbb9-4a70-b943-8a2506f6abdd req-943f832f-35ff-47d6-b619-10cd5841b7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:36:37.742881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cbe80980-cbb9-4a70-b943-8a2506f6abdd req-943f832f-35ff-47d6-b619-10cd5841b7d4 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:37.743391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cbe80980-cbb9-4a70-b943-8a2506f6abdd req-943f832f-35ff-47d6-b619-10cd5841b7d4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:37.743834 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cbe80980-cbb9-4a70-b943-8a2506f6abdd req-943f832f-35ff-47d6-b619-10cd5841b7d4 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:37.756220 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cbe80980-cbb9-4a70-b943-8a2506f6abdd req-943f832f-35ff-47d6-b619-10cd5841b7d4 service nova] Creating event network-changed:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h1-854925-5 Aug 30 05:36:37.761622 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cbe80980-cbb9-4a70-b943-8a2506f6abdd req-943f832f-35ff-47d6-b619-10cd5841b7d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105674 Aug 30 05:36:37.762591 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3824/7707] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:36:37.770456 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:37.778825 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ece06fb3-153b-4403-bc70-9b3f6e33bbd5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.178380 Aug 30 05:36:37.779402 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3884/7708] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:37 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:38.801270 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:38.802683 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:38.810680 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:38.811535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:38.812213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:38.813155 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:38.813918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:38.814576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:39.017846 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:39.026577 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f400f71d-0be8-4513-8ab8-c2e32cacf530 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.229936 Aug 30 05:36:39.027317 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3825/7709] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:38 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:40.049900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:40.050729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:40.053981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=31 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:40.060315 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:40.060899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:40.061448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:40.062260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:40.062802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:40.063299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:40.066382 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:40.234221 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:40.243158 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-cbf4440a-165b-4742-bd6c-88ed8d32fb43 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.197713 Aug 30 05:36:40.244134 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3885/7710] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:40 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:41.266776 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:41.268660 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:41.276347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:41.278367 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:41.278997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:41.279592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:41.280378 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:41.280916 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:41.281477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:41.284912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:36:41.434578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:41.442609 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45756833-5c12-4bd4-93fa-a9132414dbe9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.180382 Aug 30 05:36:41.456741 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3826/7711] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:41 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:42.464952 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:42.466024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:42.473477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:42.474049 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:42.474558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:42.475434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:42.475897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:42.476332 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:42.628937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:42.637581 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e00a8165-fe68-4825-a540-1238fe9c5100 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.177497 Aug 30 05:36:42.638177 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3886/7712] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:42 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:43.660348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:43.660959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:43.667582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:43.668177 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:43.668735 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:43.670027 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:43.671239 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:43.672245 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:43.820186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:43.831538 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-de25ca8e-80ed-4288-a60b-5c3bc50d53d7 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.175660 Aug 30 05:36:43.833354 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3827/7713] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:43 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:44.854732 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:44.855359 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:44.862575 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:44.863090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:44.863543 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:44.864253 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:44.864715 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:44.865148 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:45.039001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:45.046991 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ce2a544d-544e-49e6-9ba5-a8842aa3bf12 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.196550 Aug 30 05:36:45.047762 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3887/7714] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:44 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:36:46.068831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:46.069486 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:46.076393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:46.076893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:46.077369 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:46.078080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:46.078558 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:46.078999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:46.210391 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:46.218195 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2a4774ae-743e-4f73-976c-49838d6c360b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.154042 Aug 30 05:36:46.218771 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3828/7715] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:46 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:47.239549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:47.240123 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:47.246875 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:47.247355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:47.247790 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:47.248477 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:47.248928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:47.249377 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:47.382352 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:47.390005 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f143d63e-467d-4b6a-9493-0c838d427f74 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.154509 Aug 30 05:36:47.390579 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3888/7716] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:47 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:48.411985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:48.412627 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:48.419656 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:48.420157 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:48.420613 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:48.421317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:48.421806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:48.422251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:48.556561 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:48.564619 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-32e733f3-487e-4b1a-ae56-a529944c3eac tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.156959 Aug 30 05:36:48.565312 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3829/7717] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:48 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:49.586169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:49.586777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:49.593618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:49.594095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:49.594533 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:49.595213 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:49.595694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:49.596119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:49.726967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:49.735307 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-da29c77b-1bae-410c-ada1-5b49bda48926 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.153044 Aug 30 05:36:49.735919 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3889/7718] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:49 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:50.757798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:50.758424 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:50.765212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:50.765737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:50.766188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:50.766878 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:50.767341 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:50.768308 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:50.901298 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:50.910000 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-9e2f991b-d3c1-4053-9010-4f15412d78d3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.156010 Aug 30 05:36:50.910509 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3830/7719] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:50 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:51.931127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:51.931750 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:51.938599 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:51.939087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:51.939526 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:51.940222 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:51.940719 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:51.941107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:52.068829 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:52.076587 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-509a0853-f7c9-4d5e-a4e2-f2ff01489563 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.149391 Aug 30 05:36:52.077189 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3890/7720] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:51 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:53.098335 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:53.099085 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:53.106310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:53.106811 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:53.107267 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:53.107977 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:53.108444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:53.108888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:53.244013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:53.251851 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8255c8ac-9564-4a5c-b05b-4184bd740c91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.158155 Aug 30 05:36:53.252440 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3831/7721] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:53 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:54.274090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:54.274796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:54.281914 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:54.282404 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:54.282845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:54.283540 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:54.284002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:54.284433 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:54.422120 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:54.430517 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-504cff08-0775-4d7c-bc2f-d3f9a2efcdc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.160429 Aug 30 05:36:54.431296 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3891/7722] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:54 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:54.432471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9b226a8b-cc13-4bb8-8073-83d2ade9d41b req-0e85938e-f4a0-46d2-b186-e9d00cfd0072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "name": "network-vif-plugged", "status": "completed", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:36:54.447522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9b226a8b-cc13-4bb8-8073-83d2ade9d41b req-0e85938e-f4a0-46d2-b186-e9d00cfd0072 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:54.448090 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9b226a8b-cc13-4bb8-8073-83d2ade9d41b req-0e85938e-f4a0-46d2-b186-e9d00cfd0072 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:54.448563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9b226a8b-cc13-4bb8-8073-83d2ade9d41b req-0e85938e-f4a0-46d2-b186-e9d00cfd0072 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:54.460591 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9b226a8b-cc13-4bb8-8073-83d2ade9d41b req-0e85938e-f4a0-46d2-b186-e9d00cfd0072 service nova] Creating event network-vif-plugged:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h1-854925-5 Aug 30 05:36:54.466198 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9b226a8b-cc13-4bb8-8073-83d2ade9d41b req-0e85938e-f4a0-46d2-b186-e9d00cfd0072 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038303 Aug 30 05:36:54.466796 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3832/7723] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:36:55.452685 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:55.453299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:55.460940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:55.461722 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:55.462107 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:55.462793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:55.463246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:55.463673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:55.598274 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:55.606174 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aea385f5-dd1a-480f-9dbc-8172a0058790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1687 microversion: 2.1 time: 0.157570 Aug 30 05:36:55.606754 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3892/7724] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:55 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:36:56.627667 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:36:56.628532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:36:56.636571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:56.637071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:56.637554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:56.638292 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:36:56.638767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:36:56.639212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:36:56.776114 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:36:56.784608 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0d710f05-f6a1-4d22-a76c-c9e566ede852 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1674 microversion: 2.1 time: 0.161305 Aug 30 05:36:56.785196 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3833/7725] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:36:56 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:38:33.254503 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 05:38:33.255131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=15 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:33.255890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=47 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:33.256734 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=15 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:33.257278 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 05:38:33.257278 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 (ip 10.222.0.27) !!! Aug 30 05:38:33.257577 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=43 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:33.258054 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:38:33.258054 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 (ip 10.222.0.27) !!! Aug 30 05:38:33.258913 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:38:33.259095 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:38:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 30 05:38:33.263507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:33.264017 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:33.264241 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-92614fa5-4ca4-4f50-b31a-17b7b983a0b5 req-b4f4c742-56bd-4a8a-b88c-ef5bae0d939f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:38:33.279067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:33.279681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:33.280147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:33.280862 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:33.281796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:33.282326 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:33.293521 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-92614fa5-4ca4-4f50-b31a-17b7b983a0b5 req-b4f4c742-56bd-4a8a-b88c-ef5bae0d939f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:33.294168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-92614fa5-4ca4-4f50-b31a-17b7b983a0b5 req-b4f4c742-56bd-4a8a-b88c-ef5bae0d939f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:33.294709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-92614fa5-4ca4-4f50-b31a-17b7b983a0b5 req-b4f4c742-56bd-4a8a-b88c-ef5bae0d939f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:33.308832 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-92614fa5-4ca4-4f50-b31a-17b7b983a0b5 req-b4f4c742-56bd-4a8a-b88c-ef5bae0d939f service nova] Creating event network-changed:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h1-854925-5 Aug 30 05:38:33.311695 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:38:33.314304 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-92614fa5-4ca4-4f50-b31a-17b7b983a0b5 req-b4f4c742-56bd-4a8a-b88c-ef5bae0d939f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059476 Aug 30 05:38:33.315136 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3834/7726] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:38:33.405194 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-eba5fbba-4ec2-4fdd-90b3-9bc0c0b30897 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "DELETE /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 204 len: 0 microversion: 2.1 time: 0.152750 Aug 30 05:38:33.408916 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3893/7727] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:38:33 2022] DELETE /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:38:33.415071 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:33.416302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:33.423605 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:33.424117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:33.425143 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:33.425888 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:33.426386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:33.426975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:33.669716 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:33.677708 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cc8c3fa3-3cc2-4a49-a4fc-3a6598da1644 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.267293 Aug 30 05:38:33.678601 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3835/7728] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:33 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:38:34.700962 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:34.701709 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:34.709597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:34.710086 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:34.710524 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:34.711220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:34.711729 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:34.712081 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:34.730990 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40432. Aug 30 05:38:34.926195 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:34.934191 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4dec72aa-5c34-4f7d-8216-bf77d8a7f817 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1680 microversion: 2.1 time: 0.237644 Aug 30 05:38:34.934774 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3894/7729] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:34 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1680 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:38:35.443166 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-9fd890a0-ee48-420a-81a0-02875f647b0a req-feab0d89-b472-46eb-9a40-73dd8dc18f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74337c73-0d32-4285-bf47-e1e58615ee00", "name": "network-vif-deleted", "tag": "326932d5-5f78-4755-af63-dbf9c38e6eb6"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:38:35.454477 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9fd890a0-ee48-420a-81a0-02875f647b0a req-feab0d89-b472-46eb-9a40-73dd8dc18f5c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:35.454958 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9fd890a0-ee48-420a-81a0-02875f647b0a req-feab0d89-b472-46eb-9a40-73dd8dc18f5c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:35.455406 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-9fd890a0-ee48-420a-81a0-02875f647b0a req-feab0d89-b472-46eb-9a40-73dd8dc18f5c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:35.467019 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-9fd890a0-ee48-420a-81a0-02875f647b0a req-feab0d89-b472-46eb-9a40-73dd8dc18f5c service nova] Creating event network-vif-deleted:326932d5-5f78-4755-af63-dbf9c38e6eb6 for instance 74337c73-0d32-4285-bf47-e1e58615ee00 on n-h1-854925-5 Aug 30 05:38:35.472484 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-9fd890a0-ee48-420a-81a0-02875f647b0a req-feab0d89-b472-46eb-9a40-73dd8dc18f5c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033097 Aug 30 05:38:35.473113 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3836/7730] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:38:35.955114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:35.955734 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:35.962670 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:35.963102 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:35.964114 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:35.964845 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:35.965310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:35.965762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:35.997345 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:35.997851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:35.998292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:35.998742 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lazy-loading 'fault' on Instance uuid 74337c73-0d32-4285-bf47-e1e58615ee00 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:38:36.044467 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:36.051948 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3917e8b1-e247-4d6d-8ac0-0518e986e9bb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 200 len: 1335 microversion: 2.1 time: 0.100705 Aug 30 05:38:36.056000 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3895/7731] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:35 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:38:37.076694 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:37.077353 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: 74337c73-0d32-4285-bf47-e1e58615ee00] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:37.083687 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:37.084186 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:37.084959 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:37.085362 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:37.085833 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:37.086276 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:37.100238 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] HTTP exception thrown: Instance 74337c73-0d32-4285-bf47-e1e58615ee00 could not be found. Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Request method failure captured: Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 HTTP/1.1 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDaFEzQp7iyqthSmTu1kMcd_Uc8YZlRpnRRO87JrQwariNUTdhbKmYIYH_qAfG3cM5At3eZEgW-27umhoDXpth18iADzNFKuFAasnZonvaYmf5TnwLdlaOYg8dZybUVvkXGvEoDQR_LqomxE4Q_BLiGuTpUfv1_6uX8abRyd5WZ8ThEQ Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: e4736613a59b4dee92992b02a81e7245 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestShelveInstance-1831233960 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4736613a59b4dee92992b02a81e7245", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4736613a59b4dee92992b02a81e7245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4736613a59b4dee92992b02a81e7245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4736613a59b4dee92992b02a81e7245"}]}] Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestShelveInstance-1831233960 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: e4736613a59b4dee92992b02a81e7245 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestShelveInstance-1831233960 Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestShelveInstance-1831233960-project Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 2ef9a4cf4217488cbf7ffe96d4e350db Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestShelveInstance-1831233960-project Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 74337c73-0d32-4285-bf47-e1e58615ee00 could not be found. Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '74337c73-0d32-4285-bf47-e1e58615ee00'} Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74337c73-0d32-4285-bf47-e1e58615ee00 could not be found. Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74337c73-0d32-4285-bf47-e1e58615ee00 could not be found. Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:38:37.101926 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74337c73-0d32-4285-bf47-e1e58615ee00 could not be found. Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Returning 404 to user: Instance 74337c73-0d32-4285-bf47-e1e58615ee00 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4278bc14-2a0c-4f80-84e9-7291553dd18a tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00" status: 404 len: 111 microversion: 2.1 time: 0.031866 Aug 30 05:38:37.108886 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3837/7732] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:37 2022] GET /compute/v2.1/servers/74337c73-0d32-4285-bf47-e1e58615ee00 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:38:37.266743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-21bf2c2f-0a74-4950-b55c-1f3dfbe9d25b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '.version_select at 0x7fe96905cdc0>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:37.292503 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-21bf2c2f-0a74-4950-b55c-1f3dfbe9d25b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503131128" status: 202 len: 0 microversion: 2.1 time: 0.029019 Aug 30 05:38:37.293040 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3896/7733] 10.222.0.27 () {58 vars in 1251 bytes} [Tue Aug 30 05:38:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-503131128 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:38:37.316822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bf6feac8-790c-4927-9fb7-7a0549a7367f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'create', calling method: .version_select at 0x7fe96a1c1280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1717536284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK85pyRHdgT3CrPGpxGQke2zULqpuuCC23aDTNgAU5sZ/dUSyP1KBVVSG+sgUw24H1uj0oraPugoPSpIidLdlV8ffr9D6aRZ7Z1qJf+M65r5w4p1Ui+dBVBK3BX3NJybyA=="}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:38:37.332423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-bf6feac8-790c-4927-9fb7-7a0549a7367f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for project e4736613a59b4dee92992b02a81e7245. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:38:37.337456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-bf6feac8-790c-4927-9fb7-7a0549a7367f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for user 2ef9a4cf4217488cbf7ffe96d4e350db and project e4736613a59b4dee92992b02a81e7245. Resources: {'key_pairs'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:38:37.365244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bf6feac8-790c-4927-9fb7-7a0549a7367f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.052588 Aug 30 05:38:37.365887 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3838/7734] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:38:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:38:53.490560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:53.491520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:53.495563 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-546111775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1717536284", "security_groups": [{"name": "tempest-secgroup-smoke-1413476827"}], "networks": [{"uuid": "3a40fccb-470f-44a1-b7fe-d31c3a3126d2"}], "block_device_mapping_v2": [{"uuid": "af80ee0d-dce2-49bb-9c2f-f5827b443ccf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:38:53.609970 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] validate_networks() for [('3a40fccb-470f-44a1-b7fe-d31c3a3126d2', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:38:53.978654 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:38:53.979088 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:38:53.979598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:38:53.980271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:38:53.980700 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:38:53.989624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:53.990109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:53.990579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:53.991401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:53.991857 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:53.992285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:54.009764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for project e4736613a59b4dee92992b02a81e7245. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:38:54.015612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Getting quotas for user 2ef9a4cf4217488cbf7ffe96d4e350db and project e4736613a59b4dee92992b02a81e7245. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:38:54.072430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:38:54.075280 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='af80ee0d-dce2-49bb-9c2f-f5827b443ccf',volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:38:54.204208 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-775959bb-bad2-42da-aa8b-acba39a8b084 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.715359 Aug 30 05:38:54.204870 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3897/7735] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:38:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:38:54.213633 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=12 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:54.214395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=4 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:54.215117 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:38:54.219274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3fde9c7e-2e25-4af2-8069-9f9abb97e27b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:54.219896 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3fde9c7e-2e25-4af2-8069-9f9abb97e27b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:54.277904 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3fde9c7e-2e25-4af2-8069-9f9abb97e27b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:54.285352 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3fde9c7e-2e25-4af2-8069-9f9abb97e27b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1088 microversion: 2.1 time: 0.073531 Aug 30 05:38:54.286041 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3839/7736] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:54 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1088 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:38:55.305894 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:55.306539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:55.316472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:55.316981 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:55.317457 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:55.318173 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:55.318635 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:55.319073 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:55.398112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:55.407081 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-730dae63-5383-4e03-941b-2b7350655daf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1204 microversion: 2.1 time: 0.105980 Aug 30 05:38:55.407805 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3898/7737] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:55 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1204 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:38:56.428305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:56.429204 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:56.437642 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:56.438919 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:56.439470 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:56.440280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:56.440835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:56.441510 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:56.647150 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:56.663677 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-35655c2a-a761-48a7-be04-766bee809d44 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1272 microversion: 2.1 time: 0.239191 Aug 30 05:38:56.664357 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3840/7738] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:56 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:38:56.680628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-09940d30-556d-4701-aa45-bd842c11add8 req-770a1207-16c3-4dd4-bfbb-68e1b73fd1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de53db96-578e-4568-81a3-61e88d643a28", "tag": "872e86d4-faa0-4e66-b202-ce1e77535f2b"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:38:56.692449 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-09940d30-556d-4701-aa45-bd842c11add8 req-770a1207-16c3-4dd4-bfbb-68e1b73fd1d6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:56.693231 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-09940d30-556d-4701-aa45-bd842c11add8 req-770a1207-16c3-4dd4-bfbb-68e1b73fd1d6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:56.693880 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-09940d30-556d-4701-aa45-bd842c11add8 req-770a1207-16c3-4dd4-bfbb-68e1b73fd1d6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:56.706676 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-09940d30-556d-4701-aa45-bd842c11add8 req-770a1207-16c3-4dd4-bfbb-68e1b73fd1d6 service nova] Creating event network-changed:872e86d4-faa0-4e66-b202-ce1e77535f2b for instance de53db96-578e-4568-81a3-61e88d643a28 on n-h2-854925-5 Aug 30 05:38:56.711990 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-09940d30-556d-4701-aa45-bd842c11add8 req-770a1207-16c3-4dd4-bfbb-68e1b73fd1d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035086 Aug 30 05:38:56.712829 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3899/7739] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:38:57.692855 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:57.693536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:57.701553 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:57.701894 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:57.702562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:57.703395 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:57.703873 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:57.704325 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:58.024030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:58.033144 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0d581e2e-2327-4f81-a8e4-f34a24d4b496 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1272 microversion: 2.1 time: 0.344677 Aug 30 05:38:58.033774 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3841/7740] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:57 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1272 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:38:59.055602 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:38:59.056226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:38:59.063171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:59.063655 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:59.064092 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:59.064784 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:38:59.065236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:38:59.065689 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:38:59.203380 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:38:59.211675 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d4db95f9-925f-44c0-967e-2a2114a84bff tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1272 microversion: 2.1 time: 0.161187 Aug 30 05:38:59.212273 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3900/7741] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:38:59 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:00.232853 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:00.233535 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:00.240274 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:00.240717 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:00.241170 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:00.241915 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:00.242379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:00.242818 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:00.387453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:00.397616 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e92867f4-95a8-4b00-b28a-1a83e430c2b0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1272 microversion: 2.1 time: 0.169343 Aug 30 05:39:00.398224 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3842/7742] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:00 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:01.466268 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:01.466897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:01.472904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:01.473426 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:01.473871 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:01.474567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:01.475025 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:01.475455 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:01.603899 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:01.612459 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-aec5be2d-b944-4372-b8bf-ddb7202d9a58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.197466 Aug 30 05:39:01.613035 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3901/7743] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:01 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:02.633900 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:02.634526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:02.641940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:02.642428 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:02.642883 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:02.643572 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:02.644040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:02.644471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:02.775893 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:02.783664 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-d7d79952-3cbd-47e1-8887-1287f5791790 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.153708 Aug 30 05:39:02.784244 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3843/7744] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:02 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:03.805139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:03.805721 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:03.812707 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:03.813194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:03.813658 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:03.814357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:03.814819 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:03.815252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:03.946097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:03.954430 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d47953d2-7113-4a94-80fd-e6eb9cc0de38 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.153374 Aug 30 05:39:03.954998 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3902/7745] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:03 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:04.975189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:04.975830 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:04.978690 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:39:04.984921 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:04.985524 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:04.985984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:04.986695 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:04.987173 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:04.987623 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:05.118867 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:05.126724 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-284bd089-5c9d-47e4-8539-a34fc166bcc8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.155571 Aug 30 05:39:05.127304 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3844/7746] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:04 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:06.152075 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:06.152698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:06.154937 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:39:06.155604 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:39:06.162305 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:06.162796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:06.163242 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:06.163942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:06.164401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:06.164835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:06.298339 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:06.306137 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ed4715da-6b3b-42b7-aa46-bd520636e873 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.158000 Aug 30 05:39:06.306722 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3903/7747] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:06 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:07.327393 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:07.328021 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:07.335135 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:07.335626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:07.336076 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:07.336775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:07.337286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:07.337701 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:07.467404 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:07.475158 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-0984c084-dcd3-4063-b82d-7bec883569c8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.152205 Aug 30 05:39:07.475730 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3845/7748] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:07 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:08.496615 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:08.497229 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:08.504103 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:08.504588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:08.505026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:08.505777 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:08.506236 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:08.506664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:08.645613 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:08.653281 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-08643695-2f69-4139-be39-824697af9fe3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.161163 Aug 30 05:39:08.653881 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3904/7749] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:08 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:09.675317 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:09.675947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:09.683086 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:09.684251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:09.684696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:09.685418 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:09.685881 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:09.686319 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:09.820610 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:09.828604 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c19c7898-c647-4d59-bc45-4907f06dacbf tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.157143 Aug 30 05:39:09.829416 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3846/7750] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:09 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:10.849687 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:10.850309 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:10.858098 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:10.858582 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:10.859024 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:10.859717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:10.860171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:10.860603 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:10.991802 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:10.999599 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f91a46ff-6ef0-4bcc-98ee-e3b429268269 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.153977 Aug 30 05:39:11.000177 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3905/7751] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:10 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:11.973724 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-17261d2b-afca-4c38-9a00-15aed45c317e req-25c0130e-53a5-43f7-b06b-1bd94e213a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de53db96-578e-4568-81a3-61e88d643a28", "name": "network-vif-plugged", "status": "completed", "tag": "872e86d4-faa0-4e66-b202-ce1e77535f2b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:39:11.984863 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-17261d2b-afca-4c38-9a00-15aed45c317e req-25c0130e-53a5-43f7-b06b-1bd94e213a78 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:11.985375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-17261d2b-afca-4c38-9a00-15aed45c317e req-25c0130e-53a5-43f7-b06b-1bd94e213a78 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:11.985820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-17261d2b-afca-4c38-9a00-15aed45c317e req-25c0130e-53a5-43f7-b06b-1bd94e213a78 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:11.998467 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-17261d2b-afca-4c38-9a00-15aed45c317e req-25c0130e-53a5-43f7-b06b-1bd94e213a78 service nova] Creating event network-vif-plugged:872e86d4-faa0-4e66-b202-ce1e77535f2b for instance de53db96-578e-4568-81a3-61e88d643a28 on n-h2-854925-5 Aug 30 05:39:12.003673 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-17261d2b-afca-4c38-9a00-15aed45c317e req-25c0130e-53a5-43f7-b06b-1bd94e213a78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033630 Aug 30 05:39:12.004307 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3847/7752] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:39:12.020260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:12.021093 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:12.027503 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:12.028792 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:12.029490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:12.031196 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:12.032037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:12.032911 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:12.234507 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:12.242271 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f65b07dd-1a95-4fac-a628-aab5d7c7989e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1260 microversion: 2.1 time: 0.225994 Aug 30 05:39:12.242845 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3906/7753] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:12 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:13.264020 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:13.265571 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:13.272987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:13.273532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:13.274107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:13.274831 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:13.275345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:13.275798 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:13.415861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:13.424201 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a9d9bb23-a72e-4000-889c-40304a1b1973 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1445 microversion: 2.1 time: 0.165128 Aug 30 05:39:13.424800 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3848/7754] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:13 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1445 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:13.445249 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:39:13.445908 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:39:13.452653 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:13.453139 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:13.453607 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:13.454299 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:13.454757 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:13.455187 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:13.583527 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:39:13.591275 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5c341597-2b2e-4f72-b9d2-631ab5f8c379 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1445 microversion: 2.1 time: 0.150590 Aug 30 05:39:13.591852 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3907/7755] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:39:13 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:39:15.288698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c429c530-dbc8-4e38-9575-dc53847e6d9a req-7999a438-e172-49b1-bdd4-4769c30e984c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de53db96-578e-4568-81a3-61e88d643a28", "tag": "872e86d4-faa0-4e66-b202-ce1e77535f2b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:39:15.298816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c429c530-dbc8-4e38-9575-dc53847e6d9a req-7999a438-e172-49b1-bdd4-4769c30e984c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:39:15.299310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c429c530-dbc8-4e38-9575-dc53847e6d9a req-7999a438-e172-49b1-bdd4-4769c30e984c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:39:15.299820 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c429c530-dbc8-4e38-9575-dc53847e6d9a req-7999a438-e172-49b1-bdd4-4769c30e984c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:39:15.311749 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c429c530-dbc8-4e38-9575-dc53847e6d9a req-7999a438-e172-49b1-bdd4-4769c30e984c service nova] Creating event network-changed:872e86d4-faa0-4e66-b202-ce1e77535f2b for instance de53db96-578e-4568-81a3-61e88d643a28 on n-h2-854925-5 Aug 30 05:39:15.316863 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c429c530-dbc8-4e38-9575-dc53847e6d9a req-7999a438-e172-49b1-bdd4-4769c30e984c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082260 Aug 30 05:39:15.317541 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3849/7756] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:41:07.583668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:07.584427 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=58 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:07.590097 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:41:07.590642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:07.598119 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:07.598619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:07.599067 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:07.599780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:07.601194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:07.601194 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:07.625731 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.objects.instance [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lazy-loading 'flavor' on Instance uuid de53db96-578e-4568-81a3-61e88d643a28 {{(pid=122403) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:41:07.697312 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42a94cd2-76e7-489a-b1d9-04e401f4ccc4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28/action" status: 202 len: 0 microversion: 2.1 time: 0.114856 Aug 30 05:41:07.697949 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3908/7757] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:41:07 2022] POST /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:41:07.705315 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=24 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:07.706600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=52 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:07.707737 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:41:07.707875 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:41:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 (ip 10.222.0.27) !!! Aug 30 05:41:07.714487 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:07.715255 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:07.723984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:07.724508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:07.724948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:07.725693 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:07.726163 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:07.726612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:07.862402 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:07.870223 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-45d3964f-92a2-4111-8d21-8d6a4b768867 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.167596 Aug 30 05:41:07.870834 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3850/7758] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:07 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:41:08.892761 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:08.893520 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:08.900416 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:08.900903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:08.901362 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:08.902060 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:08.902514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:08.902951 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:09.033169 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:09.041780 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-18549f6b-0502-460d-8f5a-2d9d2ae4b91b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.154368 Aug 30 05:41:09.042360 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3909/7759] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:08 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:10.064387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:10.064945 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:10.071847 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:10.072345 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:10.072809 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:10.073532 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:10.074006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:10.074449 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:10.206259 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:10.213983 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-6cafe3de-1260-4e0c-8449-ae909b79f26e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.153609 Aug 30 05:41:10.214557 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3851/7760] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:10 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:11.235724 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:11.236261 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:11.242832 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:11.243321 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:11.243763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:11.244461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:11.248876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:11.248876 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:11.380077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:11.388520 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-37309a14-f111-4802-9c37-1dcb9df86ad4 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.157340 Aug 30 05:41:11.389099 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3910/7761] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:11 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:12.409545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:12.410196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:12.416279 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:12.416737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:12.417188 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:12.417918 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:12.418386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:12.418826 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:12.544997 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:12.552953 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-c981c40a-d421-4252-9095-ac5c299faf58 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.147689 Aug 30 05:41:12.553549 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3852/7762] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:12 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:13.574233 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:13.575373 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:13.586008 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:13.586501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:13.587080 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:13.587817 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:13.588270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:13.589220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:13.723121 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:13.730930 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-24bece94-b888-4b74-a67b-bf5264129c0f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.161052 Aug 30 05:41:13.731760 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3911/7763] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:13 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:14.752252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:14.752879 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:14.759456 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:14.759954 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:14.760407 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:14.761107 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:14.761600 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:14.762043 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:14.892316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:14.900404 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e320ee77-1570-45ba-a171-26f4e595baaa tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.152095 Aug 30 05:41:14.901696 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3853/7764] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:14 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:15.923004 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:15.923628 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:15.930539 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:15.931023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:15.931461 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:15.932147 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:15.932601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:15.933037 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:16.064485 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:16.072373 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-66dd952c-5d91-4627-aef7-d8304072ec8c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.153380 Aug 30 05:41:16.073537 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3912/7765] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:15 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:17.094658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:17.095218 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:17.102015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:17.102508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:17.102957 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:17.103682 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:17.104765 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:17.105212 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:17.233248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:17.241077 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1c12f774-0215-49bf-9646-c23f0c43b154 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.150437 Aug 30 05:41:17.241678 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3854/7766] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:17 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:18.261600 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:18.262224 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:18.269109 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:18.269618 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:18.270062 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:18.270762 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:18.271220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:18.271649 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:18.800624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:18.808620 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-33b7d525-3f69-4564-8510-c46a124a066d tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.551027 Aug 30 05:41:18.809194 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3913/7767] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:18 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:19.831484 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:19.832088 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:19.839799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:19.840291 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:19.840738 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:19.841462 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:19.841926 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:19.842358 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:19.982838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:19.991131 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-01617696-7cee-404c-8f7c-3803fe73c293 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.164239 Aug 30 05:41:19.991596 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3855/7768] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:19 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:21.012984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:21.013630 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:21.020694 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:21.021181 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:21.021650 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:21.022401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:21.022844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:21.023271 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:21.156708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:21.164804 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a580fbb9-a2da-4b0e-b511-3ab98132f0f1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.156384 Aug 30 05:41:21.165392 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3914/7769] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:21 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:41:22.186383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:22.186968 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:22.193845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:22.194343 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:22.194800 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:22.195502 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:22.195971 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:22.196415 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:22.323588 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:22.331351 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e184e5a7-558e-4810-871f-6c93c9604364 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1510 microversion: 2.1 time: 0.149405 Aug 30 05:41:22.331935 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3856/7770] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:22 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:22.352219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:41:22.352831 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:22.360501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:22.360983 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:22.361451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:22.362149 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:22.362596 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:22.363023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:22.440892 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122403) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 05:41:22.504303 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-05f360dc-8529-4c63-acfe-dbd2fcf3dfdb tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "POST /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28/action" status: 202 len: 0 microversion: 2.1 time: 0.156027 Aug 30 05:41:22.504927 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3915/7771] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:41:22 2022] POST /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:41:22.513789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:22.515104 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:22.520564 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:22.521062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:22.521548 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:22.522250 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:22.522993 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:22.523511 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:22.658111 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:22.665896 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-745cac8a-7c9d-47b5-a514-2563b8398531 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1518 microversion: 2.1 time: 0.156756 Aug 30 05:41:22.666983 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3857/7772] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:22 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:23.688140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:23.689028 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:23.696597 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:23.697096 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:23.697609 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:23.698898 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:23.699375 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:23.699815 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:23.837140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:23.845038 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1d181078-f8e6-4fd5-b826-5c4bd1f35149 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1518 microversion: 2.1 time: 0.161725 Aug 30 05:41:23.845667 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3916/7773] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:23 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:24.406294 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-fbe56171-7e50-4147-9185-6f97dc2526f7 req-8054808f-145b-45e7-8bc5-c98404e03f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de53db96-578e-4568-81a3-61e88d643a28", "name": "network-vif-unplugged", "status": "completed", "tag": "872e86d4-faa0-4e66-b202-ce1e77535f2b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:41:24.416422 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fbe56171-7e50-4147-9185-6f97dc2526f7 req-8054808f-145b-45e7-8bc5-c98404e03f3f service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:24.416913 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fbe56171-7e50-4147-9185-6f97dc2526f7 req-8054808f-145b-45e7-8bc5-c98404e03f3f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:24.417899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-fbe56171-7e50-4147-9185-6f97dc2526f7 req-8054808f-145b-45e7-8bc5-c98404e03f3f service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:24.429563 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.compute.server_external_events [req-fbe56171-7e50-4147-9185-6f97dc2526f7 req-8054808f-145b-45e7-8bc5-c98404e03f3f service nova] Unable to find a host for instance de53db96-578e-4568-81a3-61e88d643a28. Dropping event network-vif-unplugged {{(pid=122402) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 05:41:24.430450 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-fbe56171-7e50-4147-9185-6f97dc2526f7 req-8054808f-145b-45e7-8bc5-c98404e03f3f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028129 Aug 30 05:41:24.431038 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3858/7774] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 30 05:41:24.866212 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:24.866959 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:24.874473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:24.874967 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:24.875419 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:24.876127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:24.876588 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:24.877021 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:25.016798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:25.024858 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94010551-ea6a-4556-b504-62ef2751ac70 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1518 microversion: 2.1 time: 0.162533 Aug 30 05:41:25.025460 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3917/7775] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:24 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:26.045929 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:26.046554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:26.053403 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:26.053899 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:26.054346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:26.055040 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:26.055503 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:26.055940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:26.188420 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:26.196211 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fe10c764-986a-465e-ac3c-ff6f1d62af1f tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1518 microversion: 2.1 time: 0.154306 Aug 30 05:41:26.196785 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3859/7776] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:26 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:27.216421 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:27.217051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:27.224013 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:27.224505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:27.224948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:27.225796 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:27.226331 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:27.226764 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:27.357389 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:27.365428 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ec3e902c-cebb-4350-b8aa-b04a5e80ade5 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1520 microversion: 2.1 time: 0.152936 Aug 30 05:41:27.366017 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3918/7777] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:27 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:28.387554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:28.388189 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:28.395461 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:28.395999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:28.396450 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:28.397165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:28.397698 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:28.398168 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:28.533056 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:28.541515 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-2cb36e4d-c553-4f64-88b7-3e4670979b3b tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1520 microversion: 2.1 time: 0.157932 Aug 30 05:41:28.542124 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3860/7778] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:28 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:41:29.564034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:29.564567 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:29.571622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:29.572063 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:29.572502 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:29.573191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:29.573681 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:29.574108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:29.710534 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:29.719297 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-b84be763-2142-46b2-a957-9aaa4b25dfb9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1520 microversion: 2.1 time: 0.159303 Aug 30 05:41:29.719880 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3919/7779] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:29 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:30.740379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:30.740934 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:30.748587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:30.749092 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:30.749578 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:30.750290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:30.750763 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:30.751210 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:30.886790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:30.894976 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4d2502c9-4fc2-4d28-8f1a-0bb207025bd6 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1520 microversion: 2.1 time: 0.158668 Aug 30 05:41:30.895563 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3861/7780] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:30 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:31.916112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:31.916735 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:31.924252 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:31.924743 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:31.925183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:31.925918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:31.926376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:31.926806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:32.073087 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:32.081629 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-0163a65c-5360-4c58-a115-1654157248f9 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1520 microversion: 2.1 time: 0.169426 Aug 30 05:41:32.082207 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3920/7781] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:31 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:33.102587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:33.103206 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:33.110891 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:33.111379 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:33.111821 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:33.112513 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:33.112974 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:33.113434 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:33.245845 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:33.253708 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4672efdf-5c0e-47e6-a6e8-f901140bf1e1 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.154971 Aug 30 05:41:33.254322 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3862/7782] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:33 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:34.275338 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:34.275884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:34.283385 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:34.283874 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:34.284318 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:34.285011 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:34.285496 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:34.285923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:34.304924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:34.424313 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:34.432217 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-97ae98b2-3c68-47b9-a273-76542ba03a67 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.160899 Aug 30 05:41:34.432855 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3921/7783] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:34 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:35.453152 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:35.453799 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:35.460581 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:35.461072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:35.461552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:35.462246 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:35.462709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:35.463147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:35.880789 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:35.888601 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc441851-2649-4280-a4af-1913a171cf22 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.439343 Aug 30 05:41:35.889175 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3863/7784] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:35 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:36.910739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:36.911624 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:36.918435 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:36.918920 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:36.919354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:36.920041 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:36.920493 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:36.920919 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:37.059763 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:37.067498 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-a64edc4c-dfde-4e88-9f7e-5cb887e98581 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.160959 Aug 30 05:41:37.068070 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3922/7785] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:36 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:38.091575 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:38.092211 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:38.094912 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=29 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:38.103290 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:38.103816 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:38.104275 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:38.105587 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:38.106052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:38.106764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:38.109363 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=81 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:38.239615 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:38.247731 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1abf156f-2245-4d0e-aacf-6dc951445b91 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.161070 Aug 30 05:41:38.248300 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3864/7786] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:38 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:39.270396 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:39.271023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:39.273994 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:41:39.279975 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:39.280474 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:39.280916 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:39.281652 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:39.282115 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:39.282547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:39.424856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:39.433841 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-01a3b6e9-a8e1-4941-99cf-56ba2d8e4e5e tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.167344 Aug 30 05:41:39.434437 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3923/7787] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:39 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:40.455994 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:40.456756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:40.469707 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:40.470217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:40.470676 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:40.471431 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:40.471903 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:40.472352 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:40.611794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:40.619627 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-a8d97007-49c7-447f-b535-c03902c7521c tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.167810 Aug 30 05:41:40.620725 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3865/7788] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:40 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:41.641642 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:41.642300 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:41.648963 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:41.649492 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:41.649936 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:41.650619 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:41.651077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:41.651506 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:41.782953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:41.795335 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5fbc6617-e214-40cf-abb4-23a1e5697b29 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.157817 Aug 30 05:41:41.795930 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3924/7789] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:41 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:42.556113 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de53db96-578e-4568-81a3-61e88d643a28", "name": "network-vif-plugged", "status": "completed", "tag": "872e86d4-faa0-4e66-b202-ce1e77535f2b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:41:42.566545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:42.567073 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:42.567526 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:42.579870 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] Creating event network-vif-plugged:872e86d4-faa0-4e66-b202-ce1e77535f2b for instance de53db96-578e-4568-81a3-61e88d643a28 on n-h2-854925-5 Aug 30 05:41:42.583493 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] [ea88f754-a1ac-45ec-b6bf-88e27a97e274] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:41:42.816077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:42.816847 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:42.823890 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:42.824401 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:42.824824 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:42.825556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:42.826018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:42.826454 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:42.964872 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:42.973280 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8fccad5c-8749-47b2-8cbf-9af789b7d1ec tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.161170 Aug 30 05:41:42.973881 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3925/7790] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:42 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:41:43.591131 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] [ea88f754-a1ac-45ec-b6bf-88e27a97e274] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 40788. Aug 30 05:41:43.594656 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-102c656c-b239-4a96-8b24-f92a9d453eeb req-1b98bd11-1ed4-4044-9a22-40d7b3908a71 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.093382 Aug 30 05:41:43.595290 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3866/7791] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:41:43.994589 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:43.995843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:44.002780 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:44.003267 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:44.003708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:44.004397 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:44.004850 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:44.005278 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:44.139243 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:44.147043 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-84a24537-8d5f-47a7-8b37-4f1f38a1e669 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1576 microversion: 2.1 time: 0.156406 Aug 30 05:41:44.147617 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3926/7792] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:43 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:41:45.170001 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:41:45.170714 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:41:45.177446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:45.177938 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:45.178387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:45.179082 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:41:45.179545 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:41:45.179987 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:41:45.309416 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:41:45.317225 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-1f71f082-65f7-4e5a-8103-e84dd144fcb3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1563 microversion: 2.1 time: 0.152825 Aug 30 05:41:45.317826 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3867/7793] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:41:45 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:01.778306 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=7 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:01.779184 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=32 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:01.779338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=7 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:01.780009 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=19 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:01.781603 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:43:01.781750 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:43:01.781898 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:43:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 30 05:43:01.782252 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:43:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 (ip 10.222.0.27) !!! Aug 30 05:43:01.786806 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-a1bdb105-6836-4d5b-9acb-c776a669636c req-0f0461ee-92b7-44ea-b089-f2ecc1585127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de53db96-578e-4568-81a3-61e88d643a28", "tag": "872e86d4-faa0-4e66-b202-ce1e77535f2b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:43:01.797806 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:01.799514 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:01.799856 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a1bdb105-6836-4d5b-9acb-c776a669636c req-0f0461ee-92b7-44ea-b089-f2ecc1585127 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:01.800359 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a1bdb105-6836-4d5b-9acb-c776a669636c req-0f0461ee-92b7-44ea-b089-f2ecc1585127 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:01.800829 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-a1bdb105-6836-4d5b-9acb-c776a669636c req-0f0461ee-92b7-44ea-b089-f2ecc1585127 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:01.808472 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:01.808969 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:01.809428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:01.810140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:01.810598 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:01.811034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:01.814037 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-a1bdb105-6836-4d5b-9acb-c776a669636c req-0f0461ee-92b7-44ea-b089-f2ecc1585127 service nova] Creating event network-changed:872e86d4-faa0-4e66-b202-ce1e77535f2b for instance de53db96-578e-4568-81a3-61e88d643a28 on n-h2-854925-5 Aug 30 05:43:01.819348 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-a1bdb105-6836-4d5b-9acb-c776a669636c req-0f0461ee-92b7-44ea-b089-f2ecc1585127 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041903 Aug 30 05:43:01.820275 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3868/7794] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:43:01.841035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:43:01.934782 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e66f39a7-7afa-4844-8629-0ea1d1cf3ae3 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "DELETE /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 204 len: 0 microversion: 2.1 time: 0.159402 Aug 30 05:43:01.935763 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3927/7795] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:43:01 2022] DELETE /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:43:01.944527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:01.945263 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:01.951914 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:01.952458 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:01.952922 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:01.953679 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:01.954159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:01.954607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:02.105098 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:02.113981 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-eaf42418-e210-4b82-bd8f-459df884e5b8 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.173777 Aug 30 05:43:02.114630 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3869/7796] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:01 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:43:03.136202 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:03.137015 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:03.144728 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:03.145204 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:03.145665 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:03.146356 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:03.146835 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:03.147246 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:03.292664 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:03.300631 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-611153cf-6166-48a0-a027-f7a4b61e11e0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1569 microversion: 2.1 time: 0.168872 Aug 30 05:43:03.301203 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3928/7797] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:03 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:03.906706 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-59f3b706-3535-43f3-98f9-865a0898aa58 req-db1e16d9-a969-498a-b079-2b7bdd3b3b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de53db96-578e-4568-81a3-61e88d643a28", "name": "network-vif-deleted", "tag": "872e86d4-faa0-4e66-b202-ce1e77535f2b"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:43:03.917062 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-59f3b706-3535-43f3-98f9-865a0898aa58 req-db1e16d9-a969-498a-b079-2b7bdd3b3b84 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:03.917825 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-59f3b706-3535-43f3-98f9-865a0898aa58 req-db1e16d9-a969-498a-b079-2b7bdd3b3b84 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:03.918305 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-59f3b706-3535-43f3-98f9-865a0898aa58 req-db1e16d9-a969-498a-b079-2b7bdd3b3b84 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:03.930723 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-59f3b706-3535-43f3-98f9-865a0898aa58 req-db1e16d9-a969-498a-b079-2b7bdd3b3b84 service nova] Creating event network-vif-deleted:872e86d4-faa0-4e66-b202-ce1e77535f2b for instance de53db96-578e-4568-81a3-61e88d643a28 on n-h2-854925-5 Aug 30 05:43:03.935881 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-59f3b706-3535-43f3-98f9-865a0898aa58 req-db1e16d9-a969-498a-b079-2b7bdd3b3b84 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094395 Aug 30 05:43:03.936493 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3870/7798] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:43:04.322052 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:04.322708 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:04.329544 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:04.330057 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:04.330478 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:04.331171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:04.331637 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:04.332071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:04.417019 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:04.426069 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c890e156-f342-453e-940c-e364d03a5427 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1219 microversion: 2.1 time: 0.107851 Aug 30 05:43:04.426917 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3929/7799] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:04 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:05.451287 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:05.452013 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:05.458498 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:05.458999 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:05.459460 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:05.460213 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:05.460685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:05.461131 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:05.527034 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:05.535178 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-69ce37d1-eb1e-4040-9ff4-4fce57989d54 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1219 microversion: 2.1 time: 0.089170 Aug 30 05:43:05.536002 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3871/7800] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:05 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:06.557660 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:06.558228 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:06.565355 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:06.565843 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:06.566285 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:06.566978 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:06.567440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:06.568012 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:06.630987 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:06.639125 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c03d98b7-f6c9-452b-8a7c-10d1aaf9e279 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1219 microversion: 2.1 time: 0.085887 Aug 30 05:43:06.639702 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3930/7801] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:06 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:07.660764 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:07.661421 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:07.668331 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:07.668841 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:07.669293 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:07.670030 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:07.670500 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:07.670947 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:07.733374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef9a4cf4217488cbf7ffe96d4e350db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4736613a59b4dee92992b02a81e7245', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:07.741465 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-4b455008-6e23-4a66-8df5-ae3be1200407 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 200 len: 1219 microversion: 2.1 time: 0.084608 Aug 30 05:43:07.742043 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3872/7802] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:07 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:08.761940 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:08.762554 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] [instance: de53db96-578e-4568-81a3-61e88d643a28] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:08.769793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:08.770292 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:08.770736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:08.771440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:08.771895 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:08.772322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:08.786860 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] HTTP exception thrown: Instance de53db96-578e-4568-81a3-61e88d643a28 could not be found. Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Request method failure captured: Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 HTTP/1.1 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDaFEzQp7iyqthSmTu1kMcd_Uc8YZlRpnRRO87JrQwariNUTdhbKmYIYH_qAfG3cM5At3eZEgW-27umhoDXpth18iADzNFKuFAasnZonvaYmf5TnwLdlaOYg8dZybUVvkXGvEoDQR_LqomxE4Q_BLiGuTpUfv1_6uX8abRyd5WZ8ThEQ Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: e4736613a59b4dee92992b02a81e7245 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestShelveInstance-1831233960 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e4736613a59b4dee92992b02a81e7245", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e4736613a59b4dee92992b02a81e7245"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4736613a59b4dee92992b02a81e7245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e4736613a59b4dee92992b02a81e7245"}]}] Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestShelveInstance-1831233960 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: e4736613a59b4dee92992b02a81e7245 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestShelveInstance-1831233960 Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestShelveInstance-1831233960-project Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 2ef9a4cf4217488cbf7ffe96d4e350db Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestShelveInstance-1831233960-project Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance de53db96-578e-4568-81a3-61e88d643a28 could not be found. Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': 'de53db96-578e-4568-81a3-61e88d643a28'} Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de53db96-578e-4568-81a3-61e88d643a28 could not be found. Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de53db96-578e-4568-81a3-61e88d643a28 could not be found. Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:43:08.788579 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de53db96-578e-4568-81a3-61e88d643a28 could not be found. Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Returning 404 to user: Instance de53db96-578e-4568-81a3-61e88d643a28 could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c406def8-7c33-40e2-b885-f03ac37865f0 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28" status: 404 len: 111 microversion: 2.1 time: 0.032221 Aug 30 05:43:08.793048 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3931/7803] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:08 2022] GET /compute/v2.1/servers/de53db96-578e-4568-81a3-61e88d643a28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:43:08.956740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f9e57ecc-572e-46e1-af16-df009c39e913 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] Calling method '.version_select at 0x7fe9684bd160>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:08.984556 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f9e57ecc-572e-46e1-af16-df009c39e913 tempest-TestShelveInstance-1831233960 tempest-TestShelveInstance-1831233960-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1717536284" status: 202 len: 0 microversion: 2.1 time: 0.031017 Aug 30 05:43:08.985866 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3873/7804] 10.222.0.27 () {58 vars in 1254 bytes} [Tue Aug 30 05:43:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1717536284 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 05:43:26.387842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:26.388788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:26.563691 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-8e35f883-30cf-421f-acd7-a7f46e49643c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Action: 'create', calling method: .version_select at 0x7fe96e439670>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1079679684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeXbpQAEGVynbGV3TwZA4/YVRN5Pxcje40Mzw7GgJkeu6MftdKUkTsN+U1sHbWYbwiqUUXss6o3M9f57oXMa13p910zB6wX7eIBLEGNmX+GCI+aXKXvv1fzUm0HRx48lw=="}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:43:26.579736 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8e35f883-30cf-421f-acd7-a7f46e49643c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Getting quotas for project 3fdfc4fac3134c4e8bfa5889fef210bd. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:43:26.584918 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-8e35f883-30cf-421f-acd7-a7f46e49643c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Getting quotas for user 9016ef0540ac4782953e0d7e0432f391 and project 3fdfc4fac3134c4e8bfa5889fef210bd. Resources: {'key_pairs'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:43:26.613242 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-8e35f883-30cf-421f-acd7-a7f46e49643c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.230685 Aug 30 05:43:26.614034 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3932/7805] 10.222.0.27 () {60 vars in 1159 bytes} [Tue Aug 30 05:43:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:43:27.737865 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=22 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:27.739286 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:27.744236 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-783561027", "imageRef": "b5ae2bcd-efca-4003-b452-ab36e7c230c2", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1079679684", "security_groups": [{"name": "tempest-secgroup-smoke-1530618074"}], "networks": [{"uuid": "7d77c94b-a871-4c5d-a9e2-657eb83b51f0"}]}} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:43:27.857426 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.network.neutron [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] validate_networks() for [('7d77c94b-a871-4c5d-a9e2-657eb83b51f0', None, None, None, None, None)] {{(pid=122402) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:43:28.335544 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Flavor limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:43:28.335985 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Image limits 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:43:28.336474 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Flavor pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:43:28.336897 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Image pref 0:0:0 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:43:28.337338 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.virt.hardware [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122402) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:43:28.347080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:28.347960 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:28.348740 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:28.349702 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:28.350376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:28.351156 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:28.370457 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Getting quotas for project 3fdfc4fac3134c4e8bfa5889fef210bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:43:28.376562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.quota [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Getting quotas for user 9016ef0540ac4782953e0d7e0432f391 and project 3fdfc4fac3134c4e8bfa5889fef210bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122402) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:43:28.389685 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Going to run 1 instances... {{(pid=122402) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:43:28.392047 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b5ae2bcd-efca-4003-b452-ab36e7c230c2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122402) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:43:28.444070 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-8727f552-7915-4787-81ba-251d8974eec0 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708969 Aug 30 05:43:28.444968 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3874/7806] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:43:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:43:28.456340 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-bbaf44bf-2257-4e9c-9168-d58817dd1748 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:28.456956 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-bbaf44bf-2257-4e9c-9168-d58817dd1748 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:28.517383 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-bbaf44bf-2257-4e9c-9168-d58817dd1748 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:28.524648 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-bbaf44bf-2257-4e9c-9168-d58817dd1748 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1248 microversion: 2.1 time: 0.073067 Aug 30 05:43:28.535484 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3933/7807] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:28 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1248 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:29.547344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:29.548692 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:29.558015 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:29.558793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:29.559673 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:29.560767 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:29.562248 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:29.562848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:29.637946 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:29.650610 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-829535bf-6674-4c5c-8cbc-0b6bea0ae923 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1308 microversion: 2.1 time: 0.108632 Aug 30 05:43:29.652893 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3875/7808] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:29 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:30.672219 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:30.672827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:30.679798 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:30.680284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:30.680720 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:30.681444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:30.681897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:30.682448 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:30.822431 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:30.831717 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c686e7df-ba4b-4ae1-8730-3e7facc01fe4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1374 microversion: 2.1 time: 0.163393 Aug 30 05:43:30.832936 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3934/7809] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:30 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:30.928269 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-c48e409c-05a7-4219-91ee-2b98fcf53201 req-1540102c-93f9-4c0e-8eca-e8a76c6caafe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cf9ffb-20eb-450e-9609-740610b02a63", "tag": "e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:43:30.943223 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c48e409c-05a7-4219-91ee-2b98fcf53201 req-1540102c-93f9-4c0e-8eca-e8a76c6caafe service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:30.943727 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c48e409c-05a7-4219-91ee-2b98fcf53201 req-1540102c-93f9-4c0e-8eca-e8a76c6caafe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:30.944179 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-c48e409c-05a7-4219-91ee-2b98fcf53201 req-1540102c-93f9-4c0e-8eca-e8a76c6caafe service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:30.956849 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-c48e409c-05a7-4219-91ee-2b98fcf53201 req-1540102c-93f9-4c0e-8eca-e8a76c6caafe service nova] Creating event network-changed:e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39 for instance 09cf9ffb-20eb-450e-9609-740610b02a63 on n-h2-854925-5 Aug 30 05:43:30.962138 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-c48e409c-05a7-4219-91ee-2b98fcf53201 req-1540102c-93f9-4c0e-8eca-e8a76c6caafe service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037833 Aug 30 05:43:30.963346 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3876/7810] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:43:31.852889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:31.853541 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:31.861473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:31.861965 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:31.862436 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:31.863112 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:31.863560 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:31.863988 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:31.995464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:32.003123 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-3ee5ef6a-65d0-4a1f-8524-87be64c8e585 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1374 microversion: 2.1 time: 0.154187 Aug 30 05:43:32.003692 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3935/7811] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:31 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:33.027180 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:33.027986 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:33.035386 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:33.036115 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:33.036582 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:33.037658 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:33.038133 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:33.038591 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:33.263932 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:33.271934 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-23734a62-2c17-4331-b113-f491ea721a71 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1374 microversion: 2.1 time: 0.251511 Aug 30 05:43:33.272536 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3877/7812] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:33 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1374 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:34.293434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:34.294055 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:34.301528 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:34.302009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:34.302445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:34.303131 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:34.303586 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:34.304009 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:34.496864 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:34.505439 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-94d4f624-8006-49cd-8e13-974e8c015434 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1374 microversion: 2.1 time: 0.215973 Aug 30 05:43:34.506314 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3936/7813] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:34 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1374 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:35.526890 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:35.527527 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:35.534475 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:35.534980 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:35.535437 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:35.536149 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:35.536616 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:35.537059 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:35.669739 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:35.677960 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5ad85b85-490e-47a8-86fb-17f669680278 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1374 microversion: 2.1 time: 0.155114 Aug 30 05:43:35.678533 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3878/7814] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:35 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:36.699095 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:36.699697 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:36.707034 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:36.707484 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:36.707910 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:36.708601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:36.709059 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:36.709525 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:36.839259 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:36.846940 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-819c6000-4cc5-40cc-a57b-e8b0f988bd4e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1374 microversion: 2.1 time: 0.151817 Aug 30 05:43:36.847525 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3937/7815] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:36 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:37.161917 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3e03a16c-b8b8-4cae-ac5c-c82db2cd6b2a req-558092e8-4fc2-4ab4-b905-a0eb8f76a94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cf9ffb-20eb-450e-9609-740610b02a63", "name": "network-vif-plugged", "status": "completed", "tag": "e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:43:37.174306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3e03a16c-b8b8-4cae-ac5c-c82db2cd6b2a req-558092e8-4fc2-4ab4-b905-a0eb8f76a94b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:37.174822 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3e03a16c-b8b8-4cae-ac5c-c82db2cd6b2a req-558092e8-4fc2-4ab4-b905-a0eb8f76a94b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:37.175254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3e03a16c-b8b8-4cae-ac5c-c82db2cd6b2a req-558092e8-4fc2-4ab4-b905-a0eb8f76a94b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:37.187169 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3e03a16c-b8b8-4cae-ac5c-c82db2cd6b2a req-558092e8-4fc2-4ab4-b905-a0eb8f76a94b service nova] Creating event network-vif-plugged:e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39 for instance 09cf9ffb-20eb-450e-9609-740610b02a63 on n-h2-854925-5 Aug 30 05:43:37.192340 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3e03a16c-b8b8-4cae-ac5c-c82db2cd6b2a req-558092e8-4fc2-4ab4-b905-a0eb8f76a94b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034148 Aug 30 05:43:37.192946 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3879/7816] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:43:37.867772 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:37.868398 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:37.875328 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:37.875816 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:37.876260 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:37.876953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:37.877440 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:37.877873 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:38.008180 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:38.016456 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-6c2f80c4-8900-48c0-9489-5fc9aa6f61eb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1374 microversion: 2.1 time: 0.152650 Aug 30 05:43:38.017029 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3938/7817] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:37 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:39.038031 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:39.038751 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:39.041704 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:39.042389 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=6 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:39.048628 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:39.049126 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:39.049607 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:39.050316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:39.050784 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:39.051225 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:39.189617 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:39.197666 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-186489be-b6df-4cdb-9937-afb8a9260d69 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1559 microversion: 2.1 time: 0.163899 Aug 30 05:43:39.198249 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3880/7818] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:39 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:43:39.218444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:43:39.219191 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:43:39.221161 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=6 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:43:39.227711 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:39.228227 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:39.228668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:39.230001 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:39.230460 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:39.230889 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:39.362592 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:43:39.370411 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-39e11ddb-c78b-43b3-8af8-b6c376d95043 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1559 microversion: 2.1 time: 0.155900 Aug 30 05:43:39.370982 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3939/7819] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:43:39 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:43:41.023508 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-2c8aefc7-ae21-4b56-838c-5896fc53bad9 req-b398ec92-d1b6-4492-8c62-3a57050fd5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cf9ffb-20eb-450e-9609-740610b02a63", "tag": "e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:43:41.034531 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2c8aefc7-ae21-4b56-838c-5896fc53bad9 req-b398ec92-d1b6-4492-8c62-3a57050fd5a9 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:43:41.035037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2c8aefc7-ae21-4b56-838c-5896fc53bad9 req-b398ec92-d1b6-4492-8c62-3a57050fd5a9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:43:41.035528 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-2c8aefc7-ae21-4b56-838c-5896fc53bad9 req-b398ec92-d1b6-4492-8c62-3a57050fd5a9 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:43:41.046816 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-2c8aefc7-ae21-4b56-838c-5896fc53bad9 req-b398ec92-d1b6-4492-8c62-3a57050fd5a9 service nova] Creating event network-changed:e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39 for instance 09cf9ffb-20eb-450e-9609-740610b02a63 on n-h2-854925-5 Aug 30 05:43:41.051938 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-2c8aefc7-ae21-4b56-838c-5896fc53bad9 req-b398ec92-d1b6-4492-8c62-3a57050fd5a9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032163 Aug 30 05:43:41.052531 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3881/7820] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:45:36.170642 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d6bf038f-e45d-4293-8cc8-126372c20574] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 05:45:36.171455 n-d-854925-5 devstack@n-api.service[122403]: ERROR oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] AMQP server on 10.222.0.27:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 30 05:45:36.171979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:36.172768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=36 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:36.174045 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 30 05:45:36.174191 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:45:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63/action (ip 10.222.0.27) !!! Aug 30 05:45:36.176190 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:45:36.176325 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:45:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63/action (ip 10.222.0.27) !!! Aug 30 05:45:36.181504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-470217898"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:45:36.183861 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:36.202391 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:36.202884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:36.203327 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:36.204035 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:36.204494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:36.204924 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:36.392891 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a028ff2-ad5f-4428-bc1f-b03e1b93ce34 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "POST /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63/action" status: 202 len: 0 microversion: 2.1 time: 0.224358 Aug 30 05:45:36.393573 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3940/7821] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:45:36 2022] POST /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 05:45:41.775394 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:45:41.776569 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] AMQP server on 10.222.0.27:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 05:45:41.777178 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:41.777965 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=32 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:41.783348 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3956cc5b-7566-4104-a49c-d03cc624e67d req-6ab82fb8-4337-4789-9d63-5aa7eb7fe98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cf9ffb-20eb-450e-9609-740610b02a63", "name": "network-vif-plugged", "status": "completed", "tag": "e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:45:41.800737 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3956cc5b-7566-4104-a49c-d03cc624e67d req-6ab82fb8-4337-4789-9d63-5aa7eb7fe98d service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:41.801754 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3956cc5b-7566-4104-a49c-d03cc624e67d req-6ab82fb8-4337-4789-9d63-5aa7eb7fe98d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:41.802715 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3956cc5b-7566-4104-a49c-d03cc624e67d req-6ab82fb8-4337-4789-9d63-5aa7eb7fe98d service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:41.818470 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3956cc5b-7566-4104-a49c-d03cc624e67d req-6ab82fb8-4337-4789-9d63-5aa7eb7fe98d service nova] Creating event network-vif-plugged:e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39 for instance 09cf9ffb-20eb-450e-9609-740610b02a63 on n-h2-854925-5 Aug 30 05:45:41.824959 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3956cc5b-7566-4104-a49c-d03cc624e67d req-6ab82fb8-4337-4789-9d63-5aa7eb7fe98d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053391 Aug 30 05:45:41.826252 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3882/7822] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:45:48.908250 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:48.909673 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:48.915662 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1767023204", "imageRef": "382988d8-235e-4f45-b226-91bf83bd51a6", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1079679684", "security_groups": [{"name": "tempest-secgroup-smoke-1530618074"}], "networks": [{"uuid": "7d77c94b-a871-4c5d-a9e2-657eb83b51f0"}]}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:45:48.940809 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] [842c1aab-8af1-41c7-b7c0-88e98beb25d0] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41204. Aug 30 05:45:48.942318 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] [d6bf038f-e45d-4293-8cc8-126372c20574] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41202. Aug 30 05:45:49.032273 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.network.neutron [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] validate_networks() for [('7d77c94b-a871-4c5d-a9e2-657eb83b51f0', None, None, None, None, None)] {{(pid=122403) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Aug 30 05:45:49.409570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Flavor limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 05:45:49.410002 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Image limits 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 05:45:49.410486 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Flavor pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 05:45:49.410900 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Image pref 0:0:0 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 05:45:49.411317 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.virt.hardware [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122403) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 05:45:49.420677 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:49.421159 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:49.421633 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:49.422363 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:49.422821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:49.423256 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:49.440346 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Getting quotas for project 3fdfc4fac3134c4e8bfa5889fef210bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 05:45:49.445549 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.quota [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Getting quotas for user 9016ef0540ac4782953e0d7e0432f391 and project 3fdfc4fac3134c4e8bfa5889fef210bd. Resources: {'instances', 'cores', 'ram'} {{(pid=122403) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 05:45:49.457740 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Going to run 1 instances... {{(pid=122403) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 05:45:49.460214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='382988d8-235e-4f45-b226-91bf83bd51a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122403) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 05:45:49.511372 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-ffd95c03-7341-464c-9b13-09ff596113a7 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.605197 Aug 30 05:45:49.512023 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3941/7823] 10.222.0.27 () {60 vars in 1147 bytes} [Tue Aug 30 05:45:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 05:45:49.523612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-5b8e9b0c-9f6c-4345-9480-db6a829961ba tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:49.524372 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-5b8e9b0c-9f6c-4345-9480-db6a829961ba tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:49.552516 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41218. Aug 30 05:45:49.553824 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41220. Aug 30 05:45:49.586761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-5b8e9b0c-9f6c-4345-9480-db6a829961ba tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:49.595041 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-5b8e9b0c-9f6c-4345-9480-db6a829961ba tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1249 microversion: 2.1 time: 0.075962 Aug 30 05:45:49.595800 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3883/7824] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:49 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:50.616494 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-77aebeb2-0c83-4587-8b20-4b2c41882074 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:50.617108 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-77aebeb2-0c83-4587-8b20-4b2c41882074 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:50.670220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-77aebeb2-0c83-4587-8b20-4b2c41882074 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:50.677420 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-77aebeb2-0c83-4587-8b20-4b2c41882074 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1249 microversion: 2.1 time: 0.065670 Aug 30 05:45:50.677988 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3942/7825] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:50 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1249 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:51.697549 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:51.698193 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:51.705387 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:51.706187 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:51.706655 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:51.707374 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:51.707877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:51.708329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:51.726094 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-c47f315f-a81e-4ea5-9f5c-12be533ff4b6 req-97cf4a8e-b773-4375-9f2e-281cb2ad6c7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cf9ffb-20eb-450e-9609-740610b02a63", "name": "network-vif-unplugged", "status": "completed", "tag": "e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:45:51.740283 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c47f315f-a81e-4ea5-9f5c-12be533ff4b6 req-97cf4a8e-b773-4375-9f2e-281cb2ad6c7e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:51.740785 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c47f315f-a81e-4ea5-9f5c-12be533ff4b6 req-97cf4a8e-b773-4375-9f2e-281cb2ad6c7e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:51.741225 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-c47f315f-a81e-4ea5-9f5c-12be533ff4b6 req-97cf4a8e-b773-4375-9f2e-281cb2ad6c7e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:51.755470 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-c47f315f-a81e-4ea5-9f5c-12be533ff4b6 req-97cf4a8e-b773-4375-9f2e-281cb2ad6c7e service nova] Creating event network-vif-unplugged:e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39 for instance 09cf9ffb-20eb-450e-9609-740610b02a63 on n-h2-854925-5 Aug 30 05:45:51.760982 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-c47f315f-a81e-4ea5-9f5c-12be533ff4b6 req-97cf4a8e-b773-4375-9f2e-281cb2ad6c7e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038588 Aug 30 05:45:51.761690 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3943/7826] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:45:51.771963 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:51.780090 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-69fb196a-c356-45f8-b41a-3a39ae4ee215 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1253 microversion: 2.1 time: 0.086553 Aug 30 05:45:51.780763 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3884/7827] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:51 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:52.803606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:52.804322 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:52.814680 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:52.815606 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:52.816490 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:52.817198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:52.820269 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:52.820717 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:52.905904 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:52.914146 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c999073d-d809-4bf2-bde6-1f738bf3c63c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1319 microversion: 2.1 time: 0.115920 Aug 30 05:45:52.914820 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3944/7828] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:52 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:53.936940 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:53.938802 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:53.952696 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:53.953576 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:53.954237 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:53.954975 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:53.955453 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:53.956075 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:54.104375 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:54.112645 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-bdc0bc98-992c-43da-a4f1-a3a9cbf19d4c tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.181019 Aug 30 05:45:54.114564 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3885/7829] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:53 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:55.134026 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:55.135104 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:55.145301 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:55.146160 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:55.146827 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:55.147551 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:55.148018 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:55.148445 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:55.301029 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:55.309212 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e7fb8585-0649-431a-8ab8-b5366238bc04 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.179078 Aug 30 05:45:55.321768 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3945/7830] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:55 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:56.330522 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:56.331229 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:56.338882 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:56.339554 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:56.340037 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:56.341069 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:56.341562 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:56.342091 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:56.491351 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:56.500230 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-efb6668f-a19d-495e-a498-9cb821f7786e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.173931 Aug 30 05:45:56.500818 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3886/7831] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:56 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:57.521164 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:57.521823 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:57.528928 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:57.529453 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:57.530245 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:57.530587 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:57.531042 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:57.531468 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:57.679690 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:57.687699 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-142b831b-a987-4ca4-82a5-d54c80c514b4 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.170359 Aug 30 05:45:57.698227 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3946/7832] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:57 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:45:58.708337 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:58.708970 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:58.716838 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:58.717354 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:58.720164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:58.720164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:58.720164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:58.720164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:58.868147 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:45:58.878187 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-adb17ad7-56ee-4936-a68e-a2dfe7050775 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.173743 Aug 30 05:45:58.878782 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3887/7833] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:58 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 05:45:59.901077 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:45:59.901739 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:45:59.908240 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:45:59.909865 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:59.910451 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:59.911065 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:45:59.911754 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:45:59.912220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:45:59.912648 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:00.063960 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:00.073034 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-e6449580-50e2-454e-8515-70556f7c9fab tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.175807 Aug 30 05:46:00.074051 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3947/7834] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:45:59 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:01.094302 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:01.094931 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:01.096791 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell0:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:46:01.102703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:01.103217 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:01.103646 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:01.104495 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:01.104995 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:01.105491 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:01.244555 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:01.252232 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-be87f26a-94cb-4844-ae4c-7d6ddfa95c1e tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.162021 Aug 30 05:46:01.252816 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3888/7835] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:01 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:02.273953 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:02.275084 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:02.276944 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell0:SELECT=8 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:46:02.283061 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:02.283547 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:02.283986 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:02.284675 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:02.285132 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:02.285581 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:02.420844 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:02.428528 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-d01a4ab8-fba9-4dc6-9ad5-eed6c015baee tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.158687 Aug 30 05:46:02.429113 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3948/7836] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:02 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:03.251396 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-b1268fb2-8b1c-41a0-8639-b182de064770 req-63bee575-f48e-4aef-b365-bad16bbb452c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e904e6-acf4-49cc-986d-f6db6e78d69d", "tag": "3f4931b7-9276-4ff3-b56b-1a257aa4b12e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:46:03.261153 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b1268fb2-8b1c-41a0-8639-b182de064770 req-63bee575-f48e-4aef-b365-bad16bbb452c service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:03.261712 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b1268fb2-8b1c-41a0-8639-b182de064770 req-63bee575-f48e-4aef-b365-bad16bbb452c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:03.262172 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-b1268fb2-8b1c-41a0-8639-b182de064770 req-63bee575-f48e-4aef-b365-bad16bbb452c service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:03.273097 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-b1268fb2-8b1c-41a0-8639-b182de064770 req-63bee575-f48e-4aef-b365-bad16bbb452c service nova] Creating event network-changed:3f4931b7-9276-4ff3-b56b-1a257aa4b12e for instance 42e904e6-acf4-49cc-986d-f6db6e78d69d on n-h1-854925-5 Aug 30 05:46:03.278866 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-b1268fb2-8b1c-41a0-8639-b182de064770 req-63bee575-f48e-4aef-b365-bad16bbb452c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123906 Aug 30 05:46:03.279499 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3889/7837] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:46:03.449884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:03.450428 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:03.457298 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:03.458023 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:03.458464 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:03.459162 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:03.459621 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:03.460051 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:03.672793 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:03.682495 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c7685717-1435-444c-a96a-dc279230f6e9 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.236395 Aug 30 05:46:03.683111 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3949/7838] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:03 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:04.708046 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:04.708790 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:04.715662 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:04.716160 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:04.716612 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:04.717316 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:04.717808 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:04.718249 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:04.856346 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:04.864333 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-cf7c2512-e133-4495-a672-53bb3c38075a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.161582 Aug 30 05:46:04.864913 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3890/7839] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:04 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:05.884716 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:05.885434 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:05.892537 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:05.893032 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:05.893509 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:05.894223 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:05.894683 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:05.895117 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:06.401856 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:06.409574 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-5e3d96d4-55b1-460e-8c66-0a01dc002742 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.529413 Aug 30 05:46:06.410152 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3950/7840] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:05 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:07.431376 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:07.432006 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:07.442381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:07.442381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:07.442381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:07.442381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:07.442381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:07.442381 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:07.585122 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:07.593075 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-e84ba96b-2803-42bc-95f1-f62c08d5bb1d tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.166364 Aug 30 05:46:07.593698 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3891/7841] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:07 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:08.616214 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:08.616842 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:08.623884 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:08.624376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:08.624821 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:08.625556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:08.626022 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:08.626458 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:08.762276 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:08.770047 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-1a7c4953-66d1-4ec8-9ef5-ea739572f40a tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.157856 Aug 30 05:46:08.770632 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3951/7842] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:08 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:09.327010 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-3e420a8c-2ccf-4c1b-bffd-4e321c2534f9 req-0170a702-a26d-4be2-8239-6e17dc167208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e904e6-acf4-49cc-986d-f6db6e78d69d", "name": "network-vif-plugged", "status": "completed", "tag": "3f4931b7-9276-4ff3-b56b-1a257aa4b12e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:46:09.339984 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3e420a8c-2ccf-4c1b-bffd-4e321c2534f9 req-0170a702-a26d-4be2-8239-6e17dc167208 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:09.340898 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3e420a8c-2ccf-4c1b-bffd-4e321c2534f9 req-0170a702-a26d-4be2-8239-6e17dc167208 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:09.341383 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-3e420a8c-2ccf-4c1b-bffd-4e321c2534f9 req-0170a702-a26d-4be2-8239-6e17dc167208 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:09.356824 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-3e420a8c-2ccf-4c1b-bffd-4e321c2534f9 req-0170a702-a26d-4be2-8239-6e17dc167208 service nova] Creating event network-vif-plugged:3f4931b7-9276-4ff3-b56b-1a257aa4b12e for instance 42e904e6-acf4-49cc-986d-f6db6e78d69d on n-h1-854925-5 Aug 30 05:46:09.363205 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-3e420a8c-2ccf-4c1b-bffd-4e321c2534f9 req-0170a702-a26d-4be2-8239-6e17dc167208 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040393 Aug 30 05:46:09.363842 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3892/7843] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:46:09.791714 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:09.792337 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:09.799491 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:09.799984 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:09.800424 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:09.801127 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:09.801612 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:09.802044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:09.939186 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:09.946884 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-42a229a9-4418-4e6b-a991-eb4731ece7bc tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1375 microversion: 2.1 time: 0.159670 Aug 30 05:46:09.947462 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3952/7844] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:09 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:10.968344 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:10.969065 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:10.976280 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:10.976775 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:10.977228 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:10.977948 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:10.978414 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:10.978862 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:11.109783 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:11.118244 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-fc39e7aa-2370-46d4-b4bb-e0765575b208 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1560 microversion: 2.1 time: 0.154146 Aug 30 05:46:11.118822 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3893/7845] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:10 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:11.138942 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:46:11.139558 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:46:11.146310 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:11.146788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:11.147220 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:11.147903 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:11.148354 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:11.148778 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:11.286438 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:46:11.294313 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-c2d035ce-d965-4a32-990d-f03eaa038285 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1560 microversion: 2.1 time: 0.159251 Aug 30 05:46:11.294889 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3953/7846] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:46:11 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:46:12.870520 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-238b5a70-4090-4219-94b4-a098495caa7b req-2b4e0003-4f23-4d3b-b347-0f1f7a2a36f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e904e6-acf4-49cc-986d-f6db6e78d69d", "tag": "3f4931b7-9276-4ff3-b56b-1a257aa4b12e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:46:12.880744 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-238b5a70-4090-4219-94b4-a098495caa7b req-2b4e0003-4f23-4d3b-b347-0f1f7a2a36f6 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:46:12.881252 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-238b5a70-4090-4219-94b4-a098495caa7b req-2b4e0003-4f23-4d3b-b347-0f1f7a2a36f6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:46:12.881745 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-238b5a70-4090-4219-94b4-a098495caa7b req-2b4e0003-4f23-4d3b-b347-0f1f7a2a36f6 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:46:12.886214 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=55 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:46:12.894405 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-238b5a70-4090-4219-94b4-a098495caa7b req-2b4e0003-4f23-4d3b-b347-0f1f7a2a36f6 service nova] Creating event network-changed:3f4931b7-9276-4ff3-b56b-1a257aa4b12e for instance 42e904e6-acf4-49cc-986d-f6db6e78d69d on n-h1-854925-5 Aug 30 05:46:12.900262 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-238b5a70-4090-4219-94b4-a098495caa7b req-2b4e0003-4f23-4d3b-b347-0f1f7a2a36f6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032753 Aug 30 05:46:12.901084 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3894/7847] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:48:11.666430 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:11.667182 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=64 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:11.667998 n-d-854925-5 devstack@n-api.service[122403]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:48:11.668144 n-d-854925-5 devstack@n-api.service[122403]: Tue Aug 30 05:48:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d/action (ip 10.222.0.27) !!! Aug 30 05:48:11.673501 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1462175616"}} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:48:11.675863 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:11.684990 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:11.685505 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:11.685948 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:11.686645 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:11.687101 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:11.687532 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:11.887341 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-2d9b8f1c-c782-4c10-98ef-126e6c8bf512 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "POST /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d/action" status: 202 len: 0 microversion: 2.1 time: 0.223430 Aug 30 05:48:11.887982 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3954/7848] 10.222.0.27 () {60 vars in 1278 bytes} [Tue Aug 30 05:48:11 2022] POST /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 30 05:48:17.950123 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:48:17.952260 n-d-854925-5 devstack@n-api.service[122402]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] AMQP server on 10.222.0.27:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 30 05:48:17.952807 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=28 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:17.953747 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=1 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:17.955014 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:48:17.955197 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:48:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 30 05:48:17.956964 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 05:48:17.957136 n-d-854925-5 devstack@n-api.service[122402]: Tue Aug 30 05:48:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.27) !!! Aug 30 05:48:18.039471 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-0bc51ae3-618d-4845-94ca-5c217ad60381 req-85228c37-3d69-4136-a2db-3fd405908f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e904e6-acf4-49cc-986d-f6db6e78d69d", "name": "network-vif-plugged", "status": "completed", "tag": "3f4931b7-9276-4ff3-b56b-1a257aa4b12e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:48:18.050444 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0bc51ae3-618d-4845-94ca-5c217ad60381 req-85228c37-3d69-4136-a2db-3fd405908f8b service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:18.050861 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0bc51ae3-618d-4845-94ca-5c217ad60381 req-85228c37-3d69-4136-a2db-3fd405908f8b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:18.051306 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-0bc51ae3-618d-4845-94ca-5c217ad60381 req-85228c37-3d69-4136-a2db-3fd405908f8b service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:18.062140 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-0bc51ae3-618d-4845-94ca-5c217ad60381 req-85228c37-3d69-4136-a2db-3fd405908f8b service nova] Creating event network-vif-plugged:3f4931b7-9276-4ff3-b56b-1a257aa4b12e for instance 42e904e6-acf4-49cc-986d-f6db6e78d69d on n-h1-854925-5 Aug 30 05:48:18.067361 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-0bc51ae3-618d-4845-94ca-5c217ad60381 req-85228c37-3d69-4136-a2db-3fd405908f8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121064 Aug 30 05:48:18.067982 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3895/7849] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:48:29.776432 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_api:SELECT=2 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:29.777556 n-d-854925-5 devstack@n-api.service[122403]: DEBUG dbcounter [-] [122403] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122403) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:29.779257 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_api:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:29.780733 n-d-854925-5 devstack@n-api.service[122402]: DEBUG dbcounter [-] [122402] Writing DB stats nova_cell1:SELECT=2 {{(pid=122402) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 05:48:29.782270 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:29.782909 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:29.787432 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-f4d83c2a-331d-4dbb-9736-6afae85b9ee9 req-7379e215-b18f-4dc9-96e2-d1dc04e52929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42e904e6-acf4-49cc-986d-f6db6e78d69d", "tag": "3f4931b7-9276-4ff3-b56b-1a257aa4b12e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:48:29.790570 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:29.791090 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:29.791561 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:29.792311 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:29.792979 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:29.793622 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:29.801468 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f4d83c2a-331d-4dbb-9736-6afae85b9ee9 req-7379e215-b18f-4dc9-96e2-d1dc04e52929 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:29.802042 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f4d83c2a-331d-4dbb-9736-6afae85b9ee9 req-7379e215-b18f-4dc9-96e2-d1dc04e52929 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:29.802756 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-f4d83c2a-331d-4dbb-9736-6afae85b9ee9 req-7379e215-b18f-4dc9-96e2-d1dc04e52929 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:29.814687 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [f6b73b9e-698a-410b-b60d-f2264500f807] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41560. Aug 30 05:48:29.817588 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-f4d83c2a-331d-4dbb-9736-6afae85b9ee9 req-7379e215-b18f-4dc9-96e2-d1dc04e52929 service nova] Creating event network-changed:3f4931b7-9276-4ff3-b56b-1a257aa4b12e for instance 42e904e6-acf4-49cc-986d-f6db6e78d69d on n-h1-854925-5 Aug 30 05:48:29.823545 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-f4d83c2a-331d-4dbb-9736-6afae85b9ee9 req-7379e215-b18f-4dc9-96e2-d1dc04e52929 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046009 Aug 30 05:48:29.824257 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3896/7850] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:48:29.826140 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Going to try to terminate instance {{(pid=122403) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:48:29.927951 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f0ba477c-e209-4381-bd7b-497817e11fa2 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "DELETE /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 204 len: 0 microversion: 2.1 time: 0.154163 Aug 30 05:48:29.929135 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3955/7851] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:48:29 2022] DELETE /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:48:29.938165 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:29.939017 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:29.941565 n-d-854925-5 devstack@n-api.service[122402]: INFO oslo.messaging._drivers.impl_rabbit [-] [e4f23cbd-ca2a-47d3-90bb-1c9a28c6422a] Reconnected to AMQP server on 10.222.0.27:5672 via [amqp] client with port 41562. Aug 30 05:48:29.946885 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:29.947536 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:29.949644 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:29.950490 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:29.951626 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:29.952164 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:30.112848 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:48:30.121526 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-3345572e-d6d7-42d5-b423-48eff4629d30 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1685 microversion: 2.1 time: 0.187610 Aug 30 05:48:30.122373 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3897/7852] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:48:29 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:48:31.143370 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:31.144071 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:31.151444 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:31.151923 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:31.152357 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:31.153044 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:31.153529 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:31.153957 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:31.358515 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:48:31.366930 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-9b6886ef-b6b9-4572-a4bf-7c4647a530f6 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1685 microversion: 2.1 time: 0.227881 Aug 30 05:48:31.367506 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3956/7853] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:48:31 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1685 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:48:31.950663 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [req-cbfbef09-5626-4243-a4d4-6ee451c47b4a req-a2b2665e-e587-4bd8-b1a1-c0b9baa23c87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e904e6-acf4-49cc-986d-f6db6e78d69d", "name": "network-vif-unplugged", "status": "completed", "tag": "3f4931b7-9276-4ff3-b56b-1a257aa4b12e"}]} {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:48:31.962467 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cbfbef09-5626-4243-a4d4-6ee451c47b4a req-a2b2665e-e587-4bd8-b1a1-c0b9baa23c87 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:31.963254 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cbfbef09-5626-4243-a4d4-6ee451c47b4a req-a2b2665e-e587-4bd8-b1a1-c0b9baa23c87 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:31.963709 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [req-cbfbef09-5626-4243-a4d4-6ee451c47b4a req-a2b2665e-e587-4bd8-b1a1-c0b9baa23c87 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:31.981437 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.compute.server_external_events [req-cbfbef09-5626-4243-a4d4-6ee451c47b4a req-a2b2665e-e587-4bd8-b1a1-c0b9baa23c87 service nova] Creating event network-vif-unplugged:3f4931b7-9276-4ff3-b56b-1a257aa4b12e for instance 42e904e6-acf4-49cc-986d-f6db6e78d69d on n-h1-854925-5 Aug 30 05:48:31.987033 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [req-cbfbef09-5626-4243-a4d4-6ee451c47b4a req-a2b2665e-e587-4bd8-b1a1-c0b9baa23c87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040589 Aug 30 05:48:31.987649 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3898/7854] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:48:32.244135 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-cb9b9444-9595-455b-8381-92c1a8d491f5 req-02063fa6-4871-4712-b1cc-25cc92e2a917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42e904e6-acf4-49cc-986d-f6db6e78d69d", "name": "network-vif-deleted", "tag": "3f4931b7-9276-4ff3-b56b-1a257aa4b12e"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:48:32.254851 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cb9b9444-9595-455b-8381-92c1a8d491f5 req-02063fa6-4871-4712-b1cc-25cc92e2a917 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:32.255342 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cb9b9444-9595-455b-8381-92c1a8d491f5 req-02063fa6-4871-4712-b1cc-25cc92e2a917 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:32.255788 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-cb9b9444-9595-455b-8381-92c1a8d491f5 req-02063fa6-4871-4712-b1cc-25cc92e2a917 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:32.267337 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-cb9b9444-9595-455b-8381-92c1a8d491f5 req-02063fa6-4871-4712-b1cc-25cc92e2a917 service nova] Creating event network-vif-deleted:3f4931b7-9276-4ff3-b56b-1a257aa4b12e for instance 42e904e6-acf4-49cc-986d-f6db6e78d69d on n-h1-854925-5 Aug 30 05:48:32.272234 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-cb9b9444-9595-455b-8381-92c1a8d491f5 req-02063fa6-4871-4712-b1cc-25cc92e2a917 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091436 Aug 30 05:48:32.272880 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3957/7855] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:48:32.389652 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:32.390310 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:32.396446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:32.396944 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:32.397423 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:32.398124 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:32.398592 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:32.399035 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:32.431125 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:32.431552 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:32.432072 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:32.432530 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.objects.instance [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lazy-loading 'fault' on Instance uuid 42e904e6-acf4-49cc-986d-f6db6e78d69d {{(pid=122402) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Aug 30 05:48:32.474251 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:48:32.482256 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-f79405c6-11ec-4b5a-8323-b5858228a0de tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 200 len: 1339 microversion: 2.1 time: 0.097547 Aug 30 05:48:32.482753 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3899/7856] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:48:32 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 1339 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:48:33.504661 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:33.505423 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 42e904e6-acf4-49cc-986d-f6db6e78d69d] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:33.511668 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:33.512152 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:33.512591 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:33.513284 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:33.513768 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:33.514198 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:33.527869 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.wsgi [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] HTTP exception thrown: Instance 42e904e6-acf4-49cc-986d-f6db6e78d69d could not be found. Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Request method failure captured: Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: request: GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d HTTP/1.1 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: Accept: application/json Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: Accept-Encoding: identity Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: Connection: close Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: Content-Length: 0 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: Content-Type: application/json Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: Host: 10.222.0.27 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: Openstack-System-Scope: None Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: User-Agent: python-urllib3/1.26.12 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Auth-Token: gAAAAABjDaN5ip7HsKqiP5yTiUAPUOrcXoNAQlZcDVF5v4oqCEJERXhigw_fVBIIvmqCFQqMpTGNXwWGChP0ZDNkrp1UijKofbgdv_5E6AlF2Ld4Mc7xBOuQhSiMukj8hz3N29AJgJz-2yvGdCDPV2zk4XK6nkddO66ykWasHTLPXp1ymNRs2oY Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Id: None Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Domain-Name: None Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Identity-Status: Confirmed Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Is-Admin-Project: True Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Id: default Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Domain-Name: Default Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Id: 3fdfc4fac3134c4e8bfa5889fef210bd Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Project-Name: tempest-TestSnapshotPattern-869978922 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Role: reader,member Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Roles: reader,member Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fdfc4fac3134c4e8bfa5889fef210bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fdfc4fac3134c4e8bfa5889fef210bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fdfc4fac3134c4e8bfa5889fef210bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fdfc4fac3134c4e8bfa5889fef210bd"}]}] Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant: tempest-TestSnapshotPattern-869978922 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Id: 3fdfc4fac3134c4e8bfa5889fef210bd Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-Tenant-Name: tempest-TestSnapshotPattern-869978922 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-User: tempest-TestSnapshotPattern-869978922-project Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Id: default Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-User-Domain-Name: Default Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-User-Id: 9016ef0540ac4782953e0d7e0432f391 Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: X-User-Name: tempest-TestSnapshotPattern-869978922-project Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: method: > Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: exception: Instance 42e904e6-acf4-49cc-986d-f6db6e78d69d could not be found. Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: action_args: {'id': '42e904e6-acf4-49cc-986d-f6db6e78d69d'} Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42e904e6-acf4-49cc-986d-f6db6e78d69d could not be found. Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42e904e6-acf4-49cc-986d-f6db6e78d69d could not be found. Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:48:33.529552 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42e904e6-acf4-49cc-986d-f6db6e78d69d could not be found. Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: ERROR nova.api.openstack.wsgi Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Returning 404 to user: Instance 42e904e6-acf4-49cc-986d-f6db6e78d69d could not be found. {{(pid=122403) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-4e164683-72b6-4017-89cc-d198a62601bb tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d" status: 404 len: 111 microversion: 2.1 time: 0.031484 Aug 30 05:48:33.535639 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3958/7857] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:48:33 2022] GET /compute/v2.1/servers/42e904e6-acf4-49cc-986d-f6db6e78d69d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:48:35.240688 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:35.241761 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:35.243183 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-f717db40-d50b-47e9-abda-ca4d29219ee6 req-7db12762-d258-4ef1-95af-e3cf5544f48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09cf9ffb-20eb-450e-9609-740610b02a63", "tag": "e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:48:35.249459 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:35.250159 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:35.250793 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:35.251691 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:35.252321 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:35.252923 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:35.254698 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f717db40-d50b-47e9-abda-ca4d29219ee6 req-7db12762-d258-4ef1-95af-e3cf5544f48e service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:35.255192 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f717db40-d50b-47e9-abda-ca4d29219ee6 req-7db12762-d258-4ef1-95af-e3cf5544f48e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:35.255753 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-f717db40-d50b-47e9-abda-ca4d29219ee6 req-7db12762-d258-4ef1-95af-e3cf5544f48e service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:35.266406 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-f717db40-d50b-47e9-abda-ca4d29219ee6 req-7db12762-d258-4ef1-95af-e3cf5544f48e service nova] Creating event network-changed:e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39 for instance 09cf9ffb-20eb-450e-9609-740610b02a63 on n-h2-854925-5 Aug 30 05:48:35.271586 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-f717db40-d50b-47e9-abda-ca4d29219ee6 req-7db12762-d258-4ef1-95af-e3cf5544f48e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032172 Aug 30 05:48:35.272258 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3959/7858] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 05:48:35.285794 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Going to try to terminate instance {{(pid=122402) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 05:48:35.376076 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-df4d481e-eb03-4fe4-a9b0-31f5a6874a7f tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "DELETE /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 204 len: 0 microversion: 2.1 time: 0.137871 Aug 30 05:48:35.376076 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3900/7859] 10.222.0.27 () {58 vars in 1239 bytes} [Tue Aug 30 05:48:35 2022] DELETE /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 05:48:35.384641 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:35.385504 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.compute.api [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122403) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:35.392644 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:35.393226 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:35.393773 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:35.394531 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:35.395171 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:35.395601 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:35.587897 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.policy [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122403) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:48:35.596605 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-7433eef2-db1b-43a3-957a-8a7d3dc643bd tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1683 microversion: 2.1 time: 0.216232 Aug 30 05:48:35.597180 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3960/7860] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:48:35 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:48:36.619052 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:36.619839 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:36.626835 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:36.627446 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:36.627906 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:36.628614 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:36.629080 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:36.629602 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:36.785494 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.policy [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9016ef0540ac4782953e0d7e0432f391', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fdfc4fac3134c4e8bfa5889fef210bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122402) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 05:48:36.794274 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-ee5e7450-066b-4967-92c7-8f7a72f7fe39 tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 200 len: 1497 microversion: 2.1 time: 0.179739 Aug 30 05:48:36.794863 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3901/7861] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:48:36 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 05:48:37.286463 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [req-212db2d8-3a4f-4e63-b0d0-1dae58d0bd6f req-901f72dd-4190-4a03-99be-f72216b4f0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09cf9ffb-20eb-450e-9609-740610b02a63", "name": "network-vif-deleted", "tag": "e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39"}]} {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 05:48:37.297473 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-212db2d8-3a4f-4e63-b0d0-1dae58d0bd6f req-901f72dd-4190-4a03-99be-f72216b4f0e8 service nova] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:37.297946 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-212db2d8-3a4f-4e63-b0d0-1dae58d0bd6f req-901f72dd-4190-4a03-99be-f72216b4f0e8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:37.298376 n-d-854925-5 devstack@n-api.service[122403]: DEBUG oslo_concurrency.lockutils [req-212db2d8-3a4f-4e63-b0d0-1dae58d0bd6f req-901f72dd-4190-4a03-99be-f72216b4f0e8 service nova] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122403) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:37.311593 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.compute.server_external_events [req-212db2d8-3a4f-4e63-b0d0-1dae58d0bd6f req-901f72dd-4190-4a03-99be-f72216b4f0e8 service nova] Creating event network-vif-deleted:e5a06b0a-6c0b-4193-a69e-f27d5e8c2e39 for instance 09cf9ffb-20eb-450e-9609-740610b02a63 on n-h2-854925-5 Aug 30 05:48:37.317640 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [req-212db2d8-3a4f-4e63-b0d0-1dae58d0bd6f req-901f72dd-4190-4a03-99be-f72216b4f0e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034925 Aug 30 05:48:37.318251 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3961/7862] 10.222.0.27 () {64 vars in 1317 bytes} [Tue Aug 30 05:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 05:48:37.815703 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '>' {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:37.816347 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.compute.api [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] [instance: 09cf9ffb-20eb-450e-9609-740610b02a63] Fetching instance by UUID {{(pid=122402) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 05:48:37.823209 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:37.823711 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:37.824671 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:37.825405 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Acquiring lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 05:48:37.825877 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 05:48:37.826329 n-d-854925-5 devstack@n-api.service[122402]: DEBUG oslo_concurrency.lockutils [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Lock "ae7f45c9-5d99-4b18-9061-1e16276d093b" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122402) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 05:48:37.841519 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.wsgi [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] HTTP exception thrown: Instance 09cf9ffb-20eb-450e-9609-740610b02a63 could not be found. Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Request method failure captured: Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: request: GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 HTTP/1.1 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: Accept: application/json Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: Accept-Encoding: identity Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: Connection: close Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: Content-Length: 0 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: Content-Type: application/json Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: Host: 10.222.0.27 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: Openstack-System-Scope: None Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: User-Agent: python-urllib3/1.26.12 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Auth-Token: gAAAAABjDaN5ip7HsKqiP5yTiUAPUOrcXoNAQlZcDVF5v4oqCEJERXhigw_fVBIIvmqCFQqMpTGNXwWGChP0ZDNkrp1UijKofbgdv_5E6AlF2Ld4Mc7xBOuQhSiMukj8hz3N29AJgJz-2yvGdCDPV2zk4XK6nkddO66ykWasHTLPXp1ymNRs2oY Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Id: None Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Domain-Name: None Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Identity-Status: Confirmed Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Is-Admin-Project: True Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Id: default Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Domain-Name: Default Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Id: 3fdfc4fac3134c4e8bfa5889fef210bd Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Project-Name: tempest-TestSnapshotPattern-869978922 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Role: reader,member Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Roles: reader,member Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_3fdfc4fac3134c4e8bfa5889fef210bd", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/3fdfc4fac3134c4e8bfa5889fef210bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fdfc4fac3134c4e8bfa5889fef210bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/3fdfc4fac3134c4e8bfa5889fef210bd"}]}] Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant: tempest-TestSnapshotPattern-869978922 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Id: 3fdfc4fac3134c4e8bfa5889fef210bd Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-Tenant-Name: tempest-TestSnapshotPattern-869978922 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-User: tempest-TestSnapshotPattern-869978922-project Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Id: default Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-User-Domain-Name: Default Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-User-Id: 9016ef0540ac4782953e0d7e0432f391 Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: X-User-Name: tempest-TestSnapshotPattern-869978922-project Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: method: > Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: exception: Instance 09cf9ffb-20eb-450e-9609-740610b02a63 could not be found. Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: action_args: {'id': '09cf9ffb-20eb-450e-9609-740610b02a63'} Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: {{(pid=122402) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09cf9ffb-20eb-450e-9609-740610b02a63 could not be found. Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09cf9ffb-20eb-450e-9609-740610b02a63 could not be found. Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 05:48:37.843196 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09cf9ffb-20eb-450e-9609-740610b02a63 could not be found. Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: ERROR nova.api.openstack.wsgi Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: DEBUG nova.api.openstack.wsgi [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Returning 404 to user: Instance 09cf9ffb-20eb-450e-9609-740610b02a63 could not be found. {{(pid=122402) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: INFO nova.api.openstack.requestlog [None req-b555442a-2f9a-4c15-90a0-b4a0e1f6d5ea tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63" status: 404 len: 111 microversion: 2.1 time: 0.032942 Aug 30 05:48:37.848635 n-d-854925-5 devstack@n-api.service[122402]: [pid: 122402|app: 0|req: 3902/7863] 10.222.0.27 () {58 vars in 1236 bytes} [Tue Aug 30 05:48:37 2022] GET /compute/v2.1/servers/09cf9ffb-20eb-450e-9609-740610b02a63 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 05:48:38.016545 n-d-854925-5 devstack@n-api.service[122403]: DEBUG nova.api.openstack.wsgi [None req-f60ab111-4c01-47a4-b697-58983644c18b tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] Calling method '.version_select at 0x7fe969cadd30>' {{(pid=122403) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 05:48:38.040670 n-d-854925-5 devstack@n-api.service[122403]: INFO nova.api.openstack.requestlog [None req-f60ab111-4c01-47a4-b697-58983644c18b tempest-TestSnapshotPattern-869978922 tempest-TestSnapshotPattern-869978922-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1079679684" status: 202 len: 0 microversion: 2.1 time: 0.028856 Aug 30 05:48:38.041599 n-d-854925-5 devstack@n-api.service[122403]: [pid: 122403|app: 0|req: 3962/7864] 10.222.0.27 () {58 vars in 1257 bytes} [Tue Aug 30 05:48:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1079679684 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)